Determination of Trace Elements in Uranium by HPLC-ID-ICP-MS: NTNFC Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Manard, Benjamin Thomas; Wylie, Ernest Miller II; Xu, Ning

This report covers the FY 16 effort for the HPLC-ID-ICP-MS methodology 1) sub-method validation for the group I&II elements, 2) sub-method stood-up and validation for REE, 3) sub-method development for the transition element, and 4) completion of a comprehensive SOP for three families of elements.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET).

PubMed

Koehler, Ryan J; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Bramen, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J; Nicandri, Gregg T

2013-06-01

Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. Cross-sectional study; Level of evidence, 3. Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.

Validation of a simplified food frequency questionnaire for the assessment of dietary habits in Iranian adults: Isfahan Healthy Heart Program, Iran.

PubMed

Mohammadifard, Noushin; Sajjadi, Firouzeh; Maghroun, Maryam; Alikhasi, Hassan; Nilforoushzadeh, Farzaneh; Sarrafzadegan, Nizal

2015-03-01

Dietary assessment is the first step of dietary modification in community-based interventional programs. This study was performed to validate a simple food frequency questionnaire (SFFQ) for assessment of selected food items in epidemiological studies with a large sample size as well as community trails. This validation study was carried out on 264 healthy adults aged ≥ 41 years old living in 3 district central of Iran, including Isfahan, Najafabad, and Arak. Selected food intakes were assessed using a 48-item food frequency questionnaire (FFQ). The FFQ was interviewer-administered, which was completed twice; at the beginning of the study and 2 weeks thereafter. The validity of this SFFQ was examined compared to estimated amount by single 24 h dietary recall and 2 days dietary record. Validation of the FFQ was determined using Spearman correlation coefficients between daily frequency consumption of food groups as assessed by the FFQ and the qualitative amount of daily food groups intake accessed by dietary reference method was applied to evaluate validity. Intraclass correlation coefficients (ICC) were used to determine the reproducibility. Spearman correlation coefficient between the estimated amount of food groups intake by examined and reference methods ranged from 0.105 (P = 0.378) in pickles to 0.48 (P < 0.001) in plant protein. ICC for reproducibility of FFQ were between 0.47-0.69 in different food groups (P < 0.001). The designed SFFQ has a good relative validity and reproducibility for assessment of selected food groups intake. Thus, it can serve as a valid tool in epidemiological studies and clinical trial with large participants.

Modeling Group Differences in OLS and Orthogonal Regression: Implications for Differential Validity Studies

ERIC Educational Resources Information Center

Kane, Michael T.; Mroch, Andrew A.

2010-01-01

In evaluating the relationship between two measures across different groups (i.e., in evaluating "differential validity") it is necessary to examine differences in correlation coefficients and in regression lines. Ordinary least squares (OLS) regression is the standard method for fitting lines to data, but its criterion for optimal fit…

Evaluation of the Spiritual Well-Being Scale in a Sample of Korean Adults.

PubMed

You, Sukkyung; Yoo, Ji Eun

2016-08-01

This study explored the psychometric qualities and construct validity of the Spiritual Well-Being Scale (SWBS; Ellison in J Psychol Theol 11:330-340, 1983) using a sample of 470 Korean adults. Two factor analyses, exploratory factor analysis and confirmatory factor analysis, were conducted in order to test the validity of the SWBS. The results of the factor analyses supported the original two-dimensional structure of the SWBS-religious well-being (RWB) and existential well-being (EWB) with method effects associated with negatively worded items. By controlling for method effects, the evaluation of the two-factor structure of SWBS is confirmed with clarity. Further, the differential pattern and magnitude of correlations between the SWB subscales and the religious and psychological variables suggested that two factors of the SWBS were valid for Protestant, Catholic, and religiously unaffiliated groups except Buddhists. The Protestant group scored higher in RWB compared to the Buddhist, Catholic, and unaffiliated groups. The Protestant group scored higher in EWB compared to the unaffiliated groups. Future studies may need to include more Buddhist samples to gain solid evidence for validity of the SWBS on a non-Western religious tradition.

Fractal Clustering and Knowledge-driven Validation Assessment for Gene Expression Profiling.

PubMed

Wang, Lu-Yong; Balasubramanian, Ammaiappan; Chakraborty, Amit; Comaniciu, Dorin

2005-01-01

DNA microarray experiments generate a substantial amount of information about the global gene expression. Gene expression profiles can be represented as points in multi-dimensional space. It is essential to identify relevant groups of genes in biomedical research. Clustering is helpful in pattern recognition in gene expression profiles. A number of clustering techniques have been introduced. However, these traditional methods mainly utilize shape-based assumption or some distance metric to cluster the points in multi-dimension linear Euclidean space. Their results shows poor consistence with the functional annotation of genes in previous validation study. From a novel different perspective, we propose fractal clustering method to cluster genes using intrinsic (fractal) dimension from modern geometry. This method clusters points in such a way that points in the same clusters are more self-affine among themselves than to the points in other clusters. We assess this method using annotation-based validation assessment for gene clusters. It shows that this method is superior in identifying functional related gene groups than other traditional methods.

Quantification of myocardial blood flow using dynamic 320-row multi-detector CT as compared with ¹⁵O-H₂O PET.

PubMed

Kikuchi, Yasuka; Oyama-Manabe, Noriko; Naya, Masanao; Manabe, Osamu; Tomiyama, Yuuki; Sasaki, Tsukasa; Katoh, Chietsugu; Kudo, Kohsuke; Tamaki, Nagara; Shirato, Hiroki

2014-07-01

This study introduces a method to calculate myocardium blood flow (MBF) and coronary flow reserve (CFR) using the relatively low-dose dynamic 320-row multi-detector computed tomography (MDCT), validates the method against (15)O-H₂O positron-emission tomography (PET) and assesses the CFRs of coronary artery disease (CAD) patients. Thirty-two subjects underwent both dynamic CT perfusion (CTP) and PET perfusion imaging at rest and during pharmacological stress. In 12 normal subjects (pilot group), the calculation method for MBF and CFR was established. In the other 13 normal subjects (validation group), MBF and CFR obtained by dynamic CTP and PET were compared. Finally, the CFRs obtained by dynamic CTP and PET were compared between the validation group and CAD patients (n = 7). Correlation between MBF of MDCT and PET was strong (r = 0.95, P < 0.0001). CFR showed good correlation between dynamic CTP and PET (r = 0.67, P = 0.0126). CFRCT in the CAD group (2.3 ± 0.8) was significantly lower than that in the validation group (5.2 ± 1.8) (P = 0.0011). We established a method for measuring MBF and CFR with the relatively low-dose dynamic MDCT. Lower CFR was well demonstrated in CAD patients by dynamic CTP. • MBF and CFR can be calculated using dynamic CTP with 320-row MDCT. • MBF and CFR showed good correlation between dynamic CTP and PET. • Lower CFR was well demonstrated in CAD patients by dynamic CTP.

Evaluation of Informed Choice for contraceptive methods among women attending a family planning program: conceptual development; a case study in Chile.

PubMed

Valdés, Patricio R; Alarcon, Ana M; Munoz, Sergio R

2013-03-01

To generate and validate a scale to measure the Informed Choice of contraceptive methods among women attending a family health care service in Chile. The study follows a multimethod design that combined expert opinions from 13 physicians, 3 focus groups of 21 women each, and a sample survey of 1,446 women. Data analysis consisted of a qualitative text analysis of group interviews, a factor analysis for construct validity, and kappa statistic and Cronbach alpha to assess scale reliability. The instrument comprises 25 items grouped into six categories: information and orientation, quality of treatment, communication, participation in decision making, expression of reproductive rights, and method access and availability. Internal consistency measured with Cronbach alpha ranged from 0.75 to 0.89 for all subscales (kappa, 0.62; standard deviation, 0.06), and construct validity was demonstrated from the testing of several hypotheses. The use of mixed methods contributed to developing a scale of Informed Choice that was culturally appropriate for assessing the women who participated in the family planning program. Copyright © 2013 Elsevier Inc. All rights reserved.

Validation of Gujarati Version of ABILOCO-Kids Questionnaire.

PubMed

Diwan, Shraddha; Diwan, Jasmin; Patel, Pankaj; Bansal, Ankita B

2015-10-01

ABILOCO-Kids is a measure of locomotion ability for children with cerebral palsy (CP) aged 6 to 15 years & is available in English & French. To validate the Gujarati version of ABILOCO-Kids questionnaire to be used in clinical research on Gujarati population. ABILOCO-Kids questionnaire was translated into Gujarati from English using forward-backward-forward method. To ensure face & content validity of Gujarati version using group consensus method, each item was examined by group of experts having mean experience of 24.62 years in field of paediatric and paediatric physiotherapy. Each item was analysed for content, meaning, wording, format, ease of administration & scoring. Each item was scored by expert group as either accepted, rejected or accepted with modification. Procedure was continued until 80% of consensus for all items. Concurrent validity was examined on 55 children with Cerebral Palsy (6-15 years) of all Gross Motor Functional Classification System (GMFCS) level & all clinical types by correlating score of ABILOCO-Kids with Gross Motor Functional Measure & GMFCS. In phase 1 of validation, 16 items were accepted as it is; 22 items accepted with modification & 3 items went for phase 2 validation. For concurrent validity, highly significant positive correlation was found between score of ABILOCO-Kids & total GMFM (r=0.713, p<0.005) & highly significant negative correlation with GMFCS (r= -0.778, p<0.005). Gujarati translated version of ABILOCO-Kids questionnaire has good face & content validity as well as concurrent validity which can be used to measure caregiver reported locomotion ability in children with CP.

PRO development: rigorous qualitative research as the crucial foundation.

PubMed

Lasch, Kathryn Eilene; Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-10-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.

PRO development: rigorous qualitative research as the crucial foundation

PubMed Central

Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-01-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity. PMID:20512662

Group power through the lens of the 21st century and beyond: further validation of the Sieloff-King Assessment of Group Power within Organizations.

PubMed

Sieloff, Christina L; Bularzik, Anne M

2011-11-01

The purpose was to determine the content validity of a semantic revision of items on a reliable and valid instrument, the Sieloff-King Assessment of Group Power within Organizations (SKAGPO). Research participants expressed negative perceptions regarding the use of the concept of 'power' in SKAGPO items. The SKAGPO is the only instrument measuring a nursing group's power or outcome attainment. Using a survey method, the instrument and grading scale were sent to 12 expert judges. Six participants completed the grading scale. The Content Validity Index (CVI) for seven questions was at or above 83% agreement. Overall, the CVI for the eight revised questions was 93.75%. Subsequently, the instrument was renamed the Sieloff-King Assessment of Group Outcome Attainment within Organizations (SKAGOAO). The semantic revision demonstrated content validity for the revised SKAGOAO. When used by nursing groups to assess their level of outcome attainment, the instrument should continue to be psychometrically evaluated. A nursing group of any size can use the SKAGOAO to both assess the group's level of outcome attainment or empowerment and direct plans to further improve that level. © 2011 Blackwell Publishing Ltd.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET)

PubMed Central

Koehler, Ryan J.; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J.; Nicandri, Gregg T.

2014-01-01

Background Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. Hypothesis The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability, when used to assess the technical ability of surgeons performing diagnostic knee arthroscopy on cadaveric specimens. Study Design Cross-sectional study; Level of evidence, 3 Methods Content validity was determined by a group of seven experts using a Delphi process. Intra-articular performance of a right and left diagnostic knee arthroscopy was recorded for twenty-eight residents and two sports medicine fellowship trained attending surgeons. Subject performance was assessed by two blinded raters using the ASSET. Concurrent criterion-oriented validity, inter-rater reliability, and test-retest reliability were evaluated. Results Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in total ASSET score (p<0.05) between novice, intermediate, and advanced experience groups were identified. Inter-rater reliability: The ASSET scores assigned by each rater were strongly correlated (r=0.91, p <0.01) and the intra-class correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: there was a significant correlation between ASSET scores for both procedures attempted by each individual (r = 0.79, p<0.01). Conclusion The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopy in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live OR and other simulated environments. PMID:23548808

Brazilian Center for the Validation of Alternative Methods (BraCVAM) and the process of validation in Brazil.

PubMed

Presgrave, Octavio; Moura, Wlamir; Caldeira, Cristiane; Pereira, Elisabete; Bôas, Maria H Villas; Eskes, Chantra

2016-03-01

The need for the creation of a Brazilian centre for the validation of alternative methods was recognised in 2008, and members of academia, industry and existing international validation centres immediately engaged with the idea. In 2012, co-operation between the Oswaldo Cruz Foundation (FIOCRUZ) and the Brazilian Health Surveillance Agency (ANVISA) instigated the establishment of the Brazilian Center for the Validation of Alternative Methods (BraCVAM), which was officially launched in 2013. The Brazilian validation process follows OECD Guidance Document No. 34, where BraCVAM functions as the focal point to identify and/or receive requests from parties interested in submitting tests for validation. BraCVAM then informs the Brazilian National Network on Alternative Methods (RENaMA) of promising assays, which helps with prioritisation and contributes to the validation studies of selected assays. A Validation Management Group supervises the validation study, and the results obtained are peer-reviewed by an ad hoc Scientific Review Committee, organised under the auspices of BraCVAM. Based on the peer-review outcome, BraCVAM will prepare recommendations on the validated test method, which will be sent to the National Council for the Control of Animal Experimentation (CONCEA). CONCEA is in charge of the regulatory adoption of all validated test methods in Brazil, following an open public consultation. 2016 FRAME.

Actor groups, related needs, and challenges at the climate downscaling interface

NASA Astrophysics Data System (ADS)

Rössler, Ole; Benestad, Rasmus; Diamando, Vlachogannis; Heike, Hübener; Kanamaru, Hideki; Pagé, Christian; Margarida Cardoso, Rita; Soares, Pedro; Maraun, Douglas; Kreienkamp, Frank; Christodoulides, Paul; Fischer, Andreas; Szabo, Peter

2016-04-01

At the climate downscaling interface, numerous downscaling techniques and different philosophies compete on being the best method in their specific terms. Thereby, it remains unclear to what extent and for which purpose these downscaling techniques are valid or even the most appropriate choice. A common validation framework that compares all the different available methods was missing so far. The initiative VALUE closes this gap with such a common validation framework. An essential part of a validation framework for downscaling techniques is the definition of appropriate validation measures. The selection of validation measures should consider the needs of the stakeholder: some might need a temporal or spatial average of a certain variable, others might need temporal or spatial distributions of some variables, still others might need extremes for the variables of interest or even inter-variable dependencies. Hence, a close interaction of climate data providers and climate data users is necessary. Thus, the challenge in formulating a common validation framework mirrors also the challenges between the climate data providers and the impact assessment community. This poster elaborates the issues and challenges at the downscaling interface as it is seen within the VALUE community. It suggests three different actor groups: one group consisting of the climate data providers, the other two groups being climate data users (impact modellers and societal users). Hence, the downscaling interface faces classical transdisciplinary challenges. We depict a graphical illustration of actors involved and their interactions. In addition, we identified four different types of issues that need to be considered: i.e. data based, knowledge based, communication based, and structural issues. They all may, individually or jointly, hinder an optimal exchange of data and information between the actor groups at the downscaling interface. Finally, some possible ways to tackle these issues are discussed.

Global Land Product Validation Protocols: An Initiative of the CEOS Working Group on Calibration and Validation to Evaluate Satellite-derived Essential Climate Variables

NASA Astrophysics Data System (ADS)

Guillevic, P. C.; Nickeson, J. E.; Roman, M. O.; camacho De Coca, F.; Wang, Z.; Schaepman-Strub, G.

2016-12-01

The Global Climate Observing System (GCOS) has specified the need to systematically produce and validate Essential Climate Variables (ECVs). The Committee on Earth Observation Satellites (CEOS) Working Group on Calibration and Validation (WGCV) and in particular its subgroup on Land Product Validation (LPV) is playing a key coordination role leveraging the international expertise required to address actions related to the validation of global land ECVs. The primary objective of the LPV subgroup is to set standards for validation methods and reporting in order to provide traceable and reliable uncertainty estimates for scientists and stakeholders. The Subgroup is comprised of 9 focus areas that encompass 10 land surface variables. The activities of each focus area are coordinated by two international co-leads and currently include leaf area index (LAI) and fraction of absorbed photosynthetically active radiation (FAPAR), vegetation phenology, surface albedo, fire disturbance, snow cover, land cover and land use change, soil moisture, land surface temperature (LST) and emissivity. Recent additions to the focus areas include vegetation indices and biomass. The development of best practice validation protocols is a core activity of CEOS LPV with the objective to standardize the evaluation of land surface products. LPV has identified four validation levels corresponding to increasing spatial and temporal representativeness of reference samples used to perform validation. Best practice validation protocols (1) provide the definition of variables, ancillary information and uncertainty metrics, (2) describe available data sources and methods to establish reference validation datasets with SI traceability, and (3) describe evaluation methods and reporting. An overview on validation best practice components will be presented based on the LAI and LST protocol efforts to date.

Validation of a multi-residue method for the determination of several antibiotic groups in honey by LC-MS/MS.

PubMed

Bohm, Detlef A; Stachel, Carolin S; Gowik, Petra

2012-07-01

The presented multi-method was developed for the confirmation of 37 antibiotic substances from the six antibiotic groups: macrolides, lincosamides, quinolones, tetracyclines, pleuromutilines and diamino-pyrimidine derivatives. All substances were analysed simultaneously in a single analytical run with the same procedure, including an extraction with buffer, a clean-up by solid-phase extraction, and the measurement by liquid chromatography tandem mass spectrometry in ESI+ mode. The method was validated on the basis of an in-house validation concept with factorial design by combination of seven factors to check the robustness in a concentration range of 5-50 μg kg(-1). The honeys used were of different types with regard to colour and origin. The values calculated for the validation parameters-decision limit CCα (range, 7.5-12.9 μg kg(-1)), detection capability CCβ (range, 9.4-19.9 μg kg(-1)), within-laboratory reproducibility RSD(wR) (<20% except for tulathromycin with 23.5% and tylvalosin with 21.4 %), repeatability RSD(r) (<20% except for tylvalosin with 21.1%), and recovery (range, 92-106%)-were acceptable and in agreement with the criteria of Commission Decision 2002/657/EC. The validation results showed that the method was applicable for the residue analysis of antibiotics in honey to substances with and without recommended concentrations, although some changes had been tested during validation to determine the robustness of the method.

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for the detection of genotoxic carcinogens: I. Summary of pre-validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Burlinson, Brian; Escobar, Patricia A; Kraynak, Andrew R; Nakagawa, Yuzuki; Nakajima, Madoka; Pant, Kamala; Asano, Norihide; Lovell, David; Morita, Takeshi; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this validation effort was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The purpose of the pre-validation studies (i.e., Phase 1 through 3), conducted in four or five laboratories with extensive comet assay experience, was to optimize the protocol to be used during the definitive validation study. Copyright © 2015 Elsevier B.V. All rights reserved.

Validation of highly sensitive simultaneous targeted and untargeted analysis of keto-steroids by Girard P derivatization and stable isotope dilution-liquid chromatography-high resolution mass spectrometry.

PubMed

Frey, Alexander J; Wang, Qingqing; Busch, Christine; Feldman, Daniel; Bottalico, Lisa; Mesaros, Clementina A; Blair, Ian A; Vachani, Anil; Snyder, Nathaniel W

2016-12-01

A multiplexed quantitative method for the analysis of three major unconjugated steroids in human serum by stable isotope dilution liquid chromatography-high resolution mass spectrometry (LC-HRMS) was developed and validated on a Q Exactive Plus hybrid quadrupole/Orbitrap mass spectrometer. This quantification utilized isotope dilution and Girard P derivatization on the keto-groups of testosterone (T), androstenedione (AD) and dehydroepiandrosterone (DHEA) to improve ionization efficiency using electrospray ionization. Major isomeric compounds to T and DHEA; the inactive epimer of testosterone (epiT), and the metabolite of AD, 5α-androstanedione (5α-AD) were completely resolved on a biphenyl column within an 18min method. Inter- and intra-day method validation using LC-HRMS with qualifying product ions was performed and acceptable analytical performance was achieved. The method was further validated by comparing steroid levels from 100μL of serum from young vs older subjects. Since this approach provides high-dimensional HRMS data, untargeted analysis by age group was performed. DHEA and T were detected among the top analytes most significantly different across the two groups after untargeted LC-HRMS analysis, as well as a number of other still unknown metabolites, indicating the potential for combined targeted/untargeted analysis in steroid analysis. Copyright © 2016 Elsevier Inc. All rights reserved.

The face of pain--a pilot study to validate the measurement of facial pain expression with an improved electromyogram method.

PubMed

Wolf, Karsten; Raedler, Thomas; Henke, Kai; Kiefer, Falk; Mass, Reinhard; Quante, Markus; Wiedemann, Klaus

2005-01-01

The purpose of this pilot study was to establish the validity of an improved facial electromyogram (EMG) method for the measurement of facial pain expression. Darwin defined pain in connection with fear as a simultaneous occurrence of eye staring, brow contraction and teeth chattering. Prkachin was the first to use the video-based Facial Action Coding System to measure facial expressions while using four different types of pain triggers, identifying a group of facial muscles around the eyes. The activity of nine facial muscles in 10 healthy male subjects was analyzed. Pain was induced through a laser system with a randomized sequence of different intensities. Muscle activity was measured with a new, highly sensitive and selective facial EMG. The results indicate two groups of muscles as key for pain expression. These results are in concordance with Darwin's definition. As in Prkachin's findings, one muscle group is assembled around the orbicularis oculi muscle, initiating eye staring. The second group consists of the mentalis and depressor anguli oris muscles, which trigger mouth movements. The results demonstrate the validity of the facial EMG method for measuring facial pain expression. Further studies with psychometric measurements, a larger sample size and a female test group should be conducted.

A Design to Improve Internal Validity of Assessments of Teaching Demonstrations

ERIC Educational Resources Information Center

Bartsch, Robert A.; Engelhardt Bittner, Wendy M.; Moreno, Jesse E., Jr.

2008-01-01

Internal validity is important in assessing teaching demonstrations both for one's knowledge and for quality assessment demanded by outside sources. We describe a method to improve the internal validity of assessments of teaching demonstrations: a 1-group pretest-posttest design with alternative forms. This design is often more practical and…

Mixed group validation: a method to address the limitations of criterion group validation in research on malingering detection.

PubMed

Frederick, R I

2000-01-01

Mixed group validation (MGV) is offered as an alternative to criterion group validation (CGV) to estimate the true positive and false positive rates of tests and other diagnostic signs. CGV requires perfect confidence about each research participant's status with respect to the presence or absence of pathology. MGV determines diagnostic efficiencies based on group data; knowing an individual's status with respect to pathology is not required. MGV can use relatively weak indicators to validate better diagnostic signs, whereas CGV requires perfect diagnostic signs to avoid error in computing true positive and false positive rates. The process of MGV is explained, and a computer simulation demonstrates the soundness of the procedure. MGV of the Rey 15-Item Memory Test (Rey, 1958) for 723 pre-trial criminal defendants resulted in higher estimates of true positive rates and lower estimates of false positive rates as compared with prior research conducted with CGV. The author demonstrates how MGV addresses all the criticisms Rogers (1997b) outlined for differential prevalence designs in malingering detection research. Copyright 2000 John Wiley & Sons, Ltd.

Validating a work group climate assessment tool for improving the performance of public health organizations

PubMed Central

Perry, Cary; LeMay, Nancy; Rodway, Greg; Tracy, Allison; Galer, Joan

2005-01-01

Background This article describes the validation of an instrument to measure work group climate in public health organizations in developing countries. The instrument, the Work Group Climate Assessment Tool (WCA), was applied in Brazil, Mozambique, and Guinea to assess the intermediate outcomes of a program to develop leadership for performance improvement. Data were collected from 305 individuals in 42 work groups, who completed a self-administered questionnaire. Methods The WCA was initially validated using Cronbach's alpha reliability coefficient and exploratory factor analysis. This article presents the results of a second validation study to refine the initial analyses to account for nested data, to provide item-level psychometrics, and to establish construct validity. Analyses included eigenvalue decomposition analysis, confirmatory factor analysis, and validity and reliability analyses. Results This study confirmed the validity and reliability of the WCA across work groups with different demographic characteristics (gender, education, management level, and geographical location). The study showed that there is agreement between the theoretical construct of work climate and the items in the WCA tool across different populations. The WCA captures a single perception of climate rather than individual sub-scales of clarity, support, and challenge. Conclusion The WCA is useful for comparing the climates of different work groups, tracking the changes in climate in a single work group over time, or examining differences among individuals' perceptions of their work group climate. Application of the WCA before and after a leadership development process can help work groups hold a discussion about current climate and select a target for improvement. The WCA provides work groups with a tool to take ownership of their own group climate through a process that is simple and objective and that protects individual confidentiality. PMID:16223447

Scoring Systems to Estimate Intracerebral Control and Survival Rates of Patients Irradiated for Brain Metastases;Brain metastases; Radiation therapy; Local control; Survival; Prognostic scores

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rades, Dirk, E-mail: Rades.Dirk@gmx.net; Dziggel, Liesa; Haatanen, Tiina

2011-07-15

Purpose: To create and validate scoring systems for intracerebral control (IC) and overall survival (OS) of patients irradiated for brain metastases. Methods and Materials: In this study, 1,797 patients were randomly assigned to the test (n = 1,198) or the validation group (n = 599). Two scoring systems were developed, one for IC and another for OS. The scores included prognostic factors found significant on multivariate analyses. Age, performance status, extracerebral metastases, interval tumor diagnosis to RT, and number of brain metastases were associated with OS. Tumor type, performance status, interval, and number of brain metastases were associated with IC.more » The score for each factor was determined by dividing the 6-month IC or OS rate (given in percent) by 10. The total score represented the sum of the scores for each factor. The score groups of the test group were compared with the corresponding score groups of the validation group. Results: In the test group, 6-month IC rates were 17% for 14-18 points, 49% for 19-23 points, and 77% for 24-27 points (p < 0.0001). IC rates in the validation group were 19%, 52%, and 77%, respectively (p < 0.0001). In the test group, 6-month OS rates were 9% for 15-19 points, 41% for 20-25 points, and 78% for 26-30 points (p < 0.0001). OS rates in the validation group were 7%, 39%, and 79%, respectively (p < 0.0001). Conclusions: Patients irradiated for brain metastases can be given scores to estimate OS and IC. IC and OS rates of the validation group were similar to the test group demonstrating the validity and reproducibility of both scores.« less

The validity of a web-based FFQ assessed by doubly labelled water and multiple 24-h recalls.

PubMed

Medin, Anine C; Carlsen, Monica H; Hambly, Catherine; Speakman, John R; Strohmaier, Susanne; Andersen, Lene F

2017-12-01

The aim of this study was to validate the estimated habitual dietary intake from a newly developed web-based FFQ (WebFFQ), for use in an adult population in Norway. In total, ninety-two individuals were recruited. Total energy expenditure (TEE) measured by doubly labelled water was used as the reference method for energy intake (EI) in a subsample of twenty-nine women, and multiple 24-h recalls (24HR) were used as the reference method for the relative validation of macronutrients and food groups in the entire sample. Absolute differences, ratios, crude and deattenuated correlations, cross-classifications, Bland-Altman plot and plots between misreporting of EI (EI-TEE) and the relative misreporting of food groups (WebFFQ-24HR) were used to assess the validity. Results showed that EI on group level was not significantly different from TEE measured by doubly labelled water (0·7 MJ/d), but ranking abilities were poor (r -0·18). The relative validation showed an overestimation for the majority of the variables using absolute intakes, especially for the food groups 'vegetables' and 'fish and shellfish', but an improved agreement between the test and reference tool was observed for energy adjusted intakes. Deattenuated correlation coefficients were between 0·22 and 0·89, and low levels of grossly misclassified individuals (0-3 %) were observed for the majority of the energy adjusted variables for macronutrients and food groups. In conclusion, energy estimates from the WebFFQ should be used with caution, but the estimated absolute intakes on group level and ranking abilities seem acceptable for macronutrients and most food groups.

Patterns of Cognitive Strengths and Weaknesses: Identification Rates, Agreement, and Validity for Learning Disabilities Identification

PubMed Central

Miciak, Jeremy; Fletcher, Jack M.; Stuebing, Karla; Vaughn, Sharon; Tolar, Tammy D.

2014-01-01

Purpose Few empirical investigations have evaluated LD identification methods based on a pattern of cognitive strengths and weaknesses (PSW). This study investigated the reliability and validity of two proposed PSW methods: the concordance/discordance method (C/DM) and cross battery assessment (XBA) method. Methods Cognitive assessment data for 139 adolescents demonstrating inadequate response to intervention was utilized to empirically classify participants as meeting or not meeting PSW LD identification criteria using the two approaches, permitting an analysis of: (1) LD identification rates; (2) agreement between methods; and (3) external validity. Results LD identification rates varied between the two methods depending upon the cut point for low achievement, with low agreement for LD identification decisions. Comparisons of groups that met and did not meet LD identification criteria on external academic variables were largely null, raising questions of external validity. Conclusions This study found low agreement and little evidence of validity for LD identification decisions based on PSW methods. An alternative may be to use multiple measures of academic achievement to guide intervention. PMID:24274155

Development plan for the External Hazards Experimental Group. Light Water Reactor Sustainability Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Coleman, Justin Leigh; Smith, Curtis Lee; Burns, Douglas Edward

This report describes the development plan for a new multi-partner External Hazards Experimental Group (EHEG) coordinated by Idaho National Laboratory (INL) within the Risk-Informed Safety Margin Characterization (RISMC) technical pathway of the Light Water Reactor Sustainability Program. Currently, there is limited data available for development and validation of the tools and methods being developed in the RISMC Toolkit. The EHEG is being developed to obtain high-quality, small- and large-scale experimental data validation of RISMC tools and methods in a timely and cost-effective way. The group of universities and national laboratories that will eventually form the EHEG (which is ultimately expectedmore » to include both the initial participants and other universities and national laboratories that have been identified) have the expertise and experimental capabilities needed to both obtain and compile existing data archives and perform additional seismic and flooding experiments. The data developed by EHEG will be stored in databases for use within RISMC. These databases will be used to validate the advanced external hazard tools and methods.« less

PCA as a practical indicator of OPLS-DA model reliability.

PubMed

Worley, Bradley; Powers, Robert

Principal Component Analysis (PCA) and Orthogonal Projections to Latent Structures Discriminant Analysis (OPLS-DA) are powerful statistical modeling tools that provide insights into separations between experimental groups based on high-dimensional spectral measurements from NMR, MS or other analytical instrumentation. However, when used without validation, these tools may lead investigators to statistically unreliable conclusions. This danger is especially real for Partial Least Squares (PLS) and OPLS, which aggressively force separations between experimental groups. As a result, OPLS-DA is often used as an alternative method when PCA fails to expose group separation, but this practice is highly dangerous. Without rigorous validation, OPLS-DA can easily yield statistically unreliable group separation. A Monte Carlo analysis of PCA group separations and OPLS-DA cross-validation metrics was performed on NMR datasets with statistically significant separations in scores-space. A linearly increasing amount of Gaussian noise was added to each data matrix followed by the construction and validation of PCA and OPLS-DA models. With increasing added noise, the PCA scores-space distance between groups rapidly decreased and the OPLS-DA cross-validation statistics simultaneously deteriorated. A decrease in correlation between the estimated loadings (added noise) and the true (original) loadings was also observed. While the validity of the OPLS-DA model diminished with increasing added noise, the group separation in scores-space remained basically unaffected. Supported by the results of Monte Carlo analyses of PCA group separations and OPLS-DA cross-validation metrics, we provide practical guidelines and cross-validatory recommendations for reliable inference from PCA and OPLS-DA models.

Validation of a Group-Administered Pictorial Dietary Recall with 9- to 11-Year-Old Children

ERIC Educational Resources Information Center

Wallen, Victoria; Cunningham-Sabo, Leslie; Auld, Garry; Romaniello, Cathy

2011-01-01

Objective: Determine validity of Day in the Life Questionnaire-Colorado (DILQ-CO) as a dietary assessment tool for classroom-administered use. Methods: Agreement between DILQ-CO responses and weighed plate waste measured in 125 fourth-grade students in 2 low-income schools. Validity assessed by comparing reported school lunch items and portion…

RELIABILITY AND VALIDITY OF A MODIFIED ISOMETRIC DYNAMOMETER IN THE ASSESSMENT OF MUSCULAR PERFORMANCE IN INDIVIDUALS WITH ANTERIOR CRUCIATE LIGAMENT RECONSTRUCTION

PubMed Central

de Vasconcelos, Rodrigo Antunes; Bevilaqua-Grossi, Débora; Shimano, Antonio Carlos; Paccola, Cleber Jansen; Salvini, Tânia Fátima; Prado, Christiane Lanatovits; Junior, Wilson A. Mello

2015-01-01

Objectives: The aim of this study was to evaluate the reliability and validity of a modified isometric dynamometer (MID) in performance deficits of the knee extensor and flexor muscles in normal individuals and in those with ACL reconstructions. Methods: Sixty male subjects were invited to participate of the study, being divided into three groups with 20 subjects each: control group (GC), group of individuals with ACL reconstruction with patellar tendon graft (GTP, and group of individuals with ACL reconstruction with hamstrings graft (GTF). All individuals performed isometric tests in the MID, muscular strength deficits collected were subsequently compared to the tests performed on the Biodex System 3 operating in the isometric and isokinetic mode at speeds of 60°/s and 180o/s. Intraclass ICC correlation calculations were done in order to assess MID reliability, specificity, sensitivity and Kappa's consistency coefficient calculations, respectively, for assessing the MID's validity in detecting muscular deficits and intra- and intergroup comparisons when performing the four strength tests using the ANOVA method. Results: The modified isometric dynamometer (MID) showed excellent reliability and good validity in the assessment of the performance of the knee extensor and flexor muscles groups. In the comparison between groups, the GTP showed significantly greater deficits as compared to the GTF and GC groups. Conclusion: Isometric dynamometers connected to mechanotherapy equipments could be an alternative option to collect data concerning performance deficits of the extensor and flexor muscles groups of the knee in subjects with ACL reconstruction. PMID:27004175

A Method and a Model for Describing Competence and Adjustment: A Preschool Version of the Classroom Behavior Inventory.

ERIC Educational Resources Information Center

Schaefer, Earl S.; Edgerton, Marianna D.

A preschool version of the Classroom Behavior Inventory which provides a method for collecting valid data on a child's classroom behavior from day care and preschool teachers, was developed to complement the earlier form which was developed and validated for elementary school populations. The new version was tested with a pilot group of twenty-two…

Development and Validation of a Job Exposure Matrix for Physical Risk Factors in Low Back Pain

PubMed Central

Solovieva, Svetlana; Pehkonen, Irmeli; Kausto, Johanna; Miranda, Helena; Shiri, Rahman; Kauppinen, Timo; Heliövaara, Markku; Burdorf, Alex; Husgafvel-Pursiainen, Kirsti; Viikari-Juntura, Eira

2012-01-01

Objectives The aim was to construct and validate a gender-specific job exposure matrix (JEM) for physical exposures to be used in epidemiological studies of low back pain (LBP). Materials and Methods We utilized two large Finnish population surveys, one to construct the JEM and another to test matrix validity. The exposure axis of the matrix included exposures relevant to LBP (heavy physical work, heavy lifting, awkward trunk posture and whole body vibration) and exposures that increase the biomechanical load on the low back (arm elevation) or those that in combination with other known risk factors could be related to LBP (kneeling or squatting). Job titles with similar work tasks and exposures were grouped. Exposure information was based on face-to-face interviews. Validity of the matrix was explored by comparing the JEM (group-based) binary measures with individual-based measures. The predictive validity of the matrix against LBP was evaluated by comparing the associations of the group-based (JEM) exposures with those of individual-based exposures. Results The matrix includes 348 job titles, representing 81% of all Finnish job titles in the early 2000s. The specificity of the constructed matrix was good, especially in women. The validity measured with kappa-statistic ranged from good to poor, being fair for most exposures. In men, all group-based (JEM) exposures were statistically significantly associated with one-month prevalence of LBP. In women, four out of six group-based exposures showed an association with LBP. Conclusions The gender-specific JEM for physical exposures showed relatively high specificity without compromising sensitivity. The matrix can therefore be considered as a valid instrument for exposure assessment in large-scale epidemiological studies, when more precise but more labour-intensive methods are not feasible. Although the matrix was based on Finnish data we foresee that it could be applicable, with some modifications, in other countries with a similar level of technology. PMID:23152793

Development and validation of a Food Frequency Questionnaire (FFQ) for assessing sugar consumption among adults in Klang Valley, Malaysia.

PubMed

Shanita, Nik S; Norimah, A K; Abu Hanifah, S

2012-12-01

The aim of this study was to develop and validate a semiquantitative food frequency questionnaire (FFQ) for assessing habitual added sugar consumption of adults in the Klang Valley. In the development phase, a 24-hour dietary recall (24-hr DR) was used to determine food items to be included into the FFQ among adults from three major ethnicities (n = 51). In the validation phase, the FFQ was further validated against a reference method which was a multiple-pass 24-hr DR among 125 adults in Klang Valley. The response rate for the latter phase was 96.1%. The semi-quantitative FFQ consisting of 64 food items was categorised into 10 food groups. The mean added sugar intake determined by the reference method was 44.2 +/- 20.2 g/day while that from the FFQ was 49.4 +/- 21.4 g/day. The difference in mean intake between the two methods was 5.2 g (95% CI = 2.6-7.9; SD = 14.9, p < 0.05) or 11.8%. Pearson correlation was r = 0.74 (p < 0.001) for the two methods while Spearman rank correlations for the various food groups ranged between 0.11 (cake and related foods) to 0.61 (self-prepared drinks), with most groups correlating significantly (p < 0.05). Cross-classification of subjects into quintiles of intake showed 47.2% of the subjects correctly classifying into the same quintile, 34.4% into adjacent quintiles while none were grossly misclassified. The Bland-Altman plot was concentrated in the y-axis range (-24.14 g to 34.8 g) with a mean of 5.22 g. This semi-quantitative FFQ provides a validated tool for estimating habitual intake of added sugar in the adult population of the Klang Valley.

Convergent and divergent validity of the Mullen Scales of Early Learning in young children with and without autism spectrum disorder.

PubMed

Swineford, Lauren B; Guthrie, Whitney; Thurm, Audrey

2015-12-01

The purpose of this study was to report on the construct, convergent, and divergent validity of the Mullen Scales of Early Learning (MSEL), a widely used test of development for young children. The sample consisted of 399 children with a mean age of 3.38 years (SD = 1.14) divided into a group of children with autism spectrum disorder (ASD) and a group of children not on the autism spectrum, with and without developmental delays. The study used the MSEL and several other measures assessing constructs relevant to the age range--including developmental skills, autism symptoms, and psychopathology symptoms--across multiple methods of assessment. Multiple-group confirmatory factor analyses revealed good overall fit and equal form of the MSEL 1-factor model across the ASD and nonspectrum groups, supporting the construct validity of the MSEL. However, neither full nor partial invariance of factor loadings was established because of the lower loadings in the ASD group compared with the nonspectrum group. Exploratory structural equation modeling revealed that other measures of developmental skills loaded together with the MSEL domain scores on a Developmental Functioning factor, supporting convergent validity of the MSEL. Divergent validity was supported by the lack of loading of MSEL domain scores on Autism Symptoms or Emotion/Behavior Problems factors. Although factor structure and loadings varied across groups, convergent and divergent validity findings were similar in the ASD and nonspectrum samples. Together, these results demonstrate evidence for the construct, convergent, and divergent validity of the MSEL using powerful data-analytic techniques. (c) 2015 APA, all rights reserved).

Development of Creative Behavior Observation Form: A Study on Validity and Reliability

ERIC Educational Resources Information Center

Dere, Zeynep; Ömeroglu, Esra

2018-01-01

This study, Creative Behavior Observation Form was developed to assess creativity of the children. While the study group on the reliability and validity of Creative Behavior Observation Form was being developed, 257 children in total who were at the ages of 5-6 were used as samples with stratified sampling method. Content Validity Index (CVI) and…

The Individual Regulation Component of Group Emotional Intelligence: Measure Development and Validation

ERIC Educational Resources Information Center

Peterson, Christina Hamme

2012-01-01

Counseling work is increasingly conducted in team format. The methods counseling teams use to manage the emotional component of their group life, or their group emotional intelligence, have been proposed as significantly contributing to group member trust, cooperation, and ultimate performance. Item development, exploratory factor analysis, and…

Experimental and statistical post-validation of positive example EST sequences carrying peroxisome targeting signals type 1 (PTS1)

PubMed Central

Lingner, Thomas; Kataya, Amr R. A.; Reumann, Sigrun

2012-01-01

We recently developed the first algorithms specifically for plants to predict proteins carrying peroxisome targeting signals type 1 (PTS1) from genome sequences.1 As validated experimentally, the prediction methods are able to correctly predict unknown peroxisomal Arabidopsis proteins and to infer novel PTS1 tripeptides. The high prediction performance is primarily determined by the large number and sequence diversity of the underlying positive example sequences, which mainly derived from EST databases. However, a few constructs remained cytosolic in experimental validation studies, indicating sequencing errors in some ESTs. To identify erroneous sequences, we validated subcellular targeting of additional positive example sequences in the present study. Moreover, we analyzed the distribution of prediction scores separately for each orthologous group of PTS1 proteins, which generally resembled normal distributions with group-specific mean values. The cytosolic sequences commonly represented outliers of low prediction scores and were located at the very tail of a fitted normal distribution. Three statistical methods for identifying outliers were compared in terms of sensitivity and specificity.” Their combined application allows elimination of erroneous ESTs from positive example data sets. This new post-validation method will further improve the prediction accuracy of both PTS1 and PTS2 protein prediction models for plants, fungi, and mammals. PMID:22415050

Experimental and statistical post-validation of positive example EST sequences carrying peroxisome targeting signals type 1 (PTS1).

PubMed

Lingner, Thomas; Kataya, Amr R A; Reumann, Sigrun

2012-02-01

We recently developed the first algorithms specifically for plants to predict proteins carrying peroxisome targeting signals type 1 (PTS1) from genome sequences. As validated experimentally, the prediction methods are able to correctly predict unknown peroxisomal Arabidopsis proteins and to infer novel PTS1 tripeptides. The high prediction performance is primarily determined by the large number and sequence diversity of the underlying positive example sequences, which mainly derived from EST databases. However, a few constructs remained cytosolic in experimental validation studies, indicating sequencing errors in some ESTs. To identify erroneous sequences, we validated subcellular targeting of additional positive example sequences in the present study. Moreover, we analyzed the distribution of prediction scores separately for each orthologous group of PTS1 proteins, which generally resembled normal distributions with group-specific mean values. The cytosolic sequences commonly represented outliers of low prediction scores and were located at the very tail of a fitted normal distribution. Three statistical methods for identifying outliers were compared in terms of sensitivity and specificity." Their combined application allows elimination of erroneous ESTs from positive example data sets. This new post-validation method will further improve the prediction accuracy of both PTS1 and PTS2 protein prediction models for plants, fungi, and mammals.

Determination of free sulphydryl groups in wheat gluten under the influence of different time and temperature of incubation: method validation.

PubMed

Rakita, Slađana; Pojić, Milica; Tomić, Jelena; Torbica, Aleksandra

2014-05-01

The aim of the present study was to determine the characteristics of an analytical method for determination of free sulphydryl (SH) groups of wheat gluten performed with previous gluten incubation for variable times (45, 90 and 135min) at variable temperatures (30 and 37°C), in order to determine its fitness-for-purpose. It was observed that the increase in temperature and gluten incubation time caused the increase in the amount of free SH groups, with more dynamic changes at 37°C. The method characteristics identified as relevant were: linearity, limit of detection, limit of quantification, precision (repeatability and reproducibility) and measurement uncertainty, which were checked within the validation protocol, while the method performance was monitored by X- and R-control charts. Identified method characteristics demonstrated its acceptable fitness-for-purpose, when assay included previous gluten incubation at 30°C. Although the method repeatability at 37°C was acceptable, the corresponding reproducibility did not meet the performance criterion on the basis of HORRAT value (HORRAT<2). Copyright © 2013 Elsevier Ltd. All rights reserved.

Validity of Dietary Assessment in Athletes: A Systematic Review

PubMed Central

Beck, Kathryn L.; Gifford, Janelle A.; Slater, Gary; Flood, Victoria M.; O’Connor, Helen

2017-01-01

Dietary assessment methods that are recognized as appropriate for the general population are usually applied in a similar manner to athletes, despite the knowledge that sport-specific factors can complicate assessment and impact accuracy in unique ways. As dietary assessment methods are used extensively within the field of sports nutrition, there is concern the validity of methodologies have not undergone more rigorous evaluation in this unique population sub-group. The purpose of this systematic review was to compare two or more methods of dietary assessment, including dietary intake measured against biomarkers or reference measures of energy expenditure, in athletes. Six electronic databases were searched for English-language, full-text articles published from January 1980 until June 2016. The search strategy combined the following keywords: diet, nutrition assessment, athlete, and validity; where the following outcomes are reported but not limited to: energy intake, macro and/or micronutrient intake, food intake, nutritional adequacy, diet quality, or nutritional status. Meta-analysis was performed on studies with sufficient methodological similarity, with between-group standardized mean differences (or effect size) and 95% confidence intervals (CI) being calculated. Of the 1624 studies identified, 18 were eligible for inclusion. Studies comparing self-reported energy intake (EI) to energy expenditure assessed via doubly labelled water were grouped for comparison (n = 11) and demonstrated mean EI was under-estimated by 19% (−2793 ± 1134 kJ/day). Meta-analysis revealed a large pooled effect size of −1.006 (95% CI: −1.3 to −0.7; p < 0.001). The remaining studies (n = 7) compared a new dietary tool or instrument to a reference method(s) (e.g., food record, 24-h dietary recall, biomarker) as part of a validation study. This systematic review revealed there are limited robust studies evaluating dietary assessment methods in athletes. Existing literature demonstrates the substantial variability between methods, with under- and misreporting of intake being frequently observed. There is a clear need for careful validation of dietary assessment methods, including emerging technical innovations, among athlete populations. PMID:29207495

Validation of Digital Systems in Avionics and Flight Control Applications Handbook. Volume 1.

DTIC Science & Technology

1983-07-01

will also be available to Airways Facilities, Systems Research and Development Service, Air Traffic Control Service, and Flight Standards elements...2114, March 12-14, 1979. 3. Validation Methods Research for Fault-Tolerant Avionics and Control Systems-- *r Working Group Meeting II, NASA...command generation with the multiple methods becoming avail- able for closure of the outer control loop necessitates research on alternative integration

Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review

PubMed Central

Hanskamp-Sebregts, Mirelle; Zegers, Marieke; Vincent, Charles; van Gurp, Petra J; de Vet, Henrica C W; Wollersheim, Hub

2016-01-01

Objectives Record review is the most used method to quantify patient safety. We systematically reviewed the reliability and validity of adverse event detection with record review. Design A systematic review of the literature. Methods We searched PubMed, EMBASE, CINAHL, PsycINFO and the Cochrane Library and from their inception through February 2015. We included all studies that aimed to describe the reliability and/or validity of record review. Two reviewers conducted data extraction. We pooled κ values (κ) and analysed the differences in subgroups according to number of reviewers, reviewer experience and training level, adjusted for the prevalence of adverse events. Results In 25 studies, the psychometric data of the Global Trigger Tool (GTT) and the Harvard Medical Practice Study (HMPS) were reported and 24 studies were included for statistical pooling. The inter-rater reliability of the GTT and HMPS showed a pooled κ of 0.65 and 0.55, respectively. The inter-rater agreement was statistically significantly higher when the group of reviewers within a study consisted of a maximum five reviewers. We found no studies reporting on the validity of the GTT and HMPS. Conclusions The reliability of record review is moderate to substantial and improved when a small group of reviewers carried out record review. The validity of the record review method has never been evaluated, while clinical data registries, autopsy or direct observations of patient care are potential reference methods that can be used to test concurrent validity. PMID:27550650

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Osteoarthritis

PubMed Central

Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.

2013-01-01

Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494

External validation of a Cox prognostic model: principles and methods

PubMed Central

2013-01-01

Background A prognostic model should not enter clinical practice unless it has been demonstrated that it performs a useful role. External validation denotes evaluation of model performance in a sample independent of that used to develop the model. Unlike for logistic regression models, external validation of Cox models is sparsely treated in the literature. Successful validation of a model means achieving satisfactory discrimination and calibration (prediction accuracy) in the validation sample. Validating Cox models is not straightforward because event probabilities are estimated relative to an unspecified baseline function. Methods We describe statistical approaches to external validation of a published Cox model according to the level of published information, specifically (1) the prognostic index only, (2) the prognostic index together with Kaplan-Meier curves for risk groups, and (3) the first two plus the baseline survival curve (the estimated survival function at the mean prognostic index across the sample). The most challenging task, requiring level 3 information, is assessing calibration, for which we suggest a method of approximating the baseline survival function. Results We apply the methods to two comparable datasets in primary breast cancer, treating one as derivation and the other as validation sample. Results are presented for discrimination and calibration. We demonstrate plots of survival probabilities that can assist model evaluation. Conclusions Our validation methods are applicable to a wide range of prognostic studies and provide researchers with a toolkit for external validation of a published Cox model. PMID:23496923

A systematic review and appraisal of methods of developing and validating lifestyle cardiovascular disease risk factors questionnaires.

PubMed

Nse, Odunaiya; Quinette, Louw; Okechukwu, Ogah

2015-09-01

Well developed and validated lifestyle cardiovascular disease (CVD) risk factors questionnaires is the key to obtaining accurate information to enable planning of CVD prevention program which is a necessity in developing countries. We conducted this review to assess methods and processes used for development and content validation of lifestyle CVD risk factors questionnaires and possibly develop an evidence based guideline for development and content validation of lifestyle CVD risk factors questionnaires. Relevant databases at the Stellenbosch University library were searched for studies conducted between 2008 and 2012, in English language and among humans. Using the following databases; pubmed, cinahl, psyc info and proquest. Search terms used were CVD risk factors, questionnaires, smoking, alcohol, physical activity and diet. Methods identified for development of lifestyle CVD risk factors were; review of literature either systematic or traditional, involvement of expert and /or target population using focus group discussion/interview, clinical experience of authors and deductive reasoning of authors. For validation, methods used were; the involvement of expert panel, the use of target population and factor analysis. Combination of methods produces questionnaires with good content validity and other psychometric properties which we consider good.

Products of composite operators in the exact renormalization group formalism

NASA Astrophysics Data System (ADS)

Pagani, C.; Sonoda, H.

2018-02-01

We discuss a general method of constructing the products of composite operators using the exact renormalization group formalism. Considering mainly the Wilson action at a generic fixed point of the renormalization group, we give an argument for the validity of short-distance expansions of operator products. We show how to compute the expansion coefficients by solving differential equations, and test our method with some simple examples.

External validation of a 5-year survival prediction model after elective abdominal aortic aneurysm repair.

PubMed

DeMartino, Randall R; Huang, Ying; Mandrekar, Jay; Goodney, Philip P; Oderich, Gustavo S; Kalra, Manju; Bower, Thomas C; Cronenwett, Jack L; Gloviczki, Peter

2018-01-01

The benefit of prophylactic repair of abdominal aortic aneurysms (AAAs) is based on the risk of rupture exceeding the risk of death from other comorbidities. The purpose of this study was to validate a 5-year survival prediction model for patients undergoing elective repair of asymptomatic AAA <6.5 cm to assist in optimal selection of patients. All patients undergoing elective repair for asymptomatic AAA <6.5 cm (open or endovascular) from 2002 to 2011 were identified from a single institutional database (validation group). We assessed the ability of a prior published Vascular Study Group of New England (VSGNE) model (derivation group) to predict survival in our cohort. The model was assessed for discrimination (concordance index), calibration (calibration slope and calibration in the large), and goodness of fit (score test). The VSGNE derivation group consisted of 2367 patients (70% endovascular). Major factors associated with survival in the derivation group were age, coronary disease, chronic obstructive pulmonary disease, renal function, and antiplatelet and statin medication use. Our validation group consisted of 1038 patients (59% endovascular). The validation group was slightly older (74 vs 72 years; P < .01) and had a higher proportion of men (76% vs 68%; P < .01). In addition, the derivation group had higher rates of advanced cardiac disease, chronic obstructive pulmonary disease, and baseline creatinine concentration (1.2 vs 1.1 mg/dL; P < .01). Despite slight differences in preoperative patient factors, 5-year survival was similar between validation and derivation groups (75% vs 77%; P = .33). The concordance index of the validation group was identical between derivation and validation groups at 0.659 (95% confidence interval, 0.63-0.69). Our validation calibration in the large value was 1.02 (P = .62, closer to 1 indicating better calibration), calibration slope of 0.84 (95% confidence interval, 0.71-0.97), and score test of P = .57 (>.05 indicating goodness of fit). Across different populations of patients, assessment of age and level of cardiac, pulmonary, and renal disease can accurately predict 5-year survival in patients with AAA <6.5 cm undergoing repair. This risk prediction model is a valid method to assess mortality risk in determining potential overall survival benefit from elective AAA repair. Copyright © 2017 Society for Vascular Surgery. Published by Elsevier Inc. All rights reserved.

A collaborative design method to support integrated care. An ICT development method containing continuous user validation improves the entire care process and the individual work situation

PubMed Central

Scandurra, Isabella; Hägglund, Maria

2009-01-01

Introduction Integrated care involves different professionals, belonging to different care provider organizations and requires immediate and ubiquitous access to patient-oriented information, supporting an integrated view on the care process [1]. Purpose To present a method for development of usable and work process-oriented information and communication technology (ICT) systems for integrated care. Theory and method Based on Human-computer Interaction Science and in particular Participatory Design [2], we present a new collaborative design method in the context of health information systems (HIS) development [3]. This method implies a thorough analysis of the entire interdisciplinary cooperative work and a transformation of the results into technical specifications, via user validated scenarios, prototypes and use cases, ultimately leading to the development of appropriate ICT for the variety of occurring work situations for different user groups, or professions, in integrated care. Results and conclusions Application of the method in homecare of the elderly resulted in an HIS that was well adapted to the intended user groups. Conducted in multi-disciplinary seminars, the method captured and validated user needs and system requirements for different professionals, work situations, and environments not only for current work; it also aimed to improve collaboration in future (ICT supported) work processes. A holistic view of the entire care process was obtained and supported through different views of the HIS for different user groups, resulting in improved work in the entire care process as well as for each collaborating profession [4].

Concurrent and discriminant validity of the Star Excursion Balance Test for military personnel with lateral ankle sprain.

PubMed

Bastien, Maude; Moffet, Hélène; Bouyer, Laurent; Perron, Marc; Hébert, Luc J; Leblond, Jean

2014-02-01

The Star Excursion Balance Test (SEBT) has frequently been used to measure motor control and residual functional deficits at different stages of recovery from lateral ankle sprain (LAS) in various populations. However, the validity of the measure used to characterize performance--the maximal reach distance (MRD) measured by visual estimation--is still unknown. To evaluate the concurrent validity of the MRD in the SEBT estimated visually vs the MRD measured with a 3D motion-capture system and evaluate and compare the discriminant validity of 2 MRD-normalization methods (by height or by lower-limb length) in participants with or without LAS (n = 10 per group). There is a high concurrent validity and a good degree of accuracy between the visual estimation measurement and the MRD gold-standard measurement for both groups and under all conditions. The Cohen d ratios between groups and MANOVA products were higher when computed from MRD data normalized by height. The results support the concurrent validity of visual estimation of the MRD and the use of the SEBT to evaluate motor control. Moreover, normalization of MRD data by height appears to increase the discriminant validity of this test.

Validity and reliability of a scale to measure genital body image.

PubMed

Zielinski, Ruth E; Kane-Low, Lisa; Miller, Janis M; Sampselle, Carolyn

2012-01-01

Women's body image dissatisfaction extends to body parts usually hidden from view--their genitals. Ability to measure genital body image is limited by lack of valid and reliable questionnaires. We subjected a previously developed questionnaire, the Genital Self Image Scale (GSIS) to psychometric testing using a variety of methods. Five experts determined the content validity of the scale. Then using four participant groups, factor analysis was performed to determine construct validity and to identify factors. Further construct validity was established using the contrasting groups approach. Internal consistency and test-retest reliability was determined. Twenty one of 29 items were considered content valid. Two items were added based on expert suggestions. Factor analysis was undertaken resulting in four factors, identified as Genital Confidence, Appeal, Function, and Comfort. The revised scale (GSIS-20) included 20 items explaining 59.4% of the variance. Women indicating an interest in genital cosmetic surgery exhibited significantly lower scores on the GSIS-20 than those who did not. The final 20 item scale exhibited internal reliability across all sample groups as well as test-retest reliability. The GSIS-20 provides a measure of genital body image demonstrating reliability and validity across several populations of women.

How to Assign Individualized Scores on a Group Project: An Empirical Evaluation

ERIC Educational Resources Information Center

Zhang, Bo; Ohland, Matthew W.

2009-01-01

One major challenge in using group projects to assess student learning is accounting for the differences of contribution among group members so that the mark assigned to each individual actually reflects their performance. This research addresses the validity of grading group projects by evaluating different methods that derive individualized…

Validation Methods Research for Fault-Tolerant Avionics and Control Systems: Working Group Meeting, 2

NASA Technical Reports Server (NTRS)

Gault, J. W. (Editor); Trivedi, K. S. (Editor); Clary, J. B. (Editor)

1980-01-01

The validation process comprises the activities required to insure the agreement of system realization with system specification. A preliminary validation methodology for fault tolerant systems documented. A general framework for a validation methodology is presented along with a set of specific tasks intended for the validation of two specimen system, SIFT and FTMP. Two major areas of research are identified. First, are those activities required to support the ongoing development of the validation process itself, and second, are those activities required to support the design, development, and understanding of fault tolerant systems.

The Development, Validation, and User Evaluation of Foodbook24: A Web-Based Dietary Assessment Tool Developed for the Irish Adult Population

PubMed Central

McNulty, Breige; Kehoe, Laura; Evans, Katie; Walton, Janette; Flynn, Albert

2017-01-01

Background The application of technology in the area of dietary assessment has resulted in the development of an array of tools, which are often specifically designed for a particular country or region. Objective The aim of this study was to describe the development, validation, and user evaluation of a Web-based dietary assessment tool “Foodbook24.” Methods Foodbook24 is a Web-based, dietary assessment tool consisting of a 24-hour dietary recall (24HDR) and food frequency questionnaire (FFQ) alongside supplementary questionnaires. Validity of the 24HDR component was assessed by 40 participants, who completed 3 nonconsecutive, self-administered 24HDR using Foodbook24 and a 4-day semi-weighed food diary at separate time points. Participants also provided fasted blood samples and 24-hour urine collections for the identification of biomarkers of nutrient and food group intake during each recording period. Statistical analyses on the nutrient and food group intake data derived from each method were performed in SPSS version 20.0 (SPSS Inc). Mean nutrient intakes (and standard deviations) recorded using each method of dietary assessment were calculated. Spearman and Pearson correlations, Wilcoxon Signed Rank and Paired t test were used to investigate the agreement and differences between the nutritional output from Foodbook24 (test method) and the 4-day semi-weighed food diary (reference method). Urinary and plasma biomarkers of nutrient intake were used as an objective validation of Foodbook24. To investigate the user acceptability of Foodbook24, participants from different studies involved with Foodbook24 were asked to complete an evaluation questionnaire. Results For nutrient intake, correlations between the dietary assessment methods were acceptable to very good in strength and statistically significant (range r=.32 to .75). There were some significant differences between reported mean intakes of micronutrients recorded by both methods; however, with the exception of protein (P=.03), there were no significant differences in the reporting of energy or macronutrient intake. Of the 19 food groups investigated in this analysis, there were significant differences between 6 food groups reported by both methods. Spearman correlations for biomarkers of nutrient and food group intake and reported intake were similar for both methods. A total of 118 participants evaluated the acceptability of Foodbook24. The tool was well-received and the majority, 67.8% (80/118), opted for Foodbook24 as the preferred method for future dietary intake assessment when compared against a traditional interviewer led recall and semi-weighed food diary. Conclusions The results of this study demonstrate the validity and user acceptability of Foodbook24. The results also highlight the potential of Foodbook24, a Web-based dietary assessment method, and present a viable alternative to nutritional surveillance in Ireland. PMID:28495662

Sex estimation from measurements of the first rib in a contemporary Polish population.

PubMed

Kubicka, Anna Maria; Piontek, Janusz

2016-01-01

The aim of this study was to evaluate the accuracy of sex assessment using measurements of the first rib from computed tomography (CT) to develop a discriminant formula. Four discriminant formulae were derived based on CT imaging of the right first rib of 85 female and 91 male Polish patients of known age and sex. In direct discriminant analysis, the first equation consisted of all first rib variables; the second included measurements of the rib body; the third comprised only two measurements of the sternal end of the first rib. The stepwise method selected the four best variables from all measurements. The discriminant function equation was then tested on a cross-validated group consisting of 23 females and 24 males. The direct discriminant analysis showed that sex assessment was possible in 81.5% of cases in the first group and in 91.5% in the cross-validated group when all variables for the first rib were included. The average accuracy for the original group for rib body and sternal end was 80.9 and 67.9%, respectively. The percentages of correctly assigned individuals for the functions based on the rib body and sternal end in the cross-validated group were 76.6 and 85.0%, respectively. Higher average accuracies were obtained for stepwise discriminant analysis: 83.1% for the original group and 91.2% for the cross-validated group. The exterior edge, anterior-posterior of the sternal end, and depth of the arc were the most reliable parameters. Our results suggest that the first rib is dimorphic and that the described method can be used for sex assessment.

Systematic behavioural observation of executive performance after brain injury.

PubMed

Lewis, Mark W; Babbage, Duncan R; Leathem, Janet M

2017-01-01

To develop an ecologically valid measure of executive functioning (i.e. Planning and Organization, Executive Memory, Initiation, Cognitive Shifting, Impulsivity, Sustained and Directed Attention, Error Detection, Error Correction and Time Management) during a functional chocolate brownie cooking task. In Study 1, the inter-rater reliability of a novel behavioural observation assessment method was assessed with 10 people with traumatic brain injury (TBI). In Study 2, 27 people with TBI and 16 healthy controls completed the functional task along with other measures of executive functioning to assess validity. Intraclass correlation coefficients for six of the nine aspects of executive functioning ranged from .54 to 1.00. Percentage agreements for the remaining aspects ranged from 70% to 90%. Significant and non-significant, moderate, correlations were found between the functional cooking task and standard neuropsychological measures. The healthy control group performed better than the TBI group in six areas (d = 0.56 to 1.23). In this initial trial of a novel assessment method, adequate inter-rater reliability was found. The measure was associated with standard neuropsychological measures, and our healthy control group performed better than the TBI group. The measure appears to be an ecologically valid measure of executive functioning.

Validation of wet mount microscopy against Trichomonas culture among women of reproductive age group in Western province, Sri Lanka.

PubMed

Banneheke, H; Fernandopulle, R; Gunasekara, U; Barua, A; Fernando, N; Wickremasinghe, R

2015-06-01

Wet mount microscopy is the most commonly used diagnostic method for trichomoniasis in clinical diagnostic services all over the world including Sri Lanka due to its availability, simplicity and is relatively inexpensive. However, Trichomonas culture and PCR are the gold standard tests. Unfortunately, neither the culture nor PCR is available for the diagnosis of trichomoniasis in Sri Lanka. Thus, it is important to validate the wet mount microscopy as it is the only available diagnostic test and has not been validated to date in Sri Lanka. The objective was to evaluate the validity and reliability of wet mount microscopy against gold standard Trichomonas culture among clinic based population of reproductive age group women in Western province, Sri Lanka. Women attending hospital and institutional based clinics were enrolled. They were interviewed and high vaginal swabs were taken for laboratory diagnosis by culture and wet mount microscopy. There were 601 participants in the age group of 15-45 years. Wet mount microscopy showed 68% sensitivity, 100% specificity, 100% positive (PPV) and 98% negative predictive values (NPV) (P=0.001, kappa=0.803) respectively against the gold standard culture. The area under the ROC curve was 0.840. Sensitivity of wet mount microscopy is low. However it has high validity and reliability as a specific diagnostic test for trichomoniasis. If it is to be used among women of reproductive age group in Western province, Sri Lanka, a culture method could be adopted as a second test to confirm the negative wet mount for symptomatic patients.

Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

PubMed

Yousuf, Naveed; Violato, Claudio; Zuberi, Rukhsana W

2015-01-01

CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Thirty OSCE stations administered at least twice in the years 2010-2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean-1.5SD, Mean-1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean-1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study. We also found that cluster analysis using mean method can be used for quality assurance of borderline methods. These findings should be further confirmed by studies in other settings.

Measuring benefits and patients' satisfaction when glasses are not needed after cataract and presbyopia surgery: scoring and psychometric validation of the Freedom from Glasses Value Scale (FGVS©)

PubMed Central

2010-01-01

Background The purpose of this study was to reduce the number of items, create a scoring method and assess the psychometric properties of the Freedom from Glasses Value Scale (FGVS), which measures benefits of freedom from glasses perceived by cataract and presbyopic patients after multifocal intraocular lens (IOL) surgery. Methods The 21-item FGVS, developed simultaneously in French and Spanish, was administered by phone during an observational study to 152 French and 152 Spanish patients who had undergone cataract or presbyopia surgery at least 1 year before the study. Reduction of items and creation of the scoring method employed statistical methods (principal component analysis, multitrait analysis) and content analysis. Psychometric properties (validation of the structure, internal consistency reliability, and known-group validity) of the resulting version were assessed in the pooled population and per country. Results One item was deleted and 3 were kept but not aggregated in a dimension. The other 17 items were grouped into 2 dimensions ('global evaluation', 9 items; 'advantages', 8 items) and divided into 5 sub-dimensions, with higher scores indicating higher benefit of surgery. The structure was validated (good item convergent and discriminant validity). Internal consistency reliability was good for all dimensions and sub-dimensions (Cronbach's alphas above 0.70). The FGVS was able to discriminate between patients wearing glasses or not after surgery (higher scores for patients not wearing glasses). FGVS scores were significantly higher in Spain than France; however, the measure had similar psychometric performances in both countries. Conclusions The FGVS is a valid and reliable instrument measuring benefits of freedom from glasses perceived by cataract and presbyopic patients after multifocal IOL surgery. PMID:20497555

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient

PubMed Central

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Background Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. Methods We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test. Results Compared to the preseminar result, Group A’s postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Conclusion Improved pre–post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence. PMID:28794664

PESTICIDE ANALYTICAL METHODS TO SUPPORT DUPLICATE-DIET HUMAN EXPOSURE MEASUREMENTS

EPA Science Inventory

Historically, analytical methods for determination of pesticides in foods have been developed in support of regulatory programs and are specific to food items or food groups. Most of the available methods have been developed, tested and validated for relatively few analytes an...

Validated spectrofluorimetric method for the determination of clonazepam in pharmaceutical preparations.

PubMed

Ibrahim, Fawzia; El-Enany, Nahed; Shalan, Shereen; Elsharawy, Rasha

2016-05-01

A simple, highly sensitive and validated spectrofluorimetric method was applied in the determination of clonazepam (CLZ). The method is based on reduction of the nitro group of clonazepam with zinc/CaCl2, and the product is then reacted with 2-cyanoacetamide (2-CNA) in the presence of ammonia (25%) yielding a highly fluorescent product. The produced fluorophore exhibits strong fluorescence intensity at ʎ(em) = 383 nm after excitation at ʎ(ex) = 333 nm. The method was rectilinear over a concentration range of 0.1-0.5 ng/mL with a limit of detection (LOD) of 0.0057 ng/mL and a limit of quantification (LOQ) of 0.017 ng/mL. The method was fully validated and successfully applied to the determination of CLZ in its tablets with a mean percentage recovery of 100.10 ± 0.75%. Method validation according to ICH Guidelines was evaluated. Statistical analysis of the results obtained using the proposed method was successfully compared with those obtained using a reference method, and there was no significance difference between the two methods in terms of accuracy and precision. Copyright © 2015 John Wiley & Sons, Ltd.

Millon Clinical Multiaxial Inventory-III Subtypes of Opioid Dependence: Validity and Matching to Behavioral Therapies

ERIC Educational Resources Information Center

Ball, Samuel A.; Nich, Charla; Rounsaville, Bruce J.; Eagan, Dorothy; Carroll, Kathleen M.

2004-01-01

The concurrent and predictive validity of 2 different methods of Millon Clinical Multiaxial Inventory-III subtyping (protocol sorting, cluster analysis) was evaluated in 125 recently detoxified opioid-dependent outpatients in a 12-week randomized clinical trial. Participants received naltrexone and relapse prevention group counseling and were…

Development and Validation of the Perceived Social Work Competence Scale in China

ERIC Educational Resources Information Center

Wang, Yean; Chui, Ernest

2017-01-01

Objective: This article reports a study that developed and validated the Perceived Social Work Competence Scale (PSWCS) for assessing social work students' competence in Mainland China. Method: The indicators were generated by a broad empirical review of recent literature, confirmed by experts, and indigenized by means of two focus groups of…

Development and Validation of Videotaped Scenarios: A Method for Targeting Specific Participant Groups

ERIC Educational Resources Information Center

Noel, Nora E.; Maisto, Stephen A.; Johnson, James D.; Jackson, Lee A., Jr.; Goings, Christopher D.; Hagman, Brett T.

2008-01-01

Researchers using scenarios often neglect to validate perceived content and salience of embedded stimuli specifically with intended participants, even when such meaning is integral to the study. For example, sex and aggression stimuli are heavily influenced by culture, so participants may not perceive what researchers intended in sexual aggression…

ODD and ADHD Symptoms in Ukrainian Children: External Validators and Comorbidity

ERIC Educational Resources Information Center

Drabick, Deborah A. G.; Gadow, Kenneth D.; Carlson, Gabrielle A.; Bromet, Evelyn J.

2004-01-01

Objective: To examine potential external validators for oppositional defiant disorder (ODD) and attention-deficient/hyperactive disorder (ADHD) symptoms in a Ukrainian community-based sample of 600 children age 10 to 12 years old and evaluate the nature of co-occurring ODD and ADHD symptoms using mother- and teacher-defined groups. Method: In…

Reliability and Validity Testing of the Physical Resilience Measure

ERIC Educational Resources Information Center

Resnick, Barbara; Galik, Elizabeth; Dorsey, Susan; Scheve, Ann; Gutkin, Susan

2011-01-01

Objective: The purpose of this study was to test reliability and validity of the Physical Resilience Scale. Methods: A single-group repeated measure design was used and 130 older adults from three different housing sites participated. Participants completed the Physical Resilience Scale, Hardy-Gill Resilience Scale, 14-item Resilience Scale,…

Development and validation of an automated, microscopy-based method for enumeration of groups of intestinal bacteria.

PubMed

Jansen, G J; Wildeboer-Veloo, A C; Tonk, R H; Franks, A H; Welling, G W

1999-09-01

An automated microscopy-based method using fluorescently labelled 16S rRNA-targeted oligonucleotide probes directed against the predominant groups of intestinal bacteria was developed and validated. The method makes use of the Leica 600HR image analysis system, a Kodak MegaPlus camera model 1.4 and a servo-controlled Leica DM/RXA ultra-violet microscope. Software for automated image acquisition and analysis was developed and tested. The performance of the method was validated using a set of four fluorescent oligonucleotide probes: a universal probe for the detection of all bacterial species, one probe specific for Bifidobacterium spp., a digenus-probe specific for Bacteroides spp. and Prevotella spp. and a trigenus-probe specific for Ruminococcus spp., Clostridium spp. and Eubacterium spp. A nucleic acid stain, 4',6-diamidino-2-phenylindole (DAPI), was also included in the validation. In order to quantify the assay-error, one faecal sample was measured 20 times using each separate probe. Thereafter faecal samples of 20 different volunteers were measured following the same procedure in order to quantify the error due to individual-related differences in gut flora composition. It was concluded that the combination of automated microscopy and fluorescent whole-cell hybridisation enables distinction in gut flora-composition between volunteers at a significant level. With this method it is possible to process 48 faecal samples overnight, with coefficients of variation ranging from 0.07 to 0.30.

Cross-validation of the Beunen-Malina method to predict adult height.

PubMed

Beunen, Gaston P; Malina, Robert M; Freitas, Duarte I; Maia, José A; Claessens, Albrecht L; Gouveia, Elvio R; Lefevre, Johan

2010-08-01

The purpose of this study was to cross-validate the Beunen-Malina method for non-invasive prediction of adult height. Three hundred and eight boys aged 13, 14, 15 and 16 years from the Madeira Growth Study were observed at annual intervals in 1996, 1997 and 1998 and re-measured 7-8 years later. Height, sitting height and the triceps and subscapular skinfolds were measured; skeletal age was assessed using the Tanner-Whitehouse 2 method. Adult height was measured and predicted using the Beunen-Malina method. Maturity groups were classified using relative skeletal age (skeletal age minus chronological age). Pearson correlations, mean differences and standard errors of estimate (SEE) were calculated. Age-specific correlations between predicted and measured adult height vary between 0.70 and 0.85, while age-specific SEE varies between 3.3 and 4.7 cm. The correlations and SEE are similar to those obtained in the development of the original Beunen-Malina method. The Beunen-Malina method is a valid method to predict adult height in adolescent boys and can be used in European populations or populations from European ancestry. Percentage of predicted adult height is a non-invasive valid method to assess biological maturity.

Validity and reliability assessment of a peer evaluation method in team-based learning classes.

PubMed

Yoon, Hyun Bae; Park, Wan Beom; Myung, Sun-Jung; Moon, Sang Hui; Park, Jun-Bean

2018-03-01

Team-based learning (TBL) is increasingly employed in medical education because of its potential to promote active group learning. In TBL, learners are usually asked to assess the contributions of peers within their group to ensure accountability. The purpose of this study is to assess the validity and reliability of a peer evaluation instrument that was used in TBL classes in a single medical school. A total of 141 students were divided into 18 groups in 11 TBL classes. The students were asked to evaluate their peers in the group based on evaluation criteria that were provided to them. We analyzed the comments that were written for the highest and lowest achievers to assess the validity of the peer evaluation instrument. The reliability of the instrument was assessed by examining the agreement among peer ratings within each group of students via intraclass correlation coefficient (ICC) analysis. Most of the students provided reasonable and understandable comments for the high and low achievers within their group, and most of those comments were compatible with the evaluation criteria. The average ICC of each group ranged from 0.390 to 0.863, and the overall average was 0.659. There was no significant difference in inter-rater reliability according to the number of members in the group or the timing of the evaluation within the course. The peer evaluation instrument that was used in the TBL classes was valid and reliable. Providing evaluation criteria and rules seemed to improve the validity and reliability of the instrument.

Concurrent validity of different functional and neuroproteomic pain assessment methods in the rat osteoarthritis monosodium iodoacetate (MIA) model.

PubMed

Otis, Colombe; Gervais, Julie; Guillot, Martin; Gervais, Julie-Anne; Gauvin, Dominique; Péthel, Catherine; Authier, Simon; Dansereau, Marc-André; Sarret, Philippe; Martel-Pelletier, Johanne; Pelletier, Jean-Pierre; Beaudry, Francis; Troncy, Eric

2016-06-23

Lack of validity in osteoarthritis pain models and assessment methods is suspected. Our goal was to 1) assess the repeatability and reproducibility of measurement and the influence of environment, and acclimatization, to different pain assessment outcomes in normal rats, and 2) test the concurrent validity of the most reliable methods in relation to the expression of different spinal neuropeptides in a chemical model of osteoarthritic pain. Repeatability and inter-rater reliability of reflexive nociceptive mechanical thresholds, spontaneous static weight-bearing, treadmill, rotarod, and operant place escape/avoidance paradigm (PEAP) were assessed by the intraclass correlation coefficient (ICC). The most reliable acclimatization protocol was determined by comparing coefficients of variation. In a pilot comparative study, the sensitivity and responsiveness to treatment of the most reliable methods were tested in the monosodium iodoacetate (MIA) model over 21 days. Two MIA (2 mg) groups (including one lidocaine treatment group) and one sham group (0.9 % saline) received an intra-articular (50 μL) injection. No effect of environment (observer, inverted circadian cycle, or exercise) was observed; all tested methods except mechanical sensitivity (ICC <0.3), offered good repeatability (ICC ≥0.7). The most reliable acclimatization protocol included five assessments over two weeks. MIA-related osteoarthritic change in pain was demonstrated with static weight-bearing, punctate tactile allodynia evaluation, treadmill exercise and operant PEAP, the latter being the most responsive to analgesic intra-articular lidocaine. Substance P and calcitonin gene-related peptide were higher in MIA groups compared to naive (adjusted P (adj-P) = 0.016) or sham-treated (adj-P = 0.029) rats. Repeated post-MIA lidocaine injection resulted in 34 times lower downregulation for spinal substance P compared to MIA alone (adj-P = 0.029), with a concomitant increase of 17 % in time spent on the PEAP dark side (indicative of increased comfort). This study of normal rats and rats with pain established the most reliable and sensitive pain assessment methods and an optimized acclimatization protocol. Operant PEAP testing was more responsive to lidocaine analgesia than other tests used, while neuropeptide spinal concentration is an objective quantification method attractive to support and validate different centralized pain functional assessment methods.

A multiple-group measurement scale for interprofessional collaboration: Adaptation and validation into Italian and German languages.

PubMed

Vittadello, Fabio; Mischo-Kelling, Maria; Wieser, Heike; Cavada, Luisa; Lochner, Lukas; Naletto, Carla; Fink, Verena; Reeves, Scott

2018-05-01

This article presents a study that aimed to validate a translation of a multiple-group measurement scale for interprofessional collaboration (IPC). We used survey data gathered over a three month period as part of a mixed methods study that explored the nature of IPC in Northern Italy. Following a translation from English into Italian and German the survey was distributed online to over 5,000 health professionals (dieticians, nurses, occupational therapists, physicians, physiotherapists, speech therapists and psychologists) based in one regional health trust. In total, 2,238 different health professions completed the survey. Based on the original scale, three principal components were extracted and confirmed as relevant factors for IPC (communication, accommodation and isolation). A confirmatory analysis (3-factor model) was applied to the data of physicians and nurses by language group. In conclusion, the validation of the German and Italian IPC scale has provided an instrument of acceptable reliability and validity for the assessment of IPC involving physicians and nurses.

Development of a Measure to Assess the Impact of Epilepsy on People with an Intellectual Disability: The Glasgow Epilepsy Outcome Scale-Client Version (GEOS-C)

ERIC Educational Resources Information Center

Watkins, J.; Espie, C. A.; Curtice, L.; Mantala, K.; Corp, A.; Foley, J.

2006-01-01

Background: Epilepsy is common in people with intellectual disability, yet clinicians and researchers seldom obtain information directly from the client. The development and preliminary validation of a novel measure for use with people with mild to moderate intellectual disabilities is described. Methods: Focus group methods (6 groups; 24…

Development and validation of a questionnaire to evaluate infection control in oral radiology

PubMed Central

Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-01-01

Objectives: To create and validate a questionnaire to evaluate infection control in oral radiology. Methods: The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test–retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. Results: The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722–1.000) and good to great for the yes/no questions (kappa = 0.662–0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. Conclusions: The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology. PMID:28112553

Reliability and validity of a visual analogue scale used by owners to measure chronic pain attributable to osteoarthritis in their dogs.

PubMed

Hielm-Björkman, Anna K; Kapatkin, Amy S; Rita, Hannu J

2011-05-01

To assess validity and reliability for a visual analogue scale (VAS) used by owners to measure chronic pain in their osteoarthritic dogs. 68, 61, and 34 owners who completed a questionnaire. Owners answered questionnaires at 5 time points. Criterion validity of the VAS was evaluated for all dogs in the intended-to-treat population by correlating scores for the VAS with scores for the validated Helsinki Chronic Pain Index (HCPI) and a relative quality-of-life scale. Intraclass correlation was used to assess repeatability of the pain VAS at 2 baseline evaluations. To determine sensitivity to change and face validity of the VAS, 2 blinded, randomized control groups (17 dogs receiving carprofen and 17 receiving a placebo) were analyzed over time. Significant correlations existed between the VAS score and the quality-of-life scale and HCPI scores. Intraclass coefficient (r = 0.72; 95% confidence interval, 0.57 to 0.82) for the VAS indicated good repeatability. In the carprofen and placebo groups, there was poor correlation between the 2 pain evaluation methods (VAS and HCPI items) at the baseline evaluation, but the correlation improved in the carprofen group over time. No correlation was detected for the placebo group over time. Although valid and reliable, the pain VAS was a poor tool for untrained owners because of poor face validity (ie, owners could not recognize their dogs' behavior as signs of pain). Only after owners had seen pain diminish and then return (after starting and discontinuing NSAID use) did the VAS have face validity.

Retrospective Methods Analysis of Semiautomated Intracerebral Hemorrhage Volume Quantification From a Selection of the STICH II Cohort (Early Surgery Versus Initial Conservative Treatment in Patients With Spontaneous Supratentorial Lobar Intracerebral Haematomas).

PubMed

Haley, Mark D; Gregson, Barbara A; Mould, W Andrew; Hanley, Daniel F; Mendelow, Alexander David

2018-02-01

The ABC/2 method for calculating intracerebral hemorrhage (ICH) volume has been well validated. However, the formula, derived from the volume of an ellipse, assumes the shape of ICH is elliptical. We sought to compare the agreement of the ABC/2 formula with other methods through retrospective analysis of a selection of the STICH II cohort (Early Surgery Versus Initial Conservative Treatment in Patients With Spontaneous Supratentorial Lobar Intracerebral Haematomas). From 390 patients, 739 scans were selected from the STICH II image archive based on the availability of a CT scan compatible with OsiriX DICOM viewer. ICH volumes were calculated by the reference standard semiautomatic segmentation in OsiriX software and compared with calculated arithmetic methods (ABC/2, ABC/2.4, ABC/3, and 2/3SC) volumes. Volumes were compared by difference plots for specific groups: randomization ICH (n=374), 3- to 7-day postsurgical ICH (n=206), antithrombotic-associated ICH (n=79), irregular-shape ICH (n=703) and irregular-density ICH (n=650). Density and shape were measured by the Barras ordinal shape and density groups (1-5). The ABC/2.4 method had the closest agreement to the semiautomatic segmentation volume in all groups, except for the 3- to 7-day postsurgical ICH group where the ABC/3 method was superior. Although the ABC/2 formula for calculating elliptical ICH is well validated, it must be used with caution in ICH scans where the elliptical shape of ICH is a false assumption. We validated the adjustment of the ABC/2.4 method in randomization, antithrombotic-associated, heterogeneous-density, and irregular-shape ICH. URL: http://www.isrctn.com/ISRCTN22153967. Unique identifier: ISRCTN22153967. © 2018 American Heart Association, Inc.

Mixed qualitative and quantitative approach for validating an information booklet before total hip arthroplasty.

PubMed

Chabaud, Aurore; Eschalier, Bénédicte; Zullian, Myriam; Plan-Paquet, Anne; Aubreton, Sylvie; Saragaglia, Dominique; Descamps, Stéphane; Coudeyre, Emmanuel

2018-05-01

Providing patients with validated information before total hip arthroplasty may help lessen discrepancies between patients' expectations and the surgical result. This study sought to validate an information booklet for candidates for hip arthroplasty by using a mixed qualitative and quantitative approach based on a panel of patients and a sample of healthcare professionals. We developed a booklet in accordance with the standard methods and then conducted focus groups to collect the opinions of a sample of multidisciplinary experts involved in the care of patients with hip osteoarthritis. The number of focus groups and experts was determined according to the data saturation principle. A panel of patients awaiting hip arthroplasty or those in the immediate post-operative period assessed the booklet with self-reporting questionnaires (knowledge, beliefs, and expectations) and semi-structured interviews. All experts and both patient groups validated the booklet in terms of content and presentation. Semi-structured interviews were uninformative, especially for post-operative patients. Reading the booklet significantly (P<0.001) improved the knowledge scores in both groups, with no intergroup differences, but did not affect beliefs in either patient group. Only pre-operative patients significantly changed their expectations. Our mixed qualitative and quantitative approach allowed us to validate a booklet for patients awaiting hip arthroplasty, taking into account the opinions of both patients and healthcare professionals. Copyright © 2018 Elsevier Masson SAS. All rights reserved.

Measuring landscape esthetics: the scenic beauty estimation method

Treesearch

Terry C. Daniel; Ron S. Boster

1976-01-01

The Scenic Beauty Estimation Method (SBE) provides quantitative measures of esthetic preferences for alternative wildland management systems. Extensive experimentation and testing with user, interest, and professional groups validated the method. SBE shows promise as an efficient and objective means for assessing the scenic beauty of public forests and wildlands, and...

A brief measure of attitudes toward mixed methods research in psychology.

PubMed

Roberts, Lynne D; Povee, Kate

2014-01-01

The adoption of mixed methods research in psychology has trailed behind other social science disciplines. Teaching psychology students, academics, and practitioners about mixed methodologies may increase the use of mixed methods within the discipline. However, tailoring and evaluating education and training in mixed methodologies requires an understanding of, and way of measuring, attitudes toward mixed methods research in psychology. To date, no such measure exists. In this article we present the development and initial validation of a new measure: Attitudes toward Mixed Methods Research in Psychology. A pool of 42 items developed from previous qualitative research on attitudes toward mixed methods research along with validation measures was administered via an online survey to a convenience sample of 274 psychology students, academics and psychologists. Principal axis factoring with varimax rotation on a subset of the sample produced a four-factor, 12-item solution. Confirmatory factor analysis on a separate subset of the sample indicated that a higher order four factor model provided the best fit to the data. The four factors; 'Limited Exposure,' '(in)Compatibility,' 'Validity,' and 'Tokenistic Qualitative Component'; each have acceptable internal reliability. Known groups validity analyses based on preferred research orientation and self-rated mixed methods research skills, and convergent and divergent validity analyses based on measures of attitudes toward psychology as a science and scientist and practitioner orientation, provide initial validation of the measure. This brief, internally reliable measure can be used in assessing attitudes toward mixed methods research in psychology, measuring change in attitudes as part of the evaluation of mixed methods education, and in larger research programs.

Summative Self-Assessment in Higher Education: Implications of Its Counting towards the Final Mark

ERIC Educational Resources Information Center

Tejeiro, Ricardo A.; Gomez-Vallecillo, Jorge L.; Romero, Antonio F.; Pelegrina, Manuel; Wallace, Agustin; Emberley, Enrique

2012-01-01

Introduction: Our study aims at assessing the validity of summative criteria-referenced self-assessment in higher education, and in particular, if that validity varies when the professor counts self-assessment toward the final mark. Method: One hundred and twenty-two first year students from two groups in Teacher Education at the Universidad de…

A Validity and Reliability Study of the Basic Electronics Skills Self-Efficacy Scale (BESS)

ERIC Educational Resources Information Center

Korkmaz, Ö.; Korkmaz, M. K.

2016-01-01

The aim of this study is to improve a measurement tool to evaluate the self-efficacy of Electrical-Electronics Engineering students through their basic electronics skills. The sample group is composed of 124 Electrical-Electronics engineering students. The validity of the scale is analyzed with two different methods through factor analysis and…

Assessing College Student-Athletes' Life Stress: Initial Measurement Development and Validation

ERIC Educational Resources Information Center

Lu, Frank Jing-Horng; Hsu, Ya-Wen; Chan, Yuan-Shuo; Cheen, Jang-Rong; Kao, Kuei-Tsu

2012-01-01

College student-athletes have unique life stress that warrants close attention. The purpose of this study was to develop a reliable and valid measurement assessing college student-athletes' life stress. In Study 1, a focus group discussion and Delphi method produced a questionnaire draft, termed the College Student-Athletes' Life Stress Scale. In…

Using a Parental Checklist to Identify Diagnostic Groups in Children with Communication Impairment: A Validation of the Children's Communication Checklist--2

ERIC Educational Resources Information Center

Norbury, Courtenay Frazier; Nash, Marysia; Baird, Gillian; Bishop, Dorothy V. M.

2004-01-01

Background: The Children's Communication Checklist (CCC 1998) was revised in 2003 (CCC-2) to provide a general screen for communication disorder and to identify pragmatic/social interaction deficits. Two validation studies were conducted with different populations of children with language and communication impairments. Methods & Procedures: In…

Family Early Literacy Practices Questionnaire: A Validation Study for a Spanish-Speaking Population

ERIC Educational Resources Information Center

Lewis, Kandia

2012-01-01

The purpose of the current study was to evaluate the psychometric validity of a Spanish translated version of a family involvement questionnaire (the FELP) using a mixed-methods design. Thus, statistical analyses (i.e., factor analysis, reliability analysis, and item analysis) and qualitative analyses (i.e., focus group data) were assessed.…

Rapid characterization of transgenic and non-transgenic soybean oils by chemometric methods using NIR spectroscopy

NASA Astrophysics Data System (ADS)

Luna, Aderval S.; da Silva, Arnaldo P.; Pinho, Jéssica S. A.; Ferré, Joan; Boqué, Ricard

Near infrared (NIR) spectroscopy and multivariate classification were applied to discriminate soybean oil samples into non-transgenic and transgenic. Principal Component Analysis (PCA) was applied to extract relevant features from the spectral data and to remove the anomalous samples. The best results were obtained when with Support Vectors Machine-Discriminant Analysis (SVM-DA) and Partial Least Squares-Discriminant Analysis (PLS-DA) after mean centering plus multiplicative scatter correction. For SVM-DA the percentage of successful classification was 100% for the training group and 100% and 90% in validation group for non transgenic and transgenic soybean oil samples respectively. For PLS-DA the percentage of successful classification was 95% and 100% in training group for non transgenic and transgenic soybean oil samples respectively and 100% and 80% in validation group for non transgenic and transgenic respectively. The results demonstrate that NIR spectroscopy can provide a rapid, nondestructive and reliable method to distinguish non-transgenic and transgenic soybean oils.

Comparison of two methods in deriving a short version of oral health-related quality of life measure.

PubMed

Saub, R; Locker, D; Allison, P

2008-09-01

To compare two methods of developing short forms of the Malaysian Oral Health Impact Profile (OHIP-M) measure. Cross sectional data obtained using the long form of the OHIP-M was used to produce two types of OHIP-M short forms, derived using two different methods; namely regression and item frequency methods. The short version derived using a regression method is known as Reg-SOHIP(M) and that derived using a frequency method is known as Freq-SOHIP(M). Both short forms contained 14 items. These two forms were then compared in terms of their content, scores, reliability, validity and the ability to distinguish between groups. Out of 14 items, only four were in common. The form derived from the frequency method contained more high prevalence items and higher scores than the form derived from the regression method. Both methods produced a reliable and valid measure. However, the frequency method produced a measure, which was slightly better in terms of distinguishing between groups. Regardless of the method used to produce the measures, both forms performed equally well when tested for their cross-sectional psychometric properties.

78 FR 79579 - Energy Conservation Program: Alternative Efficiency Determination Methods, Basic Model Definition...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-31

... Working Group agreed on a one- sided 5 percent tolerance when comparing the validation test results to the... one DOE representative. 78 FR 22431. The members of the Working Group were selected to ensure a broad... Issues 1. Pre-Approval The Working Group unanimously recommended that DOE not require pre- approval for...

Development and validation of a preoperative prediction model for colorectal cancer T-staging based on MDCT images and clinical information.

PubMed

Sa, Sha; Li, Jing; Li, Xiaodong; Li, Yongrui; Liu, Xiaoming; Wang, Defeng; Zhang, Huimao; Fu, Yu

2017-08-15

This study aimed to establish and evaluate the efficacy of a prediction model for colorectal cancer T-staging. T-staging was positively correlated with the level of carcinoembryonic antigen (CEA), expression of carbohydrate antigen 19-9 (CA19-9), wall deformity, blurred outer edges, fat infiltration, infiltration into the surrounding tissue, tumor size and wall thickness. Age, location, enhancement rate and enhancement homogeneity were negatively correlated with T-staging. The predictive results of the model were consistent with the pathological gold standard, and the kappa value was 0.805. The total accuracy of staging improved from 51.04% to 86.98% with the proposed model. The clinical, imaging and pathological data of 611 patients with colorectal cancer (419 patients in the training group and 192 patients in the validation group) were collected. A spearman correlation analysis was used to validate the relationship among these factors and pathological T-staging. A prediction model was trained with the random forest algorithm. T staging of the patients in the validation group was predicted by both prediction model and traditional method. The consistency, accuracy, sensitivity, specificity and area under the curve (AUC) were used to compare the efficacy of the two methods. The newly established comprehensive model can improve the predictive efficiency of preoperative colorectal cancer T-staging.

The application of a handheld personal digital assistant with camera and mobile phone card (Wellnavi) to the general population in a dietary survey.

PubMed

Kikunaga, Shigeshi; Tin, Tomoe; Ishibashi, Genji; Wang, Da-Hong; Kira, Shohei

2007-04-01

This study was carried out to examine first, the validity of a new dietary assessment method, a handheld personal digital assistant with camera and mobile phone card (Wellnavi), in comparison with a weighed diet record as a reference method and second, the relation between obesity and underreporting in the Wellnavi method in 27 men and 48 women volunteers aged 30-67 y from the general population. On the validity, there were significant correlations (0.32-0.75) between the daily nutrient intakes measured by the Wellnavi method and the weighed diet record method in all the subjects except for some nutrients such as iron, magnesium and vitamin E. Results similar to those from the group of all the subjects were obtained in the men's group and the women's group. In all the subjects and the men's group and the women's group, the differences in the daily nutrient intakes between the two dietary assessment methods were statistically significant. However, good agreement of the differences between the two dietary assessment methods for many daily nutrient intakes was obtained in the nonobese men. The nutrient intakes estimated by the Wellnavi method in all the subjects and the men's group and the women's group were significantly lower than those values estimated by the weighed diet record method except for some nutrients such as sodium, iron and fat-soluble vitamins. With respect to the relation between obesity and underreporting, the obesity in women was not a factor of underreporting in the Wellnavi method, but the presence of this relation was undeniable in the obese men. The reason why the values of daily nutrient intakes in the Wellnavi method were lower than those estimated by the weighed diet record method seemed to be the low quality of the digital photo of the Wellnavi instrument. By improving the digital photo quality of this instrument, the Wellnavi method could become a useful new dietary assessment method to get accurate dietary information from people of a wide range of age and occupation, and a wide variety of physical situations of subjects from the general population.

Heart rate deceleration runs for postinfarction risk prediction.

PubMed

Guzik, Przemyslaw; Piskorski, Jaroslaw; Barthel, Petra; Bauer, Axel; Müller, Alexander; Junk, Nadine; Ulm, Kurt; Malik, Marek; Schmidt, Georg

2012-01-01

A method for counting episodes of uninterrupted beat-to-beat heart rate decelerations was developed. The method was set up and evaluated using 24-hour electrocardiogram Holter recordings of 1455 (training sample) and 946 (validation sample) postinfarction patients. During a median follow-up of 24 months, 70, 46, and 19 patients of the training sample suffered from total, cardiac, and sudden cardiac mortality, respectively. In the validation sample, these numbers were 39, 25, and 15. Episodes of consecutive beat-to-beat heart rate decelerations (deceleration runs [DRs]) were characterized by their length. Deceleration runs of 2 to 10 cycles were significantly less frequent in nonsurvivors. Multivariate model of DRs of 2, 4, and 8 cycles identified low-, intermediate-, and high-risk groups. In these groups of the training sample, the total mortalities were 1.8%, 6.1%, and 24%, respectively. In the validation sample, these numbers were 1.8%, 4.1%, and 21.9%. Infrequent DRs during 24-hour Holter indicate high risk of postinfarction mortality. Copyright © 2012 Elsevier Inc. All rights reserved.

Validation of Yoon's Critical Thinking Disposition Instrument.

PubMed

Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin

2015-12-01

The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Procedure-specific assessment tool for flexible pharyngo-laryngoscopy: gathering validity evidence and setting pass-fail standards.

PubMed

Melchiors, Jacob; Petersen, K; Todsen, T; Bohr, A; Konge, Lars; von Buchwald, Christian

2018-06-01

The attainment of specific identifiable competencies is the primary measure of progress in the modern medical education system. The system, therefore, requires a method for accurately assessing competence to be feasible. Evidence of validity needs to be gathered before an assessment tool can be implemented in the training and assessment of physicians. This evidence of validity must according to the contemporary theory on validity be gathered from specific sources in a structured and rigorous manner. The flexible pharyngo-laryngoscopy (FPL) is central to the otorhinolaryngologist. We aim to evaluate the flexible pharyngo-laryngoscopy assessment tool (FLEXPAT) created in a previous study and to establish a pass-fail level for proficiency. Eighteen physicians with different levels of experience (novices, intermediates, and experienced) were recruited to the study. Each performed an FPL on two patients. These procedures were video recorded, blinded, and assessed by two specialists. The score was expressed as the percentage of a possible max score. Cronbach's α was used to analyze internal consistency of the data, and a generalizability analysis was performed. The scores of the three different groups were explored, and a pass-fail level was determined using the contrasting groups' standard setting method. Internal consistency was strong with a Cronbach's α of 0.86. We found a generalizability coefficient of 0.72 sufficient for moderate stakes assessment. We found a significant difference between the novice and experienced groups (p < 0.001) and strong correlation between experience and score (Pearson's r = 0.75). The pass/fail level was established at 72% of the maximum score. Applying this pass-fail level in the test population resulted in half of the intermediary group receiving a failing score. We gathered validity evidence for the FLEXPAT according to the contemporary framework as described by Messick. Our results support a claim of validity and are comparable to other studies exploring clinical assessment tools. The high rate of physicians underperforming in the intermediary group demonstrates the need for continued educational intervention. Based on our work, we recommend the use of the FLEXPAT in clinical assessment of FPL and the application of a pass-fail level of 72% for proficiency.

Reliability and validity of the Iranian version of the QAPACE in adolescents.

PubMed

Amiri, Parisa; Jalali-Farahani, Sara; Zarkesh, Maryam; Barzin, Maryam; Kaviani, Robabeh; Ahmadizad, Sajad

2014-08-01

The aim of this study was to determine the reliability and validity of the Iranian version of the Quantification de l'Activite Physique en Altitude Chez les Enfants (QAPACE) in adolescents. After linguistic validation, the Iranian version of the QAPACE was completed by 359 (52.4 % girls) schoolchildren, aged 15-18 years. Test-retest reliability of the questionnaire was determined by intraclass correlation coefficients (ICCs). For validation purposes, two methods were used for (1) the correlation between VO2peak and the DEE and (2) known-group validity, which was examined by comparing the normal weight adolescents and those who were overweight/obese. ICCs for test-retest ranged from 0.79 to 0.98. The mean scores in test-retest surveys for total score and all of the subscores were significant (p < 0.05). Sex-specific analysis showed a significant correlation between VO2peak and DEE over 12-month, school, and vacation periods in girls (p < 0.05). The mean values for all activities except for transportation, other activities in school, personal artistic activities, sport competition, and home activities were significantly lower in overweight/obese group than normal group. Our results support the initial reliability and validity of the Iranian version of QAPACE as a daily physical activity measure in adolescents.

Using cognitive pre-testing methods in the development of a new evidenced-based pressure ulcer risk assessment instrument.

PubMed

Coleman, S; Nixon, J; Keen, J; Muir, D; Wilson, L; McGinnis, E; Stubbs, N; Dealey, C; Nelson, E A

2016-11-16

Variation in development methods of Pressure Ulcer Risk Assessment Instruments has led to inconsistent inclusion of risk factors and concerns about content validity. A new evidenced-based Risk Assessment Instrument, the Pressure Ulcer Risk Primary Or Secondary Evaluation Tool - PURPOSE-T was developed as part of a National Institute for Health Research (NIHR) funded Pressure Ulcer Research Programme (PURPOSE: RP-PG-0407-10056). This paper reports the pre-test phase to assess and improve PURPOSE-T acceptability, usability and confirm content validity. A descriptive study incorporating cognitive pre-testing methods and integration of service user views was undertaken over 3 cycles comprising PURPOSE-T training, a focus group and one-to-one think-aloud interviews. Clinical nurses from 2 acute and 2 community NHS Trusts, were grouped according to job role. Focus group participants used 3 vignettes to complete PURPOSE-T assessments and then participated in the focus group. Think-aloud participants were interviewed during their completion of PURPOSE-T. After each pre-test cycle analysis was undertaken and adjustment/improvements made to PURPOSE-T in an iterative process. This incorporated the use of descriptive statistics for data completeness and decision rule compliance and directed content analysis for interview and focus group data. Data were collected April 2012-June 2012. Thirty-four nurses participated in 3 pre-test cycles. Data from 3 focus groups, 12 think-aloud interviews incorporating 101 PURPOSE-T assessments led to changes to improve instrument content and design, flow and format, decision support and item-specific wording. Acceptability and usability were demonstrated by improved data completion and appropriate risk pathway allocation. The pre-test also confirmed content validity with clinical nurses. The pre-test was an important step in the development of the preliminary PURPOSE-T and the methods used may have wider instrument development application. PURPOSE-T proposes a new approach to pressure ulcer risk assessment, incorporating a screening stage, the inclusion of skin status to distinguish between those who require primary prevention and those who require secondary prevention/treatment and the use of colour to support pathway allocation and decision making. Further clinical evaluation is planned to assess the reliability and validity of PURPOSE-T and it's impact on care processes and patient outcomes.

A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method.

PubMed

Martin, Corby K; Han, Hongmei; Coulon, Sandra M; Allen, H Raymond; Champagne, Catherine M; Anton, Stephen D

2009-02-01

The aim of the present study was to report the first reliability and validity tests of the remote food photography method (RFPM), which consists of camera-enabled cell phones with data transfer capability. Participants take and transmit photographs of food selection and plate waste to researchers/clinicians for analysis. Following two pilot studies, adult participants (n 52; BMI 20-35 kg/m2 inclusive) were randomly assigned to the dine-in or take-out group. Energy intake (EI) was measured for 3 d. The dine-in group ate lunch and dinner in the laboratory. The take-out group ate lunch in the laboratory and dinner in free-living conditions (participants received a cooler with pre-weighed food that they returned the following morning). EI was measured with the RFPM and by directly weighing foods. The RFPM was tested in laboratory and free-living conditions. Reliability was tested over 3 d and validity was tested by comparing directly weighed EI to EI estimated with the RFPM using Bland-Altman analysis. The RFPM produced reliable EI estimates over 3 d in laboratory (r 0.62; P < 0.0001) and free-living (r 0.68; P < 0.0001) conditions. Weighed EI correlated highly with EI estimated with the RFPM in laboratory and free-living conditions (r>0.93; P < 0.0001). In two laboratory-based validity tests, the RFPM underestimated EI by - 4.7 % (P = 0.046) and - 5.5 % (P = 0.076). In free-living conditions, the RFPM underestimated EI by - 6.6 % (P = 0.017). Bias did not differ by body weight or age. The RFPM is a promising new method for accurately measuring the EI of free-living individuals. Error associated with the method is small compared with self-report methods.

A study in the founding of applied behavior analysis through its publications.

PubMed

Morris, Edward K; Altus, Deborah E; Smith, Nathaniel G

2013-01-01

This article reports a study of the founding of applied behavior analysis through its publications. Our methods included hand searches of sources (e.g., journals, reference lists), search terms (i.e., early, applied, behavioral, research, literature), inclusion criteria (e.g., the field's applied dimension), and (d) challenges to their face and content validity. Our results were 36 articles published between 1959 and 1967 that we organized into 4 groups: 12 in 3 programs of research and 24 others. Our discussion addresses (a) limitations in our method (e.g., the completeness of our search), (b) challenges to the validity of our methods and results (e.g., convergent validity), and (c) priority claims about the field's founding. We conclude that the claims are irresolvable because identification of the founding publications depends significantly on methods and because the field's founding was an evolutionary process. We close with suggestions for future research.

A Study in the Founding of Applied Behavior Analysis Through Its Publications

PubMed Central

Morris, Edward K.; Altus, Deborah E.; Smith, Nathaniel G.

2013-01-01

This article reports a study of the founding of applied behavior analysis through its publications. Our methods included hand searches of sources (e.g., journals, reference lists), search terms (i.e., early, applied, behavioral, research, literature), inclusion criteria (e.g., the field's applied dimension), and (d) challenges to their face and content validity. Our results were 36 articles published between 1959 and 1967 that we organized into 4 groups: 12 in 3 programs of research and 24 others. Our discussion addresses (a) limitations in our method (e.g., the completeness of our search), (b) challenges to the validity of our methods and results (e.g., convergent validity), and (c) priority claims about the field's founding. We conclude that the claims are irresolvable because identification of the founding publications depends significantly on methods and because the field's founding was an evolutionary process. We close with suggestions for future research. PMID:25729133

Validating the measurement of social capital in Bangladesh: a cognitive approach.

PubMed

Story, William T; Taleb, Fahmida; Ahasan, S M Monirul; Ali, Nabeel A

2015-06-01

Despite the growing evidence linking social capital to improvements in health and health behaviors, reliable measures of social capital are lacking in low-income countries. To accurately measure social capital in new contexts, there is a need to validate social capital survey questions in each new cultural setting. In this article, we examine the content validity of the measurement of social capital in Bangladesh using qualitative methods. In December 2012, we conducted four focus group discussions and 32 cognitive interviews in one rural subdistrict (Durgapur) and one urban slum (Mirpur). We used the findings from the focus groups and cognitive interviews to create a new social capital survey instrument that can be used by health and development organizations in Bangladesh. Furthermore, in this article, we provide insight into social capital survey research in general, including suggestions for the measurement of group membership, social support, collective action, and social trust. © The Author(s) 2015.

Validating the Measurement of Social Capital in Bangladesh: A Cognitive Approach

PubMed Central

Story, William T.; Taleb, Fahmida; Ahasan, S.M. Monirul; Ali, Nabeel A.

2015-01-01

Despite the growing evidence linking social capital to improvements in health and health behaviors, reliable measures of social capital are lacking in low-income countries. To accurately measure social capital in new contexts, there is a need to validate social capital survey questions in each new cultural setting. In this article we examine the content validity of the measurement of social capital in Bangladesh using qualitative methods. In December 2012, we conducted four focus group discussions and 32 cognitive interviews in one rural subdistrict (Durgapur) and one urban slum (Mirpur). We used the findings from the focus groups and cognitive interviews to create a new social capital survey instrument that can be used by health and development organizations in Bangladesh. Furthermore, in this article we provide insight into social capital survey research in general, including suggestions for the measurement of group membership, social support, collective action, and social trust. PMID:25857652

A simple randomisation procedure for validating discriminant analysis: a methodological note.

PubMed

Wastell, D G

1987-04-01

Because the goal of discriminant analysis (DA) is to optimise classification, it designedly exaggerates between-group differences. This bias complicates validation of DA. Jack-knifing has been used for validation but is inappropriate when stepwise selection (SWDA) is employed. A simple randomisation test is presented which is shown to give correct decisions for SWDA. The general superiority of randomisation tests over orthodox significance tests is discussed. Current work on non-parametric methods of estimating the error rates of prediction rules is briefly reviewed.

Developing group investigation-based book on numerical analysis to increase critical thinking student’s ability

NASA Astrophysics Data System (ADS)

Maharani, S.; Suprapto, E.

2018-03-01

Critical thinking is very important in Mathematics; it can make student more understanding mathematics concept. Critical thinking is also needed in numerical analysis. The Numerical analysis's book is not yet including critical thinking in them. This research aims to develop group investigation-based book on numerical analysis to increase critical thinking student’s ability, to know the quality of the group investigation-based book on numerical analysis is valid, practical, and effective. The research method is Research and Development (R&D) with the subject are 30 student college department of Mathematics education at Universitas PGRI Madiun. The development model used is 4-D modified to 3-D until the stage development. The type of data used is descriptive qualitative data. Instruments used are sheets of validation, test, and questionnaire. Development results indicate that group investigation-based book on numerical analysis in the category of valid a value 84.25%. Students response to the books very positive, so group investigation-based book on numerical analysis category practical, i.e., 86.00%. The use of group investigation-based book on numerical analysis has been meeting the completeness criteria classical learning that is 84.32 %. Based on research result of this study concluded that group investigation-based book on numerical analysis is feasible because it meets the criteria valid, practical, and effective. So, the book can be used by every mathematics academician. The next research can be observed that book based group investigation in other subjects.

Contributing to the ICNP: validating the term cultural diversity.

PubMed

Geyer, N; Peu, M D; Roussouw, S; Morudi, J; Uys, E

2005-05-01

The specific aims of this study were to: Propose a definition of the term cultural diversity; Validate the term cultural diversity; and Submit a term and definition for international utilisation to the International Council of Nurses (ICN) for consideration for inclusion in the ICNP. South Africa was one of four African countries (Botswana, South Africa, Swaziland, and Zimbabwe) funded by the WK Kellogg Foundation to participate in the ICNP project. South Africa had 2 research groups. One of the research groups identified the term cultural diversity to define. This was a qualitative study where a philosophical perspective was used to explore, explain and describe nursing practice. The combined method proposed by the International Council of Nurses (ICN) was utilised to define and validate the term cultural diversity. Validation and literature review provided sufficient support for the defined characteristics and the term was finally defined and submitted to ICN in November 2002 as: CULTURAL DIVERSITY is a type of CULTURE with the specific characteristics: co-existence of different groups, e.g. ethnic, religious, linguistic and other groups each with their own values and belief systems, traditions and different lifestyles. The research group was informed in December 2003 of the ICNP Evaluation Committee recommendation that the term cultural diversity will be included in the ICNP.

Development and validation of a professionalism assessment scale for medical students

PubMed Central

Klemenc-Ketis, Zalika; Vrecko, Helena

2014-01-01

Objectives To develop and validate a scale for the assess-ment of professionalism in medical students based on students' perceptions of and attitudes towards professional-ism in medicine. Methods This was a mixed methods study with under-graduate medical students. Two focus groups were carried out with 12 students, followed by a transcript analysis (grounded theory method with open coding). Then, a 3-round Delphi with 20 family medicine experts was carried out. A psychometric assessment of the scale was performed with a group of 449 students. The items of the Professional-ism Assessment Scale could be answered on a five-point Likert scale. Results After the focus groups, the first version of the PAS consisted of 56 items and after the Delphi study, 30 items remained. The final sample for quantitative study consisted of 122 students (27.2% response rate). There were 95 (77.9%) female students in the sample. The mean age of the sample was 22.1 ± 2.1 years. After the principal component analysis, we removed 8 items and produced the final version of the PAS (22 items). The Cronbach's alpha of the scale was 0.88. Factor analysis revealed three factors: empathy and humanism, professional relationships and development and responsibility. Conclusions The new Professionalism Assessment Scale proved to be valid and reliable. It can be used for the assessment of professionalism in undergraduate medical students. PMID:25382090

Update of Standard Practices for New Method Validation in Forensic Toxicology.

PubMed

Wille, Sarah M R; Coucke, Wim; De Baere, Thierry; Peters, Frank T

2017-01-01

International agreement concerning validation guidelines is important to obtain quality forensic bioanalytical research and routine applications as it all starts with the reporting of reliable analytical data. Standards for fundamental validation parameters are provided in guidelines as those from the US Food and Drug Administration (FDA), the European Medicines Agency (EMA), the German speaking Gesellschaft fur Toxikologie und Forensische Chemie (GTFCH) and the Scientific Working Group of Forensic Toxicology (SWGTOX). These validation parameters include selectivity, matrix effects, method limits, calibration, accuracy and stability, as well as other parameters such as carryover, dilution integrity and incurred sample reanalysis. It is, however, not easy for laboratories to implement these guidelines into practice as these international guidelines remain nonbinding protocols, that depend on the applied analytical technique, and that need to be updated according the analyst's method requirements and the application type. In this manuscript, a review of the current guidelines and literature concerning bioanalytical validation parameters in a forensic context is given and discussed. In addition, suggestions for the experimental set-up, the pros and cons of statistical approaches and adequate acceptance criteria for the validation of bioanalytical applications are given. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

A Residual Mass Ballistic Testing Method to Compare Armor Materials or Components (Residual Mass Ballistic Testing Method)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Benjamin Langhorst; Thomas M Lillo; Henry S Chu

2014-05-01

A statistics based ballistic test method is presented for use when comparing multiple groups of test articles of unknown relative ballistic perforation resistance. The method is intended to be more efficient than many traditional methods for research and development testing. To establish the validity of the method, it is employed in this study to compare test groups of known relative ballistic performance. Multiple groups of test articles were perforated using consistent projectiles and impact conditions. Test groups were made of rolled homogeneous armor (RHA) plates and differed in thickness. After perforation, each residual projectile was captured behind the target andmore » its mass was measured. The residual masses measured for each test group were analyzed to provide ballistic performance rankings with associated confidence levels. When compared to traditional V50 methods, the residual mass (RM) method was found to require fewer test events and be more tolerant of variations in impact conditions.« less

Measuring benefits and patients' satisfaction when glasses are not needed after cataract and presbyopia surgery: scoring and psychometric validation of the Freedom from Glasses Value Scale (FGVS).

PubMed

Berdeaux, Gilles; Meunier, Juliette; Arnould, Benoit; Viala-Danten, Muriel

2010-05-24

The purpose of this study was to reduce the number of items, create a scoring method and assess the psychometric properties of the Freedom from Glasses Value Scale (FGVS), which measures benefits of freedom from glasses perceived by cataract and presbyopic patients after multifocal intraocular lens (IOL) surgery. The 21-item FGVS, developed simultaneously in French and Spanish, was administered by phone during an observational study to 152 French and 152 Spanish patients who had undergone cataract or presbyopia surgery at least 1 year before the study. Reduction of items and creation of the scoring method employed statistical methods (principal component analysis, multitrait analysis) and content analysis. Psychometric properties (validation of the structure, internal consistency reliability, and known-group validity) of the resulting version were assessed in the pooled population and per country. One item was deleted and 3 were kept but not aggregated in a dimension. The other 17 items were grouped into 2 dimensions ('global evaluation', 9 items; 'advantages', 8 items) and divided into 5 sub-dimensions, with higher scores indicating higher benefit of surgery. The structure was validated (good item convergent and discriminant validity). Internal consistency reliability was good for all dimensions and sub-dimensions (Cronbach's alphas above 0.70). The FGVS was able to discriminate between patients wearing glasses or not after surgery (higher scores for patients not wearing glasses). FGVS scores were significantly higher in Spain than France; however, the measure had similar psychometric performances in both countries. The FGVS is a valid and reliable instrument measuring benefits of freedom from glasses perceived by cataract and presbyopic patients after multifocal IOL surgery.

Criterion validity and clinical usefulness of Attention Deficit Hyperactivity Disorder Rating Scale IV in attention deficit hyperactivity disorder (ADHD) as a function of method and age.

PubMed

López-Villalobos, José A; Andrés-De Llano, Jesús; López-Sánchez, María V; Rodríguez-Molinero, Luis; Garrido-Redondo, Mercedes; Sacristán-Martín, Ana M; Martínez-Rivera, María T; Alberola-López, Susana

2017-02-01

The aim of this research is to analyze Attention Deficit Hyperactivity Disorder Rating Scales IV (ADHD RS-IV) criteria validity and its clinical usefulness for the assessment of Attention Deficit Hyperactivity Disorder (ADHD) as a function of assessment method and age. A sample was obtained from an epidemiological study (n = 1095, 6-16 years). Clinical cases of ADHD  (ADHD-CL) were selected by dimensional ADHD RS-IV and later by clinical interview (DSM-IV). ADHD-CL cases were compared with four categorical results of ADHD RS-IV provided by parents (CATPA), teachers (CATPR), either parents or teachers (CATPAOPR) and both parents and teachers (CATPA&PR). Criterion validity and clinical usefulness of the answer modalities to ADHD RS-IV were studied. ADHD-CL rate was 6.9% in childhood, 6.2% in preadolescence and 6.9% in adolescence. Alternative methods to the clinical interview led to increased numbers of ADHD cases in all age groups analyzed, in the following sequence: CATPAOPR> CATPRO> CATPA> CATPA&PR> ADHD-CL. CATPA&PR was the procedure with the greatest validity, specificity and clinical usefulness in all three age groups, particularly in the childhood. Isolated use of ADHD RS-IV leads to an increase in ADHD cases compared to clinical interview, and varies depending on the procedure used.

A brief measure of attitudes toward mixed methods research in psychology

PubMed Central

Roberts, Lynne D.; Povee, Kate

2014-01-01

The adoption of mixed methods research in psychology has trailed behind other social science disciplines. Teaching psychology students, academics, and practitioners about mixed methodologies may increase the use of mixed methods within the discipline. However, tailoring and evaluating education and training in mixed methodologies requires an understanding of, and way of measuring, attitudes toward mixed methods research in psychology. To date, no such measure exists. In this article we present the development and initial validation of a new measure: Attitudes toward Mixed Methods Research in Psychology. A pool of 42 items developed from previous qualitative research on attitudes toward mixed methods research along with validation measures was administered via an online survey to a convenience sample of 274 psychology students, academics and psychologists. Principal axis factoring with varimax rotation on a subset of the sample produced a four-factor, 12-item solution. Confirmatory factor analysis on a separate subset of the sample indicated that a higher order four factor model provided the best fit to the data. The four factors; ‘Limited Exposure,’ ‘(in)Compatibility,’ ‘Validity,’ and ‘Tokenistic Qualitative Component’; each have acceptable internal reliability. Known groups validity analyses based on preferred research orientation and self-rated mixed methods research skills, and convergent and divergent validity analyses based on measures of attitudes toward psychology as a science and scientist and practitioner orientation, provide initial validation of the measure. This brief, internally reliable measure can be used in assessing attitudes toward mixed methods research in psychology, measuring change in attitudes as part of the evaluation of mixed methods education, and in larger research programs. PMID:25429281

Polish Adult Reading Test (PART) - construction of Polish test for estimating the level of premorbid intelligence in schizophrenia.

PubMed

Karakuła-Juchnowicz, Hanna; Stecka, Mariola

2017-08-29

In view of unavailability in Poland of the standardized methods to measure PIQ, the aim of the work was to develop a Polish test to assess the premorbid level of intelligence - PART(Polish AdultReading Test) and to measureits psychometric properties, such as validity, reliability as well as standardization in the group of schizophrenia patients. The principles of PART construction were based on the idea of popular worldwide National Adult Reading Test by Hazel Nelson. The research comprised a group of 122 subjects (65 schizophrenia patients and 57 healthy people), aged 18-60 years, matched for age and gender. PART appears to be a method with high internal consistency and reliability measured by test-retest, inter-rater reliability, and the method with acceptable diagnostic and prognostic validity. The standardized procedures of PART have been investigated and described. Considering the psychometric values of PART and a short time of its performance, the test may be a useful diagnostic instrument in the assessment of premorbid level of intelligence in a group of schizophrenic patients.

Rapid Detection Method for the Four Most Common CHEK2 Mutations Based on Melting Profile Analysis.

PubMed

Borun, Pawel; Salanowski, Kacper; Godlewski, Dariusz; Walkowiak, Jaroslaw; Plawski, Andrzej

2015-12-01

CHEK2 is a tumor suppressor gene, and the mutations affecting the functionality of the protein product increase cancer risk in various organs. The elevated risk, in a significant percentage of cases, is determined by the occurrence of one of the four most common mutations in the CHEK2 gene, including c.470T>C (p.I157T), c.444+1G>A (IVS2+1G>A), c.1100delC, and c.1037+1538_1224+328del5395 (del5395). We have developed and validated a rapid and effective method for their detection based on high-resolution melting analysis and comparative-high-resolution melting, a novel approach enabling simultaneous detection of copy number variations. The analysis is performed in two polymerase chain reactions followed by melting analysis, without any additional reagents or handling other than that used in standard high-resolution melting. Validation of the method was conducted in a group of 103 patients with diagnosed breast cancer, a group of 240 unrelated patients with familial history of cancer associated with the CHEK2 gene mutations, and a 100-person control group. The results of the analyses for all three groups were fully consistent with the results from other methods. The method we have developed improves the identification of the CHEK2 mutation carriers, reduces the cost of such analyses, as well as facilitates their implementation. Along with the increased efficiency, the method maintains accuracy and reliability comparable to other more labor-consuming techniques.

Optimization and validation of a method using UHPLC-fluorescence for the analysis of polycyclic aromatic hydrocarbons in cold-pressed vegetable oils.

PubMed

Silva, Simone Alves da; Sampaio, Geni Rodrigues; Torres, Elizabeth Aparecida Ferraz da Silva

2017-04-15

Among the different food categories, the oils and fats are important sources of exposure to polycyclic aromatic hydrocarbons (PAHs), a group of organic chemical contaminants. The use of a validated method is essential to obtain reliable analytical results since the legislation establishes maximum limits in different foods. The objective of this study was to optimize and validate a method for the quantification of four PAHs [benzo(a)anthracene, chrysene, benzo(b)fluoranthene, benzo(a)pyrene] in vegetable oils. The samples were submitted to liquid-liquid extraction, followed by solid-phase extraction, and analyzed by ultra-high performance liquid chromatography. Under the optimized conditions, the validation parameters were evaluated according to the INMETRO Guidelines: linearity (r2 >0.99), selectivity (no matrix interference), limits of detection (0.08-0.30μgkg -1 ) and quantification (0.25-1.00μgkg -1 ), recovery (80.13-100.04%), repeatability and intermediate precision (<10% RSD). The method was found to be adequate for routine analysis of PAHs in the vegetable oils evaluated. Copyright © 2016. Published by Elsevier Ltd.

Video-imaging assessment of nasal morphology in individuals with complete unilateral cleft lip and palate.

PubMed

Russell, K A; Waldman, S D; Lee, J M

2000-11-01

The purpose of this study was to develop a video-imaging mathematical method to assess nostril morphology. This retrospective study involved two age-matched groups: 28 subjects with complete unilateral cleft lip and palate (CUCLP) and 19 noncleft controls. Nose casts were reproducibly oriented in a jig such that the casts could be rotated about the coronal axis. Video images of the nostrils were captured and then analyzed for area, perimeter, centroid, principal axis, moments about the major and minor axes (I11, I22), anisometry, bulkiness, lateral offset, internostril angle, and rotational angle. All parameters identified nostril asymmetry in both groups. The results of the analyses using anisometry, I11, and I22 showed that, in both groups, one nostril was rounder and one was more elliptical. This asymmetry, however, differed between the two groups, and the difference was primarily based on the degree of ellipticity of the nostrils. Maximum dimension, perimeter, lateral offset, I11, and I22 were more asymmetric in the cleft group. In the control group, the right nostril was more elliptical and had a greater perimeter, and the left-side nostril had a greater bulkiness (enfolding). The method developed was validated for assessment of nasal morphology in cleft and noncleft samples. Nostril morphology was asymmetric in both groups but more asymmetric in the cleft group than the control group. The dominant influence of the cleft resulted in more elliptical noncleft nostrils and greater nostril shape asymmetry in the cleft group. The validated video-imaging method can now be used to assess the efficacy of treatment on nasal morphology.

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)”

PubMed Central

2012-01-01

Background The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. Methods This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom / Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Results Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. Conclusion The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration. PMID:22984850

Validation of orthopedic postoperative pain assessment methods for dogs: a prospective, blinded, randomized, placebo-controlled study.

PubMed

Rialland, Pascale; Authier, Simon; Guillot, Martin; Del Castillo, Jérôme R E; Veilleux-Lemieux, Daphnée; Frank, Diane; Gauvin, Dominique; Troncy, Eric

2012-01-01

In the context of translational research, there is growing interest in studying surgical orthopedic pain management approaches that are common to humans and dogs. The validity of postoperative pain assessment methods is uncertain with regards to responsiveness and the potential interference of analgesia. The hypothesis was that video analysis (as a reference), electrodermal activity, and two subjective pain scales (VAS and 4A-VET) would detect different levels of pain intensity in dogs after a standardized trochleoplasty procedure. In this prospective, blinded, randomized study, postoperative pain was assessed in 25 healthy dogs during a 48-hour time frame (T). Pain was managed with placebo (Group 1, n = 10), preemptive and multimodal analgesia (Group 2, n = 5), or preemptive analgesia consisting in oral tramadol (Group 3, n = 10). Changes over time among groups were analyzed using generalized estimating equations. Multivariate regression tested the significance of relationships between pain scales and video analysis. Video analysis identified that one orthopedic behavior, namely 'Walking with full weight bearing' of the operated leg, decreased more in Group 1 at T24 (indicative of pain), whereas three behaviors indicative of sedation decreased in Group 2 at T24 (all p<0.004). Electrodermal activity was higher in Group 1 than in Groups 2 and 3 until T1 (p<0.0003). The VAS was not responsive. 4A-VET showed divergent results as its orthopedic component (4A-VETleg) detected lower pain in Group 2 until T12 (p<0.0009), but its interactive component (4A-VETbeh) was increased in Group 2 from T12 to T48 (p<0.001). Concurrent validity established that 4A-VETleg scores the painful orthopedic condition accurately and that pain assessment through 4A-VETbeh and VAS was severely biased by the sedative side-effect of the analgesics. Finally, the video analysis offered a concise template for assessment in dogs with acute orthopedic pain. However, subjective pain quantification methods and electrodermal activity need further investigation.

Development, validation and matrix effect of a QuEChERS method for the analysis of organochlorine pesticides in fish tissue.

PubMed

Stremel, Tatiana R De O; Domingues, Cinthia E; Zittel, Rosimara; Silva, Cleber P; Weinert, Patricia L; Monteiro, Franciele C; Campos, Sandro X

2018-04-03

This study aims to develop and validate a method to determine OCPs in fish tissues, minimizing the consumption of sample and reagents, by using a modified QuEChERS along with ultrasound, d-SPE and gas chromatography with an electron capture detector (GC-ECD), refraining the pooling. Different factorial designs were employed to optimize the sample preparation phase. The validation method presented a recovery of around 77.3% and 110.8%, with RSD lower than 13% and the detection limits were between 0.24 and 2.88 μgkg -1 , revealing good sensitiveness and accuracy. The method was satisfactorily applied to the analysis of tissues from different species of fish and OCPs residues were detected. The proposed method was shown effective to determine OCPs low concentrations in fish tissues, using small sample mass (0.5 g), making the sample analyses viable without the need for grouping (pool).

Proposal of a method for the evaluation of inaccuracy of home sphygmomanometers.

PubMed

Akpolat, Tekin

2009-10-01

There is no formal protocol for evaluating the individual accuracy of home sphygmomanometers. The aims of this study were to propose a method for achieving accuracy in automated home sphygmomanometers and to test the applicability of the defined method. The purposes of this method were to avoid major inaccuracies and to estimate the optimal circumstance for individual accuracy. The method has three stages and sequential measurement of blood pressure is used. The tested devices were categorized into four groups: accurate, acceptable, inaccurate and very inaccurate (major inaccuracy). The defined method takes approximately 10 min (excluding relaxation time) and was tested on three different occasions. The application of the method has shown that inaccuracy is a common problem among non-tested devices, that validated devices are superior to those that are non-validated or whose validation status is unknown, that major inaccuracy is common, especially in non-tested devices and that validation does not guarantee individual accuracy. A protocol addressing the accuracy of a particular sphygmomanometer in an individual patient is required, and a practical method has been suggested to achieve this. This method can be modified, but the main idea and approach should be preserved unless a better method is proposed. The purchase of validated devices and evaluation of accuracy for the purchased device in an individual patient will improve the monitoring of self-measurement of blood pressure at home. This study addresses device inaccuracy, but errors related to the patient, observer or blood pressure measurement technique should not be underestimated, and strict adherence to the manufacturer's instructions is essential.

Mediating the Cognitive Walkthrough with Patient Groups to achieve Personalized Health in Chronic Disease Self-Management System Evaluation.

PubMed

Georgsson, Mattias; Kushniruk, Andre

2016-01-01

The cognitive walkthrough (CW) is a task-based, expert inspection usability evaluation method involving benefits such as cost effectiveness and efficiency. A drawback of the method is that it doesn't involve the user perspective from real users but instead is based on experts' predictions about the usability of the system and how users interact. In this paper, we propose a way of involving the user in an expert evaluation method by modifying the CW with patient groups as mediators. This along with other modifications include a dual domain session facilitator, specific patient groups and three different phases: 1) a preparation phase where suitable tasks are developed by a panel of experts and patients, validated through the content validity index 2) a patient user evaluation phase including an individual and collaborative process part 3) an analysis and coding phase where all data is digitalized and synthesized making use of Qualitative Data Analysis Software (QDAS) to determine usability deficiencies. We predict that this way of evaluating will utilize the benefits of the expert methods, also providing a way of including the patient user of these self-management systems. Results from this prospective study should provide evidence of the usefulness of this method modification.

Processing and validation of JEFF-3.1.1 and ENDF/B-VII.0 group-wise cross section libraries for shielding calculations

NASA Astrophysics Data System (ADS)

Pescarini, M.; Sinitsa, V.; Orsi, R.; Frisoni, M.

2013-03-01

This paper presents a synthesis of the ENEA-Bologna Nuclear Data Group programme dedicated to generate and validate group-wise cross section libraries for shielding and radiation damage deterministic calculations in nuclear fission reactors, following the data processing methodology recommended in the ANSI/ANS-6.1.2-1999 (R2009) American Standard. The VITJEFF311.BOLIB and VITENDF70.BOLIB finegroup coupled n-γ (199 n + 42 γ - VITAMIN-B6 structure) multi-purpose cross section libraries, based on the Bondarenko method for neutron resonance self-shielding and respectively on JEFF-3.1.1 and ENDF/B-VII.0 evaluated nuclear data, were produced in AMPX format using the NJOY-99.259 and the ENEA-Bologna 2007 Revision of the SCAMPI nuclear data processing systems. Two derived broad-group coupled n-γ (47 n + 20 γ - BUGLE-96 structure) working cross section libraries in FIDO-ANISN format for LWR shielding and pressure vessel dosimetry calculations, named BUGJEFF311.BOLIB and BUGENDF70.BOLIB, were generated by the revised version of SCAMPI, through problem-dependent cross section collapsing and self-shielding from the cited fine-group libraries. The validation results on the criticality safety benchmark experiments for the fine-group libraries and the preliminary validation results for the broad-group working libraries on the PCA-Replica and VENUS-3 engineering neutron shielding benchmark experiments are reported in synthesis.

Development and initial validity of the in-hand manipulation assessment.

PubMed

Klymenko, Gabrielle; Liu, Karen P Y; Bissett, Michelle; Fong, Kenneth N K; Welage, Nandana; Wong, Rebecca S M

2018-04-01

A review of the literature related to in-hand manipulation (IHM) revealed that there is no assessment which specifically measures this construct in the adult population. This study reports the face and content validity of an IHM assessment for adults with impaired hand function based on expert opinion. The definition of IHM skills, assessment tasks and scoring methods identified from literature was discussed in a focus group (n = 4) to establish face validity. An expert panel (n = 16) reviewed the content validity of the proposed assessment; evaluating the representativeness and relevance of encompassing the IHM skills in the proposed assessment tasks, the clarity and importance to daily life of the task and the clarity and applicability to clinical environment of the scoring method. The content validity was calculated using the content validity index for both the individual task and all tasks together (I-CVI and S-CVI). Feedback was incorporated to create the assessment. The focus group members agreed to include 10 assessment tasks that covered all IHM skills. In the expert panel review, all tasks received an I-CVI above 0.78 and S-CVI above 0.80 in representativeness and relevance ratings, representing good content validity. With the comments from the expert panel, tasks were modified to improve the clarity and importance to daily life. A four-point Likert scale was identified for assessing both the completion of the assessment tasks and the quality of IHM skills within the task performance. Face and content validity were established in this new IHM assessment. Further studies to examine psychometric properties and use within clinical practice are recommended. © 2018 Occupational Therapy Australia.

Correspondence of Parent Report and Laboratory Measures of Inattention and Hyperactivity in Children with Heavy Prenatal Alcohol Exposure

PubMed Central

Glass, Leila; Graham, Diana M.; Deweese, Benjamin N.; Jones, Kenneth Lyons; Riley, Edward P.; Mattson, Sarah N.

2014-01-01

Clinical research and practice support a multi-method approach to validating behavioral problems in children. We examined whether parent-reported symptoms of hyperactivity and inattention (using the Disruptive Behavior Disorder Rating Scale) were substantiated by objective laboratory measures [hyperactivity measured by wrist-worn actigraphy (ACT) and inattention assessed using a 20-minute continuous performance task (CPT)] in three age- and demographically-matched groups of school-age children: children with prenatal alcohol exposure (AE), non-exposed children with idiopathic ADHD (ADHD), and controls (CON). Results indicated that the clinical groups (AE, ADHD) had significantly higher parent-reported levels for both domains compared to the CON group, and did not differ from each other. On the laboratory measures, the clinical groups were more inattentive than controls on the CPT, but did not differ from each other. In contrast, the ADHD group had higher objective activity on the ACT than AE and CON, which did not differ from each other. Thus, laboratory measures differentially validated parent reports in a group-dependent manner. Actigraphy substantiated parent-reported hyperactivity for children in the ADHD group but not for children in the AE group, while the CPT validated parent-reported inattention for both clinical groups. Although the majority of children in the AE group met criteria for ADHD, objective activity levels were not different from controls, indicating that hyperactivity may be a less prominent feature in the AE group. Thus, while there is considerable overlap between the effects of prenatal alcohol exposure and ADHD, differences in behavioral profiles may be clinically useful in differential diagnosis. Further, these data indicate that objective measures should be used to validate parent reports. PMID:24512965

Computer-assisted teaching of skin flap surgery: validation of a mobile platform software for medical students.

PubMed

de Sena, David P; Fabricio, Daniela D; Lopes, Maria Helena I; da Silva, Vinicius D

2013-01-01

The purpose of this study was to develop and validate a multimedia software application for mobile platforms to assist in the teaching and learning process of design and construction of a skin flap. Traditional training in surgery is based on learning by doing. Initially, the use of cadavers and animal models appeared to be a valid alternative for training. However, many conflicts with these training models prompted progression to synthetic and virtual reality models. Fifty volunteer fifth- and sixth-year medical students completed a pretest and were randomly allocated into two groups of 25 students each. The control group was exposed for 5 minutes to a standard text-based print article, while the test group used multimedia software describing how to fashion a rhomboid flap. Each group then performed a cutaneous flap on a training bench model while being evaluated by three blinded BSPS (Brazilian Society of Plastic Surgery) board-certified surgeons using the OSATS (Objective Structured Assessment of Technical Skill) protocol and answered a post-test. The text-based group was then tested again using the software. The computer-assisted learning (CAL) group had superior performance as confirmed by checklist scores (p<0.002), overall global assessment (p = 0.017) and post-test results (p<0.001). All participants ranked the multimedia method as the best study tool. CAL learners exhibited better subjective and objective performance when fashioning rhomboid flaps as compared to those taught with standard print material. These findings indicate that students preferred to learn using the multimedia method.

76 FR 55329 - Receipt of Several Pesticide Petitions Filed for Residues of Pesticide Chemicals in or on Various...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-07

... (HPLC) method was validated for determination of dinotefuran, DN and UF in or on tomatoes and peppers... quantified after HPLC separation by tandem mass spectrometry (MS/MS) detection. Contact: Sidney Jackson, (703..., group 9 at 0.03 ppm. Adequate analytical methods (HPLC-fluorescence methods) are available for...

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda

PubMed Central

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-01-01

Background The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. Methods A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. Results The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. Conclusion This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda. PMID:19055716

A novel method to remotely measure food intake of free-living people in real-time

PubMed Central

Martin, Corby K.; Han, Hongmei; Coulon, Sandra M.; Allen, H. Raymond; Champagne, Catherine M.; Anton, Stephen D.

2008-01-01

The aim of this study was to report the first reliability and validity tests of the Remote Food Photography Method (RFPM), which consists of camera-enabled cell phones with data transfer capability. Participants take and transmit photographs of food selection and plate waste to researchers/clinicians for analysis. Following two pilot studies, adult participants (N=52, 20≤BMI≤35) were randomly assigned to the dine-in or take-out group. Energy intake (EI) was measured for three days. The dine-in group ate lunch and dinner in the laboratory. The take-out group ate lunch in the laboratory and dinner in free-living conditions (participants received a cooler with pre-weighed food that they returned the following morning). Energy intake was measured with the RFPM and by directly weighing foods. The RFPM was tested in laboratory and free-living conditions. Reliability was tested over three days and validity was tested by comparing directly weighed EI to EI estimated with the RFPM using Bland-Altman analysis. The RFPM produced reliable EI estimates over three days in laboratory (r=.62, p<.0001) and free-living (r=.68, p<.0001) conditions. Weighed EI correlated highly with EI estimated with the RFPM in laboratory and free-living conditions (r’s>.93, p<.0001). In two laboratory-based validity tests, the RFPM underestimated EI by -4.7% (p=.046) and -5.5% (p=.076). In free-living conditions, the RFPM underestimated EI by -6.6% (p=.017). Bias did not differ by body weight or age. The RFPM is a promising new method for accurately measuring the EI of free-living people. Error associated with the method is small compared to self-report methods. PMID:18616837

Standardization and validation of a new atomic absorption spectroscopy technique for determination and quantitation of aluminium adjuvant in immunobiologicals.

PubMed

Mishra, Arti; Bhalla, Sumir Rai; Rawat, Sameera; Bansal, Vivek; Sehgal, Rakesh; Kumar, Sunil

2007-10-01

In the present study, Aluminium quantification in immunobiologicals has been described using atomic absorption spectroscopy (AAS) technique. The assay was found to be linear in 25-125 microg/ml Aluminium range. The procedure was found to be accurate for different vaccines with recoveries of external additions ranging between 93.26 and 103.41%. The mean Limit of Variation (L.V.) for both intra- and inter-assay precision was calculated to be 1.62 and 2.22%, respectively. Further the procedure was found to be robust in relation to digestion temperature, alteration in acid (HNO(3) and H(2)SO(4)) ratio used for sample digestion and storage of digested vaccine samples up to a period of 15 days. After validation, AAS method was compared for its equivalency with routinely used complexometric titration method. On simultaneously applying on seven different groups of both bacterial and viral vaccines, viz., DPT, DT, TT, Hepatitis-A and B, Antirabies vaccine (cell culture) and tetravalent DPT-Hib, a high degree of positive correlation (+0.85-0.998) among AAS and titration methods was observed. Further AAS method was found to have an edge over complexometric titration method that a group of vaccines, viz., ARV (cell culture, adsorbed) and Hepatitis-A, in which Aluminium estimation is not feasible by pharmacopoeial approved complexometric titration method (possibly due to some interference in the sample matrix), this newly described and validated AAS assay procedure delivered accurate and reproducible results.

[Selection of risk and diagnosis in diabetic polyneuropathy. Validation of method of new systems].

PubMed

Jurado, Jerónimo; Caula, Jacinto; Pou i Torelló, Josep Maria

2006-06-30

In a previous study we developed a specific algorithm, the polyneuropathy selection method (PSM) with 4 parameters (age, HDL-C, HbA1c, and retinopathy), to select patients at risk of diabetic polyneuropathy (DPN). We also developed a simplified method for DPN diagnosis: outpatient polyneuropathy diagnosis (OPD), with 4 variables (symptoms and 3 objective tests). To confirm the validity of conventional tests for DPN diagnosis; to validate the discriminatory power of the PSM and the diagnostic value of OPD by evaluating their relationship to electrodiagnosis studies and objective clinical neurological assessment; and to evaluate the correlation of DPN and pro-inflammatory status. Cross-sectional, crossed association for PSM validation. Paired samples for OPD validation. Primary care in 3 counties. Random sample of 75 subjects from the type-2 diabetes census for PSM evaluation. Thirty DPN patients and 30 non-DPN patients (from 2 DM2 sub-groups in our earlier study) for OPD evaluation. The gold standard for DPN diagnosis will be studied by means of a clinical neurological study (symptoms, physical examination, and sensitivity tests) and electrodiagnosis studies (sensitivity and motor EMG). Risks of neuropathy, macroangiopathy and pro-inflammatory status (PCR, TNF soluble fraction and total TGF-beta1) will be studied in every subject. Electrodiagnosis studies should confirm the validity of conventional tests for DPN diagnosis. PSM and OPD will be valid methods for selecting patients at risk and diagnosing DPN. There will be a significant relationship between DPN and pro-inflammatory tests.

Research Diagnostic Criteria for Temporomandibular Disorders: Validity of Axis I Diagnoses

PubMed Central

Truelove, Edmond; Pan, Wei; Look, John O.; Mancl, Lloyd A.; Ohrbach, Richard K.; Velly, Ana; Huggins, Kimberly; Lenton, Patricia; Schiffman, Eric L.

2011-01-01

AIMS To estimate the criterion validity of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Axis I TMD diagnoses. METHODS A combined total of 614 TMD community and clinic cases and 91 controls were examined at 3 study sites. RDC/TMD Axis I diagnoses were algorithmically derived from an examination performed by calibrated dental hygienists. Reference standards (Gold Standards) were established by means of consensus diagnoses rendered by 2 TMD experts using all available clinical data, including imaging studies. Validity of the RDC/TMD Axis I TMD diagnoses was estimated relative to reference-standard diagnoses (gold standard diagnoses). Target sensitivity and specificity were set a priori at ≥ 0.70 and ≥ 0.95, respectively. RESULTS Target sensitivity and specificity were not observed for any of the 8 RDC/TMD diagnoses. The highest validity was achieved for Group Ia myofascial pain (sensitivity 0.65, specificity 0.92) and Group Ib myofascial pain with limited opening (sensitivity 0.79, specificity 0.92). Target sensitivity and specificity were observed only when both Group I diagnoses were combined (0.87 and 0.98, respectively). For Group II (disc displacements) and Group III (arthralgia, arthritis, arthrosis) diagnoses, all estimates for sensitivity were below target (0.03 to 0.53), and specificity ranged from below to on target (0.86 to 0.99). CONCLUSION The RDC/TMD Axis I TMD diagnoses did not reach the targets set at sensitivity of ≥ 0.70 and specificity of ≥ 0.95. Target validity was obtained only for myofascial pain without differentiation between normal and limited opening. Revision of the current Axis I TMD diagnostic algorithms is warranted to improve their validity. PMID:20213030

Comparing Two Processing Pipelines to Measure Subcortical and Cortical Volumes in Patients with and without Mild Traumatic Brain Injury.

PubMed

Reid, Matthew W; Hannemann, Nathan P; York, Gerald E; Ritter, John L; Kini, Jonathan A; Lewis, Jeffrey D; Sherman, Paul M; Velez, Carmen S; Drennon, Ann Marie; Bolzenius, Jacob D; Tate, David F

2017-07-01

To compare volumetric results from NeuroQuant® and FreeSurfer in a service member setting. Since the advent of medical imaging, quantification of brain anatomy has been a major research and clinical effort. Rapid advancement of methods to automate quantification and to deploy this information into clinical practice has surfaced in recent years. NeuroQuant® is one such tool that has recently been used in clinical settings. Accurate volumetric data are useful in many clinical indications; therefore, it is important to assess the intermethod reliability and concurrent validity of similar volume quantifying tools. Volumetric data from 148 U.S. service members across three different experimental groups participating in a study of mild traumatic brain injury (mTBI) were examined. Groups included mTBI (n = 71), posttraumatic stress disorder (n = 22), or a noncranial orthopedic injury (n = 55). Correlation coefficients and nonparametric group mean comparisons were used to assess reliability and concurrent validity, respectively. Comparison of these methods across our entire sample demonstrates generally fair to excellent reliability as evidenced by large intraclass correlation coefficients (ICC = .4 to .99), but little concurrent validity as evidenced by significantly different Mann-Whitney U comparisons for 26 of 30 brain structures measured. While reliability between the two segmenting tools is fair to excellent, volumetric outcomes are statistically different between the two methods. As suggested by both developers, structure segmentation should be visually verified prior to clinical use and rigor should be used when interpreting results generated by either method. Copyright © 2017 by the American Society of Neuroimaging.

Consensus methods: review of original methods and their main alternatives used in public health

PubMed Central

Bourrée, Fanny; Michel, Philippe; Salmi, Louis Rachid

2008-01-01

Summary Background Consensus-based studies are increasingly used as decision-making methods, for they have lower production cost than other methods (observation, experimentation, modelling) and provide results more rapidly. The objective of this paper is to describe the principles and methods of the four main methods, Delphi, nominal group, consensus development conference and RAND/UCLA, their use as it appears in peer-reviewed publications and validation studies published in the healthcare literature. Methods A bibliographic search was performed in Pubmed/MEDLINE, Banque de Données Santé Publique (BDSP), The Cochrane Library, Pascal and Francis. Keywords, headings and qualifiers corresponding to a list of terms and expressions related to the consensus methods were searched in the thesauri, and used in the literature search. A search with the same terms and expressions was performed on Internet using the website Google Scholar. Results All methods, precisely described in the literature, are based on common basic principles such as definition of subject, selection of experts, and direct or remote interaction processes. They sometimes use quantitative assessment for ranking items. Numerous variants of these methods have been described. Few validation studies have been implemented. Not implementing these basic principles and failing to describe the methods used to reach the consensus were both frequent reasons contributing to raise suspicion regarding the validity of consensus methods. Conclusion When it is applied to a new domain with important consequences in terms of decision making, a consensus method should be first validated. PMID:19013039

A neural network - based algorithm for predicting stone -free status after ESWL therapy

PubMed Central

Seckiner, Ilker; Seckiner, Serap; Sen, Haluk; Bayrak, Omer; Dogan, Kazım; Erturhan, Sakip

2017-01-01

ABSTRACT Objective: The prototype artificial neural network (ANN) model was developed using data from patients with renal stone, in order to predict stone-free status and to help in planning treatment with Extracorporeal Shock Wave Lithotripsy (ESWL) for kidney stones. Materials and Methods: Data were collected from the 203 patients including gender, single or multiple nature of the stone, location of the stone, infundibulopelvic angle primary or secondary nature of the stone, status of hydronephrosis, stone size after ESWL, age, size, skin to stone distance, stone density and creatinine, for eleven variables. Regression analysis and the ANN method were applied to predict treatment success using the same series of data. Results: Subsequently, patients were divided into three groups by neural network software, in order to implement the ANN: training group (n=139), validation group (n=32), and the test group (n=32). ANN analysis demonstrated that the prediction accuracy of the stone-free rate was 99.25% in the training group, 85.48% in the validation group, and 88.70% in the test group. Conclusions: Successful results were obtained to predict the stone-free rate, with the help of the ANN model designed by using a series of data collected from real patients in whom ESWL was implemented to help in planning treatment for kidney stones. PMID:28727384

Students' Ideas on Cooperative Learning Method

ERIC Educational Resources Information Center

Yoruk, Abdulkadir

2016-01-01

Aim of this study is to investigate students' ideas on cooperative learning method. For that purpose students who are studying at elementary science education program are distributed into two groups through an experimental design. Factors threaten the internal validity are either eliminated or reduced to minimum value. Data analysis is done…

Verification and Validation of Neural Networks for Aerospace Systems

NASA Technical Reports Server (NTRS)

Mackall, Dale; Nelson, Stacy; Schumman, Johann; Clancy, Daniel (Technical Monitor)

2002-01-01

The Dryden Flight Research Center V&V working group and NASA Ames Research Center Automated Software Engineering (ASE) group collaborated to prepare this report. The purpose is to describe V&V processes and methods for certification of neural networks for aerospace applications, particularly adaptive flight control systems like Intelligent Flight Control Systems (IFCS) that use neural networks. This report is divided into the following two sections: 1) Overview of Adaptive Systems; and 2) V&V Processes/Methods.

Verification and Validation of Neural Networks for Aerospace Systems

NASA Technical Reports Server (NTRS)

Mackall, Dale; Nelson, Stacy; Schumann, Johann

2002-01-01

The Dryden Flight Research Center V&V working group and NASA Ames Research Center Automated Software Engineering (ASE) group collaborated to prepare this report. The purpose is to describe V&V processes and methods for certification of neural networks for aerospace applications, particularly adaptive flight control systems like Intelligent Flight Control Systems (IFCS) that use neural networks. This report is divided into the following two sections: Overview of Adaptive Systems and V&V Processes/Methods.

Application of a Multivariant, Caucasian-Specific, Genotyped Donor Panel for Performance Validation of MDmulticard®, ID-System®, and Scangel® RhD/ABO Serotyping

PubMed Central

Gassner, Christoph; Rainer, Esther; Pircher, Elfriede; Markut, Lydia; Körmöczi, Günther F.; Jungbauer, Christof; Wessin, Dietmar; Klinghofer, Roswitha; Schennach, Harald; Schwind, Peter; Schönitzer, Diether

2009-01-01

Summary Background Validations of routinely used serological typing methods require intense performance evaluations typically including large numbers of samples before routine application. However, such evaluations could be improved considering information about the frequency of standard blood groups and their variants. Methods Using RHD and ABO population genetic data, a Caucasian-specific donor panel was compiled for a performance comparison of the three RhD and ABO serological typing methods MDmulticard (Medion Diagnostics), ID-System (DiaMed) and ScanGel (Bio-Rad). The final test panel included standard and variant RHD and ABO genotypes, e.g. RhD categories, partial and weak RhDs, RhD DELs, and ABO samples, mainly to interpret weak serological reactivity for blood group A specificity. All samples were from individuals recorded in our local DNA blood group typing database. Results For ‘standard’ blood groups, results of performance were clearly interpretable for all three serological methods compared. However, when focusing on specific variant phenotypes, pronounced differences in reaction strengths and specificities were observed between them. Conclusions A genetically and ethnically predefined donor test panel consisting of 93 individual samples only, delivered highly significant results for serological performance comparisons. Such small panels offer impressive representative powers, higher as such based on statistical chances and large numbers only. PMID:21113264

Benefits of virtual reality based cognitive rehabilitation through simulated activities of daily living: a randomized controlled trial with stroke patients.

PubMed

Faria, Ana Lúcia; Andrade, Andreia; Soares, Luísa; I Badia, Sergi Bermúdez

2016-11-02

Stroke is one of the most common causes of acquired disability, leaving numerous adults with cognitive and motor impairments, and affecting patients' capability to live independently. There is substancial evidence on post-stroke cognitive rehabilitation benefits, but its implementation is generally limited by the use of paper-and-pencil methods, insufficient personalization, and suboptimal intensity. Virtual reality tools have shown potential for improving cognitive rehabilitation by supporting carefully personalized, ecologically valid tasks through accessible technologies. Notwithstanding important progress in VR-based cognitive rehabilitation systems, specially with Activities of Daily Living (ADL's) simulations, there is still a need of more clinical trials for its validation. In this work we present a one-month randomized controlled trial with 18 stroke in and outpatients from two rehabilitation units: 9 performing a VR-based intervention and 9 performing conventional rehabilitation. The VR-based intervention involved a virtual simulation of a city - Reh@City - where memory, attention, visuo-spatial abilities and executive functions tasks are integrated in the performance of several daily routines. The intervention had levels of difficulty progression through a method of fading cues. There was a pre and post-intervention assessment in both groups with the Addenbrooke Cognitive Examination (primary outcome) and the Trail Making Test A and B, Picture Arrangement from WAIS III and Stroke Impact Scale 3.0 (secondary outcomes). A within groups analysis revealed significant improvements in global cognitive functioning, attention, memory, visuo-spatial abilities, executive functions, emotion and overall recovery in the VR group. The control group only improved in self-reported memory and social participation. A between groups analysis, showed significantly greater improvements in global cognitive functioning, attention and executive functions when comparing VR to conventional therapy. Our results suggest that cognitive rehabilitation through the Reh@City, an ecologically valid VR system for the training of ADL's, has more impact than conventional methods. This trial was not registered because it is a small sample study that evaluates the clinical validity of a prototype virtual reality system.

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for detection of genotoxic carcinogens: II. Summary of definitive validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Beevers, Carol; De Boeck, Marlies; Burlinson, Brian; Hobbs, Cheryl A; Kitamoto, Sachiko; Kraynak, Andrew R; McNamee, James; Nakagawa, Yuzuki; Pant, Kamala; Plappert-Helbig, Ulla; Priestley, Catherine; Takasawa, Hironao; Wada, Kunio; Wirnitzer, Uta; Asano, Norihide; Escobar, Patricia A; Lovell, David; Morita, Takeshi; Nakajima, Madoka; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this exercise was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The study protocol was optimized in the pre-validation studies, and then the definitive (4th phase) validation study was conducted in two steps. In the 1st step, assay reproducibility was confirmed among laboratories using four coded reference chemicals and the positive control ethyl methanesulfonate. In the 2nd step, the predictive capability was investigated using 40 coded chemicals with known genotoxic and carcinogenic activity (i.e., genotoxic carcinogens, genotoxic non-carcinogens, non-genotoxic carcinogens, and non-genotoxic non-carcinogens). Based on the results obtained, the in vivo comet assay is concluded to be highly capable of identifying genotoxic chemicals and therefore can serve as a reliable predictor of rodent carcinogenicity. Copyright © 2015 Elsevier B.V. All rights reserved.

Validation d'un nouveau calcul de reference en evolution pour les reacteurs thermiques

NASA Astrophysics Data System (ADS)

Canbakan, Axel

Resonance self-shielding calculations are an essential component of a deterministic lattice code calculation. Even if their aim is to correct the cross sections deviation, they introduce a non negligible error in evaluated parameters such as the flux. Until now, French studies for light water reactors are based on effective reaction rates obtained using an equivalence in dilution technique. With the increase of computing capacities, this method starts to show its limits in precision and can be replaced by a subgroup method. Originally used for fast neutron reactor calculations, the subgroup method has many advantages such as using an exact slowing down equation. The aim of this thesis is to suggest a validation as precise as possible without burnup, and then with an isotopic depletion study for the subgroup method. In the end, users interested in implementing a subgroup method in their scheme for Pressurized Water Reactors can rely on this thesis to justify their modelization choices. Moreover, other parameters are validated to suggest a new reference scheme for fast execution and precise results. These new techniques are implemented in the French lattice scheme SHEM-MOC, composed of a Method Of Characteristics flux calculation and a SHEM-like 281-energy group mesh. First, the libraries processed by the CEA are compared. Then, this thesis suggests the most suitable energetic discretization for a subgroup method. Finally, other techniques such as the representation of the anisotropy of the scattering sources and the spatial representation of the source in the MOC calculation are studied. A DRAGON5 scheme is also validated as it shows interesting elements: the DRAGON5 subgroup method is run with a 295-eenergy group mesh (compared to 361 groups for APOLLO2). There are two reasons to use this code. The first involves offering a new reference lattice scheme for Pressurized Water Reactors to DRAGON5 users. The second is to study parameters that are not available in APOLLO2 such as self-shielding in a temperature gradient and using a flux calculation based on MOC in the self-shielding part of the simulation. This thesis concludes that: (1) The subgroup method is at least more precise than a technique based on effective reaction rates, only if we use a 361-energy group mesh; (2) MOC with a linear source in a geometrical region gives better results than a MOC with a constant model. A moderator discretization is compulsory; (3) A P3 choc law is satisfactory, ensuring a coherence with 2D full core calculations; (4) SHEM295 is viable with a Subgroup Projection Method for DRAGON5.

Evaluation of ultrasonic cavitation of metallic and non-metallic surfaces

NASA Technical Reports Server (NTRS)

Mehta, Narinder K.

1992-01-01

1,1,2 trichloro-1,2,2 trifluoro ethane (CFC-113) commercially known as Freon-113 is the primary test solvent used for validating the cleaned hardware at the Kennedy Space Center (KSC). Due to the ozone depletion problem, the current United States policy calls for the phase out of Freons by 1995. NASAs chlorofluorocarbon (CFC) replacement group at KSC has opted to use water as a replacement fluid for the validation process since water is non-toxic, inexpensive, and is environmentally friendly. The replacement validation method calls for the ultrasonification of the small parts with water at 52 C for a cycle or two of 10 min duration wash using commercial ultrasonic baths. In this project, experimental data was obtained to assess the applicability of the proposed validation method for any damage of the metallic and non-metallic surfaces resulting from ultrasonic cavitation.

Reliability and validity of the test of incremental respiratory endurance measures of inspiratory muscle performance in COPD

PubMed Central

Formiga, Magno F; Roach, Kathryn E; Vital, Isabel; Urdaneta, Gisel; Balestrini, Kira; Calderon-Candelario, Rafael A

2018-01-01

Purpose The Test of Incremental Respiratory Endurance (TIRE) provides a comprehensive assessment of inspiratory muscle performance by measuring maximal inspiratory pressure (MIP) over time. The integration of MIP over inspiratory duration (ID) provides the sustained maximal inspiratory pressure (SMIP). Evidence on the reliability and validity of these measurements in COPD is not currently available. Therefore, we assessed the reliability, responsiveness and construct validity of the TIRE measures of inspiratory muscle performance in subjects with COPD. Patients and methods Test–retest reliability, known-groups and convergent validity assessments were implemented simultaneously in 81 male subjects with mild to very severe COPD. TIRE measures were obtained using the portable PrO2 device, following standard guidelines. Results All TIRE measures were found to be highly reliable, with SMIP demonstrating the strongest test–retest reliability with a nearly perfect intraclass correlation coefficient (ICC) of 0.99, while MIP and ID clustered closely together behind SMIP with ICC values of about 0.97. Our findings also demonstrated known-groups validity of all TIRE measures, with SMIP and ID yielding larger effect sizes when compared to MIP in distinguishing between subjects of different COPD status. Finally, our analyses confirmed convergent validity for both SMIP and ID, but not MIP. Conclusion The TIRE measures of MIP, SMIP and ID have excellent test–retest reliability and demonstrated known-groups validity in subjects with COPD. SMIP and ID also demonstrated evidence of moderate convergent validity and appear to be more stable measures in this patient population than the traditional MIP. PMID:29805255

Bayesian Group Bridge for Bi-level Variable Selection.

PubMed

Mallick, Himel; Yi, Nengjun

2017-06-01

A Bayesian bi-level variable selection method (BAGB: Bayesian Analysis of Group Bridge) is developed for regularized regression and classification. This new development is motivated by grouped data, where generic variables can be divided into multiple groups, with variables in the same group being mechanistically related or statistically correlated. As an alternative to frequentist group variable selection methods, BAGB incorporates structural information among predictors through a group-wise shrinkage prior. Posterior computation proceeds via an efficient MCMC algorithm. In addition to the usual ease-of-interpretation of hierarchical linear models, the Bayesian formulation produces valid standard errors, a feature that is notably absent in the frequentist framework. Empirical evidence of the attractiveness of the method is illustrated by extensive Monte Carlo simulations and real data analysis. Finally, several extensions of this new approach are presented, providing a unified framework for bi-level variable selection in general models with flexible penalties.

Developmental validation of a Nextera XT mitogenome Illumina MiSeq sequencing method for high-quality samples.

PubMed

Peck, Michelle A; Sturk-Andreaggi, Kimberly; Thomas, Jacqueline T; Oliver, Robert S; Barritt-Ross, Suzanne; Marshall, Charla

2018-05-01

Generating mitochondrial genome (mitogenome) data from reference samples in a rapid and efficient manner is critical to harnessing the greater power of discrimination of the entire mitochondrial DNA (mtDNA) marker. The method of long-range target enrichment, Nextera XT library preparation, and Illumina sequencing on the MiSeq is a well-established technique for generating mitogenome data from high-quality samples. To this end, a validation was conducted for this mitogenome method processing up to 24 samples simultaneously along with analysis in the CLC Genomics Workbench and utilizing the AQME (AFDIL-QIAGEN mtDNA Expert) tool to generate forensic profiles. This validation followed the Federal Bureau of Investigation's Quality Assurance Standards (QAS) for forensic DNA testing laboratories and the Scientific Working Group on DNA Analysis Methods (SWGDAM) validation guidelines. The evaluation of control DNA, non-probative samples, blank controls, mixtures, and nonhuman samples demonstrated the validity of this method. Specifically, the sensitivity was established at ≥25 pg of nuclear DNA input for accurate mitogenome profile generation. Unreproducible low-level variants were observed in samples with low amplicon yields. Further, variant quality was shown to be a useful metric for identifying sequencing error and crosstalk. Success of this method was demonstrated with a variety of reference sample substrates and extract types. These studies further demonstrate the advantages of using NGS techniques by highlighting the quantitative nature of heteroplasmy detection. The results presented herein from more than 175 samples processed in ten sequencing runs, show this mitogenome sequencing method and analysis strategy to be valid for the generation of reference data. Copyright © 2018 Elsevier B.V. All rights reserved.

New method for evaluation of cervical vertebral maturation based on angular measurements.

PubMed

Alhadlaq, Adel M; Al-Shayea, Eman I

2013-04-01

To investigate the validity of a new approach to assess the cervical vertebral maturation based on angular measurements of the lower border concavity of cervical vertebral bodies. Hand-wrist and lateral cephalometric radiographs of 197 male subjects with age range of 10-15 years attending the orthodontic clinic at King Saud University, Riyadh, Kingdom of Saudi Arabia were utilized. The study was carried out between September 2009 and May 2011. The study sample was divided into 6 groups (group 1: 10 years to group 6: 15 years) based on the chronological age of the subject. The skeletal age of the subjects was determined using Greulich and Pyle's standard radiographic atlas, and skeletal maturation was assessed by Fishman's skeletal maturity indicators. The cervical vertebral maturation (CVM) of subjects was determined using angular measurements of the second, third, and fourth cervical vertebral bodies. The validity of the newly developed method was assessed by examining the correlation between CVM stages determined by the angular measurements and the skeletal maturation level as determined by the standard hand-wrist methods. A significant correlation (r=0.94) was found between the angular CVM stages and the skeletal age determined by Greulich and Pyle's atlas from hand-wrist radiographs. Also, a high correlation (r=0.94) was found between the angular CVM stages and the Fishman's hand-wrist skeletal maturity indicators. The new angular measurement approach to determine CVM is valid and has the potential to be applied in assessing skeletal maturity level in growing male children.

Relative validity of an FFQ for pre-school children in the mother-child 'Rhea' birth cohort in Crete, Greece.

PubMed

Leventakou, Vasiliki; Georgiou, Vaggelis; Chatzi, Leda; Sarri, Katerina

2015-02-01

To examine the relative validity of an FFQ based on parental report for pre-school children in the mother-child 'Rhea' birth cohort. The children's mothers completed an FFQ that referred to the children's dietary intake for the previous year by telephone interview. Mothers completed also three food records, two on weekdays and one on a weekend day. Spearman correlation coefficients were calculated for the energy-adjusted values. Weighted kappa statistics (κ(w)) and the Bland-Altman technique were used to test the degree of agreement between the two dietary methods. Heraklion, Crete, Greece, 2011-2012. A total of ninety-nine mothers (corresponding to fifty-one boys and forty-eight girls) participated in the validation study. The mean and median values of all food group and nutrient intakes did not differ significantly between the two dietary methods. Overall, fair agreement was observed between the FFQ and the food records for ranking participants based on their intake, with κ(w) ranging from 0·21 to 0·40 for most foods and nutrients. On average, 88 % of participants were classified into the same or adjacent tertiles for nutrient and food group intakes by both dietary methods. The degree of agreement was also confirmed by the visual examination of the Bland-Altman plots. The study indicates that the Rhea 4 years FFQ is a relatively accurate tool for assessing habitual food group and nutrient intakes among pre-school children in Crete, Greece.

The Successful Diagnosis and Typing of Systemic Amyloidosis Using A Microwave-Assisted Filter-Aided Fast Sample Preparation Method and LC/MS/MS Analysis

PubMed Central

Zou, Lili; Shen, Kaini; Zhong, Dingrong; Zhou, Daobin; Sun, Wei; Li, Jian

2015-01-01

Laser microdissection followed by mass spectrometry has been successfully used for amyloid typing. However, sample contamination can interfere with proteomic analysis, and overnight digestion limits the analytical throughput. Moreover, current quantitative analysis methods are based on the spectrum count, which ignores differences in protein length and may lead to misdiagnoses. Here, we developed a microwave-assisted filter-aided sample preparation (maFASP) method that can efficiently remove contaminants with a 10-kDa cutoff ultrafiltration unit and can accelerate the digestion process with the assistance of a microwave. Additionally, two parameters (P- and D-scores) based on the exponentially modified protein abundance index were developed to define the existence of amyloid deposits and those causative proteins with the greatest abundance. Using our protocol, twenty cases of systemic amyloidosis that were well-typed according to clinical diagnostic standards (training group) and another twenty-four cases without subtype diagnoses (validation group) were analyzed. Using this approach, sample preparation could be completed within four hours. We successfully subtyped 100% of the cases in the training group, and the diagnostic success rate in the validation group was 91.7%. This maFASP-aided proteomic protocol represents an efficient approach for amyloid diagnosis and subtyping, particularly for serum-contaminated samples. PMID:25984759

Evaluation of three different validation procedures regarding the accuracy of template-guided implant placement: an in vitro study.

PubMed

Vasak, Christoph; Strbac, Georg D; Huber, Christian D; Lettner, Stefan; Gahleitner, André; Zechner, Werner

2015-02-01

The study aims to evaluate the accuracy of the NobelGuide™ (Medicim/Nobel Biocare, Göteborg, Sweden) concept maximally reducing the influence of clinical and surgical parameters. Moreover, the study was to compare and validate two validation procedures versus a reference method. Overall, 60 implants were placed in 10 artificial edentulous mandibles according to the NobelGuide™ protocol. For merging the pre- and postoperative DICOM data sets, three different fusion methods (Triple Scan Technique, NobelGuide™ Validation software, and AMIRA® software [VSG - Visualization Sciences Group, Burlington, MA, USA] as reference) were applied. Discrepancies between the virtual and the actual implant positions were measured. The mean deviations measured with AMIRA® were 0.49 mm (implant shoulder), 0.69 mm (implant apex), and 1.98°mm (implant axis). The Triple Scan Technique as well as the NobelGuide™ Validation software revealed similar deviations compared with the reference method. A significant correlation between angular and apical deviations was seen (r = 0.53; p < .001). A greater implant diameter was associated with greater deviations (p = .03). The Triple Scan Technique as a system-independent validation procedure as well as the NobelGuide™ Validation software are in accordance with the AMIRA® software. The NobelGuide™ system showed similar or less spatial and angular deviations compared with others. © 2013 Wiley Periodicals, Inc.

The reliability and validity of Chinese version of SF36 v2 in aging patients with chronic heart failure.

PubMed

Dong, Aishu; Chen, Sisi; Zhu, Lianlian; Shi, Lingmin; Cai, Yueli; Zeng, Jingni; Guo, Wenjian

2017-08-01

Chronic heart failure (CHF), a major public health problem worldwide, seriously limits health-related quality of life (HRQOL). How to evaluate HRQOL in older patients with CHF remains a problem. To evaluate the reliability and validity of the Chinese version of the Medical Outcomes Study Short Form version 2 (SF-36v2) in CHF patients. From September 2012 to June 2014, we assessed QOL using the SF-36v2 in 171 aging participants with CHF in four cardiology departments. Convergent and discriminant validity, factorial validity, sensitivity among different NYHA classes and between different age groups, and reliability were determined using standard measurement methods. A total of 150 participants completed a structured questionnaire including general information and the Chinese SF-36v2; 132 questionnaires were considered valid, while 21 patients refused to take part. 25 of the 50 participants invited to complete the 2-week test-retest questionnaires returned completed questionnaires. The internal consistency reliability (Cronbach's α) of the total SF-36v2 was 0.92 (range 0.74-0.93). All hypothesized item-subscale correlations showed satisfactory convergent and discriminant validity. Sensitivity was measured in different NYHA classes and age groups. Comparison of different NYHA classes showed statistical significance, but there was no significant difference between age groups. We confirmed the SF-36v2 as a valid instrument for evaluating HRQOL Chinese CHF patients. Both reliability and validity were strongly satisfactory, but there was divergence in understanding subscales such as "social functioning" because of differing cultural background. The reliability, validity, and sensitivity of SF-36v2 in aging patients with CHF were acceptable.

Finding Risk Groups by Optimizing Artificial Neural Networks on the Area under the Survival Curve Using Genetic Algorithms.

PubMed

Kalderstam, Jonas; Edén, Patrik; Ohlsson, Mattias

2015-01-01

We investigate a new method to place patients into risk groups in censored survival data. Properties such as median survival time, and end survival rate, are implicitly improved by optimizing the area under the survival curve. Artificial neural networks (ANN) are trained to either maximize or minimize this area using a genetic algorithm, and combined into an ensemble to predict one of low, intermediate, or high risk groups. Estimated patient risk can influence treatment choices, and is important for study stratification. A common approach is to sort the patients according to a prognostic index and then group them along the quartile limits. The Cox proportional hazards model (Cox) is one example of this approach. Another method of doing risk grouping is recursive partitioning (Rpart), which constructs a decision tree where each branch point maximizes the statistical separation between the groups. ANN, Cox, and Rpart are compared on five publicly available data sets with varying properties. Cross-validation, as well as separate test sets, are used to validate the models. Results on the test sets show comparable performance, except for the smallest data set where Rpart's predicted risk groups turn out to be inverted, an example of crossing survival curves. Cross-validation shows that all three models exhibit crossing of some survival curves on this small data set but that the ANN model manages the best separation of groups in terms of median survival time before such crossings. The conclusion is that optimizing the area under the survival curve is a viable approach to identify risk groups. Training ANNs to optimize this area combines two key strengths from both prognostic indices and Rpart. First, a desired minimum group size can be specified, as for a prognostic index. Second, the ability to utilize non-linear effects among the covariates, which Rpart is also able to do.

Ranking of physiotherapeutic evaluation methods as outcome measures of stifle functionality in dogs.

PubMed

Hyytiäinen, Heli K; Mölsä, Sari H; Junnila, Jouni T; Laitinen-Vapaavuori, Outi M; Hielm-Björkman, Anna K

2013-04-08

Various physiotherapeutic evaluation methods are used to assess the functionality of dogs with stifle problems. Neither validity nor sensitivity of these methods has been investigated. This study aimed to determine the most valid and sensitive physiotherapeutic evaluation methods for assessing functional capacity in hind limbs of dogs with stifle problems and to serve as a basis for developing an indexed test for these dogs. A group of 43 dogs with unilateral surgically treated cranial cruciate ligament deficiency and osteoarthritic findings was used to test different physiotherapeutic evaluation methods. Twenty-one healthy dogs served as the control group and were used to determine normal variation in static weight bearing and range of motion.The protocol consisted of 14 different evaluation methods: visual evaluation of lameness, visual evaluation of diagonal movement, visual evaluation of functional active range of motion and difference in thrust of hind limbs via functional tests (sit-to-move and lie-to-move), movement in stairs, evaluation of hind limb muscle atrophy, manual evaluation of hind limb static weight bearing, quantitative measurement of static weight bearing of hind limbs with bathroom scales, and passive range of motion of hind limb stifle (flexion and extension) and tarsal (flexion and extension) joints using a universal goniometer. The results were compared with those from an orthopaedic examination, force plate analysis, radiographic evaluation, and a conclusive assessment. Congruity of the methods was assessed with a combination of three statistical approaches (Fisher's exact test and two differently calculated proportions of agreeing observations), and the components were ranked from best to worst. Sensitivities of all of the physiotherapeutic evaluation methods against each standard were calculated. Evaluation of asymmetry in a sitting and lying position, assessment of muscle atrophy, manual and measured static weight bearing, and measurement of stifle passive range of motion were the most valid and sensitive physiotherapeutic evaluation methods. Ranking of the various physiotherapeutic evaluation methods was accomplished. Several of these methods can be considered valid and sensitive when examining the functionality of dogs with stifle problems.

Ranking of physiotherapeutic evaluation methods as outcome measures of stifle functionality in dogs

PubMed Central

2013-01-01

Background Various physiotherapeutic evaluation methods are used to assess the functionality of dogs with stifle problems. Neither validity nor sensitivity of these methods has been investigated. This study aimed to determine the most valid and sensitive physiotherapeutic evaluation methods for assessing functional capacity in hind limbs of dogs with stifle problems and to serve as a basis for developing an indexed test for these dogs. A group of 43 dogs with unilateral surgically treated cranial cruciate ligament deficiency and osteoarthritic findings was used to test different physiotherapeutic evaluation methods. Twenty-one healthy dogs served as the control group and were used to determine normal variation in static weight bearing and range of motion. The protocol consisted of 14 different evaluation methods: visual evaluation of lameness, visual evaluation of diagonal movement, visual evaluation of functional active range of motion and difference in thrust of hind limbs via functional tests (sit-to-move and lie-to-move), movement in stairs, evaluation of hind limb muscle atrophy, manual evaluation of hind limb static weight bearing, quantitative measurement of static weight bearing of hind limbs with bathroom scales, and passive range of motion of hind limb stifle (flexion and extension) and tarsal (flexion and extension) joints using a universal goniometer. The results were compared with those from an orthopaedic examination, force plate analysis, radiographic evaluation, and a conclusive assessment. Congruity of the methods was assessed with a combination of three statistical approaches (Fisher’s exact test and two differently calculated proportions of agreeing observations), and the components were ranked from best to worst. Sensitivities of all of the physiotherapeutic evaluation methods against each standard were calculated. Results Evaluation of asymmetry in a sitting and lying position, assessment of muscle atrophy, manual and measured static weight bearing, and measurement of stifle passive range of motion were the most valid and sensitive physiotherapeutic evaluation methods. Conclusions Ranking of the various physiotherapeutic evaluation methods was accomplished. Several of these methods can be considered valid and sensitive when examining the functionality of dogs with stifle problems. PMID:23566355

A Psychometric Evaluation of the Danish Version of the Theory of Mind Storybook for 8–14 Year-Old Children

PubMed Central

Clemmensen, Lars; Bartels-Velthuis, Agna A.; Jespersen, Rókur av F.; van Os, Jim; Blijd-Hoogewys, Els M. A.; Ankerstrøm, Lise; Væver, Mette; Daniel, Peter F.; Drukker, Marjan; Jeppesen, Pia; Jepsen, Jens R. M.

2016-01-01

Background: Theory-of-Mind (ToM) keeps on developing in late childhood and early adolescence, and the study of ToM development later in childhood had to await the development of sufficiently sensitive tests challenging more mature children. The current study aimed to investigate the psychometric properties of the Danish version of the Theory-of-Mind Storybook Frederik (ToM-Frederik). Methods: We assessed whether ToM-Frederik scores differed between a group of 41 typically developing (TD) children and a group of 33 children with High Functioning Autism Spectrum Disorder (HFASD). A lower mean ToM-Frederik score was expected in the HFASD group. To determine the convergent validity of ToM-Frederik, potential associations with Strange Stories and Animated Triangles (AT) were analyzed. Furthermore, potential associations between ToM-Frederik and the Social Responsiveness Scale (SRS) and between ToM-Frederik and the Social Emotional Evaluation (SEE) Total score were analyzed. Results: A significantly higher ToM-Frederik score was observed in the TD group compared to the HFASD group. Furthermore, the convergent validity of ToM-Frederik as a measure of ToM was supported by significant and positive associations with the Strange Stories and the AT scores in the HFASD group, whereas ToM-Frederik was significantly correlated with Strange Stories, but not with AT in the TD group. ToM-Frederik was not significantly associated with SRS in neither the HFASD nor the TD group. Conclusion: The findings are supportive of ToM-Frederik as a valid indicator of deficits at the group level in children with HFASD between 7 and 14 years of age. Furthermore, the convergent validity is supported. PMID:27014139

Boomerang: A method for recursive reclassification.

PubMed

Devlin, Sean M; Ostrovnaya, Irina; Gönen, Mithat

2016-09-01

While there are many validated prognostic classifiers used in practice, often their accuracy is modest and heterogeneity in clinical outcomes exists in one or more risk subgroups. Newly available markers, such as genomic mutations, may be used to improve the accuracy of an existing classifier by reclassifying patients from a heterogenous group into a higher or lower risk category. The statistical tools typically applied to develop the initial classifiers are not easily adapted toward this reclassification goal. In this article, we develop a new method designed to refine an existing prognostic classifier by incorporating new markers. The two-stage algorithm called Boomerang first searches for modifications of the existing classifier that increase the overall predictive accuracy and then merges to a prespecified number of risk groups. Resampling techniques are proposed to assess the improvement in predictive accuracy when an independent validation data set is not available. The performance of the algorithm is assessed under various simulation scenarios where the marker frequency, degree of censoring, and total sample size are varied. The results suggest that the method selects few false positive markers and is able to improve the predictive accuracy of the classifier in many settings. Lastly, the method is illustrated on an acute myeloid leukemia data set where a new refined classifier incorporates four new mutations into the existing three category classifier and is validated on an independent data set. © 2016, The International Biometric Society.

Boomerang: A Method for Recursive Reclassification

PubMed Central

Devlin, Sean M.; Ostrovnaya, Irina; Gönen, Mithat

2016-01-01

Summary While there are many validated prognostic classifiers used in practice, often their accuracy is modest and heterogeneity in clinical outcomes exists in one or more risk subgroups. Newly available markers, such as genomic mutations, may be used to improve the accuracy of an existing classifier by reclassifying patients from a heterogenous group into a higher or lower risk category. The statistical tools typically applied to develop the initial classifiers are not easily adapted towards this reclassification goal. In this paper, we develop a new method designed to refine an existing prognostic classifier by incorporating new markers. The two-stage algorithm called Boomerang first searches for modifications of the existing classifier that increase the overall predictive accuracy and then merges to a pre-specified number of risk groups. Resampling techniques are proposed to assess the improvement in predictive accuracy when an independent validation data set is not available. The performance of the algorithm is assessed under various simulation scenarios where the marker frequency, degree of censoring, and total sample size are varied. The results suggest that the method selects few false positive markers and is able to improve the predictive accuracy of the classifier in many settings. Lastly, the method is illustrated on an acute myeloid leukemia dataset where a new refined classifier incorporates four new mutations into the existing three category classifier and is validated on an independent dataset. PMID:26754051

ICCS/ESCCA consensus guidelines to detect GPI-deficient cells in paroxysmal nocturnal hemoglobinuria (PNH) and related disorders part 4 - assay validation and quality assurance.

PubMed

Oldaker, Teri; Whitby, Liam; Saber, Maryam; Holden, Jeannine; Wallace, Paul K; Litwin, Virginia

2018-01-01

Over the past six years, a diverse group of stakeholders have put forth recommendations regarding the analytical validation of flow cytometric methods and described in detail the differences between cell-based and traditional soluble analyte assay validations. This manuscript is based on these general recommendations as well as the published experience of experts in the area of PNH testing. The goal is to provide practical assay-specific guidelines for the validation of high-sensitivity flow cytometric PNH assays. Examples of the reports and validation data described herein are provided in Supporting Information. © 2017 International Clinical Cytometry Society. © 2017 International Clinical Cytometry Society.

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Diagnostic Group Differences in Parent and Teacher Ratings on the BRIEF and Conners' Scales

ERIC Educational Resources Information Center

Sullivan, Jeremy R.; Riccio, Cynthia A.

2007-01-01

Objective: Behavioral rating scales are common instruments used in evaluations of ADHD and executive function. It is important to explore how different diagnostic groups perform on these measures, as this information can be used to provide criterion-related validity evidence for the measures. Method: Data from 92 children and adolescents were used…

Validation of Personal Digital Photography to Assess Dietary Quality among People with Intellectual Disabilities

ERIC Educational Resources Information Center

Elinder, L. S.; Brunosson, A.; Bergstrom, H.; Hagstromer, M.; Patterson, E.

2012-01-01

Background: Dietary assessment is a challenge in general, and specifically in individuals with intellectual disabilities (ID). This study aimed to evaluate personal digital photography as a method of assessing different aspects of dietary quality in this target group. Method: Eighteen adults with ID were recruited from community residences and…

Optimization and Verification of Droplet Digital PCR Even-Specific Methods for the Quantification of GM Maize DAS1507 and NK603.

PubMed

Grelewska-Nowotko, Katarzyna; Żurawska-Zajfert, Magdalena; Żmijewska, Ewelina; Sowa, Sławomir

2018-05-01

In recent years, digital polymerase chain reaction (dPCR), a new molecular biology technique, has been gaining in popularity. Among many other applications, this technique can also be used for the detection and quantification of genetically modified organisms (GMOs) in food and feed. It might replace the currently widely used real-time PCR method (qPCR), by overcoming problems related to the PCR inhibition and the requirement of certified reference materials to be used as a calibrant. In theory, validated qPCR methods can be easily transferred to the dPCR platform. However, optimization of the PCR conditions might be necessary. In this study, we report the transfer of two validated qPCR methods for quantification of maize DAS1507 and NK603 events to the droplet dPCR (ddPCR) platform. After some optimization, both methods have been verified according to the guidance of the European Network of GMO Laboratories (ENGL) on analytical method verification (ENGL working group on "Method Verification." (2011) Verification of Analytical Methods for GMO Testing When Implementing Interlaboratory Validated Methods). Digital PCR methods performed equally or better than the qPCR methods. Optimized ddPCR methods confirm their suitability for GMO determination in food and feed.

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)".

PubMed

Resnik, Linda; Borgia, Matthew; Ni, Pensheng; Pirraglia, Paul A; Jette, Alan

2012-09-17

The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT.The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration.

Validation of energy intake estimated from a food frequency questionnaire: a doubly labelled water study.

PubMed

Andersen, L Frost; Tomten, H; Haggarty, P; Løvø, A; Hustvedt, B-E

2003-02-01

The validation of dietary assessment methods is critical in the evaluation of the relation between dietary intake and health. The aim of this study was to assess the validity of a food frequency questionnaire by comparing energy intake with energy expenditure measured with the doubly labelled water method. Total energy expenditure was measured with the doubly labelled water (DLW) method during a 10 day period. Furthermore, the subjects filled in the food frequency questionnaire about 18-35 days after the DLW phase of the study was completed. Twenty-one healthy, non-pregnant females volunteered to participate in the study; only 17 subjects completed the study. The group energy intake was on average 10% lower than the energy expenditure, but the difference was not statistically significant. However, there was a wide range in reporting accuracy: seven subjects were identified as acceptable reporters, eight as under-reporters and two were identified as over-reporters. The width of the 95% confidence limits of agreement in a Bland and Altman plot for energy intake and energy expenditure varied from -5 to 3 MJ. The data showed that there was substantial variability in the accuracy of the food frequency questionnaire at the individual level. Furthermore, the results showed that the questionnaire was more accurate for groups than individuals.

Validation of 15 kGy as a radiation sterilisation dose for bone allografts manufactured at the Queensland Bone Bank: application of the VDmax 15 method.

PubMed

Nguyen, Huynh; Morgan, David A F; Sly, Lindsay I; Benkovich, Morris; Cull, Sharon; Forwood, Mark R

2008-06-01

ISO 11137-2006 (ISO 11137-2a 2006) provides a VDmax 15 method for substantiation of 15 kGy as radiation sterilisation dose (RSD) for health care products with a relatively low sample requirement. Moreover, the method is also valid for products in which the bioburden level is less than or equal to 1.5. In the literature, the bioburden level of processed bone allografts is extremely low. Similarly, the Queensland Bone Bank (QBB) usually recovers no viable organisms from processed bone allografts. Because bone allografts are treated as a type of health care product, the aim of this research was to substantiate 15 kGy as a RSD for frozen bone allografts at the QBB using method VDmax 15-ISO 11137-2: 2006 (ISO 11137-2e, Procedure for method VDmax 15 for multiple production batches. Sterilisation of health care products - radiation - part 2: establishing the sterilisation dose, 2006; ISO 11137-2f, Procedure for method VDmax 15 for a single production batch. Sterilisation of health care products - radiation - part 2: establishing the sterilisation dose, 2006). 30 femoral heads, 40 milled bone allografts and 40 structural bone allografts manufactured according to QBB standard operating procedures were used. Estimated bioburdens for each bone allograft group were used to calculate the verification doses. Next, 10 samples per group were irradiated at the verification dose, sterility was tested and the number of positive tests of sterility recorded. If the number of positive samples was no more than 1, from the 10 tests carried out in each group, the verification was accepted and 15 kGy was substantiated as RSD for those bone allografts. The bioburdens in all three groups were 0, and therefore the verification doses were 0 kGy. Sterility tests of femoral heads and milled bones were all negative (no contamination), and there was one positive test of sterility in the structural bone allograft. Accordingly, the verification was accepted. Using the ISO validated protocol, VDmax 15, 15 kGy was substantiated as RSD for frozen bone allografts manufactured at the QBB.

Measurement in Sensory Modulation: The Sensory Processing Scale Assessment

PubMed Central

Miller, Lucy J.; Sullivan, Jillian C.

2014-01-01

OBJECTIVE. Sensory modulation issues have a significant impact on participation in daily life. Moreover, understanding phenotypic variation in sensory modulation dysfunction is crucial for research related to defining homogeneous groups and for clinical work in guiding treatment planning. We thus evaluated the new Sensory Processing Scale (SPS) Assessment. METHOD. Research included item development, behavioral scoring system development, test administration, and item analyses to evaluate reliability and validity across sensory domains. RESULTS. Items with adequate reliability (internal reliability >.4) and discriminant validity (p < .01) were retained. Feedback from the expert panel also contributed to decisions about retaining items in the scale. CONCLUSION. The SPS Assessment appears to be a reliable and valid measure of sensory modulation (scale reliability >.90; discrimination between group effect sizes >1.00). This scale has the potential to aid in differential diagnosis of sensory modulation issues. PMID:25184464

Factorial validity of the Problematic Facebook Use Scale for adolescents and young adults

PubMed Central

Marino, Claudia; Vieno, Alessio; Altoè, Gianmarco; Spada, Marcantonio M.

2017-01-01

Background and aims Recent research on problematic Facebook use has highlighted the need to develop a specific theory-driven measure to assess this potential behavioral addiction. The aim of the present study was to examine the factorial validity of the Problematic Facebook Use Scale (PFUS) adapted from Caplan’s Generalized Problematic Internet Scale model. Methods A total of 1,460 Italian adolescents and young adults (aged 14–29 years) participated in the study. Confirmatory factor analyses were performed in order to assess the factorial validity of the scale. Results Results revealed that the factor structure of the PFUS provided a good fit to the data. Furthermore, results of the multiple group analyses supported the invariance of the model across age and gender groups. Discussion and conclusions This study provides evidence supporting the factorial validity of the PFUS. This new scale provides a theory-driven tool to assess problematic use of Facebook among male and female adolescents and young adults. PMID:28198639

Factorial validity of the Problematic Facebook Use Scale for adolescents and young adults.

PubMed

Marino, Claudia; Vieno, Alessio; Altoè, Gianmarco; Spada, Marcantonio M

2017-03-01

Background and aims Recent research on problematic Facebook use has highlighted the need to develop a specific theory-driven measure to assess this potential behavioral addiction. The aim of the present study was to examine the factorial validity of the Problematic Facebook Use Scale (PFUS) adapted from Caplan's Generalized Problematic Internet Scale model. Methods A total of 1,460 Italian adolescents and young adults (aged 14-29 years) participated in the study. Confirmatory factor analyses were performed in order to assess the factorial validity of the scale. Results Results revealed that the factor structure of the PFUS provided a good fit to the data. Furthermore, results of the multiple group analyses supported the invariance of the model across age and gender groups. Discussion and conclusions This study provides evidence supporting the factorial validity of the PFUS. This new scale provides a theory-driven tool to assess problematic use of Facebook among male and female adolescents and young adults.

Towards Virtual FLS: Development of a Peg Transfer Simulator

PubMed Central

Arikatla, Venkata S; Ahn, Woojin; Sankaranarayanan, Ganesh; De, Suvranu

2014-01-01

Background Peg transfer is one of five tasks in the Fundamentals of Laparoscopic Surgery (FLS), program. We report the development and validation of a Virtual Basic Laparoscopic Skill Trainer-Peg Transfer (VBLaST-PT©) simulator for automatic real-time scoring and objective quantification of performance. Methods We have introduced new techniques in order to allow bi-manual manipulation of pegs and automatic scoring/evaluation while maintaining high quality of simulation. We performed a preliminary face and construct validation study with 22 subjects divided into two groups: experts (PGY 4–5, fellow and practicing surgeons) and novice (PGY 1–3). Results Face validation shows high scores for all the aspects of the simulation. A two-tailed Mann-Whitney U-test scores showed significant difference between the two groups on completion time (p=0.003), FLS score (p=0.002) and the VBLaST-PT© score (p=0.006). Conclusions VBLaST-PT© is a high quality virtual simulator that showed both face and construct validity. PMID:24030904

Content validation using an expert panel: assessment process for assistive technology adopted by farmers with disabilities.

PubMed

Mathew, S N; Field, W E; French, B F

2011-07-01

This article reports the use of an expert panel to perform content validation of an experimental assessment process for the safety of assistive technology (AT) adopted by farmers with disabilities. The validation process was conducted by a panel of six experts experienced in the subject matter, i.e., design, use, and assessment of AT for farmers with disabilities. The exercise included an evaluation session and two focus group sessions. The evaluation session consisted of using the assessment process under consideration by the panel to evaluate a set of nine ATs fabricated by a farmer on his farm site. The expert panel also participated in the focus group sessions conducted immediately before and after the evaluation session. The resulting data were analyzed using discursive analysis, and the results were incorporated into the final assessment process. The method and the results are presented with recommendations for the use of expert panels in research projects and validation of assessment tools.

Descriptive analysis of the verbal behavior of a therapist: a known-group validity analysis of the putative behavioral functions involved in clinical interaction.

PubMed

Virues-Ortega, Javier; Montaño-Fidalgo, Montserrat; Froján-Parga, María Xesús; Calero-Elvira, Ana

2011-12-01

This study analyzes the interobserver agreement and hypothesis-based known-group validity of the Therapist's Verbal Behavior Category System (SISC-INTER). The SISC-INTER is a behavioral observation protocol comprised of a set of verbal categories representing putative behavioral functions of the in-session verbal behavior of a therapist (e.g., discriminative, reinforcing, punishing, and motivational operations). The complete therapeutic process of a clinical case of an individual with marital problems was recorded (10 sessions, 8 hours), and data were arranged in a temporal sequence using 10-min periods. Hypotheses based on the expected performance of the putative behavioral functions portrayed by the SISC-INTER codes across prevalent clinical activities (i.e., assessing, explaining, Socratic method, providing clinical guidance) were tested using autoregressive integrated moving average (ARIMA) models. Known-group validity analyses provided support to all hypotheses. The SISC-INTER may be a useful tool to describe therapist-client interaction in operant terms. The utility of reliable and valid protocols for the descriptive analysis of clinical practice in terms of verbal behavior is discussed. Copyright © 2011. Published by Elsevier Ltd.

The art and science of knowledge synthesis.

PubMed

Tricco, Andrea C; Tetzlaff, Jennifer; Moher, David

2011-01-01

To review methods for completing knowledge synthesis. We discuss how to complete a broad range of knowledge syntheses. Our article is intended as an introductory guide. Many groups worldwide conduct knowledge syntheses, and some methods are applicable to most reviews. However, variations of these methods are apparent for different types of reviews, such as realist reviews and mixed-model reviews. Review validity is dependent on the validity of the included primary studies and the review process itself. Steps should be taken to avoid bias in the conduct of knowledge synthesis. Transparency in reporting will help readers assess review validity and applicability, increasing its utility. Given the magnitude of the literature, the increasing demands on knowledge syntheses teams, and the diversity of approaches, continuing efforts will be important to increase the efficiency, validity, and applicability of systematic reviews. Future research should focus on increasing the uptake of knowledge synthesis, how best to update reviews, the comparability between different types of reviews (eg, rapid vs. comprehensive reviews), and how to prioritize knowledge synthesis topics. Copyright © 2011 Elsevier Inc. All rights reserved.

Anatomical masking of pressure footprints based on the Oxford Foot Model: validation and clinical relevance.

PubMed

Giacomozzi, Claudia; Stebbins, Julie A

2017-03-01

Plantar pressure analysis is widely used in the assessment of foot function. In order to assess regional loading, a mask is applied to the footprint to sub-divide it into regions of interest (ROIs). The most common masking method is based on geometric features of the footprint (GM). Footprint masking based on anatomical landmarks of the foot has been implemented more recently, and involves the integration of a 3D motion capture system, plantar pressure measurement device, and a multi-segment foot model. However, thorough validation of anatomical masking (AM) using pathological footprints has not yet been presented. In the present study, an AM method based on the Oxford Foot Model (OFM) was compared to an equivalent GM. Pressure footprints from 20 young healthy subjects (HG) and 20 patients with clubfoot (CF) were anatomically divided into 5 ROIs using a subset of the OFM markers. The same foot regions were also identified by using a standard GM method. Comparisons of intra-subject coefficient of variation (CV) showed that the OFM-based AM was at least as reliable as the GM for all investigated pressure parameters in all foot regions. Clinical relevance of AM was investigated by comparing footprints from HG and CF groups. Contact time, maximum force, force-time integral and contact area proved to be sensitive parameters that were able to distinguish HG and CF groups, using both AM and GM methods However, the AM method revealed statistically significant differences between groups in 75% of measured variables, compared to 62% using a standard GM method, indicating that the AM method is more sensitive for revealing differences between groups. Copyright © 2017 Elsevier B.V. All rights reserved.

Validity and relative validity of a novel digital approach for 24-h dietary recall in athletes

PubMed Central

2014-01-01

Background We developed a digital dietary analysis tool for athletes (DATA) using a modified 24-h recall method and an integrated, customized nutrient database. The purpose of this study was to assess DATA’s validity and relative validity by measuring its agreement with registered dietitians’ (RDs) direct observations (OBSERVATION) and 24-h dietary recall interviews using the USDA 5-step multiple-pass method (INTERVIEW), respectively. Methods Fifty-six athletes (14–20 y) completed DATA and INTERVIEW in randomized counter-balanced order. OBSERVATION (n = 26) consisted of RDs recording participants’ food/drink intake in a 24-h period and were completed the day prior to DATA and INTERVIEW. Agreement among methods was estimated using a repeated measures t-test and Bland-Altman analysis. Results The paired differences (with 95% confidence intervals) between DATA and OBSERVATION were not significant for carbohydrate (10.1%, -1.2–22.7%) and protein (14.1%, -3.2–34.5%) but was significant for energy (14.4%, 1.2–29.3%). There were no differences between DATA and INTERVIEW for energy (-1.1%, -9.1–7.7%), carbohydrate (0.2%, -7.1–8.0%) or protein (-2.7%, -11.3–6.7%). Bland-Altman analysis indicated significant positive correlations between absolute values of the differences and the means for OBSERVATION vs. DATA (r = 0.40 and r = 0.47 for energy and carbohydrate, respectively) and INTERVIEW vs. DATA (r = 0.52, r = 0.29, and r = 0.61 for energy, carbohydrate, and protein, respectively). There were also wide 95% limits of agreement (LOA) for most method comparisons. The mean bias ratio (with 95% LOA) for OBSERVATION vs. DATA was 0.874 (0.551-1.385) for energy, 0.906 (0.522-1.575) for carbohydrate, and 0.895(0.395-2.031) for protein. The mean bias ratio (with 95% LOA) for INTERVIEW vs. DATA was 1.016 (0.538-1.919) for energy, 0.995 (0.563-1.757) for carbohydrate, and 1.031 (0.514-2.068) for protein. Conclusion DATA has good relative validity for group-level comparisons in athletes. However, there are large variations in the relative validity of individuals’ dietary intake estimates from DATA, particularly in athletes with higher energy and nutrient intakes. DATA can be a useful athlete-specific, digital alternative to conventional 24-h dietary recall methods at the group level. Further development and testing is needed to improve DATA’s validity for estimations of individual dietary intakes. PMID:24779565

HPLC method for urinary theobromine determination: Effect of consumption of cocoa products on theobromine urinary excretion in children.

PubMed

Rodriguez, Adrian; Costa-Bauza, Antonia; Saez-Torres, Concepcion; Rodrigo, Dolores; Grases, Felix

2015-11-01

To validate a simple method of urinary theobromine determination, to assess urinary theobromine levels in 80 healthy children and to relate these levels to consumption of cocoa products. Urine samples were diluted, directly injected into an HPLC system, separated by gradient elution on a C18 column, and detected by UV spectrometry. The method was validated for linearity, limits of detection and quantification, imprecision, accuracy, recovery and interferences. The proposed method was used to assess 12-h day and 12-h night urinary theobromine excretion by 80 healthy children, divided into four groups based on consumption of cocoa products. In addition, urinary excretion of magnesium and oxalate, also present in cocoa, was measured in these four groups. The method was linear to a theobromine concentration of 278μmol/L (50mg/L). LOD and LOQ for urine samples, diluted 1:5 (vol/vol) with water, were 1.1 and 3.6μmol/L respectively. Within-run and between-run imprecisions (CV) were each <2%. Average recovery was 99%, and analysis of a certified reference sample showed an error <2.5%. Theobromine excretion levels were significantly higher in healthy children with higher consumption of cocoa products (p<0.001), but oxalate (p=0.098) and magnesium (p=0.068) excretion levels did not differ significantly. This validated method resulted in urinary theobromine determination with 100% recovery, without sample pretreatment. Urinary theobromine levels in healthy children were directly related to their consumption of cocoa products. Copyright © 2015 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

Focus groups: a useful tool for curriculum evaluation.

PubMed

Frasier, P Y; Slatt, L; Kowlowitz, V; Kollisch, D O; Mintzer, M

1997-01-01

Focus group interviews have been used extensively in health services program planning, health education, and curriculum planning. However, with the exception of a few reports describing the use of focus groups for a basic science course evaluation and a clerkship's impact on medical students, the potential of focus groups as a tool for curriculum evaluation has not been explored. Focus groups are a valid stand-alone evaluation process, but they are most often used in combination with other quantitative and qualitative methods. Focus groups rely heavily on group interaction, combining elements of individual interviews and participant observation. This article compares the focus group interview with both quantitative and qualitative methods; discusses when to use focus group interviews; outlines a protocol for conducting focus groups, including a comparison of various styles of qualitative data analysis; and offers a case study, in which focus groups evaluated the effectiveness of a pilot preclinical curriculum.

Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

NASA Astrophysics Data System (ADS)

Azizah, K. N.; Ibrahim, M.; Widodo, W.

2018-01-01

Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

Assessment of Lower Limb Muscle Strength and Power Using Hand-Held and Fixed Dynamometry: A Reliability and Validity Study

PubMed Central

Perraton, Luke G.; Bower, Kelly J.; Adair, Brooke; Pua, Yong-Hao; Williams, Gavin P.; McGaw, Rebekah

2015-01-01

Introduction Hand-held dynamometry (HHD) has never previously been used to examine isometric muscle power. Rate of force development (RFD) is often used for muscle power assessment, however no consensus currently exists on the most appropriate method of calculation. The aim of this study was to examine the reliability of different algorithms for RFD calculation and to examine the intra-rater, inter-rater, and inter-device reliability of HHD as well as the concurrent validity of HHD for the assessment of isometric lower limb muscle strength and power. Methods 30 healthy young adults (age: 23±5yrs, male: 15) were assessed on two sessions. Isometric muscle strength and power were measured using peak force and RFD respectively using two HHDs (Lafayette Model-01165 and Hoggan microFET2) and a criterion-reference KinCom dynamometer. Statistical analysis of reliability and validity comprised intraclass correlation coefficients (ICC), Pearson correlations, concordance correlations, standard error of measurement, and minimal detectable change. Results Comparison of RFD methods revealed that a peak 200ms moving window algorithm provided optimal reliability results. Intra-rater, inter-rater, and inter-device reliability analysis of peak force and RFD revealed mostly good to excellent reliability (coefficients ≥ 0.70) for all muscle groups. Concurrent validity analysis showed moderate to excellent relationships between HHD and fixed dynamometry for the hip and knee (ICCs ≥ 0.70) for both peak force and RFD, with mostly poor to good results shown for the ankle muscles (ICCs = 0.31–0.79). Conclusions Hand-held dynamometry has good to excellent reliability and validity for most measures of isometric lower limb strength and power in a healthy population, particularly for proximal muscle groups. To aid implementation we have created freely available software to extract these variables from data stored on the Lafayette device. Future research should examine the reliability and validity of these variables in clinical populations. PMID:26509265

Validation of the PROMIS Physical Function Measures in a Diverse U.S. Population-Based Cohort of Cancer Patients

PubMed Central

Jensen, Roxanne E.; Potosky, Arnold L.; Reeve, Bryce B.; Hahn, Elizabeth; Cella, David; Fries, James; Smith, Ashley Wilder; Keegan, Theresa H.M.; Wu, Xiao-Cheng; Paddock, Lisa; Moinpour, Carol M.

2016-01-01

Purpose To evaluate the validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function measures in a diverse, population-based cancer sample. Methods Cancer patients 6–13 months post diagnosis (n=4,840) were recruited for the Measuring Your Health (MY-Health) study. Participants were diagnosed between 2010–2013 with non-Hodgkin lymphoma or cancers of the colorectum, lung, breast, uterus, cervix, or prostate. Four PROMIS Physical Function short forms (4a, 6b, 10a, and 16) were evaluated for validity and reliability across age and race-ethnicity groups. Covariates included gender, marital status, education level, cancer site and stage, comorbidities, and functional status. Results PROMIS Physical Function short forms showed high internal consistency (Cronbach’s α =0.92 – 0.96), convergent validity (Fatigue, Pain Interference, FACT Physical Well-Being all r≥0.68) and discriminant validity (unrelated domains all r≤0.3) across survey short forms, age, and race-ethnicity. Known group differences by demographic, clinical, and functional characteristics performed as hypothesized. Ceiling effects for higher-functioning individuals were identified on most forms. Conclusions This study provides strong evidence that PROMIS Physical Function measures are valid and reliable in multiple race-ethnicity and age groups. Researchers selecting specific PROMIS short forms should consider the degree of functional disability in their patient population to ensure that length and content are tailored to limit response burden. PMID:25935353

Boiling points of halogenated aliphatic compounds: a quantitative structure-property relationship for prediction and validation.

PubMed

Oberg, Tomas

2004-01-01

Halogenated aliphatic compounds have many technical uses, but substances within this group are also ubiquitous environmental pollutants that can affect the ozone layer and contribute to global warming. The establishment of quantitative structure-property relationships is of interest not only to fill in gaps in the available database but also to validate experimental data already acquired. The three-dimensional structures of 240 compounds were modeled with molecular mechanics prior to the generation of empirical descriptors. Two bilinear projection methods, principal component analysis (PCA) and partial-least-squares regression (PLSR), were used to identify outliers. PLSR was subsequently used to build a multivariate calibration model by extracting the latent variables that describe most of the covariation between the molecular structure and the boiling point. Boiling points were also estimated with an extension of the group contribution method of Stein and Brown.

Robust d -wave pairing symmetry in multiorbital cobalt high-temperature superconductors

NASA Astrophysics Data System (ADS)

Li, Yinxiang; Han, Xinloong; Qin, Shengshan; Le, Congcong; Wang, Qiang-Hua; Hu, Jiangping

2017-07-01

The pairing symmetry of the cobalt high-temperature (high-Tc) superconductors formed by vertex-shared cation-anion tetrahedral complexes is studied by the methods of mean-field, random phase approximation (RPA), and functional renormalization-group (FRG) analyses. The results of all of these methods show that the dx2-y2 pairing symmetry is robustly favored near half filling. The RPA and FRG methods, which are valid in weak-interaction regions, predict that the superconducting state is also strongly orbital selective, namely, the dx2-y2 orbital that has the largest density near half filling among the three t2 g orbitals dominates superconducting pairing. These results suggest that these materials, if synthesized, can provide an indisputable test of the high-Tc pairing mechanism and the validity of different theoretical methods.

Comparison of statistical methods for detection of serum lipid biomarkers for mesothelioma and asbestos exposure.

PubMed

Xu, Rengyi; Mesaros, Clementina; Weng, Liwei; Snyder, Nathaniel W; Vachani, Anil; Blair, Ian A; Hwang, Wei-Ting

2017-07-01

We compared three statistical methods in selecting a panel of serum lipid biomarkers for mesothelioma and asbestos exposure. Serum samples from mesothelioma, asbestos-exposed subjects and controls (40 per group) were analyzed. Three variable selection methods were considered: top-ranked predictors from univariate model, stepwise and least absolute shrinkage and selection operator. Crossed-validated area under the receiver operating characteristic curve was used to compare the prediction performance. Lipids with high crossed-validated area under the curve were identified. Lipid with mass-to-charge ratio of 372.31 was selected by all three methods comparing mesothelioma versus control. Lipids with mass-to-charge ratio of 1464.80 and 329.21 were selected by two models for asbestos exposure versus control. Different methods selected a similar set of serum lipids. Combining candidate biomarkers can improve prediction.

Assessing cross-cultural differences through use of multiple-group invariance analyses.

PubMed

Stein, Judith A; Lee, Jerry W; Jones, Patricia S

2006-12-01

The use of structural equation modeling in cross-cultural personality research has become a popular method for testing measurement invariance. In this report, we present an example of testing measurement invariance using the Sense of Coherence Scale of Antonovsky (1993) in 3 ethnic groups: Chinese, Japanese, and Whites. In a series of increasingly restrictive constraints on the measurement models of the 3 groups, we demonstrate how to assess differences among the groups. We also provide an example of construct validation.

The effect of social and token economy reinforcements on academic achievement of students with intellectual disabilities.

PubMed

Mirzamani, S Mahmood; Ashoori, Mohammad; Sereshki, Narges Adib

2011-01-01

This study investigates the effect of social and token economy reinforcements on academic achievement of 9th grade boy students with intellectual disabilities in an experimental science class in Tehran Province. The method used for this study was experimental by pre-test, post- test with a control group. The boy students with intellectual disabilities from three junior high schools participated in this study. The sample consisted of thirty, 9th grade boy students with intellectual disabilities in the selected schools; the schools were chosen by the multi-stage cluster method. To measure the progress of students in the science class, a teacher made test and the Wechsler intelligence test for matching the groups for IQ were used. To ensure validity, the content validity criteria depended tests calculated by the Lashe method and teachers' perspective were used. The reliability coefficient was obtained by the reliability coefficient of related tests; the percent agreement method and the obtained data were analyzed using one-way variance analysis and Shefe prosecution test. The results showed that there was a significant increase in academic achievement of students with intellectual disabilities when using token economy than using social reinforcements compared with the control group. Also, when using social reinforcements, the academic achievement of students was more than the control group. Token economy and social reinforcements increased the academic achievement of students with intellectual disabilities in the science class; and also the effect of token economy reinforcements was more than social reinforcements on the subjects.

Supervised group Lasso with applications to microarray data analysis

PubMed Central

Ma, Shuangge; Song, Xiao; Huang, Jian

2007-01-01

Background A tremendous amount of efforts have been devoted to identifying genes for diagnosis and prognosis of diseases using microarray gene expression data. It has been demonstrated that gene expression data have cluster structure, where the clusters consist of co-regulated genes which tend to have coordinated functions. However, most available statistical methods for gene selection do not take into consideration the cluster structure. Results We propose a supervised group Lasso approach that takes into account the cluster structure in gene expression data for gene selection and predictive model building. For gene expression data without biological cluster information, we first divide genes into clusters using the K-means approach and determine the optimal number of clusters using the Gap method. The supervised group Lasso consists of two steps. In the first step, we identify important genes within each cluster using the Lasso method. In the second step, we select important clusters using the group Lasso. Tuning parameters are determined using V-fold cross validation at both steps to allow for further flexibility. Prediction performance is evaluated using leave-one-out cross validation. We apply the proposed method to disease classification and survival analysis with microarray data. Conclusion We analyze four microarray data sets using the proposed approach: two cancer data sets with binary cancer occurrence as outcomes and two lymphoma data sets with survival outcomes. The results show that the proposed approach is capable of identifying a small number of influential gene clusters and important genes within those clusters, and has better prediction performance than existing methods. PMID:17316436

The Effect of Social and Token Economy Reinforcements on Academic Achievement of Students with Intellectual Disabilities

PubMed Central

Ashoori, Mohammad; Sereshki, Narges Adib

2011-01-01

Objective This study investigates the effect of social and token economy reinforcements on academic achievement of 9th grade boy students with intellectual disabilities in an experimental science class in Tehran Province. Method The method used for this study was experimental by pre-test, post- test with a control group. The boy students with intellectual disabilities from three junior high schools participated in this study. The sample consisted of thirty, 9th grade boy students with intellectual disabilities in the selected schools; the schools were chosen by the multi-stage cluster method. To measure the progress of students in the science class, a teacher made test and the Wechsler intelligence test for matching the groups for IQ were used. To ensure validity, the content validity criteria depended tests calculated by the Lashe method and teachers' perspective were used. The reliability coefficient was obtained by the reliability coefficient of related tests; the percent agreement method and the obtained data were analyzed using one-way variance analysis and Shefe prosecution test. Results The results showed that there was a significant increase in academic achievement of students with intellectual disabilities when using token economy than using social reinforcements compared with the control group. Also, when using social reinforcements, the academic achievement of students was more than the control group. Conclusion Token economy and social reinforcements increased the academic achievement of students with intellectual disabilities in the science class; and also the effect of token economy reinforcements was more than social reinforcements on the subjects. PMID:22952517

A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

PubMed Central

Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

2013-01-01

Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020

Study on ABO and RhD blood grouping: Comparison between conventional tile method and a new solid phase method (InTec Blood Grouping Test Kit).

PubMed

Yousuf, R; Abdul Ghani, S A; Abdul Khalid, N; Leong, C F

2018-04-01

'InTec Blood Grouping Test kit' using solid-phase technology is a new method which may be used at outdoor blood donation site or at bed side as an alternative to the conventional tile method in view of its stability at room temperature and fulfilled the criteria as point of care test. This study aimed to compare the efficiency of this solid phase method (InTec Blood Grouping Test Kit) with the conventional tile method in determining the ABO and RhD blood group of healthy donors. A total of 760 voluntary donors who attended the Blood Bank, Penang Hospital or offsite blood donation campaigns from April to May 2014 were recruited. The ABO and RhD blood groups were determined by the conventional tile method and the solid phase method, in which the tube method was used as the gold standard. For ABO blood grouping, the tile method has shown 100% concordance results with the gold standard tube method, whereas the solid-phase method only showed concordance result for 754/760 samples (99.2%). Therefore, for ABO grouping, tile method has 100% sensitivity and specificity while the solid phase method has slightly lower sensitivity of 97.7% but both with good specificity of 100%. For RhD grouping, both the tile and solid phase methods have grouped one RhD positive specimen as negative each, thus giving the sensitivity and specificity of 99.9% and 100% for both methods respectively. The 'InTec Blood Grouping Test Kit' is suitable for offsite usage because of its simplicity and user friendliness. However, further improvement in adding the internal quality control may increase the test sensitivity and validity of the test results.

Use of genetic programming, logistic regression, and artificial neural nets to predict readmission after coronary artery bypass surgery.

PubMed

Engoren, Milo; Habib, Robert H; Dooner, John J; Schwann, Thomas A

2013-08-01

As many as 14 % of patients undergoing coronary artery bypass surgery are readmitted within 30 days. Readmission is usually the result of morbidity and may lead to death. The purpose of this study is to develop and compare statistical and genetic programming models to predict readmission. Patients were divided into separate Construction and Validation populations. Using 88 variables, logistic regression, genetic programs, and artificial neural nets were used to develop predictive models. Models were first constructed and tested on the Construction populations, then validated on the Validation population. Areas under the receiver operator characteristic curves (AU ROC) were used to compare the models. Two hundred and two patients (7.6 %) in the 2,644 patient Construction group and 216 (8.0 %) of the 2,711 patient Validation group were re-admitted within 30 days of CABG surgery. Logistic regression predicted readmission with AU ROC = .675 ± .021 in the Construction group. Genetic programs significantly improved the accuracy, AU ROC = .767 ± .001, p < .001). Artificial neural nets were less accurate with AU ROC = 0.597 ± .001 in the Construction group. Predictive accuracy of all three techniques fell in the Validation group. However, the accuracy of genetic programming (AU ROC = .654 ± .001) was still trivially but statistically non-significantly better than that of the logistic regression (AU ROC = .644 ± .020, p = .61). Genetic programming and logistic regression provide alternative methods to predict readmission that are similarly accurate.

Adaptation and validation of Mandarin Chinese version of the pediatric Voice Handicap Index (pVHI).

PubMed

Lu, Dan; Huang, Mengjie; Li, Zhen; Yiu, Edwin M-L; Cheng, Ivy K-Y; Yang, Hui; Ma, Estella P-M

2018-01-01

The aim of this study was to adapt and validate the English version of pediatric voice handicap index (pVHI) into Mandarin Chinese.
 METHODS: A cross-sectional study was performed from May 2016 to April 2017. A total of 367 parents participated in this study, and 338 parents completed the translated questionnaire without missing data, including 213 parents of children with voice disorders (patients group), and 125 parents of children without voice disorders (control group). The internal consistency, test-retest reliability, contents validity, construct validity, clinical validity, and cutoff point were calculated. The most common voice disorder in the patients group was vocal fold nodules (77.9%), followed by chronic laryngitis (18.8%), and vocal fold polyps (3.3%). The prevalence for voice disorders was higher in boys (67.1%) than girls (32.9%). The most common vocal misuse and abuse habit was shouting loudly (n = 186, 87.3%), followed by speaking for a long time (n = 158, 74.2%), and crying loudly (n = 99, 46.5%). The internal consistency for the Mandarin Chinese version of pVHI was excellent in patients group (Cronbach α = 0.95). The inter-class correlation coefficient indicated strong test-retest reliability (ICC = 0.99). The principal-component analysis demonstrated three-factor eigenvalues greater than 1, and the cumulative proportion was 66.23%. The mean total scores and mean subscales scores were significantly higher in the patients group than the control group (p < 0.05). The physical domain had the highest mean score among the three subscales (functional, physical and emotional) in the patients group. The optimal cutoff point of the Mandarin Chinese version of pVHI was 9.5 points with a sensitivity of 80.3% and a specificity of 84.8%. The Mandarin Chinese version of pVHI was a reliable and valid tool to assess the parents' perception about their children's voice disorders. It is recommended that it can be used as a screening tool for discriminating between children with and without dysphonia. Copyright © 2017 Elsevier B.V. All rights reserved.

A Validity Study of the Working Group's Orientation Test for Individuals with Moderate to Severe Intellectual Disability

ERIC Educational Resources Information Center

Pyo, G.; Curtis, K.; Curtis, R.; Markwell, S.

2009-01-01

Background: Decline in orientation skill has been reported as an early indicator of Dementia of Alzheimer's Type (DAT). Orientation subtest of the Working Group's Test Battery was examined whether this test is useful to identify DAT patients among adults with moderate to severe ID. Methods: Sixteen DAT patients and 35 non-demented normal controls…

Reliability and validity of pendulum test measures of spasticity obtained with the Polhemus tracking system from patients with chronic stroke

PubMed Central

Bohannon, Richard W; Harrison, Steven; Kinsella-Shaw, Jeffrey

2009-01-01

Background Spasticity is a common impairment accompanying stroke. Spasticity of the quadriceps femoris muscle can be quantified using the pendulum test. The measurement properties of pendular kinematics captured using a magnetic tracking system has not been studied among patients who have experienced a stroke. Therefore, this study describes the test-retest reliability and known groups and convergent validity of the pendulum test measures obtained with the Polhemus tracking system. Methods Eight patients with chronic stroke underwent pendulum tests with their affected and unaffected lower limbs, with and without the addition of a 2.2 kg cuff weight at the ankle, using the Polhemus magnetic tracking system. Also measured bilaterally were knee resting angles, Ashworth scores (grades 0–4) of quadriceps femoris muscles, patellar tendon (knee jerk) reflexes (grades 0–4), and isometric knee extension force. Results Three measures obtained from pendular traces of the affected side were reliable (intraclass correlation coefficient ≥ .844). Known groups validity was confirmed by demonstration of a significant difference in the measurements between sides. Convergent validity was supported by correlations ≥ .57 between pendulum test measures and other measures reflective of spasticity. Conclusion Pendulum test measures obtained with the Polhemus tracking system from the affected side of patients with stroke have good test-retest reliability and both known groups and convergent validity. PMID:19642989

Development and Validation of a Fatigue Assessment Scale for U.S. Construction Workers

PubMed Central

Zhang, Mingzong; Sparer, Emily H.; Murphy, Lauren A.; Dennerlein, Jack T.; Fang, Dongping; Katz, Jeffrey N.; Caban-Martinez, Alberto J.

2015-01-01

Objective To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Methods Using a two-phased approach, we first identified items for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n=11) and focus groups (3 groups with 6 workers each) with construction workers. The second phase included assessment for the reliability, validity and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n=144). Results Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales (“Lethargy” and “Bodily Ailment”).. During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW (0.91), Lethargy (0.86) and Bodily Ailment (0.84)) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59–0.68; Intraclass Correlation Coefficients: 0.74–0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. Conclusions The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. PMID:25603944

Validating Alternative Modes of Scoring for Coloured Progressive Matrices.

ERIC Educational Resources Information Center

Razel, Micha; Eylon, Bat-Sheva

Conventional scoring of the Coloured Progressive Matrices (CPM) was compared with three methods of multiple weight scoring. The methods include: (1) theoretical weighting in which the weights were based on a theory of cognitive processing; (2) judged weighting in which the weights were given by a group of nine adult expert judges; and (3)…

The Q-Sort method: use in landscape assessment research and landscape planning

Treesearch

David G. Pitt; Ervin H. Zube

1979-01-01

The assessment of visual quality inherently involves the measurement of perceptual response to landscape. The Q-Sort Method is a psychometric technique which produces reliable and valid interval measurements of people's perceptions of landscape visual quality as depicted in photographs. It is readily understood by participants across a wide range of age groups and...

Principles for valid histopathologic scoring in research

PubMed Central

Gibson-Corley, Katherine N.; Olivier, Alicia K.; Meyerholz, David K.

2013-01-01

Histopathologic scoring is a tool by which semi-quantitative data can be obtained from tissues. Initially, a thorough understanding of the experimental design, study objectives and methods are required to allow the pathologist to appropriately examine tissues and develop lesion scoring approaches. Many principles go into the development of a scoring system such as tissue examination, lesion identification, scoring definitions and consistency in interpretation. Masking (a.k.a. “blinding”) of the pathologist to experimental groups is often necessary to constrain bias and multiple mechanisms are available. Development of a tissue scoring system requires appreciation of the attributes and limitations of the data (e.g. nominal, ordinal, interval and ratio data) to be evaluated. Incidence, ordinal and rank methods of tissue scoring are demonstrated along with key principles for statistical analyses and reporting. Validation of a scoring system occurs through two principal measures: 1) validation of repeatability and 2) validation of tissue pathobiology. Understanding key principles of tissue scoring can help in the development and/or optimization of scoring systems so as to consistently yield meaningful and valid scoring data. PMID:23558974

An initial investigation into the validity of a computer-based auditory processing assessment (Feather Squadron).

PubMed

Barker, Matthew D; Purdy, Suzanne C

2016-01-01

This research investigates a novel method for identifying and measuring school-aged children with poor auditory processing through a tablet computer. Feasibility and test-retest reliability are investigated by examining the percentage of Group 1 participants able to complete the tasks and developmental effects on performance. Concurrent validity was investigated against traditional tests of auditory processing using Group 2. There were 847 students aged 5 to 13 years in group 1, and 46 aged 5 to 14 years in group 2. Some tasks could not be completed by the youngest participants. Significant correlations were found between results of most auditory processing areas assessed by the Feather Squadron test and traditional auditory processing tests. Test-retest comparisons indicated good reliability for most of the Feather Squadron assessments and some of the traditional tests. The results indicate the Feather Squadron assessment is a time-efficient, feasible, concurrently valid, and reliable approach for measuring auditory processing in school-aged children. Clinically, this may be a useful option for audiologists when performing auditory processing assessments as it is a relatively fast, engaging, and easy way to assess auditory processing abilities. Research is needed to investigate further the construct validity of this new assessment by examining the association between performance on Feather Squadron and objective evoked potential, lesion studies, and/or functional imaging measures of auditory function.

Electronic Dietary Intake Assessment (e-DIA): relative validity of a mobile phone application to measure intake of food groups.

PubMed

Rangan, Anna M; Tieleman, Laurissa; Louie, Jimmy C Y; Tang, Lie Ming; Hebden, Lana; Roy, Rajshri; Kay, Judy; Allman-Farinelli, Margaret

2016-06-01

Automation of dietary assessment can reduce limitations of established methodologies, by alleviating participant and researcher burden. Designed as a research tool, the electronic Dietary Intake Assessment (e-DIA) is a food record in mobile phone application format. The present study aimed to examine the relative validity of the e-DIA with the 24-h recall method to estimate intake of food groups. A sample of eighty university students aged 19-24 years recorded 5 d of e-DIA and 3 d of recall within this 5-d period. The three matching days of dietary data were used for analysis. Food intake data were disaggregated and apportioned to one of eight food groups. Median intakes of food groups were similar between the methods, and strong correlations were found (mean: 0·79, range: 0·69-0·88). Cross-classification by tertiles produced a high level of exact agreement (mean: 71 %, range: 65-75 %), and weighted κ values were moderate to good (range: 0·54-0·71). Although mean differences (e-DIA-recall) were small (range: -13 to 23 g), limits of agreement (LOA) were relatively large (e.g. for vegetables, mean difference: -4 g, LOA: -159 to 151 g). The Bland-Altman plots showed robust agreement, with minimum bias. This analysis supports the use of e-DIA as an alternative to the repeated 24-h recall method for ranking individuals' food group intake.

Development and testing of the ‘Culture of Care Barometer’ (CoCB) in healthcare organisations: a mixed methods study

PubMed Central

Rafferty, Anne Marie; Philippou, Julia; Fitzpatrick, Joanne M; Pike, Geoff; Ball, Jane

2017-01-01

Objective Concerns about care quality have prompted calls to create workplace cultures conducive to high-quality, safe and compassionate care and to provide a supportive environment in which staff can operate effectively. How healthcare organisations assess their culture of care is an important first step in creating such cultures. This article reports on the development and validation of a tool, the Culture of Care Barometer, designed to assess perceptions of a caring culture among healthcare workers preliminary to culture change. Design/setting/participants An exploratory mixed methods study designed to develop and test the validity of a tool to measure ‘culture of care’ through focus groups and questionnaires. Questionnaire development was facilitated through: a literature review, experts generating items of interest and focus group discussions with healthcare staff across specialities, roles and seniority within three types of public healthcare organisations in the UK. The tool was designed to be multiprofessional and pilot tested with a sample of 467 nurses and healthcare support workers in acute care and then validated with a sample of 1698 staff working across acute, mental health and community services in England. Exploratory factor analysis was used to identify dimensions underlying the Barometer. Results Psychometric testing resulted in the development of a 30-item questionnaire linked to four domains with retained items loading to four factors: organisational values (α=0.93, valid n=1568, M=3.7), team support (α=0.93, valid n=1557, M=3.2), relationships with colleagues (α=0.84, valid n=1617, M=4.0) and job constraints (α=0.70, valid n=1616, M=3.3). Conclusions The study developed a valid and reliable instrument with which to gauge the different attributes of care culture perceived by healthcare staff with potential for organisational benchmarking. PMID:28821526

Development and testing of the 'Culture of Care Barometer' (CoCB) in healthcare organisations: a mixed methods study.

PubMed

Rafferty, Anne Marie; Philippou, Julia; Fitzpatrick, Joanne M; Pike, Geoff; Ball, Jane

2017-08-18

Concerns about care quality have prompted calls to create workplace cultures conducive to high-quality, safe and compassionate care and to provide a supportive environment in which staff can operate effectively. How healthcare organisations assess their culture of care is an important first step in creating such cultures. This article reports on the development and validation of a tool, the Culture of Care Barometer, designed to assess perceptions of a caring culture among healthcare workers preliminary to culture change. An exploratory mixed methods study designed to develop and test the validity of a tool to measure 'culture of care' through focus groups and questionnaires. Questionnaire development was facilitated through: a literature review, experts generating items of interest and focus group discussions with healthcare staff across specialities, roles and seniority within three types of public healthcare organisations in the UK. The tool was designed to be multiprofessional and pilot tested with a sample of 467 nurses and healthcare support workers in acute care and then validated with a sample of 1698 staff working across acute, mental health and community services in England. Exploratory factor analysis was used to identify dimensions underlying the Barometer. Psychometric testing resulted in the development of a 30-item questionnaire linked to four domains with retained items loading to four factors: organisational values (α=0.93, valid n=1568, M=3.7), team support (α=0.93, valid n=1557, M=3.2), relationships with colleagues (α=0.84, valid n=1617, M=4.0) and job constraints (α=0.70, valid n=1616, M=3.3). The study developed a valid and reliable instrument with which to gauge the different attributes of care culture perceived by healthcare staff with potential for organisational benchmarking. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practice.

PubMed

Cousans, Fran; Patterson, Fiona; Edwards, Helena; Walker, Kim; McLachlan, John C; Good, David

2017-05-01

Although there is extensive evidence confirming the predictive validity of situational judgement tests (SJTs) in medical education, there remains a shortage of evidence for their predictive validity for performance of postgraduate trainees in their first role in clinical practice. Moreover, to date few researchers have empirically examined the complementary roles of academic and non-academic selection methods in predicting in-role performance. This is an important area of enquiry as despite it being common practice to use both types of methods within a selection system, there is currently no evidence that this approach translates into increased predictive validity of the selection system as a whole, over that achieved by the use of a single selection method. In this preliminary study, the majority of the range of scores achieved by successful applicants to the UK Foundation Programme provided a unique opportunity to address both of these areas of enquiry. Sampling targeted high (>80th percentile) and low (<20th percentile) scorers on the SJT. Supervisors rated 391 trainees' in-role performance, and incidence of remedial action was collected. SJT and academic performance scores correlated with supervisor ratings (r = .31 and .28, respectively). The relationship was stronger between the SJT and in-role performance for the low scoring group (r = .33, high scoring group r = .11), and between academic performance and in-role performance for the high scoring group (r = .29, low scoring group r = .11). Trainees with low SJT scores were almost five times more likely to receive remedial action. Results indicate that an SJT for entry into trainee physicians' first role in clinical practice has good predictive validity of supervisor-rated performance and incidence of remedial action. In addition, an SJT and a measure of academic performance appeared to be complementary to each other. These initial findings suggest that SJTs may be more predictive at the lower end of a scoring distribution, and academic attainment more predictive at the higher end.

Validating the short measure of the Effort-Reward Imbalance Questionnaire in older workers in the context of New Zealand

PubMed Central

Li, Jian; Herr, Raphael M.; Allen, Joanne; Stephens, Christine; Alpass, Fiona

2017-01-01

Objectives: The objective of this study was to validate a short version of the Effort-Reward-Imbalance (ERI) questionnaire in the context of New Zealand among older full-time and part-time employees. Methods: Data were collected from 1694 adults aged 48-83 years (mean 60 years, 53% female) who reported being in full- or part-time paid employment in the 2010 wave of the New Zealand Health, Work and Retirement study. Scale reliability was evaluated by item-total correlations and Cronbach's alpha. Factorial validity was assessed using multi-group confirmatory factor analyses assessing nested models of configural, metric, scalar and strict invariance across full- and part-time employment groups. Logistic regressions estimated associations of effort-reward ratio and over-commitment with poor physical/mental health, and depressive symptoms. Results: Internal consistency of ERI scales was high across employment groups: effort 0.78-0.76; reward 0.81-0.77, and over-commitment 0.83-0.80. The three-factor model displayed acceptable fit in the overall sample (X2/df = 10.31; CFI = 0.95; TLI = 0.94; RMSEA = 0.075), and decrements in model fit indices provided evidence for strict invariance of the three-factor ERI model across full-time and part-time employment groups. High effort-reward ratio scores were consistently associated with poor mental health and depressive symptoms for both employment groups. High over-commitment was associated with poor mental health and depressive symptoms in both groups and also with poor physical health in the full-time employment group. Conclusions: The short ERI questionnaire appears to be a valid instrument to assess adverse psychosocial work characteristics in old full-time and part-time employees in New Zealand. PMID:28835574

Comparing the effects of Yasmin® and LD™ (low-dose estrogen) as contraceptive methods on menstrual cycle changes in women referred to the health care centers of Isfahan

PubMed Central

Fathizadeh, Nahid; Bafghi, Raziye Karimain; Boroumandfar, Khadijeh; Savabi, Mitra

2010-01-01

BACKGROUND: One of the biggest problem today that most developing countries are faced with is the uncontrolled population growth; a serious threat to the international community. One of the most accessible contraceptive methods is the hormonal methods in which low-dose estrogen (LD) combined pills are considered as the most common among them. The most important reason for discontinuation of the combination pills is the side effects and following the discontinuation, it can lead to unwanted pregnancy. Promotion of more new methods and providing better methods with lesser side effects can be an important step towards solving some of the problems and increasing the usage percentages of contraceptive methods. This study therefore aimed to compare the effects of Yasmin and LD on menstrual cycle changes. METHODS: In this clinical trial study, 60 women referred to the Family Planning Health Center of Isfahan in 2008 were studied that finally after the sample loss, 27 and 24 samples were placed in Yasmin and LD groups, respectively. A questionnaire was used in order to collect the data. Content validity test and re-test also were used to confirm the validity and reliability of the questionnaire. To analyze the data, SPSS software and descriptive and inferential statistical methods were used. RESULTS: The results of this study indicated that the bleeding rate in the Yasmin group within the next six month compared to taking them before was significantly lower than that in LD group (p = 0.02); but there was no significant difference in terms of menstrual bleeding duration and the two menstruation interval between the two groups (p = 0.2). There was no significant difference between the Yasmin and LD groups in terms of delay in menstruation and dysmenorrheal. Spotting rate significantly was higher in Yasmin group than that in LD group (p = 0.02). There was a significant reduction in terms of bleeding rate changes and menstrual bleeding duration in both Yasmin and LD group at the following next six months in comparison with before the consumption (p < 0.05). CONCLUSIONS: According to the results obtained, the oral combination of Yasmin pills has fewer side effects than LD pills. Therefore, it is recommended to start using Yasmin pill in the family planning units in Iran. PMID:22049290

Hair Measurements of Cortisol, DHEA, and DHEA to Cortisol Ratio as Biomarkers of Chronic Stress among People Living with HIV in China: Known-Group Validation

PubMed Central

Li, Xiaoming; Zilioli, Samuele; Chen, Zheng; Deng, Huihua; Pan, Juxian

2017-01-01

Background Existing literature suggests that endocrine measures, including the steroid hormones of cortisol and Dehydroepiandrosterone (DHEA), as well as the DHEA to cortisol ratio in the human hair can be used as promising biomarkers of chronic stress among humans. However, data are limited regarding the validity of these measures as biomarkers of chronic stress among people living with HIV (PLWH), whose endocrine system or hypothalamic pituitary adrenal (HPA) axis may be affected by HIV infection and/or antiretroviral therapy (ART) medications. Method Using hair sample data and self-reported survey from 60 PLWH in China, we examined the validity of three endocrine measures among Chinese PLWH using a known-groups validation strategy. High-stress group (n = 30) and low-stress group (n = 30) of PLWH were recruited through individual assessment interviews by a local licensed psychologist. The endocrine measures in hair were extracted and assessed by LC-APCI-MS/MS method. Both bivariate and multivariate analyses were conducted to examine the associations between the endocrine measures and the stress level, and to investigate if the associations differ by ART status. Results The levels of endocrine measures among Chinese PLWH were consistent with existing studies among PLWH. Generally, this pilot study confirmed the association between endocrine measures and chronic stress. The high stress group showed higher level hair cortisol and lower DHEA to cortisol ratio. The higher stress group also reported higher scores of stressful life events, perceived stress, anxiety and depression. Hair cortisol level was positively related to anxiety; DHEA was negatively associated with stressful life events; and the DHEA to cortisol ratio was positively related to stressful life events and perceived stress. ART did not affect the associations between the endocrine measures and stress level. Conclusions Our findings suggest that hair cortisol and DHEA to cortisol ratio can be used as promising biomarkers of chronic stress among PLWH. Clarifying the role of steroid hormones in the psychoimmunology of PLWH may yield important implications for clinical practice and psychological intervention. PMID:28095431

A reliability and validity study of the Palliative Performance Scale

PubMed Central

Ho, Francis; Lau, Francis; Downing, Michael G; Lesperance, Mary

2008-01-01

Background The Palliative Performance Scale (PPS) was first introduced in1996 as a new tool for measurement of performance status in palliative care. PPS has been used in many countries and has been translated into other languages. Methods This study evaluated the reliability and validity of PPS. A web-based, case scenarios study with a test-retest format was used to determine reliability. Fifty-three participants were recruited and randomly divided into two groups, each evaluating 11 cases at two time points. The validity study was based on the content validation of 15 palliative care experts conducted over telephone interviews, with discussion on five themes: PPS as clinical assessment tool, the usefulness of PPS, PPS scores affecting decision making, the problems in using PPS, and the adequacy of PPS instruction. Results The intraclass correlation coefficients for absolute agreement were 0.959 and 0.964 for Group 1, at Time-1 and Time-2; 0.951 and 0.931 for Group 2, at Time-1 and Time-2 respectively. Results showed that the participants were consistent in their scoring over the two times, with a mean Cohen's kappa of 0.67 for Group 1 and 0.71 for Group 2. In the validity study, all experts agreed that PPS is a valuable clinical assessment tool in palliative care. Many of them have already incorporated PPS as part of their practice standard. Conclusion The results of the reliability study demonstrated that PPS is a reliable tool. The validity study found that most experts did not feel a need to further modify PPS and, only two experts requested that some performance status measures be defined more clearly. Areas of PPS use include prognostication, disease monitoring, care planning, hospital resource allocation, clinical teaching and research. PPS is also a good communication tool between palliative care workers. PMID:18680590

Validation of the Activities of Community Transportation model for individuals with cognitive impairments.

PubMed

Sohlberg, McKay Moore; Fickas, Stephen; Lemoncello, Rik; Hung, Pei-Fang

2009-01-01

To develop a theoretical, functional model of community navigation for individuals with cognitive impairments: the Activities of Community Transportation (ACTs). Iterative design using qualitative methods (i.e. document review, focus groups and observations). Four agencies providing travel training to adults with cognitive impairments in the USA participated in the validation study. A thorough document review and series of focus groups led to the development of a comprehensive model (ACTs Wheels) delineating the requisite steps and skills for community navigation. The model was validated and updated based on observations of 395 actual trips by travellers with navigational challenges from the four participating agencies. Results revealed that the 'ACTs Wheel' models were complete and comprehensive. The 'ACTs Wheels' represent a comprehensive model of the steps needed to navigate to destinations using paratransit and fixed-route public transportation systems for travellers with cognitive impairments. Suggestions are made for future investigations of community transportation for this population.

Measuring Implementation Fidelity in a Community-Based Parenting Intervention

PubMed Central

Breitenstein, Susan M.; Fogg, Louis; Garvey, Christine; Hill, Carri; Resnick, Barbara; Gross, Deborah

2012-01-01

Background Establishing the feasibility and validity of implementation fidelity monitoring strategies is an important methodological step in implementing evidence-based interventions on a large scale. Objectives The objective of the study was to examine the reliability and validity of the Fidelity Checklist, a measure designed to assess group leader adherence and competence delivering a parent training intervention (the Chicago Parent Program) in child care centers serving low-income families. Method The sample included 9 parent groups (12 group sessions each), 12 group leaders, and 103 parents. Independent raters reviewed 106 audiotaped parent group sessions and coded group leaders’ fidelity on the Adherence and Competence Scales of the Fidelity Checklist. Group leaders completed self-report adherence checklists and a measure of parent engagement in the intervention. Parents completed measures of consumer satisfaction and child behavior. Results High interrater agreement (Adherence Scale = 94%, Competence Scale = 85%) and adequate intraclass correlation coefficients (Adherence Scale = .69, Competence Scale = .91) were achieved for the Fidelity Checklist. Group leader adherence changed over time, but competence remained stable. Agreement between group leader self-report and independent ratings on the Adherence Scale was 85%; disagreements were more frequently due to positive bias in group leader self-report. Positive correlations were found between group leader adherence and parent attendance and engagement in the intervention and between group leader competence and parent satisfaction. Although child behavior problems improved, improvements were not related to fidelity. Discussion The results suggest that the Fidelity Checklist is a feasible, reliable, and valid measure of group leader implementation fidelity in a group-based parenting intervention. Future research will be focused on testing the Fidelity Checklist with diverse and larger samples and generalizing to other group-based interventions using a similar intervention model. PMID:20404777

Triacylglycerol stereospecific analysis and linear discriminant analysis for milk speciation.

PubMed

Blasi, Francesca; Lombardi, Germana; Damiani, Pietro; Simonetti, Maria Stella; Giua, Laura; Cossignani, Lina

2013-05-01

Product authenticity is an important topic in dairy sector. Dairy products sold for public consumption must be accurately labelled in accordance with the contained milk species. Linear discriminant analysis (LDA), a common chemometric procedure, has been applied to fatty acid% composition to classify pure milk samples (cow, ewe, buffalo, donkey, goat). All original grouped cases were correctly classified, while 90% of cross-validated grouped cases were correctly classified. Another objective of this research was the characterisation of cow-ewe milk mixtures in order to reveal a common fraud in dairy field, that is the addition of cow to ewe milk. Stereospecific analysis of triacylglycerols (TAG), a method based on chemical-enzymatic procedures coupled with chromatographic techniques, has been carried out to detect fraudulent milk additions, in particular 1, 3, 5% cow milk added to ewe milk. When only TAG composition data were used for the elaboration, 75% of original grouped cases were correctly classified, while totally correct classified samples were obtained when both total and intrapositional TAG data were used. Also the results of cross validation were better when TAG stereospecific analysis data were considered as LDA variables. In particular, 100% of cross-validated grouped cases were obtained when 5% cow milk mixtures were considered.

Multiplex PCR method for use in real-time PCR for identification of fish fillets from grouper (Epinephelus and Mycteroperca species) and common substitute species.

PubMed

Trotta, Michele; Schönhuth, Susana; Pepe, Tiziana; Cortesi, M Luisa; Puyet, Antonio; Bautista, José M

2005-03-23

Mitochondrial 16S rRNA sequences from morphological validated grouper (Epinephelus aeneus, E. caninus, E. costae, and E. marginatus; Mycteroperca fusca and M. rubra), Nile perch (Lates niloticus), and wreck fish (Polyprion americanus) were used to develop an analytical system for group diagnosis based on two alternative Polymerase Chain Reaction (PCR) approaches. The first includes conventional multiplex PCR in which electrophoretic migration of different sizes of bands allowed identification of the fish species. The second approach, involving real-time PCR, produced a single amplicon from each species that showed different Tm values allowing the fish groups to be directly identified. Real-time PCR allows the quick differential diagnosis of the three groups of species and high-throughput screening of multiple samples. Neither PCR system cross-reacted with DNA samples from 41 common marketed fish species, thus conforming to standards for species validation. The use of these two PCR-based methods makes it now possible to discriminate grouper from substitute fish species.

Safe surgery: validation of pre and postoperative checklists 1

PubMed Central

Alpendre, Francine Taporosky; Cruz, Elaine Drehmer de Almeida; Dyniewicz, Ana Maria; Mantovani, Maria de Fátima; Silva, Ana Elisa Bauer de Camargo e; dos Santos, Gabriela de Souza

2017-01-01

ABSTRACT Objective: to develop, evaluate and validate a surgical safety checklist for patients in the pre and postoperative periods in surgical hospitalization units. Method: methodological research carried out in a large public teaching hospital in the South of Brazil, with application of the principles of the Safe Surgery Saves Lives Programme of the World Health Organization. The checklist was applied to 16 nurses of 8 surgical units and submitted for validation by a group of eight experts using the Delphi method online. Results: the instrument was validated and it was achieved a mean score ≥1, level of agreement ≥75% and Cronbach’s alpha >0.90. The final version included 97 safety indicators organized into six categories: identification, preoperative, immediate postoperative, immediate postoperative, other surgical complications, and hospital discharge. Conclusion: the Surgical Safety Checklist in the Pre and Postoperative periods is another strategy to promote patient safety, as it allows the monitoring of predictive signs and symptoms of surgical complications and the early detection of adverse events. PMID:28699994

Evaluation of methyl methanesulfonate, 2,6-diaminotoluene and 5-fluorouracil: Part of the Japanese center for the validation of alternative methods (JaCVAM) international validation study of the in vivo rat alkaline comet assay.

PubMed

Plappert-Helbig, Ulla; Junker-Walker, Ursula; Martus, Hans-Joerg

2015-07-01

As a part of the Japanese Center for the Validation of Alternative Methods (JaCVAM)-initiative international validation study of the in vivo rat alkaline comet assay (comet assay), we examined methyl methanesulfonate, 2,6-diaminotoluene, and 5-fluorouracil under coded test conditions. Rats were treated orally with the maximum tolerated dose (MTD) and two additional descending doses of the respective compounds. In the MMS treated groups liver and stomach showed significantly elevated DNA damage at each dose level and a significant dose-response relationship. 2,6-diaminotoluene induced significantly elevated DNA damage in the liver at each dose and a statistically significant dose-response relationship whereas no DNA damage was obtained in the stomach. 5-fluorouracil did not induce DNA damage in either liver or stomach. Copyright © 2015 Elsevier B.V. All rights reserved.

Development and validation of a questionnaire to evaluate infection control in oral radiology.

PubMed

da Costa, Eliana D; Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-04-01

To create and validate a questionnaire to evaluate infection control in oral radiology. The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test-retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722-1.000) and good to great for the yes/no questions (kappa = 0.662-0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology.

Item Development and Validity Testing for a Self- and Proxy Report: The Safe Driving Behavior Measure

PubMed Central

Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.

2010-01-01

OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917

Validity and reproducibility of cephalometric measurements obtained from digital photographs of analogue headfilms.

PubMed

Grybauskas, Simonas; Balciuniene, Irena; Vetra, Janis

2007-01-01

The emerging market of digital cephalographs and computerized cephalometry is overwhelming the need to examine the advantages and drawbacks of manual cephalometry, meanwhile, small offices continue to benefit from the economic efficacy and ease of use of analogue cephalograms. The use of modern cephalometric software requires import of digital cephalograms or digital capture of analogue data: scanning and digital photography. The validity of digital photographs of analogue headfilms rather than original headfilms in clinical practice has not been well established. Digital photography could be a fast and inexpensive method of digital capture of analogue cephalograms for use in digital cephalometry. The objective of this study was to determine the validity and reproducibility of measurements obtained from digital photographs of analogue headfilms in lateral cephalometry. Analogue cephalometric radiographs were performed on 15 human dry skulls. Each of them was traced on acetate paper and photographed three times independently. Acetate tracings and digital photographs were digitized and analyzed in cephalometric software. Linear regression model, paired t-test intergroup analysis and coefficient of repeatability were used to assess validity and reproducibility for 63 angular, linear and derivative measurements. 54 out of 63 measurements were determined to have clinically acceptable reproducibility in the acetate tracing group as well as 46 out of 63 in the digital photography group. The worst reproducibility was determined for measurements dependent on landmarks of incisors and poorly defined outlines, majority of them being angular measurements. Validity was acceptable for all measurements, and although statistically significant differences between methods existed for as many as 15 parameters, they appeared to be clinically insignificant being smaller than 1 unit of measurement. Validity was acceptable for 59 of 63 measurements obtained from digital photographs, substantiating the use of digital photography for headfilm capture and computer-aided cephalometric analysis.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults

PubMed Central

Perez-Rodriguez, Roberto; Facal, David; Fernandez-Iglesias, Manuel J.; Anido-Rifon, Luis; Mouriño-Garcia, Marcos

2017-01-01

Introduction Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors. Materials and Methods Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal. Results A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game’s usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests. Limitations Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game. Conclusion Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer’s disease. PMID:28674661

Participation of Brazil in the World Congresses on Alternatives and Animal Use in the Life Sciences: an increase in commitment to the Three Rs.

PubMed

Presgrave, Octavio; Caldeira, Cristiane; Moura, Wlamir; Cruz, Mayara; Méier, Gisele; Dos Santos, Elisabete; Boas, Maria H V

2015-03-01

Many Brazilian researchers have long been interested in the development and use of alternative methods. Most of their research groups work in isolation, due to the lack of funding for collaborative studies. Despite these problems, since the Third World Congress on Alternatives and Animal Use in the Life Sciences, Brazilian researchers have strongly participated, not only by presenting posters and oral presentations, but also by being involved in the World Congress Committees. The Brazilian Center for the Validation of Alternative Methods (BraCVAM) must play an important role in the development and validation of alternative methods, through the active participation of the National Network of Alternative Methods (ReNaMA). In Brazil, Law 11,794/2008 regulates the use of animals in experimentation and education, and Law 9,605/1998 clearly states that use of the original animal test is not permitted, if an alternative method is available. Therefore, given the current legal framework, it is very important that all the Ministries involved with animal use, and the organisations responsible for funding researchers, strive to increase the financial support of those groups that are involved in the development and use of alternative methods in Brazil. 2015 FRAME.

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

3D-QSAR studies on the inhibitory activity of trimethoprim analogues against Escherichia coli dihydrofolate reductase.

PubMed

Vijayaraj, Ramadoss; Devi, Mekapothula Lakshmi Vasavi; Subramanian, Venkatesan; Chattaraj, Pratim Kumar

2012-06-01

Three-dimensional quantitative structure activity relationship (3D-QSAR) study has been carried out on the Escherichia coli DHFR inhibitors 2,4-diamino-5-(substituted-benzyl)pyrimidine derivatives to understand the structural features responsible for the improved potency. To construct highly predictive 3D-QSAR models, comparative molecular field analysis (CoMFA) and comparative molecular similarity indices analysis (CoMSIA) methods were used. The predicted models show statistically significant cross-validated and non-cross-validated correlation coefficient of r2 CV and r2 nCV, respectively. The final 3D-QSAR models were validated using structurally diverse test set compounds. Analysis of the contour maps generated from CoMFA and CoMSIA methods reveals that the substitution of electronegative groups at the first and second position along with electropositive group at the third position of R2 substitution significantly increases the potency of the derivatives. The results obtained from the CoMFA and CoMSIA study delineate the substituents on the trimethoprim analogues responsible for the enhanced potency and also provide valuable directions for the design of new trimethoprim analogues with improved affinity. © 2012 John Wiley & Sons A/S.

Development, Validation, and Application of a Novel Ligand-Binding Assay to Selectively Measure PEGylated Recombinant Human Coagulation Factor VIII (BAX 855).

PubMed

Weber, Alfred; Engelmaier, Andrea; Hainzelmayer, Sandra; Minibeck, Eva; Anderle, Heinz; Schwarz, Hans Peter; Turecek, Peter L

2015-10-21

BAX 855 is a PEGylated recombinant factor VIII preparation that showed prolonged circulatory half-life in nonclinical and clinical studies. This paper describes the development, validation, and application of a novel ligand-binding assay (LBA) to selectively measure BAX 855 in plasma. The LBA is based on PEG-specific capture of BAX 855, followed by immunological factor VIII (FVIII)-specific detection of the antibody-bound BAX 855. This assay principle enabled sensitive measurement of BAX 855 down to the low nanomolar range without interference from non-PEGylated FVIII as demonstrated by validation data for plasma from animals typically used for nonclinical characterization of FVIII. The selectivity of an in-house-developed anti-PEG and a commercially available preparation, shown by competition studies to primarily target the terminating methoxy group of PEG, also allowed assessment of the intactness of the attached PEG chains. Altogether, this new LBA adds to the group of methods to selectively, accurately, and precisely measure a PEGylated drug in complex biological matrices. The feasibility and convenience of using this method was demonstrated during extensive nonclinical characterization of BAX 855.

Focus-on-form instructional methods promote deaf college students' improvement in English grammar.

PubMed

Berent, Gerald P; Kelly, Ronald R; Aldersley, Stephen; Schmitz, Kathryn L; Khalsa, Baldev Kaur; Panara, John; Keenan, Susan

2007-01-01

Focus-on-form English teaching methods are designed to facilitate second-language learners' noticing of target language input, where "noticing" is an acquisitional prerequisite for the comprehension, processing, and eventual integration of new grammatical knowledge. While primarily designed for teaching hearing second-language learners, many focus-on-form methods lend themselves to visual presentation. This article reports the results of classroom research on the visually based implementation of focus-on-form methods with deaf college students learning English. Two of 3 groups of deaf students received focus-on-form instruction during a 10-week remedial grammar course; a third control group received grammatical instruction that did not involve focus-on-form methods. The 2 experimental groups exhibited significantly greater improvement in English grammatical knowledge relative to the control group. These results validate the efficacy of visually based focus-on-form English instruction for deaf students of English and set the stage for the continual search for innovative and effective English teaching methodologies.

Validity of Computer Adaptive Tests of Daily Routines for Youth with Spinal Cord Injury

PubMed Central

Haley, Stephen M.

2013-01-01

Objective: To evaluate the accuracy of computer adaptive tests (CATs) of daily routines for child- and parent-reported outcomes following pediatric spinal cord injury (SCI) and to evaluate the validity of the scales. Methods: One hundred ninety-six daily routine items were administered to 381 youths and 322 parents. Pearson correlations, intraclass correlation coefficients (ICC), and 95% confidence intervals (CI) were calculated to evaluate the accuracy of simulated 5-item, 10-item, and 15-item CATs against the full-item banks and to evaluate concurrent validity. Independent samples t tests and analysis of variance were used to evaluate the ability of the daily routine scales to discriminate between children with tetraplegia and paraplegia and among 5 motor groups. Results: ICC and 95% CI demonstrated that simulated 5-, 10-, and 15-item CATs accurately represented the full-item banks for both child- and parent-report scales. The daily routine scales demonstrated discriminative validity, except between 2 motor groups of children with paraplegia. Concurrent validity of the daily routine scales was demonstrated through significant relationships with the FIM scores. Conclusion: Child- and parent-reported outcomes of daily routines can be obtained using CATs with the same relative precision of a full-item bank. Five-item, 10-item, and 15-item CATs have discriminative and concurrent validity. PMID:23671380

The City of Hope-Quality of Life-Ostomy Questionnaire: Persian Translation and Validation

PubMed Central

Anaraki, F; Vafaie, M; Behboo, R; Esmaeilpour, S; Maghsoodi, N; Safaee, A; Grant, M

2014-01-01

Background: Since there is no disease-specific instrument for measuring quality-of-life (QOL) in Ostomy patients in Persian language. Aim: This study was designed to translate and evaluate the validity and reliability of City of Hope-quality of life-Ostomy questionnaire (COH-QOL-Ostomy questionnaire). Subjects and Methods: This study was designed as cross-sectional study. Reliability of the subscales and the summary scores were demonstrated by intra-class correlation coefficients. Pearson's correlations of an item with its own scale and other scales were calculated to evaluated convergent and discriminant validity. Clinical validity was also evaluated by known-group comparisons. Results: Cronbach's alpha coefficient for all subscales was about 0.70 or higher. Results of interscale correlation were satisfactory and each subscale only measured a single and specified trait. All subscales met the standards of convergent and discriminant validity. Known group comparison analysis showed significant differences in social and spiritual well-being. Conclusion: The findings confirmed the reliability and validity of Persian version of COH-QOL-Ostomy questionnaire. The instrument was also well received by the Iranian patients. It can be considered as a valuable instrument to assess the different aspects of health related quality-of-life in Ostomy patients and used in clinical research in the future. PMID:25221719

Adaptation and validation of indicators concerning the sterilization process of supplies in Primary Health Care services.

PubMed

Passos, Isis Pienta Batista Dias; Padoveze, Maria Clara; Roseira, Camila Eugênia; de Figueiredo, Rosely Moralez

2015-01-01

to adapt and validate, by expert consensus, a set of indicators used to assess the sterilization process of dental, medical and hospital supplies to be used in PHC services. qualitative methodological study performed in two stages. The first stage included a focal group composed of experts to adapt the indicators to be used in PHC. In the second stage, the indicators were validated using a 4-point Likert scale, which was completed by judges. A Content Validity Index of ≥ 0.75 was considered to show approval of the indicators. the adaptations implemented by the focal group mainly referred to the physical structure, inclusion of dental care professionals, inclusion of chemical disinfection, and replacement of the hot air and moist heat sterilization methods. The validation stage resulted in an index of 0.96, which ranged from 0.90 to 1.00, for the components of the indicators. the judges considered the indicators after adaptation to be validated. Even though there may be differences among items processed around the world, there certainly are common characteristics, especially in countries with economic and cultural environments similar to Brazil. The inclusion of these indicators to assess the safety of healthcare supplies used in PHC services should be considered.

Development and Validity of Western University's On-Road Assessment.

PubMed

Classen, Sherrilene; Krasniuk, Sarah; Alvarez, Liliana; Monahan, Miriam; Morrow, Sarah A; Danter, Tim

2017-01-01

Although used across North America, many on-road studies do not explicitly document the content and metrics of on-road courses and accompanying assessments. This article discusses the development of the University of Western Ontario's on-road course, and elucidates the validity of its accompanying on-road assessment. We identified main components for developing an on-road course and used measurement theory to establish face, content, and initial construct validity. Five adult volunteer drivers and 30 drivers with multiple sclerosis participated in the study. The road course had face and content validity, representing 100% of roadway components determined through a content validity matrix and index. The known-groups method showed that debilitated drivers (vs. not debilitated), made more driving errors ( W = 463.50, p = .03), and failed the on-road course, indicating preliminary construct validity of the on-road assessment. This research guides and empirically supports a process for developing a road course and its assessment.

Development and Validation of Videotaped Scenarios

PubMed Central

Noel, Nora E.; Maisto, Stephen A.; Johnson, James D.; Jackson, Lee A.; Goings, Christopher D.; Hagman, Brett T.

2013-01-01

Researchers using scenarios often neglect to validate perceived content and salience of embedded stimuli specifically with intended participants, even when such meaning is integral to the study. For example, sex and aggression stimuli are heavily influenced by culture, so participants may not perceive what researchers intended in sexual aggression scenarios. Using four studies, the authors describe the method of scenario validation to produce two videos assessing alcohol-related sexual aggression. Both videos are identical except for the presence in one video of antiforce cues that are extremely salient to the young heterosexual men. Focus groups and questionnaires validate these men's perceptions that (a) the woman was sexually interested, (b) the sexual cues were salient, (c) the antiforce cues were salient (antiaggression video only), and (e) these antiforce cues inhibited acceptance of forced sex. Results show the value of carefully selecting and validating content when assessing socially volatile variables and provide a useful template for developing culturally valid scenarios. PMID:18252938

Social Identity Mapping: A procedure for visual representation and assessment of subjective multiple group memberships.

PubMed

Cruwys, Tegan; Steffens, Niklas K; Haslam, S Alexander; Haslam, Catherine; Jetten, Jolanda; Dingle, Genevieve A

2016-12-01

In this research, we introduce Social Identity Mapping (SIM) as a method for visually representing and assessing a person's subjective network of group memberships. To provide evidence of its utility, we report validating data from three studies (two longitudinal), involving student, community, and clinical samples, together comprising over 400 participants. Results indicate that SIM is easy to use, internally consistent, with good convergent and discriminant validity. Each study also illustrates the ways that SIM can be used to address a range of novel research questions. Study 1 shows that multiple positive group memberships are a particularly powerful predictor of well-being. Study 2 shows that social support is primarily given and received within social groups and that only in-group support is beneficial for well-being. Study 3 shows that improved mental health following a social group intervention is attributable to an increase in group compatibility. In this way, the studies demonstrate the capacity for SIM to make a contribution both to the development of social-psychological theory and to its practical application. © 2016 The British Psychological Society.

Validity and relative validity of a novel digital approach for 24-h dietary recall in athletes.

PubMed

Baker, Lindsay B; Heaton, Lisa E; Stein, Kimberly W; Nuccio, Ryan P; Jeukendrup, Asker E

2014-04-30

We developed a digital dietary analysis tool for athletes (DATA) using a modified 24-h recall method and an integrated, customized nutrient database. The purpose of this study was to assess DATA's validity and relative validity by measuring its agreement with registered dietitians' (RDs) direct observations (OBSERVATION) and 24-h dietary recall interviews using the USDA 5-step multiple-pass method (INTERVIEW), respectively. Fifty-six athletes (14-20 y) completed DATA and INTERVIEW in randomized counter-balanced order. OBSERVATION (n = 26) consisted of RDs recording participants' food/drink intake in a 24-h period and were completed the day prior to DATA and INTERVIEW. Agreement among methods was estimated using a repeated measures t-test and Bland-Altman analysis. The paired differences (with 95% confidence intervals) between DATA and OBSERVATION were not significant for carbohydrate (10.1%, -1.2-22.7%) and protein (14.1%, -3.2-34.5%) but was significant for energy (14.4%, 1.2-29.3%). There were no differences between DATA and INTERVIEW for energy (-1.1%, -9.1-7.7%), carbohydrate (0.2%, -7.1-8.0%) or protein (-2.7%, -11.3-6.7%). Bland-Altman analysis indicated significant positive correlations between absolute values of the differences and the means for OBSERVATION vs. DATA (r = 0.40 and r = 0.47 for energy and carbohydrate, respectively) and INTERVIEW vs. DATA (r = 0.52, r = 0.29, and r = 0.61 for energy, carbohydrate, and protein, respectively). There were also wide 95% limits of agreement (LOA) for most method comparisons. The mean bias ratio (with 95% LOA) for OBSERVATION vs. DATA was 0.874 (0.551-1.385) for energy, 0.906 (0.522-1.575) for carbohydrate, and 0.895(0.395-2.031) for protein. The mean bias ratio (with 95% LOA) for INTERVIEW vs. DATA was 1.016 (0.538-1.919) for energy, 0.995 (0.563-1.757) for carbohydrate, and 1.031 (0.514-2.068) for protein. DATA has good relative validity for group-level comparisons in athletes. However, there are large variations in the relative validity of individuals' dietary intake estimates from DATA, particularly in athletes with higher energy and nutrient intakes. DATA can be a useful athlete-specific, digital alternative to conventional 24-h dietary recall methods at the group level. Further development and testing is needed to improve DATA's validity for estimations of individual dietary intakes.

A Spanish Validation of the Canadian Adolescent Gambling Inventory (CAGI).

PubMed

Jiménez-Murcia, Susana; Granero, Roser; Stinchfield, Randy; Tremblay, Joël; Del Pino-Gutiérrez, Amparo; Moragas, Laura; Savvidou, Lamprini G; Fernández-Aranda, Fernando; Aymamí, Neus; Gómez-Peña, Mónica; Tárrega, Salomé; Gunnard, Katarina; Martín-Romera, Virginia; Steward, Trevor; Mestre-Bach, Gemma; Menchón, José M

2017-01-01

Aims: Large-scale epidemiological studies show a significant prevalence of gambling disorder (GD) during adolescence and emerging adulthood, and highlight the need to identify gambling-related behaviors at early ages. However, there are only a handful of screening instruments for this population and many studies measuring youth gambling problems use adult instruments that may not be developmentally appropriate. The aim of this study was to validate a Spanish version of the Canadian Adolescent Gambling Inventory (CAGI) among late adolescent and young adults and to explore its psychometric properties. Methods: The sample (16-29 years old) included a clinical group ( n = 55) with GD patients and a control group ( n = 340). Results: Exploratory factor analysis yielded one factor as the best model. This 24-item scale demonstrated satisfactory reliability (internal consistency, Cronbach's alpha, α = 0.91), satisfactory convergent validity as measured by correlation with South Oaks Gambling Screen ( r = 0.74), and excellent classification accuracy (AUC = 0.99; sensitivity = 0.98; and specificity = 0.99). Conclusion: Our results provide empirical support for our validation of the Spanish version of the CAGI. We uphold that the Spanish CAGI can be used as a brief, reliable, and valid instrument to assess gambling problems in Spanish youth.

Validation of the tool assessment of clinical education (AssCE): A study using Delphi method and clinical experts.

PubMed

Löfmark, Anna; Mårtensson, Gunilla

2017-03-01

The aim of the present study was to establish the validity of the tool Assessment of Clinical Education (AssCE). The tool is widely used in Sweden and some Nordic countries for assessing nursing students' performance in clinical education. It is important that the tools in use be subjected to regular audit and critical reviews. The validation process, performed in two stages, was concluded with a high level of congruence. In the first stage, Delphi technique was used to elaborate the AssCE tool using a group of 35 clinical nurse lecturers. After three rounds, we reached consensus. In the second stage, a group of 46 clinical nurse lecturers representing 12 universities in Sweden and Norway audited the revised version of the AssCE in relation to learning outcomes from the last clinical course at their respective institutions. Validation of the revised AssCE was established with high congruence between the factors in the AssCE and examined learning outcomes. The revised AssCE tool seems to meet its objective to be a validated assessment tool for use in clinical nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Comparing 2 Adhesive Methods on Skin Integrity in the High-Risk Neonate.

PubMed

Boswell, Nicole; Waker, Cheryl L

2016-12-01

Nurses have a primary role in promoting neonatal skin integrity and skin care management of the critically ill neonate. Adhesive products are essential to secure needed medical devices but can be a significant factor contributing to skin breakdown. Current literature does not offer a definitive answer regarding which products most safely and effectively work to secure needed devices in the high-risk neonatal population. To determine which adhesive method is best practice to safely and effectively secure lines/tubes in the high-risk neonate population. The only main effect that was significant was age group with mean skin scores. Subjects in the younger group (24-28 weeks) had higher skin scores than in the older group (28-34 weeks), validating that younger gestations are at higher risk of breakdown with the use of adhesives. The findings did not clearly identify which product was superior to secure tubes and lines, or was the least injurious to skin of the high-risk neonate. Neither a transparent dressing only or transparent dressing over hydrocolloid method clearly demonstrated an advantage in the high-risk, preterm neonate. Anecdotal comments suggested staff preferred the transparent dressing over hydrocolloid method as providing better adhesive while protecting skin integrity. The findings validated that younger gestations are at higher risk of breakdown with the use of adhesives and therefore require close vigilance to maintain skin integrity.

Exploring rationality in schizophrenia

PubMed Central

Mortensen, Erik Lykke; Owen, Gareth; Nordgaard, Julie; Jansson, Lennart; Sæbye, Ditte; Flensborg-Madsen, Trine; Parnas, Josef

2015-01-01

Background Empirical studies of rationality (syllogisms) in patients with schizophrenia have obtained different results. One study found that patients reason more logically if the syllogism is presented through an unusual content. Aims To explore syllogism-based rationality in schizophrenia. Method Thirty-eight first-admitted patients with schizophrenia and 38 healthy controls solved 29 syllogisms that varied in presentation content (ordinary v. unusual) and validity (valid v. invalid). Statistical tests were made of unadjusted and adjusted group differences in models adjusting for intelligence and neuropsychological test performance. Results Controls outperformed patients on all syllogism types, but the difference between the two groups was only significant for valid syllogisms presented with unusual content. However, when adjusting for intelligence and neuropsychological test performance, all group differences became non-significant. Conclusions When taking intelligence and neuropsychological performance into account, patients with schizophrenia and controls perform similarly on syllogism tests of rationality. Declaration of interest None. Copyright and usage © The Royal College of Psychiatrists 2015. This is an open access article distributed under the terms of the Creative Commons Non-Commercial, No Derivatives (CC BY-NC-ND) licence. PMID:27703730

Effect of gemfibrozil on the pharmacokinetics of mitiglinide in rats.

PubMed

Jin, L; Cao, Q

2012-01-01

A sensitive and specific method was developed and validated for the determination of mitiglinide in plasma using LC-MS/MS. The effect of gemfibrozil on the pharmacokinetics of orally administered mitiglinide in rats was investigated. The validated method in positive electrospray ionization mode using MRM and fully validated according to commonly accepted criteria. The desired sensitivity of mitiglinide was achieved with an LOQ of 0.5 ng/mL and the short run time was suitable for analysis of the large batches of samples. The method was successfully used to analyze rats plasma samples for application in pharmacokinetic studies. Pharmacokinetic parameters of mitiglinide were determined in rats following oral (0.25, 0.5, 1 mg/kg) administration to rats in the presence and absence of gemfibrozil (1 mg/kg). Compared to those animals in an oral control group (given mitiglinide alone), the area under the plasma concentration-time curve (AUC) of mitiglinide were increased significantly by 2.8, 3.5, 4.1-fold (0.25, 0.5, 1 mg/kg) by gemfibrozil, respectively. Consequently, the bioavailability of mitiglinide in the presence of gemfibrozil was significantly enhanced compared to that in oral control group (only mitiglinide). Gemfibrozil significantly enhanced the oral bioavailability of mitiglinide, suggesting that concurrent use of gemfibrozil and mitiglinide should be monitored closely for potential drug interactions. © Georg Thieme Verlag KG Stuttgart · New York.

Measuring treatment satisfaction in MS: Is the Treatment Satisfaction Questionnaire for Medication fit for purpose?

PubMed

Vermersch, Patrick; Hobart, Jeremy; Dive-Pouletty, Catherine; Bozzi, Sylvie; Hass, Steven; Coyle, Patricia K

2017-04-01

The Treatment Satisfaction Questionnaire for Medication (TSQM) was designed to assess patient treatment satisfaction in chronic diseases. Its performance has not been examined in multiple sclerosis (MS). The 14 items of the TSQM cover four domains: Effectiveness, Side Effects, Convenience, and Global Satisfaction. To evaluate performance of the TSQM in patients with relapsing MS, using data collected from the TENERE study (NCT00883337), in which 324 patients received oral teriflunomide or subcutaneous interferon beta-1a for ⩾48 weeks. Five measurement properties were examined using traditional psychometric methods: data completeness, scale-to-sample targeting, scaling assumptions, reliability (including test-retest), and construct validity (internal: item-level scaling success, confirmatory factor analysis, and exploratory factor analysis; external: convergence, discrimination, and group differences). There were few (<2%) missing item data; domain scores could be computed for all patients. Score distributions were skewed toward higher satisfaction; two domains had marked ceiling effects. Scaling assumptions were supported. Internal consistency reliability was high (Cronbach's α > 0.90). Internal validity tests supported item groupings. Correlations supported convergent and discriminant construct validity; hypothesis testing supported group differences validity. This investigation found the TSQM to be a useful tool, exhibiting good psychometric measurement properties in patients with relapsing MS in the TENERE study.

How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards

PubMed Central

Rooney, Andrew A.; Cooper, Glinda S.; Jahnke, Gloria D.; Lam, Juleen; Morgan, Rebecca L.; Boyles, Abee L.; Ratcliffe, Jennifer M.; Kraft, Andrew D.; Schünemann, Holger J.; Schwingl, Pamela; Walker, Teneille D.; Thayer, Kristina A.; Lunn, Ruth M.

2016-01-01

Environmental health hazard assessments are routinely relied upon for public health decision-making. The evidence base used in these assessments is typically developed from a collection of diverse sources of information of varying quality. It is critical that literature-based evaluations consider the credibility of individual studies used to reach conclusions through consistent, transparent and accepted methods. Systematic review procedures address study credibility by assessing internal validity or “risk of bias” — the assessment of whether the design and conduct of a study compromised the credibility of the link between exposure/intervention and outcome. This paper describes the commonalities and differences in risk-of-bias methods developed or used by five groups that conduct or provide methodological input for performing environmental health hazard assessments: the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group, the Navigation Guide, the National Toxicology Program’s (NTP) Office of Health Assessment and Translation (OHAT) and Office of the Report on Carcinogens (ORoC), and the Integrated Risk Information System of the U.S. Environmental Protection Agency (EPA-IRIS). Each of these groups have been developing and applying rigorous assessment methods for integrating across a heterogeneous collection of human and animal studies to inform conclusions on potential environmental health hazards. There is substantial consistency across the groups in the consideration of risk-of-bias issues or “domains” for assessing observational human studies. There is a similar overlap in terms of domains addressed for animal studies; however, the groups differ in the relative emphasis placed on different aspects of risk of bias. Future directions for the continued harmonization and improvement of these methods are also discussed. PMID:26857180

How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards.

PubMed

Rooney, Andrew A; Cooper, Glinda S; Jahnke, Gloria D; Lam, Juleen; Morgan, Rebecca L; Boyles, Abee L; Ratcliffe, Jennifer M; Kraft, Andrew D; Schünemann, Holger J; Schwingl, Pamela; Walker, Teneille D; Thayer, Kristina A; Lunn, Ruth M

2016-01-01

Environmental health hazard assessments are routinely relied upon for public health decision-making. The evidence base used in these assessments is typically developed from a collection of diverse sources of information of varying quality. It is critical that literature-based evaluations consider the credibility of individual studies used to reach conclusions through consistent, transparent and accepted methods. Systematic review procedures address study credibility by assessing internal validity or "risk of bias" - the assessment of whether the design and conduct of a study compromised the credibility of the link between exposure/intervention and outcome. This paper describes the commonalities and differences in risk-of-bias methods developed or used by five groups that conduct or provide methodological input for performing environmental health hazard assessments: the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group, the Navigation Guide, the National Toxicology Program's (NTP) Office of Health Assessment and Translation (OHAT) and Office of the Report on Carcinogens (ORoC), and the Integrated Risk Information System of the U.S. Environmental Protection Agency (EPA-IRIS). Each of these groups have been developing and applying rigorous assessment methods for integrating across a heterogeneous collection of human and animal studies to inform conclusions on potential environmental health hazards. There is substantial consistency across the groups in the consideration of risk-of-bias issues or "domains" for assessing observational human studies. There is a similar overlap in terms of domains addressed for animal studies; however, the groups differ in the relative emphasis placed on different aspects of risk of bias. Future directions for the continued harmonization and improvement of these methods are also discussed. Published by Elsevier Ltd.

Evidence-Based Toxicology.

PubMed

Hoffmann, Sebastian; Hartung, Thomas; Stephens, Martin

Evidence-based toxicology (EBT) was introduced independently by two groups in 2005, in the context of toxicological risk assessment and causation as well as based on parallels between the evaluation of test methods in toxicology and evidence-based assessment of diagnostics tests in medicine. The role model of evidence-based medicine (EBM) motivated both proposals and guided the evolution of EBT, whereas especially systematic reviews and evidence quality assessment attract considerable attention in toxicology.Regarding test assessment, in the search of solutions for various problems related to validation, such as the imperfectness of the reference standard or the challenge to comprehensively evaluate tests, the field of Diagnostic Test Assessment (DTA) was identified as a potential resource. DTA being an EBM discipline, test method assessment/validation therefore became one of the main drivers spurring the development of EBT.In the context of pathway-based toxicology, EBT approaches, given their objectivity, transparency and consistency, have been proposed to be used for carrying out a (retrospective) mechanistic validation.In summary, implementation of more evidence-based approaches may provide the tools necessary to adapt the assessment/validation of toxicological test methods and testing strategies to face the challenges of toxicology in the twenty first century.

Good reliability and validity for a new utility instrument measuring the birth experience, the Labor and Delivery Index.

PubMed

Gärtner, Fania R; de Miranda, Esteriek; Rijnders, Marlies E; Freeman, Liv M; Middeldorp, Johanna M; Bloemenkamp, Kitty W M; Stiggelbout, Anne M; van den Akker-van Marle, M Elske

2015-10-01

To validate the Labor and Delivery Index (LADY-X), a new delivery-specific utility measure. In a test-retest design, women were surveyed online, 6 to 8 weeks postpartum and again 1 to 2 weeks later. For reliability testing, we assessed the standard error of measurement (S.E.M.) and the intraclass correlation coefficient (ICC). For construct validity, we tested hypotheses on the association with comparison instruments (Mackey Childbirth Satisfaction Rating Scale and Wijma Delivery Experience Questionnaire), both on domain and total score levels. We assessed known-group differences using eight obstetrical indicators: method and place of birth, induction, transfer, control over pain medication, complications concerning mother and child, and experienced control. The questionnaire was completed by 308 women, 257 (83%) completed the retest. The distribution of LADY-X scores was skewed. The reliability was good, as the ICC exceeded 0.80 and the S.E.M. was 0.76. Requirements for good construct validity were fulfilled: all hypotheses for convergent and divergent validity were confirmed, and six of eight hypotheses for known-group differences were confirmed as all differences were statistically significant (P-values: <0.001-0.023), but for two tests, difference scores did not exceed the S.E.M. The LADY-X demonstrates good reliability and construct validity. Despite its skewed distribution, the LADY-X can discriminate between groups. With the preference weights available, the LADY-X might fulfill the need for a utility measure for cost-effectiveness studies for perinatal care interventions. Copyright © 2015 Elsevier Inc. All rights reserved.

Internal consistency and validity of a new physical workload questionnaire

PubMed Central

Bot, S; Terwee, C; van der Windt, D A W M; Feleus, A; Bierma-Zeinstra, S; Knol, D; Bouter, L; Dekker, J

2004-01-01

Aims: To examine the dimensionality, internal consistency, and construct validity of a new physical workload questionnaire in employees with musculoskeletal complaints. Methods: Factor analysis was applied to the responses in three study populations with musculoskeletal disorders (n = 406, 300, and 557) on 26 items related to physical workload. The internal consistency of the resulting subscales was examined. It was hypothesised that physical workload would vary among different occupational groups. The occupations of all subjects were classified into four groups on the basis of expected workload (heavy physical load; long lasting postures and repetitive movements; both; no physical load). Construct validity of the subscales created was tested by comparing the subscale scores among these occupational groups. Results: The pattern of the factor loadings of items was almost identical for the three study populations. Two interpretable factors were found: items related to heavy physical workload loaded highly on the first factor, and items related to static postures or repetitive work loaded highly on the second factor. The first constructed subscale "heavy physical work" had a Cronbach's α of 0.92 to 0.93 and the second subscale "long lasting postures and repetitive movements", of 0.86 to 0.87. Six of eight hypotheses regarding the construct validity of the subscales were confirmed. Conclusions: The results support the internal structure, internal consistency, and validity of the new physical workload questionnaire. Testing this questionnaire in non-symptomatic employees and comparing its performance with objective assessments of physical workload are important next steps in the validation process. PMID:15550603

[The research of establishing discriminant function for patients with angina pectoris by stepwise analysis based on serum inflammatory factors].

PubMed

Chen, Zhi-bin; Liang, Yan-bing; Tang, Hao; Wang, Zhong-hua; Zeng, Li-jin; Wu, Jing-guo; Li, Zhen-yu; Ma, Zhong-fu

2012-12-01

To improve cost-efficiency, discriminant functions in stepwise method was founded for the differential diagnosis of angina pectoris by detecting the serum level of high-sensitivity C-reactive protein (hs-CRP), macrophage migration inhibitory factor (MIF), interleukin-4 (IL-4) and interleukin-10 (IL-10) in patients with stable angina pectoris (SAP) and unstable angina pectoris (UAP). Thirty-nine SAP patients and 47 UAP patients were enrolled into the study, while 39 healthy volunteers were enrolled into the controlled group forming the entire set of training samples. The serum levels of hs-CRP, MIF, IL-4 and IL-10 were measured by enzyme linked immunosorbent assay (ELISA). Data was analyzed by software to define discriminant functions in the ways of "entering" and "stepwise". Both functions were evaluated by the results of validation. By the way of "enter independent together", the following discriminant functions were defined based on the data of training samples' age, hs-CRP, MIF, IL-4, IL-10: healthy control group =-129.858 + 2.869×age -2.451×hs-CRP + 1.393×MIF + 6.001×IL-4 + 4.848×IL-10; SAP group=-161.037 + 2.896×age-2.022×hs-CRP + 1.662×MIF + 6.703×IL-4 + 6.287×IL-10; UAP group=-199.087 + 2.468×age-1.440×hs-CRP + 3.404×MIF-13.875×IL-4 + 7.752×IL-10. Retrospective validation showed 4.8% of total miss-grouping, while cross-validation showed 5.6% of total miss-grouping. By the way of "stepwise", the above data was screened by software and training samples' age, MIF and IL-10 were suggested to define the following functions: healthy control group = - 125.218 + 2.659 × age + 0.599×MIF + 5.040 × IL-10; SAP group=-157.864 + 2.721×age + 1.008×MIF + 6.468×IL-10; UAP group=- 197.327 + 2.360×age + 2.932×MIF + 7.640×IL-10. Both retrospective and cross validation showed 6.4% of total miss-grouping. Both sets of discriminant functions had the same efficiency (100%) for differential diagnosis of SAP and UAP. The discriminant functions based on samples' age, MIF and IL-10, which were screened and suggested by stepwise method, may contribute to the differential diagnosis of atypical SAP and UAP, and therefore demonstrate better cost-efficiency.

PROGNOSTIC SIGNIFICANCE OF CLINICAL, HISTOPATHOLOGICAL, AND MOLECULAR CHARACTERISTICS OF MEDULLOBLASTOMAS IN THE PROSPECTIVE HIT2000 MULTICENTER CLINICAL TRIAL COHORT

PubMed Central

Pietsch, Torsten; Schmidt, Rene; Remke, Marc; Korshunov, Andrey; Hovestadt, Volker; Jones, David TW; Felsberg, Jörg; Kaulich, Kerstin; Goschzik, Tobias; Kool, Marcel; Northcott, Paul A.; von Hoff, Katja; von Bueren, André O.; Friedrich, Carsten; Skladny, Heyko; Fleischhack, Gudrun; Taylor, Michael D.; Cremer, Friedrich; Lichter, Peter; Faldum, Andreas; Reifenberger, Guido; Rutkowski, Stefan; Pfister, Stefan M.

2014-01-01

BACKGROUND: This study aimed to prospectively evaluate clinical, histopathological and molecular variables for outcome prediction in medulloblastoma patients. METHODS: Patients from the HIT2000 cooperative clinical trial were prospectively enrolled based on the availability of sufficient tumor material and complete clinical information. This revealed a cohort of 184 patients (median age 7.6 years), which was randomly split at a 2:1 ratio into a training (n = 127), and a validation (n = 57) dataset. All samples were subjected to thorough histopathological investigation, CTNNB1 mutation analysis, quantitative PCR, MLPA and FISH analyses for cytogenetic variables, and methylome analysis. RESULTS: By univariable analysis, clinical factors (M-stage), histopathological variables (large cell component, endothelial proliferation, synaptophysin pattern), and molecular features (chromosome 6q status, MYC amplification, TOP2A copy-number, subgrouping) were found to be prognostic. Molecular consensus subgrouping (WNT, SHH, Group 3, Group 4) was validated as an independent feature to stratify patients into different risk groups. When comparing methods for the identification of WNT-driven medulloblastoma, this study identified CTNNB1 sequencing and methylation profiling to most reliably identify these patients. After removing patients with particularly favorable (CTNNB1 mutation, extensive nodularity) or unfavorable (MYC amplification) markers, a risk score for the remaining “intermediate molecular risk” population dependent on age, M-stage, pattern of synaptophysin expression, and MYCN copy-number status was identified and validated, with speckled synaptophysin expression indicating worse outcome. CONCLUSIONS: Methylation subgrouping and CTNNB1 mutation status represent robust tools for the risk-stratification of medulloblastoma. A simple clinico-pathological risk score for “intermediate molecular risk” patients was identified, which deserves further validation. SECONDARY CATEGORY: Pediatrics.

Development of the adult PedsQL™ neurofibromatosis type 1 module: initial feasibility, reliability and validity.

PubMed

Nutakki, Kavitha; Hingtgen, Cynthia M; Monahan, Patrick; Varni, James W; Swigonski, Nancy L

2013-02-21

Neurofibromatosis type 1 (NF1) is a common autosomal dominant genetic disorder with significant impact on health-related quality of life (HRQOL). Research in understanding the pathogenetic mechanisms of neurofibroma development has led to the use of new clinical trials for the treatment of NF1. One of the most important outcomes of a trial is improvement in quality of life, however, no condition specific HRQOL instrument for NF1 exists. The objective of this study was to develop an NF1 HRQOL instrument as a module of PedsQL™ and to test for its initial feasibility, internal consistency reliability and validity in adults with NF1. The NF1 specific HRQOL instrument was developed using a standard method of PedsQL™ module development - literature review, focus group/semi-structured interviews, cognitive interviews and experts' review of initial draft, pilot testing and field testing. Field testing involved 134 adults with NF1. Feasibility was measured by the percentage of missing responses, internal consistency reliability was measured with Cronbach's alpha and validity was measured by the known-groups method. Feasibility, measured by the percentage of missing responses was 4.8% for all subscales on the adult version of the NF1-specific instrument. Internal consistency reliability for the Total Score (alpha =0.97) and subscale reliabilities ranging from 0.72 to 0.96 were acceptable for group comparisons. The PedsQL™ NF1 module distinguished between NF1 adults with excellent to very good, good, and fair to poor health status. The results demonstrate the initial feasibility, reliability and validity of the PedsQL™ NF1 module in adult patients. The PedsQL™ NF1 Module can be used to understand the multidimensional nature of NF1 on the HRQOL patients with this disorder.

Chinese Version of the EQ-5D Preference Weights: Applicability in a Chinese General Population

PubMed Central

Wu, Chunmei; Gong, Yanhong; Wu, Jiang; Zhang, Shengchao; Yin, Xiaoxv; Dong, Xiaoxin; Li, Wenzhen; Cao, Shiyi; Mkandawire, Naomie; Lu, Zuxun

2016-01-01

Objectives This study aimed to test the reliability, validity and sensitivity of Chinese version of the EQ-5D preference weights in Chinese general people, examine the differences between the China value set and the UK, Japan and Korea value sets, and provide methods for evaluating and comparing the EQ-5D value sets of different countries. Methods A random sample of 2984 community residents (15 years or older) were interviewed using a questionnaire including the EQ-5D scale. Level of agreement, convergent validity, known-groups validity and sensitivity of the EQ-5D China, United Kingdom (UK), Japan and Korea value sets were determined. Results The mean EQ-5D index scores were significantly (P<0.05) different among the UK (0.964), Japan (0.981), Korea (0.987), and China (0.985) weights. High level of agreement (intraclass correlations coefficients > 0.75) and convergent validity (Pearson’s correlation coefficients > 0.95) were found between each paired schemes. The EQ-5D index scores discriminated equally well for the four versions between levels of 10 known-groups (P< 0.05). The effect size and the relative efficiency statistics showed that the China weights had better sensitivity. Conclusions The China EQ-5D preference weights show equivalent psychometric properties with those from the UK, Japan and Korea weights while slightly more sensitive to known group differences than those from the Japan and Korea weights. Considering both psychometric and sociocultural issues, the China scheme should be a priority as an EQ-5D based measure of the health related quality of life in Chinese general population. PMID:27711169

Development and validation of a predictor of insufficient enhancement during the hepatobiliary phase of Gd-EOB-DTPA-enhanced magnetic resonance imaging.

PubMed

Cui, Enming; Long, Wansheng; Luo, Liangping; Hu, Maoqing; Huang, Liebin; Chen, Xiangmeng

2017-10-01

Background Insufficient enhancement of liver parenchyma negatively affects diagnostic accuracy of Gd-EOB-DTPA-enhanced magnetic resonance imaging (MRI). Currently, there is no reliable method for predicting insufficient enhancement during the hepatobiliary phase (HBP) in Gd-EOB-DTPA-enhanced MRI. Purpose To develop a predictor for insufficient enhancement of liver parenchyma during HBP in Gd-EOB-DTPA-enhanced MRI. Material and Methods In order to formulate a HBP enhancement test (HBP-ET), clinical factors associated with relative enhancement ratio (RER) of liver parenchyma were retrospectively determined from the datasets of 156 patients (Development group) who underwent Gd-EOB-DTPA-enhanced MRI between November 2012 and May 2015. The independent clinical factors were identified by Pearson's correlation and multiple stepwise regression analysis; the performance of HBP-ET was compared to Child-Pugh score (CPS), Model for End-stage Liver Disease score (MELD), and total bilirubin (TBIL) using receiver operating characteristic (ROC) curve analysis. The datasets of 52 patients (Validation group), which were examined between June 2015 and Oct 2015, were applied to validate the HBP-ET. Results Six biochemical parameters independently influenced RER and were used to develop HBP-ET. The mean HBP-ET score of patients with insufficient enhancement was significantly higher than that of patients with sufficient enhancement ( P < 0.001) in both the Development and Validation groups. HBP-ET (area under the curve [AUC] = 0.895) had better performance in predicting insufficient enhancement than CPS (AUC = 0.707), MELD (AUC = 0.798), and TBIL (AUC = 0.729). Conclusion The HBP-ET is more accurate than routine indicators in predicting insufficient enhancement during HBP, which is valuable to aid clinical decisions.

Accuracies of genomic breeding values in American Angus beef cattle using K-means clustering for cross-validation

PubMed Central

2011-01-01

Background Genomic selection is a recently developed technology that is beginning to revolutionize animal breeding. The objective of this study was to estimate marker effects to derive prediction equations for direct genomic values for 16 routinely recorded traits of American Angus beef cattle and quantify corresponding accuracies of prediction. Methods Deregressed estimated breeding values were used as observations in a weighted analysis to derive direct genomic values for 3570 sires genotyped using the Illumina BovineSNP50 BeadChip. These bulls were clustered into five groups using K-means clustering on pedigree estimates of additive genetic relationships between animals, with the aim of increasing within-group and decreasing between-group relationships. All five combinations of four groups were used for model training, with cross-validation performed in the group not used in training. Bivariate animal models were used for each trait to estimate the genetic correlation between deregressed estimated breeding values and direct genomic values. Results Accuracies of direct genomic values ranged from 0.22 to 0.69 for the studied traits, with an average of 0.44. Predictions were more accurate when animals within the validation group were more closely related to animals in the training set. When training and validation sets were formed by random allocation, the accuracies of direct genomic values ranged from 0.38 to 0.85, with an average of 0.65, reflecting the greater relationship between animals in training and validation. The accuracies of direct genomic values obtained from training on older animals and validating in younger animals were intermediate to the accuracies obtained from K-means clustering and random clustering for most traits. The genetic correlation between deregressed estimated breeding values and direct genomic values ranged from 0.15 to 0.80 for the traits studied. Conclusions These results suggest that genomic estimates of genetic merit can be produced in beef cattle at a young age but the recurrent inclusion of genotyped sires in retraining analyses will be necessary to routinely produce for the industry the direct genomic values with the highest accuracy. PMID:22122853

Generalizing disease management program results: how to get from here to there.

PubMed

Linden, Ariel; Adams, John L; Roberts, Nancy

2004-07-01

For a disease management (DM) program, the ability to generalize results from the intervention group to the population, to other populations, or to other diseases is as important as demonstrating internal validity. This article provides an overview of the threats to external validity of DM programs, and offers methods to improve the capability for generalizing results obtained through the program. The external validity of DM programs must be evaluated even before program selection and implementation are begun with a prospective new client. Any fundamental differences in characteristics between individuals in an established DM program and in a new population/environment may limit the ability to generalize.

Derivation and validation of simple anthropometric equations to predict adipose tissue mass and total fat mass with MRI as the reference method

PubMed Central

Al-Gindan, Yasmin Y.; Hankey, Catherine R.; Govan, Lindsay; Gallagher, Dympna; Heymsfield, Steven B.; Lean, Michael E. J.

2017-01-01

The reference organ-level body composition measurement method is MRI. Practical estimations of total adipose tissue mass (TATM), total adipose tissue fat mass (TATFM) and total body fat are valuable for epidemiology, but validated prediction equations based on MRI are not currently available. We aimed to derive and validate new anthropometric equations to estimate MRI-measured TATM/TATFM/total body fat and compare them with existing prediction equations using older methods. The derivation sample included 416 participants (222 women), aged between 18 and 88 years with BMI between 15·9 and 40·8 (kg/m2). The validation sample included 204 participants (110 women), aged between 18 and 86 years with BMI between 15·7 and 36·4 (kg/m2). Both samples included mixed ethnic/racial groups. All the participants underwent whole-body MRI to quantify TATM (dependent variable) and anthropometry (independent variables). Prediction equations developed using stepwise multiple regression were further investigated for agreement and bias before validation in separate data sets. Simplest equations with optimal R2 and Bland–Altman plots demonstrated good agreement without bias in the validation analyses: men: TATM (kg) = 0·198 weight (kg) + 0·478 waist (cm) − 0·147 height (cm) − 12·8 (validation: R2 0·79, CV = 20 %, standard error of the estimate (SEE)=3·8 kg) and women: TATM (kg)=0·789 weight (kg) + 0·0786 age (years) − 0·342 height (cm) + 24·5 (validation: R2 0·84, CV = 13 %, SEE = 3·0 kg). Published anthropometric prediction equations, based on MRI and computed tomographic scans, correlated strongly with MRI-measured TATM: (R2 0·70 – 0·82). Estimated TATFM correlated well with published prediction equations for total body fat based on underwater weighing (R2 0·70–0·80), with mean bias of 2·5–4·9 kg, correctable with log-transformation in most equations. In conclusion, new equations, using simple anthropometric measurements, estimated MRI-measured TATM with correlations and agreements suitable for use in groups and populations across a wide range of fatness. PMID:26435103

[Quantitative research on operation behavior of acupuncture manipulation].

PubMed

Li, Jing; Grierson, Lawrence; Wu, Mary X; Breuer, Ronny; Carnahan, Heather

2014-03-01

To explore a method of quantitative evaluation on operation behavior of acupuncture manipulation and further analyze behavior features of professional acupuncture manipulation. According to acupuncture basic manipulations, Scales for Operation Behavior of Acupuncture Basic Manipulation was made and Delphi method was adopted to test its validity. Two independent estimators utilized this scale to assess operation behavior of acupuncture manipulate among 12 acupuncturists and 12 acupuncture-novices and calculate interrater reliability, also the differences of total score of operation behavior in the two groups as well as single-step score, including sterilization, needle insertion, needle manipulation and needle withdrawal, were compared. The validity of this scale was satisfied. The inter-rater reliability was 0. 768. The total score of operation behavior in acupuncturist group was significantly higher than that in the acupuncture-novice group (13.80 +/- 1.05 vs 11.03 +/- 2.14, P < 0.01). The scores of needle insertion and needle manipulation in the acupuncturist group were significantly higher than those in the acupuncture-novice group (4.28 +/- 0.91 vs 2.54 +/- 1.51, P < 0.01; 2.56 +/- 0.65 vs 1.88 +/- 0.88, P < 0.05); however, the scores of sterilization and needle withdrawal in the acupuncturist group were not different from those in the acupuncture-novice group. This scale is suitable for quantitative evaluation on operation behavior of acupuncture manipulation. The behavior features of professional acupuncture manipulation are mainly presented with needle insertion and needle manipulation which has superior difficulty, high coordination and accuracy.

Exploration, Development, and Validation of Patient-reported Outcomes in Antineutrophil Cytoplasmic Antibody–associated Vasculitis Using the OMERACT Process

PubMed Central

Robson, Joanna C.; Milman, Nataliya; Tomasson, Gunnar; Dawson, Jill; Cronholm, Peter F.; Kellom, Katherine; Shea, Judy; Ashdown, Susan; Boers, Maarten; Boonen, Annelies; Casey, George C.; Farrar, John T.; Gebhart, Don; Krischer, Jeffrey; Lanier, Georgia; McAlear, Carol A.; Peck, Jacqueline; Sreih, Antoine G.; Tugwell, Peter; Luqmani, Raashid A.; Merkel, Peter A.

2016-01-01

Objective Antineutrophil cytoplasmic antibody (ANCA)-associated vasculitis (AAV) is a group of linked multisystem life- and organ-threatening diseases. The Outcome Measures in Rheumatology (OMERACT) vasculitis working group has been at the forefront of outcome development in the field and has achieved OMERACT endorsement of a core set of outcomes for AAV. Patients with AAV report as important some manifestations of disease not routinely collected through physician-completed outcome tools; and they rate common manifestations differently from investigators. The core set includes the domain of patient-reported outcomes (PRO). However, PRO currently used in clinical trials of AAV do not fully characterize patients’ perspectives on their burden of disease. The OMERACT vasculitis working group is addressing the unmet needs for PRO in AAV. Methods Current activities of the working group include (1) evaluating the feasibility and construct validity of instruments within the PROMIS (Patient-Reported Outcome Measurement Information System) to record components of the disease experience among patients with AAV; (2) creating a disease-specific PRO measure for AAV; and (3) applying The International Classification of Functioning, Disability and Health to examine the scope of outcome measures used in AAV. Results The working group has developed a comprehensive research strategy, organized an investigative team, included patient research partners, obtained peer-reviewed funding, and is using a considerable research infrastructure to complete these interrelated projects to develop evidence-based validated outcome instruments that meet the OMERACT filter of truth, discrimination, and feasibility. Conclusion The OMERACT vasculitis working group is on schedule to achieve its goals of developing validated PRO for use in clinical trials of AAV. (First Release September 1 2015; J Rheumatol 2015;42:2204–9; doi:10.3899/jrheum.141143) PMID:26329344

Standardization of chemical analytical techniques for pyrolysis bio-oil: history, challenges, and current status of methods

DOE PAGES

Ferrell, Jack R.; Olarte, Mariefel V.; Christensen, Earl D.; ...

2016-07-05

Here, we discuss the standardization of analytical techniques for pyrolysis bio-oils, including the current status of methods, and our opinions on future directions. First, the history of past standardization efforts is summarized, and both successful and unsuccessful validation of analytical techniques highlighted. The majority of analytical standardization studies to-date has tested only physical characterization techniques. In this paper, we present results from an international round robin on the validation of chemical characterization techniques for bio-oils. Techniques tested included acid number, carbonyl titrations using two different methods (one at room temperature and one at 80 °C), 31P NMR for determination ofmore » hydroxyl groups, and a quantitative gas chromatography–mass spectrometry (GC-MS) method. Both carbonyl titration and acid number methods have yielded acceptable inter-laboratory variabilities. 31P NMR produced acceptable results for aliphatic and phenolic hydroxyl groups, but not for carboxylic hydroxyl groups. As shown in previous round robins, GC-MS results were more variable. Reliable chemical characterization of bio-oils will enable upgrading research and allow for detailed comparisons of bio-oils produced at different facilities. Reliable analytics are also needed to enable an emerging bioenergy industry, as processing facilities often have different analytical needs and capabilities than research facilities. We feel that correlations in reliable characterizations of bio-oils will help strike a balance between research and industry, and will ultimately help to -determine metrics for bio-oil quality. Lastly, the standardization of additional analytical methods is needed, particularly for upgraded bio-oils.« less

Standardization of chemical analytical techniques for pyrolysis bio-oil: history, challenges, and current status of methods

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ferrell, Jack R.; Olarte, Mariefel V.; Christensen, Earl D.

Here, we discuss the standardization of analytical techniques for pyrolysis bio-oils, including the current status of methods, and our opinions on future directions. First, the history of past standardization efforts is summarized, and both successful and unsuccessful validation of analytical techniques highlighted. The majority of analytical standardization studies to-date has tested only physical characterization techniques. In this paper, we present results from an international round robin on the validation of chemical characterization techniques for bio-oils. Techniques tested included acid number, carbonyl titrations using two different methods (one at room temperature and one at 80 °C), 31P NMR for determination ofmore » hydroxyl groups, and a quantitative gas chromatography–mass spectrometry (GC-MS) method. Both carbonyl titration and acid number methods have yielded acceptable inter-laboratory variabilities. 31P NMR produced acceptable results for aliphatic and phenolic hydroxyl groups, but not for carboxylic hydroxyl groups. As shown in previous round robins, GC-MS results were more variable. Reliable chemical characterization of bio-oils will enable upgrading research and allow for detailed comparisons of bio-oils produced at different facilities. Reliable analytics are also needed to enable an emerging bioenergy industry, as processing facilities often have different analytical needs and capabilities than research facilities. We feel that correlations in reliable characterizations of bio-oils will help strike a balance between research and industry, and will ultimately help to -determine metrics for bio-oil quality. Lastly, the standardization of additional analytical methods is needed, particularly for upgraded bio-oils.« less

Measuring verbal and non-verbal communication in aphasia: reliability, validity, and sensitivity to change of the Scenario Test.

PubMed

van der Meulen, Ineke; van de Sandt-Koenderman, W Mieke E; Duivenvoorden, Hugo J; Ribbers, Gerard M

2010-01-01

This study explores the psychometric qualities of the Scenario Test, a new test to assess daily-life communication in severe aphasia. The test is innovative in that it: (1) examines the effectiveness of verbal and non-verbal communication; and (2) assesses patients' communication in an interactive setting, with a supportive communication partner. To determine the reliability, validity, and sensitivity to change of the Scenario Test and discuss its clinical value. The Scenario Test was administered to 122 persons with aphasia after stroke and to 25 non-aphasic controls. Analyses were performed for the entire group of persons with aphasia, as well as for a subgroup of persons unable to communicate verbally (n = 43). Reliability (internal consistency, test-retest reliability, inter-judge, and intra-judge reliability) and validity (internal validity, convergent validity, known-groups validity) and sensitivity to change were examined using standard psychometric methods. The Scenario Test showed high levels of reliability. Internal consistency (Cronbach's alpha = 0.96; item-rest correlations = 0.58-0.82) and test-retest reliability (ICC = 0.98) were high. Agreement between judges in total scores was good, as indicated by the high inter- and intra-judge reliability (ICC = 0.86-1.00). Agreement in scores on the individual items was also good (square-weighted kappa values 0.61-0.92). The test demonstrated good levels of validity. A principal component analysis for categorical data identified two dimensions, interpreted as general communication and communicative creativity. Correlations with three other instruments measuring communication in aphasia, that is, Spontaneous Speech interview from the Aachen Aphasia Test (AAT), Amsterdam-Nijmegen Everyday Language Test (ANELT), and Communicative Effectiveness Index (CETI), were moderate to strong (0.50-0.85) suggesting good convergent validity. Group differences were observed between persons with aphasia and non-aphasic controls, as well as between persons with aphasia unable to use speech to convey information and those able to communicate verbally; this indicates good known-groups validity. The test was sensitive to changes in performance, measured over a period of 6 months. The data support the reliability and validity of the Scenario Test as an instrument for examining daily-life communication in aphasia. The test focuses on multimodal communication; its psychometric qualities enable future studies on the effect of Alternative and Augmentative Communication (AAC) training in aphasia.

Development and validation of a food-based diet quality index for New Zealand adolescents

PubMed Central

2013-01-01

Background As there is no population-specific, simple food-based diet index suitable for examination of diet quality in New Zealand (NZ) adolescents, there is a need to develop such a tool. Therefore, this study aimed to develop an adolescent-specific diet quality index based on dietary information sourced from a Food Questionnaire (FQ) and examine its validity relative to a four-day estimated food record (4DFR) obtained from a group of adolescents aged 14 to 18 years. Methods A diet quality index for NZ adolescents (NZDQI-A) was developed based on ‘Adequacy’ and ‘Variety’ of five food groups reflecting the New Zealand Food and Nutrition Guidelines for Healthy Adolescents. The NZDQI-A was scored from zero to 100, with a higher score reflecting a better diet quality. Forty-one adolescents (16 males, 25 females, aged 14–18 years) each completed the FQ and a 4DFR. The test-retest reliability of the FQ-derived NZDQI-A scores over a two-week period and the relative validity of the scores compared to the 4DFR were estimated using Pearson’s correlations. Construct validity was examined by comparing NZDQI-A scores against nutrient intakes obtained from the 4DFR. Results The NZDQI-A derived from the FQ showed good reliability (r = 0.65) and reasonable agreement with 4DFR in ranking participants by scores (r = 0.39). More than half of the participants were classified into the same thirds of scores while 10% were misclassified into the opposite thirds by the two methods. Higher NZDQI-A scores were also associated with lower total fat and saturated fat intakes and higher iron intakes. Conclusions Higher NZDQI-A scores were associated with more desirable fat and iron intakes. The scores derived from either FQ or 4DFR were comparable and reproducible when repeated within two weeks. The NZDQI-A is relatively valid and reliable in ranking diet quality in adolescents at a group level even in a small sample size. Further studies are required to test the predictive validity of this food-based diet index in larger samples. PMID:23759064

Assessment of forward head posture in females: observational and photogrammetry methods.

PubMed

Salahzadeh, Zahra; Maroufi, Nader; Ahmadi, Amir; Behtash, Hamid; Razmjoo, Arash; Gohari, Mahmoud; Parnianpour, Mohamad

2014-01-01

There are different methods to assess forward head posture (FHP) but the accuracy and discrimination ability of these methods are not clear. Here, we want to compare three postural angles for FHP assessment and also study the discrimination accuracy of three photogrammetric methods to differentiate groups categorized based on observational method. All Seventy-eight healthy female participants (23 ± 2.63 years), were classified into three groups: moderate-severe FHP, slight FHP and non FHP based on observational postural assessment rules. Applying three photogrammetric methods - craniovertebral angle, head title angle and head position angle - to measure FHP objectively. One - way ANOVA test showed a significant difference in three categorized group's craniovertebral angle (P< 0.05, F=83.07). There was no dramatic difference in head tilt angle and head position angle methods in three groups. According to Linear Discriminate Analysis (LDA) results, the canonical discriminant function (Wilks'Lambda) was 0.311 for craniovertebral angle with 79.5% of cross-validated grouped cases correctly classified. Our results showed that, craniovertebral angle method may discriminate the females with moderate-severe and non FHP more accurate than head position angle and head tilt angle. The photogrammetric method had excellent inter and intra rater reliability to assess the head and cervical posture.

Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

PubMed Central

Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M.; Huber, Adam M.; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

2016-01-01

Objective Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology. Methods A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Results Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Conclusions Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic diseases. PMID:26964088

The development of 'Quality of Life Instrument for Indian Diabetes patients (QOLID): a validation and reliability study in middle and higher income groups.

PubMed

Nagpal, Jitender; Kumar, Arvind; Kakar, Sonia; Bhartia, Abhishek

2010-05-01

To develop a reliable and valid quality of life questionnaire for Indian patients with diabetes. A draft of 75 questions was prepared on the basis of expert opinion, focus group discussions, review of existing literature and detailed semi-structured interviews of patients with diabetes with the intention of including all aspects of diabetes-specific and quality of life considered relevant by patients and care providers to enable constrict validity. A Stage 2 questionnaire was then prepared with 13 domains and 54 items (questions) after expert panel review for obvious irrelevance and duplication of issues. It was administered to 150 participants visiting a diabetes center at New Delhi. Factor analysis was done using principal component method with varimax rotation. Reliability analysis was done by calculating Cronbach's Alpha. For evaluating concordant validity the questionnaire was co-administered with DQL-CTQ to 30 participants. The discriminant validity of the questionnaire was tested using 't' test for metabolic control, co-morbidities, insulin use and gender. Using principal component method 8 domains were identified on the basis of an apriori hypothesis and the scree plot. These 8 domains explained 49.9% of the total variation. 34 items (questions) were selected to represent these domains on the basis of extraction communality, factor loading, inter-item and item-total correlations. The final questionnaire has an Overall Cronbach's Alpha value of 0.894 (subscale- 0.55 to 0.85) showing high internal consistency. The questionnaire showed good concordance (product moment correlation 0.724; p = 0.001; subscale correlation - 0.457 to 0.779) with the DQL-CTQ. The overall standardized questionnaire score showed good responsiveness to metabolic control and co-morbidities establishing discriminant validity. The final version of questionnaire with 8 domains and 34 items is a reliable and valid tool for assessment of quality of life of Indian patients with diabetes.

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

A comprehensive approach to psychometric assessment of instruments used in dementia educational interventions for health professionals: a cross-sectional study.

PubMed

Wang, Yao; Xiao, Lily Dongxia; He, Guo-Ping

2015-02-01

Suboptimal care for people with dementia in hospital settings has been reported and is attributed to the lack of knowledge and inadequate attitudes in dementia care among health professionals. Educational interventions have been widely used to improve care outcomes; however, Chinese-language instruments used in dementia educational interventions for health professionals are lacking. The aims of this study were to select, translate and evaluate instruments used in dementia educational interventions for Chinese health professionals in acute-care hospitals. A cross-sectional study design was used. A modified stratified random sampling was used to recruit 442 participants from different levels of hospitals in Changsha, China. Dementia care competence was used as a framework for the selection and evaluation of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale for health professionals in the study. These two scales were translated into Chinese using forward and back translation method. Content validity, test-retest reliability and internal consistency were assessed. Construct validity was tested using exploratory factor analysis. Known-group validity was established by comparing scores of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale in two sub-groups. A person-centred care scale was utilised as a gold standard to establish concurrent validity of these two scales. Results demonstrated acceptable content validity, internal consistency, test-retest reliability and concurrent validity. Exploratory factor analysis presented a single-factor structure of the Chinese Alzheimer's Disease Knowledge Scale and a two-factor structure of the Chinese Dementia Care Attitudes Scale, supporting the conceptual dimensions of the original scales. The Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale demonstrated known-group validity evidenced by significantly higher scores identified from the sub-group with a longer work experience compared to those in the sub-group with less work experience. The use of dementia care competence as a framework to inform the selection and evaluation of instruments used in dementia educational interventions for health professionals has wide applicability in other areas. The results support that Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale are reliable and valid instruments for health professionals to use in acute-care settings. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Validation and reliability of Turkish Singing Voice Handicap index].

PubMed

Denizoğlu, İsmail İlter; Şahin, Mustafa; Kazancıoğlu, Alper; Dağdelen, Zibelhan; Akdeniz, Serap; Oğuz, Haldun; Kılıç, Mehmet Akif; Yücedağ, Aslı; Öğüt, Mehmet Fatih

2016-01-01

This study aims to constitute a valid and reliable Turkish version of the original Singing Voice Handicap Index. An authorized committee assessed the reliability and validity of the content, scope, and language of the original Singing Voice Handicap Index which underwent a back translation process. The Turkish version of the questionnaire was answered twice with a 7 to 10-day interval by two singing voice groups with or without singing voice problems. The reliability and validity analyses were performed based on these answers. Of a total of 123 individuals (64 females, 59 males; mean age 26.2±7.3 years), 81 were without a voice pathology and 42 were with a voice pathology. The total Cronbach's alpha coefficient was 0.917. The item-total correlations ranged between 0.51 and 0.89. The weighted kappa values of test-retest correlation values of the items were 0.82-0.91. The Cronbach's alpha values of two part of the questionnaire based on the split-half method were 0.89 and 0.84. The mean total scale scores were 21.8±18.5 and 53.6±28.9 in normal and pathology groups, respectively and there was a statistically significant difference in scores between these two groups (p=0.000). The Turkish version of the Singing Voice Handicap Index is a valid and reliable scale which can be used in the evaluation of voice problems of Turkish-speaking singing voice users.

Chemical structure-based predictive model for the oxidation of trace organic contaminants by sulfate radical.

PubMed

Ye, Tiantian; Wei, Zongsu; Spinney, Richard; Tang, Chong-Jian; Luo, Shuang; Xiao, Ruiyang; Dionysiou, Dionysios D

2017-06-01

Second-order rate constants [Formula: see text] for the reaction of sulfate radical anion (SO 4 •- ) with trace organic contaminants (TrOCs) are of scientific and practical importance for assessing their environmental fate and removal efficiency in water treatment systems. Here, we developed a chemical structure-based model for predicting [Formula: see text] using 32 molecular fragment descriptors, as this type of model provides a quick estimate at low computational cost. The model was constructed using the multiple linear regression (MLR) and artificial neural network (ANN) methods. The MLR method yielded adequate fit for the training set (R training 2 =0.88,n=75) and reasonable predictability for the validation set (R validation 2 =0.62,n=38). In contrast, the ANN method produced a more statistical robustness but rather poor predictability (R training 2 =0.99andR validation 2 =0.42). The reaction mechanisms of SO 4 •- reactivity with TrOCs were elucidated. Our result shows that the coefficients of functional groups reflect their electron donating/withdrawing characters. For example, electron donating groups typically exhibit positive coefficients, indicating enhanced SO 4 •- reactivity. Electron withdrawing groups exhibit negative values, indicating reduced reactivity. With its quick and accurate features, we applied this structure-based model to 55 discrete TrOCs culled from the Contaminant Candidate List 4, and quantitatively compared their removal efficiency with SO 4 •- and OH in the presence of environmental matrices. This high-throughput model helps prioritize TrOCs that are persistent to SO 4 •- based oxidation technologies at the screening level, and provide diagnostics of SO 4 •- reaction mechanisms. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of a contemporary prostate cancer grading system using prostate cancer death as outcome

PubMed Central

Berney, Daniel M; Beltran, Luis; Fisher, Gabrielle; North, Bernard V; Greenberg, David; Møller, Henrik; Soosay, Geraldine; Scardino, Peter; Cuzick, Jack

2016-01-01

Background: Gleason scoring (GS) has major deficiencies and a novel system of five grade groups (GS⩽6; 3+4; 4+3; 8; ⩾9) has been recently agreed and included in the WHO 2016 classification. Although verified in radical prostatectomies using PSA relapse for outcome, it has not been validated using prostate cancer death as an outcome in biopsy series. There is debate whether an ‘overall' or ‘worst' GS in biopsies series should be used. Methods: Nine hundred and eighty-eight prostate cancer biopsy cases were identified between 1990 and 2003, and treated conservatively. Diagnosis and grade was assigned to each core as well as an overall grade. Follow-up for prostate cancer death was until 31 December 2012. A log-rank test assessed univariable differences between the five grade groups based on overall and worst grade seen, and using univariable and multivariable Cox proportional hazards. Regression was used to quantify differences in outcome. Results: Using both ‘worst' and ‘overall' GS yielded highly significant results on univariate and multivariate analysis with overall GS slightly but insignificantly outperforming worst GS. There was a strong correlation with the five grade groups and prostate cancer death. Conclusions: This is the largest conservatively treated prostate cancer cohort with long-term follow-up and contemporary assessment of grade. It validates the formation of five grade groups and suggests that the ‘worst' grade is a valid prognostic measure. PMID:27100731

Zebra: An advanced PWR lattice code

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cao, L.; Wu, H.; Zheng, Y.

2012-07-01

This paper presents an overview of an advanced PWR lattice code ZEBRA developed at NECP laboratory in Xi'an Jiaotong Univ.. The multi-group cross-section library is generated from the ENDF/B-VII library by NJOY and the 361-group SHEM structure is employed. The resonance calculation module is developed based on sub-group method. The transport solver is Auto-MOC code, which is a self-developed code based on the Method of Characteristic and the customization of AutoCAD software. The whole code is well organized in a modular software structure. Some numerical results during the validation of the code demonstrate that this code has a good precisionmore » and a high efficiency. (authors)« less

Marine and freshwater toxins.

PubMed

Hungerford, James M

2006-01-01

In a very busy and exciting year, 2005 included First Action approval of a much needed official method for paralytic shellfish toxins and multiple international toxin symposia highlighted by groundbreaking research. These are the first-year milestones and activities of the Marine and Freshwater Toxins Task Force and Analytical Community. Inaugurated in 2004 and described in detail in last year's General Referee Report (1) this international toxins group has grown to 150 members from many regions and countries. Perhaps most important they are now making important and global contributions to food safety and to providing alternatives to animal-based assays. Official Method 2005.06 was first approved in late 2004 by the Task Force and subsequently Official First Action in 2005 (2) by the Methods Committee on Natural Toxins and Food Allergens and the Official Methods Board. This nonproprietary method (3) is a precolumn oxidation, liquid chromatographic method that makes good use of fluorescence detection to provide high sensitivity detection of the saxitoxins. It has also proven to be rugged enough for regulatory use and the highest level of validation. As pointed out in the report of method principle investigator and Study Director James Lawrence, approval of 2005.06 now provides the first official alternative to the mouse bioassay after many decades of shellfish monitoring. This past year in April 2005 the group also held their first international conference, "Marine and Freshwater Toxins Analysis: Ist Joint Symposium and AOAC Task Force Meeting," in Baiona, Spain. The 4-day conference consisted of research and stakeholder presentations and symposium-integrated subgroup sessions on ciguatoxins, saxitoxin assays and liquid chromatography (LC) methods for saxitoxins and domoic acids, okadaiates and azaspiracids, and yessotoxins. Many of these subgroups were recently formed in 2005 and are working towards their goals of producing officially validated analytical methods. (Abstracts from the Baiona 2005 meeting cited in this report can be found in the online version of the conference abstract book in the Files and Folders section of the Marine and Freshwater Toxins online community at www.aoac.org.) An active topic for discussion in Baiona and subsequent Task Force activities was the expert consultation for Codex which met in Oslo, Norway in 2004 (previously described and cited in last year's GR report, ref 1). The consultation group's executive summary report (http://www.fao.org/es/ESN/food/risk_biotoxin en.stm) describes suggested changes in action levels as well as methods, method validation, and other issues. September 2005 saw the AOAC Task Force efforts further supported by another symposium, "Marine and Freshwater Toxins: Quality Methods for Food Safety and International Trade," at the AOAC INTERNATIONAL Annual Conference in Orlando, Florida. The multidisciplinary talks at this full day symposium ranged from ciguatoxins to cyanobacterial toxins, and spanned toxicology, biochemistry, molecular biology and analytical chemistry. Again, the symposium preceded Task Force meetings. Toxin subgroups, including a new group on cyanobacterial toxins, met for engaging and productive subgroup discussions. All of these activities were preceded by a Wiley Award symposium for Task Force member Mike Quilliam of NRC Canada. These talks, presented at a half-day symposium on the first day of the Annual Meeting, focused on Quilliam's work with LC tandem mass spectrometry (LC/MS/MS) and certified reference standards and materials, and included related presentations by some of his many research collaborators. To maintain flow and continuity between symposia and between Task Force meetings, the group now uses new electronic discussion forums. Individual subgroup areas, under the Marine and Freshwater Toxins Task Force, comprise this online community. First introduced by AOAC INTERNATIONAL in early 2005, these new resources are being used to distribute information and to supplement the in-person subgroup meetings and electronic mail in the group's validation efforts.

Shear elastic modulus estimation from indentation and SDUV on gelatin phantoms

PubMed Central

Amador, Carolina; Urban, Matthew W.; Chen, Shigao; Chen, Qingshan; An, Kai-Nan; Greenleaf, James F.

2011-01-01

Tissue mechanical properties such as elasticity are linked to tissue pathology state. Several groups have proposed shear wave propagation speed to quantify tissue mechanical properties. It is well known that biological tissues are viscoelastic materials; therefore velocity dispersion resulting from material viscoelasticity is expected. A method called Shearwave Dispersion Ultrasound Vibrometry (SDUV) can be used to quantify tissue viscoelasticity by measuring dispersion of shear wave propagation speed. However, there is not a gold standard method for validation. In this study we present an independent validation method of shear elastic modulus estimation by SDUV in 3 gelatin phantoms of differing stiffness. In addition, the indentation measurements are compared to estimates of elasticity derived from shear wave group velocities. The shear elastic moduli from indentation were 1.16, 3.40 and 5.6 kPa for a 7, 10 and 15% gelatin phantom respectively. SDUV measurements were 1.61, 3.57 and 5.37 kPa for the gelatin phantoms respectively. Shear elastic moduli derived from shear wave group velocities were 1.78, 5.2 and 7.18 kPa for the gelatin phantoms respectively. The shear elastic modulus estimated from the SDUV, matched the elastic modulus measured by indentation. On the other hand, shear elastic modulus estimated by group velocity did not agree with indentation test estimations. These results suggest that shear elastic modulus estimation by group velocity will be bias when the medium being investigated is dispersive. Therefore a rheological model should be used in order to estimate mechanical properties of viscoelastic materials. PMID:21317078

A pan-European ring trial to validate an International Standard for detection of Vibrio cholerae, Vibrio parahaemolyticus and Vibrio vulnificus in seafoods.

PubMed

Hartnell, R E; Stockley, L; Keay, W; Rosec, J-P; Hervio-Heath, D; Van den Berg, H; Leoni, F; Ottaviani, D; Henigman, U; Denayer, S; Serbruyns, B; Georgsson, F; Krumova-Valcheva, G; Gyurova, E; Blanco, C; Copin, S; Strauch, E; Wieczorek, K; Lopatek, M; Britova, A; Hardouin, G; Lombard, B; In't Veld, P; Leclercq, A; Baker-Austin, C

2018-02-10

Globally, vibrios represent an important and well-established group of bacterial foodborne pathogens. The European Commission (EC) mandated the Comite de European Normalisation (CEN) to undertake work to provide validation data for 15 methods in microbiology to support EC legislation. As part of this mandated work programme, merging of ISO/TS 21872-1:2007, which specifies a horizontal method for the detection of V. parahaemolyticus and V. cholerae, and ISO/TS 21872-2:2007, a similar horizontal method for the detection of potentially pathogenic vibrios other than V. cholerae and V. parahaemolyticus was proposed. Both parts of ISO/TS 21872 utilized classical culture-based isolation techniques coupled with biochemical confirmation steps. The work also considered simplification of the biochemical confirmation steps. In addition, because of advances in molecular based methods for identification of human pathogenic Vibrio spp. classical and real-time PCR options were also included within the scope of the validation. These considerations formed the basis of a multi-laboratory validation study with the aim of improving the precision of this ISO technical specification and providing a single ISO standard method to enable detection of these important foodborne Vibrio spp.. To achieve this aim, an international validation study involving 13 laboratories from 9 countries in Europe was conducted in 2013. The results of this validation have enabled integration of the two existing technical specifications targeting the detection of the major foodborne Vibrio spp., simplification of the suite of recommended biochemical identification tests and the introduction of molecular procedures that provide both species level identification and discrimination of putatively pathogenic strains of V. parahaemolyticus by the determination of the presence of theromostable direct and direct related haemolysins. The method performance characteristics generated in this have been included in revised international standard, ISO 21872:2017, published in July 2017. Copyright © 2018. Published by Elsevier B.V.

Predictive validity of the UK clinical aptitude test in the final years of medical school: a prospective cohort study

PubMed Central

2014-01-01

Background The UK Clinical Aptitude Test (UKCAT) was designed to address issues identified with traditional methods of selection. This study aims to examine the predictive validity of the UKCAT and compare this to traditional selection methods in the senior years of medical school. This was a follow-up study of two cohorts of students from two medical schools who had previously taken part in a study examining the predictive validity of the UKCAT in first year. Methods The sample consisted of 4th and 5th Year students who commenced their studies at the University of Aberdeen or University of Dundee medical schools in 2007. Data collected were: demographics (gender and age group), UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; Year 4 and 5 degree examination scores. Pearson’s correlations were used to examine the relationships between admissions variables, examination scores, gender and age group, and to select variables for multiple linear regression analysis to predict examination scores. Results Ninety-nine and 89 students at Aberdeen medical school from Years 4 and 5 respectively, and 51 Year 4 students in Dundee, were included in the analysis. Neither UCAS form nor interview scores were statistically significant predictors of examination performance. Conversely, the UKCAT yielded statistically significant validity coefficients between .24 and .36 in four of five assessments investigated. Multiple regression analysis showed the UKCAT made a statistically significant unique contribution to variance in examination performance in the senior years. Conclusions Results suggest the UKCAT appears to predict performance better in the later years of medical school compared to earlier years and provides modest supportive evidence for the UKCAT’s role in student selection within these institutions. Further research is needed to assess the predictive validity of the UKCAT against professional and behavioural outcomes as the cohort commences working life. PMID:24762134

Gene Environment Interactions and Predictors of Colorectal Cancer in Family-Based, Multi-Ethnic Groups.

PubMed

Shiao, S Pamela K; Grayson, James; Yu, Chong Ho; Wasek, Brandi; Bottiglieri, Teodoro

2018-02-16

For the personalization of polygenic/omics-based health care, the purpose of this study was to examine the gene-environment interactions and predictors of colorectal cancer (CRC) by including five key genes in the one-carbon metabolism pathways. In this proof-of-concept study, we included a total of 54 families and 108 participants, 54 CRC cases and 54 matched family friends representing four major racial ethnic groups in southern California (White, Asian, Hispanics, and Black). We used three phases of data analytics, including exploratory, family-based analyses adjusting for the dependence within the family for sharing genetic heritage, the ensemble method, and generalized regression models for predictive modeling with a machine learning validation procedure to validate the results for enhanced prediction and reproducibility. The results revealed that despite the family members sharing genetic heritage, the CRC group had greater combined gene polymorphism rates than the family controls ( p < 0.05), on MTHFR C677T , MTR A2756G , MTRR A66G, and DHFR 19 bp except MTHFR A1298C. Four racial groups presented different polymorphism rates for four genes (all p < 0.05) except MTHFR A1298C. Following the ensemble method, the most influential factors were identified, and the best predictive models were generated by using the generalized regression models, with Akaike's information criterion and leave-one-out cross validation methods. Body mass index (BMI) and gender were consistent predictors of CRC for both models when individual genes versus total polymorphism counts were used, and alcohol use was interactive with BMI status. Body mass index status was also interactive with both gender and MTHFR C677T gene polymorphism, and the exposure to environmental pollutants was an additional predictor. These results point to the important roles of environmental and modifiable factors in relation to gene-environment interactions in the prevention of CRC.

Validation of the Arabic Version of the Infant Feeding Intentions Scale Among Lebanese Women.

PubMed

Yehya, Nadine; Tamim, Hani; Shamsedine, Lama; Ayash, Soumaya; Abdel Khalek, Lama; Abou Ezzi, Amanda; Nabulsi, Mona

2017-05-01

The Infant Feeding Intentions (IFI) scale was shown to reliably measure maternal intentions to initiate breastfeeding and continue exclusive breastfeeding until 1, 3, or 6 months in English and Spanish but not in Arab contexts. Research aim: This study aimed to validate an Arabic version of the IFI scale (IFI-A) and examine its ability to predict exclusive breastfeeding at 1, 3, or 6 months in pregnant Lebanese women. The internal consistency reliability and construct validity of the IFI-A scale were tested on 50 pregnant women (Group 1), whereas its predictive ability was tested on 196 pregnant women (Group 2), who were surveyed monthly about their infants' nutrition method until 6 months. The IFI-A scale's Cronbach's alpha internal consistency reliability is .82. Its corrected item-total correlations ranged from .26 for Item 2 ("at least give breastfeeding a try") to .86 for Item 4 ("will be exclusively breastfeeding at 3 months"). Exploratory factor analysis revealed that it is unidimensional. IFI-A scores correlated significantly with exclusive breastfeeding duration in Group 1 ( r = .624; p = .001) and with participants' breastfeeding attitude ( r = .390; p < .001) and previous breastfeeding duration ( r = .237; p = .011) in Group 2, thus confirming its external construct validity. In adjusted analysis, the IFI-A scale predicted exclusive breastfeeding at 3 months, albeit weakly (odds ratio = 1.16; 95% confidence interval [0.99, 1.36]), but not at 1 or 6 months. The IFI-A scale is a reliable and valid tool to assess maternal feeding intentions and predict exclusive breastfeeding at 3 months in the Arab context. Further studies are needed in other Arab contexts to confirm our findings.

Adaptation and cross-cultural validation of the United States Primary Care Assessment Tool (expanded version) for use in South Africa

PubMed Central

Sayed, Abdul-Rauf; le Grange, Cynthia; Bhagwan, Susheela; Manga, Nayna

2015-01-01

Background Measuring primary care is important for health sector reform. The Primary Care Assessment Tool (PCAT) measures performance of elements essential for cost-effective care. Following minor adaptations prior to use in Cape Town in 2011, a few findings indicated a need to improve the content and cross-cultural validity for wider use in South Africa (SA). Aim This study aimed to validate the United States of America-developed PCAT before being used in a baseline measure of primary care performance prior to major reform. Setting Public sector primary care clinics, users, practitioners and managers in urban and rural districts in the Western Cape Province. Methods Face value evaluation of item phrasing and a combination of Delphi and Nominal Group Technique (NGT) methods with an expert panel and user focus group were used to obtain consensus on content relevant to SA. Original and new domains and items with > = 70% agreement were included in the South African version – ZA PCAT. Results All original PCAT domains achieved consensus on inclusion. One new domain, the primary healthcare (PHC) team, was added. Three of 95 original items achieved < 70% agreement, that is consensus to exclude as not relevant to SA; 19 new items were added. A few items needed minor rephrasing with local healthcare jargon. The demographic section was adapted to local socio-economic conditions. The adult PCAT was translated into isiXhosa and Afrikaans. Conclusion The PCAT is a valid measure of primary care performance in SA. The PHC team domain is an important addition, given its emphasis in PHC re-engineering. A combination of Delphi and NGT methods succeeded in obtaining consensus on a multi-domain, multi-item instrument in a resource- constrained environment. PMID:26245610

Using the Cumulative Common Log-Odds Ratio to Identify Differential Item Functioning of Rating Scale Items in the Exercise and Sport Sciences

ERIC Educational Resources Information Center

Penfield, Randall D.; Giacobbi, Peter R., Jr.; Myers, Nicholas D.

2007-01-01

One aspect of construct validity is the extent to which the measurement properties of a rating scale are invariant across the groups being compared. An increasingly used method for assessing between-group differences in the measurement properties of items of a scale is the framework of differential item functioning (DIF). In this paper we…

Development of the My Medicines and Me (M3Q) side effect questionnaire for mental health patients: a qualitative study

PubMed Central

Ashoorian, Deena M.; Davidson, Rowan M.; Rock, Daniel J. T.; Seubert, Liza J.; Clifford, Rhonda M.

2015-01-01

Objective: The objective of this study was to assess the acceptability, content validity and usability of the My Medicines and Me (M3Q) self-report side effect questionnaire. Methods: Eight focus groups consisting of mental health patients, carers, general practitioners, psychiatrists, mental health nurses and pharmacists were conducted, involving 78 participants. Two researchers independently examined the transcriptions and analysed the data thematically using an inductive method. Results: The findings supported changes to the formatting, length and phrasing of questions in the original version of the questionnaire. Although the groups provided differing views on the usability of the M3Q in clinical practice, the patient and carer groups were unconditionally in favour of such a tool to be used systematically to describe patients’ subjective experiences with side effects. Conclusion: The differing contribution made by all groups involved in the administration and completion of the M3Q assisted with content validity of the questionnaire. The acceptability and usability of this novel side effect questionnaire was also explored, with many participants agreeing it was a necessary tool for a patient centred approach to treatment. Following implementation of the changes to the current format of the questionnaire, investigation into the uptake and use in clinical practice should be carried out. PMID:26557985

Initial Development of an E-cigarette Purchase Task: A Mixed Methods Study

PubMed Central

Cassidy, Rachel N.; Tidey, Jennifer W.; Colby, Suzanne M.; Long, Victoria; Higgins, Stephen T.

2017-01-01

Objectives Behavioral economic purchase tasks, which estimate demand for drugs, have been successfully developed for cigarettes and are widely used. However, a validated purchase task does not yet exist for e-cigarettes. The aim of this project was to identify the relevant units for an e-cigarette purchase task (E-CPT). Methods Focus groups (N=28 participants in 7 groups, 2-7 participants per group) consisting of current e-cigarette users were conducted. Participants discussed their daily use patterns, completed a preliminary E-CPT which asked how many puffs of their e-cigarette they would consume per day at escalating prices, and discussed the extent to which the task accurately reflected their real-world behavior. Groups were recorded and transcribed; analysis focused on statements related to daily consumption and the E-CPT. Results Participants were unlikely to quantify their daily use in terms of puffs, and perceptions about the appropriate unit for an E-CPT varied across device type. Users of first-generation devices (eg, cigalikes) reported that the relevant unit was the individual device/cartridge; however, participants who purchased nicotine liquid for their device emphasized that e-liquid volume in milliliters would better reflect their use. Conclusions Multiple versions of the E-CPT may be necessary to provide valid measures of e-cigarette demand. PMID:28824938

Multidimensional Fatigue Inventory in People With Hepatitis B Infection: Cross-cultural Adaptation and Psychometric Evaluation of the Persian Version.

PubMed

Saffari, Mohsen; Naderi, Maryam K; Piper, Crystal N; Koenig, Harold G

There is no valid and well-established tool to measure fatigue in people with chronic hepatitis B. The aim of this study was to translate the Multidimensional Fatigue Inventory (MFI) into Persian and examine its reliability and validity in Iranian people with chronic hepatitis B. The demographic questionnaire and MFI, as well as Chronic Liver Disease Questionnaire and EuroQol-5D (to assess criterion validity), were administered in face-to-face interviews with 297 participants. A forward-backward translation method was used to develop a culturally adapted Persian version of the questionnaire. Cronbach's α was used to assess the internal reliability of the scale. Pearson correlation was used to assess criterion validity, and known-group method was used along with factor analysis to establish construct validity. Cronbach's α for the total scale was 0.89. Convergent and discriminant validities were also established. Correlations between the MFI and the health-related quality of life scales were significant (p < .01). The scale differentiated between subgroups of persons with the hepatitis B infection in terms of age, gender, employment, education, disease duration, and stage of disease. Factor analysis indicated a four-factor solution for the scale that explained 60% of the variance. The MFI is a valid and reliable instrument to identify fatigue in Iranians with hepatitis B.

An electromechanical coupling model of a bending vibration type piezoelectric ultrasonic transducer.

PubMed

Zhang, Qiang; Shi, Shengjun; Chen, Weishan

2016-03-01

An electromechanical coupling model of a bending vibration type piezoelectric ultrasonic transducer is proposed. The transducer is a Langevin type transducer which is composed of an exponential horn, four groups of PZT ceramics and a back beam. The exponential horn can focus the vibration energy, and can enlarge vibration amplitude and velocity efficiently. A bending vibration model of the transducer is first constructed, and subsequently an electromechanical coupling model is constructed based on the vibration model. In order to obtain the most suitable excitation position of the PZT ceramics, the effective electromechanical coupling coefficient is optimized by means of the quadratic interpolation method. When the effective electromechanical coupling coefficient reaches the peak value of 42.59%, the optimal excitation position (L1=22.52 mm) is found. The FEM method and the experimental method are used to validate the developed analytical model. Two groups of the FEM model (the Group A center bolt is not considered, and but the Group B center bolt is considered) are constructed and separately compared with the analytical model and the experimental model. Four prototype transducers around the peak value are fabricated and tested to validate the analytical model. A scanning laser Doppler vibrometer is employed to test the bending vibration shape and resonance frequency. Finally, the electromechanical coupling coefficient is tested indirectly through an impedance analyzer. Comparisons of the analytical results, FEM results and experiment results are presented, and the results show good agreement. Copyright © 2015 Elsevier B.V. All rights reserved.

Cytokeratin 8 in Association with sdLDL and ELISA Development

PubMed Central

Ashmaig, Mohmed

2015-01-01

Background: Cardiovascular disease (CVD) remains the leading cause of morbidity and mortality worldwide. Cytokeratins (CKs) which may also be expressed in vascular smooth muscle cells (SMCs) are generally considered to be markers for the differentiation of epithelial cells. Small, dense, low-density lipoprotein (sdLDL) particles, also termed LDL-IV, independently predict risk of CVD. Aims: The aims of this study were to develop an analytical method, apart from ultracentrifugation capable of isolating sdLDL in order to study any associated proteins. Materials and Methods: Using modified gradient gel electrophoresis (GGE), de-identified sdLDL-enriched plasma was used to physically elute and isolate sdLDL particles. To validate the finding, additional plasma from 77 normal and 48 higher risk subjects were used to measure sdLDL particles and CK8. Sodium dodecyl sulfate-polyacrylamide gel electrophoresis (SDS-PAGE) and immunoblotting method were used to identify the characteristics of proteins associated with sdLDL. An enzyme-linked immunosorbent assay (ELISA) method was developed and validated for the measurement of CK8 in plasma. Results: The validation of the CK8 ELISA method showed good analytical performance. The isolated sdLDL particles were verified with nondenaturing GGE with the apolipoprotein B component confirmed by Western immunoblotting. Confirmed by SDS-PAGE and Western immunoblotting, CK8 was associated with sdLDL. Two-tailed statistical analysis showed that CK8 and sdLDL particles were significantly higher in the high-risk CVD group compared to control group (P < 0.01 and P < 0.01, respectively). Conclusion: This study reports a novel association between CK8 and sdLDL in individuals with CVD who have a predominance of sdLDL. PMID:26713292

Combined 3D-QSAR modeling and molecular docking study on azacycles CCR5 antagonists

NASA Astrophysics Data System (ADS)

Ji, Yongjun; Shu, Mao; Lin, Yong; Wang, Yuanqiang; Wang, Rui; Hu, Yong; Lin, Zhihua

2013-08-01

The beta chemokine receptor 5 (CCR5) is an attractive target for pharmaceutical industry in the HIV-1, inflammation and cancer therapeutic areas. In this study, we have developed quantitative structure activity relationship (QSAR) models for a series of 41 azacycles CCR5 antagonists using comparative molecular field analysis (CoMFA), comparative molecular similarity indices analysis (CoMSIA), and Topomer CoMFA methods. The cross-validated coefficient q2 values of 3D-QASR (CoMFA, CoMSIA, and Topomer CoMFA) methods were 0.630, 0.758, and 0.852, respectively, the non-cross-validated R2 values were 0.979, 0.978, and 0.990, respectively. Docking studies were also employed to determine the most probable binding mode. 3D contour maps and docking results suggested that bulky groups and electron-withdrawing groups on the core part would decrease antiviral activity. Furthermore, docking results indicated that H-bonds and π bonds were favorable for antiviral activities. Finally, a set of novel derivatives with predicted activities were designed.

Calibration of a stochastic health evolution model using NHIS data

NASA Astrophysics Data System (ADS)

Gupta, Aparna; Li, Zhisheng

2011-10-01

This paper presents and calibrates an individual's stochastic health evolution model. In this health evolution model, the uncertainty of health incidents is described by a stochastic process with a finite number of possible outcomes. We construct a comprehensive health status index (HSI) to describe an individual's health status, as well as a health risk factor system (RFS) to classify individuals into different risk groups. Based on the maximum likelihood estimation (MLE) method and the method of nonlinear least squares fitting, model calibration is formulated in terms of two mixed-integer nonlinear optimization problems. Using the National Health Interview Survey (NHIS) data, the model is calibrated for specific risk groups. Longitudinal data from the Health and Retirement Study (HRS) is used to validate the calibrated model, which displays good validation properties. The end goal of this paper is to provide a model and methodology, whose output can serve as a crucial component of decision support for strategic planning of health related financing and risk management.

Estimating premorbid general cognitive functioning for children and adolescents using the American Wechsler Intelligence Scale for Children-Fourth Edition: demographic and current performance approaches.

PubMed

Schoenberg, Mike R; Lange, Rael T; Brickell, Tracey A; Saklofske, Donald H

2007-04-01

Neuropsychologic evaluation requires current test performance be contrasted against a comparison standard to determine if change has occurred. An estimate of premorbid intelligence quotient (IQ) is often used as a comparison standard. The Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) is a commonly used intelligence test. However, there is no method to estimate premorbid IQ for the WISC-IV, limiting the test's utility for neuropsychologic assessment. This study develops algorithms to estimate premorbid Full Scale IQ scores. Participants were the American WISC-IV standardization sample (N = 2172). The sample was randomly divided into 2 groups (development and validation). The development group was used to generate 12 algorithms. These algorithms were accurate predictors of WISC-IV Full Scale IQ scores in healthy children and adolescents. These algorithms hold promise as a method to predict premorbid IQ for patients with known or suspected neurologic dysfunction; however, clinical validation is required.

Nursing Job Rotation Stress Scale development and psychometric evaluation.

PubMed

Huang, Shan; Lin, Yu-Hua; Kao, Chia-Chan; Yang, Hsing-Yu; Anne, Ya-Li; Wang, Cheng-Hua

2016-01-01

The aim of this study was to develop and assess the reliability and validity of the Nurse Job Rotation Stress Scale (NJRS). A convenience sampling method was utilized to recruit two groups of nurses (n = 150 and 253) from a 2751 bed medical center in southern Taiwan. The NJRS scale was developed and used to evaluate the NJRS. Explorative factor analysis revealed that three factors accounted for 74.11% of the explained variance. Confirmatory factor analysis validity testing supported the three factor structure and the construct validity. Cronbach's alpha for the 10 item model was 0.87 and had high linearity. The NJRS can be considered a reliable and valid scale for the measurement of nurse job rotation stress for nursing management and research purposes. © 2015 Japan Academy of Nursing Science.

Mathematical modeling in realistic mathematics education

NASA Astrophysics Data System (ADS)

Riyanto, B.; Zulkardi; Putri, R. I. I.; Darmawijoyo

2017-12-01

The purpose of this paper is to produce Mathematical modelling in Realistics Mathematics Education of Junior High School. This study used development research consisting of 3 stages, namely analysis, design and evaluation. The success criteria of this study were obtained in the form of local instruction theory for school mathematical modelling learning which was valid and practical for students. The data were analyzed using descriptive analysis method as follows: (1) walk through, analysis based on the expert comments in the expert review to get Hypothetical Learning Trajectory for valid mathematical modelling learning; (2) analyzing the results of the review in one to one and small group to gain practicality. Based on the expert validation and students’ opinion and answers, the obtained mathematical modeling problem in Realistics Mathematics Education was valid and practical.

Developing a preliminary ‘never event’ list for general practice using consensus-building methods

PubMed Central

de Wet, Carl; O’Donnell, Catherine; Bowie, Paul

2014-01-01

Background The ‘never event’ concept has been implemented in many acute hospital settings to help prevent serious patient safety incidents. Benefits include increasing awareness of highly important patient safety risks among the healthcare workforce, promoting proactive implementation of preventive measures, and facilitating incident reporting. Aim To develop a preliminary list of never events for general practice. Design and setting Application of a range of consensus-building methods in Scottish and UK general practices. Method A total of 345 general practice team members suggested potential never events. Next, ‘informed’ staff (n =15) developed criteria for defining never events and applied the criteria to create a list of candidate never events. Finally, UK primary care patient safety ‘experts’ (n = 17) reviewed, refined, and validated a preliminary list via a modified Delphi group and by completing a content validity index exercise. Results There were 721 written suggestions received as potential never events. Thematic categorisation reduced this to 38. Five criteria specific to general practice were developed and applied to produce 11 candidate never events. The expert group endorsed a preliminary list of 10 items with a content validity index (CVI) score of >80%. Conclusion A preliminary list of never events was developed for general practice through practitioner experience and consensus-building methods. This is an important first step to determine the potential value of the never event concept in this setting. It is now intended to undertake further testing of this preliminary list to assess its acceptability, feasibility, and potential usefulness as a safety improvement intervention. PMID:24567655

A method to determine the mammographic regions that show early changes due to the development of breast cancer

NASA Astrophysics Data System (ADS)

Karemore, Gopal; Nielsen, Mads; Karssemeijer, Nico; Brandt, Sami S.

2014-11-01

It is well understood nowadays that changes in the mammographic parenchymal pattern are an indicator of a risk of breast cancer and we have developed a statistical method that estimates the mammogram regions where the parenchymal changes, due to breast cancer, occur. This region of interest is computed from a score map by utilising the anatomical breast coordinate system developed in our previous work. The method also makes an automatic scale selection to avoid overfitting while the region estimates are computed by a nested cross-validation scheme. In this way, it is possible to recover those mammogram regions that show a significant difference in classification scores between the cancer and the control group. Our experiments suggested that the most significant mammogram region is the region behind the nipple and that can be justified by previous findings from other research groups. This result was conducted on the basis of the cross-validation experiments on independent training, validation and testing sets from the case-control study of 490 women, of which 245 women were diagnosed with breast cancer within a period of 2-4 years after the baseline mammograms. We additionally generalised the estimated region to another, mini-MIAS study and showed that the transferred region estimate gives at least a similar classification result when compared to the case where the whole breast region is used. In all, by following our method, one most likely improves both preclinical and follow-up breast cancer screening, but a larger study population will be required to test this hypothesis.

Validated stability-indicating spectrofluorimetric methods for the determination of ebastine in pharmaceutical preparations

PubMed Central

2011-01-01

Two sensitive, selective, economic, and validated spectrofluorimetric methods were developed for the determination of ebastine (EBS) in pharmaceutical preparations depending on reaction with its tertiary amino group. Method I involves condensation of the drug with mixed anhydrides (citric and acetic anhydrides) producing a product with intense fluorescence, which was measured at 496 nm after excitation at 388 nm. Method (IIA) describes quantitative fluorescence quenching of eosin upon addition of the studied drug where the decrease in the fluorescence intensity was directly proportional to the concentration of ebastine; the fluorescence quenching was measured at 553 nm after excitation at 457 nm. This method was extended to (Method IIB) to apply first and second derivative synchronous spectrofluorimetric method (FDSFS & SDSFS) for the simultaneous analysis of EBS in presence of its alkaline, acidic, and UV degradation products. The proposed methods were successfully applied for the determination of the studied compound in its dosage forms. The results obtained were in good agreement with those obtained by a comparison method. Both methods were utilized to investigate the kinetics of the degradation of the drug. PMID:21385439

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Development of performance test instrument in the experiment of law of conservation mass using self and peer assessment’s technique

NASA Astrophysics Data System (ADS)

Siswaningsih, W.; Nahadi; Firmansyah, D. R.

2018-05-01

The purpose of this research is to develop the instrument of performance assessment of law of mass conservation using self and peer assessment technique that meet valid and reliable criteria. The instrument components consist of task and rubric. The method used is development and validation.Value of the instrument reliability obtained from twice observations that are at four and six students every group with three same observers. Cronbach alpha value for four and six students every group consecutively are 0.94 and 0.76, indicating that value shows that the instrument is reliable. Optimum amount of the students that can be observed are four students. The implementation of the instrument to limited group of students showed that All of the students give positive responses to the instrument used with the interpretation of questionnaire scores >90% that categorized as good.

Analysis of genetic association using hierarchical clustering and cluster validation indices.

PubMed

Pagnuco, Inti A; Pastore, Juan I; Abras, Guillermo; Brun, Marcel; Ballarin, Virginia L

2017-10-01

It is usually assumed that co-expressed genes suggest co-regulation in the underlying regulatory network. Determining sets of co-expressed genes is an important task, based on some criteria of similarity. This task is usually performed by clustering algorithms, where the genes are clustered into meaningful groups based on their expression values in a set of experiment. In this work, we propose a method to find sets of co-expressed genes, based on cluster validation indices as a measure of similarity for individual gene groups, and a combination of variants of hierarchical clustering to generate the candidate groups. We evaluated its ability to retrieve significant sets on simulated correlated and real genomics data, where the performance is measured based on its detection ability of co-regulated sets against a full search. Additionally, we analyzed the quality of the best ranked groups using an online bioinformatics tool that provides network information for the selected genes. Copyright © 2017 Elsevier Inc. All rights reserved.

Group refractive index quantification using a Fourier domain short coherence Sagnac interferometer.

PubMed

Montonen, Risto; Kassamakov, Ivan; Lehmann, Peter; Österberg, Kenneth; Hæggström, Edward

2018-02-15

The group refractive index is important in length calibration of Fourier domain interferometers by transparent transfer standards. We demonstrate accurate group refractive index quantification using a Fourier domain short coherence Sagnac interferometer. Because of a justified linear length calibration function, the calibration constants cancel out in the evaluation of the group refractive index, which is then obtained accurately from two uncalibrated lengths. Measurements of two standard thickness coverslips revealed group indices of 1.5426±0.0042 and 1.5434±0.0046, with accuracies quoted at the 95% confidence level. This agreed with the dispersion data of the coverslip manufacturer and therefore validates our method. Our method provides a sample specific and accurate group refractive index quantification using the same Fourier domain interferometer that is to be calibrated for the length. This reduces significantly the requirements of the calibration transfer standard.

Methyl group dynamics in paracetamol and acetanilide: probing the static properties of intermolecular hydrogen bonds formed by peptide groups

NASA Astrophysics Data System (ADS)

Johnson, M. R.; Prager, M.; Grimm, H.; Neumann, M. A.; Kearley, G. J.; Wilson, C. C.

1999-06-01

Measurements of tunnelling and librational excitations for the methyl group in paracetamol and tunnelling excitations for the methyl group in acetanilide are reported. In both cases, results are compared with molecular mechanics calculations, based on the measured low temperature crystal structures, which follow an established recipe. Agreement between calculated and measured methyl group observables is not as good as expected and this is attributed to the presence of comprehensive hydrogen bond networks formed by the peptide groups. Good agreement is obtained with a periodic quantum chemistry calculation which uses density functional methods, these calculations confirming the validity of the one-dimensional rotational model used and the crystal structures. A correction to the Coulomb contribution to the rotational potential in the established recipe using semi-emipircal quantum chemistry methods, which accommodates the modified charge distribution due to the hydrogen bonds, is investigated.

Development and validation of a gene profile predicting benefit of postmastectomy radiotherapy in patients with high-risk breast cancer: a study of gene expression in the DBCG82bc cohort.

PubMed

Tramm, Trine; Mohammed, Hayat; Myhre, Simen; Kyndi, Marianne; Alsner, Jan; Børresen-Dale, Anne-Lise; Sørlie, Therese; Frigessi, Arnoldo; Overgaard, Jens

2014-10-15

To identify genes predicting benefit of radiotherapy in patients with high-risk breast cancer treated with systemic therapy and randomized to receive or not receive postmastectomy radiotherapy (PMRT). The study was based on the Danish Breast Cancer Cooperative Group (DBCG82bc) cohort. Gene-expression analysis was performed in a training set of frozen tumor tissue from 191 patients. Genes were identified through the Lasso method with the endpoint being locoregional recurrence (LRR). A weighted gene-expression index (DBCG-RT profile) was calculated and transferred to quantitative real-time PCR (qRT-PCR) in corresponding formalin-fixed, paraffin-embedded (FFPE) samples, before validation in FFPE from 112 additional patients. Seven genes were identified, and the derived DBCG-RT profile divided the 191 patients into "high LRR risk" and "low LRR risk" groups. PMRT significantly reduced risk of LRR in "high LRR risk" patients, whereas "low LRR risk" patients showed no additional reduction in LRR rate. Technical transfer of the DBCG-RT profile to FFPE/qRT-PCR was successful, and the predictive impact was successfully validated in another 112 patients. A DBCG-RT gene profile was identified and validated, identifying patients with very low risk of LRR and no benefit from PMRT. The profile may provide a method to individualize treatment with PMRT. ©2014 American Association for Cancer Research.

Transtheoretical Model Constructs for Physical Activity Behavior are Invariant across Time among Ethnically Diverse Adults in Hawaii

PubMed Central

Nigg, Claudio R; Motl, Robert W; Horwath, Caroline; Dishman, Rod K

2012-01-01

Objectives Physical activity (PA) research applying the Transtheoretical Model (TTM) to examine group differences and/or change over time requires preliminary evidence of factorial validity and invariance. The current study examined the factorial validity and longitudinal invariance of TTM constructs recently revised for PA. Method Participants from an ethnically diverse sample in Hawaii (N=700) completed questionnaires capturing each TTM construct. Results Factorial validity was confirmed for each construct using confirmatory factor analysis with full-information maximum likelihood. Longitudinal invariance was evidenced across a shorter (3-month) and longer (6-month) time period via nested model comparisons. Conclusions The questionnaires for each validated TTM construct are provided, and can now be generalized across similar subgroups and time points. Further validation of the provided measures is suggested in additional populations and across extended time points. PMID:22778669

Development, validation and utilisation of food-frequency questionnaires - a review.

PubMed

Cade, Janet; Thompson, Rachel; Burley, Victoria; Warm, Daniel

2002-08-01

The purpose of this review is to provide guidance on the development, validation and use of food-frequency questionnaires (FFQs) for different study designs. It does not include any recommendations about the most appropriate method for dietary assessment (e.g. food-frequency questionnaire versus weighed record). A comprehensive search of electronic databases was carried out for publications from 1980 to 1999. Findings from the review were then commented upon and added to by a group of international experts. Recommendations have been developed to aid in the design, validation and use of FFQs. Specific details of each of these areas are discussed in the text. FFQs are being used in a variety of ways and different study designs. There is no gold standard for directly assessing the validity of FFQs. Nevertheless, the outcome of this review should help those wishing to develop or adapt an FFQ to validate it for its intended use.

PSI-Center Simulations of Validation Platform Experiments

NASA Astrophysics Data System (ADS)

Nelson, B. A.; Akcay, C.; Glasser, A. H.; Hansen, C. J.; Jarboe, T. R.; Marklin, G. J.; Milroy, R. D.; Morgan, K. D.; Norgaard, P. C.; Shumlak, U.; Victor, B. S.; Sovinec, C. R.; O'Bryan, J. B.; Held, E. D.; Ji, J.-Y.; Lukin, V. S.

2013-10-01

The Plasma Science and Innovation Center (PSI-Center - http://www.psicenter.org) supports collaborating validation platform experiments with extended MHD simulations. Collaborators include the Bellan Plasma Group (Caltech), CTH (Auburn U), FRX-L (Los Alamos National Laboratory), HIT-SI (U Wash - UW), LTX (PPPL), MAST (Culham), Pegasus (U Wisc-Madison), PHD/ELF (UW/MSNW), SSX (Swarthmore College), TCSU (UW), and ZaP/ZaP-HD (UW). Modifications have been made to the NIMROD, HiFi, and PSI-Tet codes to specifically model these experiments, including mesh generation/refinement, non-local closures, appropriate boundary conditions (external fields, insulating BCs, etc.), and kinetic and neutral particle interactions. The PSI-Center is exploring application of validation metrics between experimental data and simulations results. Biorthogonal decomposition is proving to be a powerful method to compare global temporal and spatial structures for validation. Results from these simulation and validation studies, as well as an overview of the PSI-Center status will be presented.

Development and evaluation of an instrument to measure health-related quality of life in Cuban breast cancer patients receiving radiotherapy.

PubMed

Lugo, Josefina; Nápoles, Misleidy; Pérez, Inés; Ordaz, Niurka; Luzardo, Mario; Fernández, Leticia

2014-01-01

INTRODUCTION Although modern technology has extended the survival of breast cancer patients, treatment's adverse effects impact their health-related quality of life. Currently, no instrument exists capable of identifying the range of problems affecting breast cancer patients receiving radiotherapy in Cuba's socioeconomic and cultural context. OBJECTIVES Construct and validate an instrument to measure the effects of breast cancer and radiotherapy on health-related quality of life in Cuban patients. METHODS The study was conducted at the Oncology and Radiobiology Institute, Havana, Cuba, from January 2010 through December 2011. Inclusion criteria were: adult female, histological diagnosis of breast cancer, treated with ambulatory radiotherapy, and written informed consent; patients unable to communicate orally or in writing, or who had neurologic or psychiatric conditions were excluded. Development phase: focus groups guided by a list of questions were carried out with 50 women. The patients reported 61 problems affecting their health-related quality-of-life. A nominal group (six oncologists and two nurses) identified the same problems. A syntactic analysis of the information was performed to create items for study and measurement scales. Content validity was determined by a nominal group of seven experts using professional judgment. Another 20 patients were selected to evaluate face validity. Validation phase: the instrument was applied to 230 patients at three different points: before radiotherapy, at the end of radiotherapy and four weeks after radiotherapy was concluded. Reliability, construct validity, discriminant validity, predictive validity, interpretability and response burden were evaluated. RESULTS The final instrument developed had 33 items distributed in 4 domains: physical functioning, psychological functioning, social and family relationships, and physical and emotional adverse effects of disease and treatment. There were two discrete items: perceived general health and perceived health-related quality of life. Content validity and face validity were assessed as acceptable, by experts and patients respectively. Homogeneity, construct validity, and discriminant validity were satisfactory. The best results were obtained with test-retest reliability, predictive validity, and interpretability; the low rate of unanswered questions indicated that the instrument did not produce excessive patient response burden. CONCLUSION The new instrument fulfilled the requirements for measuring impact of breast cancer and of radiotherapy on health-related quality of life in these Cuban patients, validating its usefulness for inclusion in clinical trial protocols.

Laparoscopic Common Bile Duct Exploration Four-Task Training Model: Construct Validity

PubMed Central

Otaño, Natalia; Rodríguez, Omaira; Sánchez, Renata; Benítez, Gustavo; Schweitzer, Michael

2012-01-01

Background: Training models in laparoscopic surgery allow the surgical team to practice procedures in a safe environment. We have proposed the use of a 4-task, low-cost inert model to practice critical steps of laparoscopic common bile duct exploration. Methods: The performance of 3 groups with different levels of expertise in laparoscopic surgery, novices (A), intermediates (B), and experts (C), was evaluated using a low-cost inert model in the following tasks: (1) intraoperative cholangiography catheter insertion, (2) transcystic exploration, (3) T-tube placement, and (4) choledochoscope management. Kruskal-Wallis and Mann-Whitney tests were used to identify differences among the groups. Results: A total of 14 individuals were evaluated: 5 novices (A), 5 intermediates (B), and 4 experts (C). The results involving intraoperative cholangiography catheter insertion were similar among the 3 groups. As for the other tasks, the expert had better results than the other 2, in which no significant differences occurred. The proposed model is able to discriminate among individuals with different levels of expertise, indicating that the abilities that the model evaluates are relevant in the surgeon's performance in CBD exploration. Conclusions: Construct validity for tasks 2 and 3 was demonstrated. However, task 1 was no capable of distinguishing between groups, and task 4 was not statistically validated. PMID:22906323

The validity of a simple outcome measure to assess stuttering therapy.

PubMed

Huinck, Wendy; Rietveld, Toni

2007-01-01

The validity of a simple and not time-consuming self-assessment (SA) Scale was tested to establish progress after or during stuttering therapy. The scores on the SA scale were related to (1) objective measures (percentage of stuttered syllables, and syllables per minute) and (2) (self-)evaluation tests (self-evaluation questionnaires and perceptual evaluations or judgments of disfluency, naturalness and comfort by naïve listeners). Data were collected from two groups of stutterers at four measurement times: pretherapy, posttherapy, 12 months after therapy and 24 months after therapy. The first group attended the Comprehensive Stuttering Program: an integrated program based on fluency shaping techniques, and the second group participated in a Dutch group therapy: the Doetinchem Method that focuses on emotions and cognitions related to stuttering. Results showed similar score patterns on the SA scale, the self-evaluation questionnaires, the objective measures over time, and significant correlations between the SA scale and syllables per minute, percentage of stuttered syllables, Struggle subscale of the Perceptions of Stuttering Inventory and judged fluency on the T1-T2 difference scores. We concluded that the validity of the SA measure was proved and therefore encourage the use of such an instrument when (stuttering) treatment efficacy is studied.

Misclassification due to age grouping in measures of child development.

PubMed

Veldhuizen, Scott; Rodriguez, Christine; Wade, Terrance J; Cairney, John

2015-03-01

Screens for developmental delay generally provide a set of norms for different age groups. Development varies continuously with age, however, and applying a single criterion for an age range will inevitably produce misclassifications. In this report, we estimate the resulting error rate for one example: the cognitive subscale of the Bayley Scales of Infant and Toddler Development (BSID-III). Data come from a general population sample of 594 children (305 male) aged 1 month to 42.5 months who received the BSID-III as part of a validation study. We used regression models to estimate the mean and variance of the cognitive subscale as a function of age. We then used these results to generate a dataset of one million simulated participants and compared their status before and after division into age groups. Finally, we applied broader age bands used in two other instruments and explored likely validity limitations when different instruments are compared. When BSID-III age groups are used, 15% of cases are missed and 15% of apparent cases are false positives. Wider age groups produced error rates from 27% to 46%. Comparison of different age groups suggests that sensitivity in validation studies would be limited, under certain assumptions, to 70% or less. The use of age groups produces a large number of misclassifications. Although affected children will usually be close to the threshold, this may lead to misreferrals. Results may help to explain the poor measured agreement of development screens. Scoring methods that treat child age as continuous would improve instrument accuracy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development of a quantitative multi-compound method for the detection of 14 nitrogen-rich adulterants by LC-MS/MS in food materials.

PubMed

Frank, Nancy; Bessaire, Thomas; Tarres, Adrienne; Goyon, Alexandre; Delatour, Thierry

2017-11-01

The increasing number of food frauds using exogenous nitrogen-rich adulterants to artificially raise the protein content for economically motivated adulteration has demonstrated the need for a robust analytical methodology. This method should be applicable for quality control in operations covering a wide range of analyte concentrations to be able to analyse high levels as usually found in adulteration, as well as low levels due to contamination. The paper describes a LC-MS/MS method covering 14 nitrogen-rich adulterants using a simple and fast sample preparation based on dilution and clean-up by dispersive SPE. Quantification is carried out by isotopic dilution reaching LOQs of 0.05-0.20 mg/kg in a broad range of food matrices (infant formula, liquid milk, dairy ingredient, high protein meal, cereal, infant cereal, and meat/fish powder). Validation of seven commodity groups was performed according to SANCO 12571/2013, giving satisfactory results demonstrating the method's fitness for purpose at the validated range at contamination level. Method ruggedness was further assessed by transferring the developed method into another laboratory devoted to routine testing for quality control. Next to the method description, emphasis is placed on challenges and problems appearing during method development as well as validation. They are discussed in detail and solutions are provided.

Onto-clust--a methodology for combining clustering analysis and ontological methods for identifying groups of comorbidities for developmental disorders.

PubMed

Peleg, Mor; Asbeh, Nuaman; Kuflik, Tsvi; Schertz, Mitchell

2009-02-01

Children with developmental disorders usually exhibit multiple developmental problems (comorbidities). Hence, such diagnosis needs to revolve on developmental disorder groups. Our objective is to systematically identify developmental disorder groups and represent them in an ontology. We developed a methodology that combines two methods (1) a literature-based ontology that we created, which represents developmental disorders and potential developmental disorder groups, and (2) clustering for detecting comorbid developmental disorders in patient data. The ontology is used to interpret and improve clustering results and the clustering results are used to validate the ontology and suggest directions for its development. We evaluated our methodology by applying it to data of 1175 patients from a child development clinic. We demonstrated that the ontology improves clustering results, bringing them closer to an expert generated gold-standard. We have shown that our methodology successfully combines an ontology with a clustering method to support systematic identification and representation of developmental disorder groups.

Compatible validated spectrofluorimetric and spectrophotometric methods for determination of vildagliptin and saxagliptin by factorial design experiments.

PubMed

Abdel-Aziz, Omar; Ayad, Miriam F; Tadros, Mariam M

2015-04-05

Simple, selective and reproducible spectrofluorimetric and spectrophotometric methods have been developed for the determination of vildagliptin and saxagliptin in bulk and their pharmaceutical dosage forms. The first proposed spectrofluorimetric method is based on the dansylation reaction of the amino group of vildagliptin with dansyl chloride to form a highly fluorescent product. The formed product was measured spectrofluorimetrically at 455 nm after excitation at 345 nm. Beer's law was obeyed in a concentration range of 100-600 μg ml(-1). The second proposed spectrophotometric method is based on the charge transfer complex of saxagliptin with tetrachloro-1,4-benzoquinone (p-chloranil). The formed charge transfer complex was measured spectrophotometrically at 530 nm. Beer's law was obeyed in a concentration range of 100-850 μg ml(-1). The third proposed spectrophotometric method is based on the condensation reaction of the primary amino group of saxagliptin with formaldehyde and acetyl acetone to form a yellow colored product known as Hantzsch reaction, measured at 342.5 nm. Beer's law was obeyed in a concentration range of 50-300 μg ml(-1). All the variables were studied to optimize the reactions' conditions using factorial design. The developed methods were validated and proved to be specific and accurate for quality control of vildagliptin and saxagliptin in their pharmaceutical dosage forms. Copyright © 2015. Published by Elsevier B.V.

Compatible validated spectrofluorimetric and spectrophotometric methods for determination of vildagliptin and saxagliptin by factorial design experiments

NASA Astrophysics Data System (ADS)

Abdel-Aziz, Omar; Ayad, Miriam F.; Tadros, Mariam M.

2015-04-01

Simple, selective and reproducible spectrofluorimetric and spectrophotometric methods have been developed for the determination of vildagliptin and saxagliptin in bulk and their pharmaceutical dosage forms. The first proposed spectrofluorimetric method is based on the dansylation reaction of the amino group of vildagliptin with dansyl chloride to form a highly fluorescent product. The formed product was measured spectrofluorimetrically at 455 nm after excitation at 345 nm. Beer's law was obeyed in a concentration range of 100-600 μg ml-1. The second proposed spectrophotometric method is based on the charge transfer complex of saxagliptin with tetrachloro-1,4-benzoquinone (p-chloranil). The formed charge transfer complex was measured spectrophotometrically at 530 nm. Beer's law was obeyed in a concentration range of 100-850 μg ml-1. The third proposed spectrophotometric method is based on the condensation reaction of the primary amino group of saxagliptin with formaldehyde and acetyl acetone to form a yellow colored product known as Hantzsch reaction, measured at 342.5 nm. Beer's law was obeyed in a concentration range of 50-300 μg ml-1. All the variables were studied to optimize the reactions' conditions using factorial design. The developed methods were validated and proved to be specific and accurate for quality control of vildagliptin and saxagliptin in their pharmaceutical dosage forms.

Questionnaire to assess patient satisfaction with pharmaceutical care in Spanish language.

PubMed

Traverso, María Luz; Salamano, Mercedes; Botta, Carina; Colautti, Marisel; Palchik, Valeria; Pérez, Beatriz

2007-08-01

To develop and validate a questionnaire, in Spanish, for assessing patient satisfaction with pharmaceutical care received in community pharmacies. Selection and translation of questionnaire's items; definition of response scale and demographic questions. Evaluation of face and content validity, feasibility, factor structure, reliability and construct validity. Forty-one community pharmacies of the province of Santa Fe. Argentina. Questionnaire administered to patients receiving pharmaceutical care or traditional pharmacy services. Pilot test to assess feasibility. Factor analysis used principal components and varimax rotation. Reliability established using internal consistency with Cronbach's alpha. Construct validity determined with extreme group method. A self-administered questionnaire with 27 items, 5-point Likert response scale and demographic questions was designed considering multidimensional structure of patient satisfaction. Questionnaire evaluates cumulative experience of patients with comprehensive pharmaceutical care practice in community pharmacies. Two hundred and seventy-four complete questionnaires were obtained. Factor analysis resulted in three factors: Managing therapy, Interpersonal relationship and General satisfaction, with a cumulative variance of 62.51%. Cronbach's alpha for the whole questionnaire was 0.96, and 0.95, 0.88 and 0.76 for the three factors, respectively. Mann-Whitney test for construct validity did not showed significant differences between pharmacies that provide pharmaceutical care and those that do not, however, 23 items showed significant differences between the two groups of pharmacies. The questionnaire developed can be a reliable and valid instrument to assess patient satisfaction with pharmaceutical care in community pharmacies in Spanish. Further research is needed to deepen the validation process.

Land surveys show regional variability of historical fire regimes and dry forest structure of the western United States.

PubMed

Baker, William L; Williams, Mark A

2018-03-01

An understanding of how historical fire and structure in dry forests (ponderosa pine, dry mixed conifer) varied across the western United States remains incomplete. Yet, fire strongly affects ecosystem services, and forest restoration programs are underway. We used General Land Office survey reconstructions from the late 1800s across 11 landscapes covering ~1.9 million ha in four states to analyze spatial variation in fire regimes and forest structure. We first synthesized the state of validation of our methods using 20 modern validations, 53 historical cross-validations, and corroborating evidence. These show our method creates accurate reconstructions with low errors. One independent modern test reported high error, but did not replicate our method and made many calculation errors. Using reconstructed parameters of historical fire regimes and forest structure from our validated methods, forests were found to be non-uniform across the 11 landscapes, but grouped together in three geographical areas. Each had a mixture of fire severities, but dominated by low-severity fire and low median tree density in Arizona, mixed-severity fire and intermediate to high median tree density in Oregon-California, and high-severity fire and intermediate median tree density in Colorado. Programs to restore fire and forest structure could benefit from regional frameworks, rather than one size fits all. © 2018 by the Ecological Society of America.

Comparison of scoring approaches for the NEI VFQ-25 in low vision.

PubMed

Dougherty, Bradley E; Bullimore, Mark A

2010-08-01

The aim of this study was to evaluate different approaches to scoring the National Eye Institute Visual Functioning Questionnaire-25 (NEI VFQ-25) in patients with low vision including scoring by the standard method, by Rasch analysis, and by use of an algorithm created by Massof to approximate Rasch person measure. Subscale validity and use of a 7-item short form instrument proposed by Ryan et al. were also investigated. NEI VFQ-25 data from 50 patients with low vision were analyzed using the standard method of summing Likert-type scores and calculating an overall average, Rasch analysis using Winsteps software, and the Massof algorithm in Excel. Correlations between scores were calculated. Rasch person separation reliability and other indicators were calculated to determine the validity of the subscales and of the 7-item instrument. Scores calculated using all three methods were highly correlated, but evidence of floor and ceiling effects was found with the standard scoring method. None of the subscales investigated proved valid. The 7-item instrument showed acceptable person separation reliability and good targeting and item performance. Although standard scores and Rasch scores are highly correlated, Rasch analysis has the advantages of eliminating floor and ceiling effects and producing interval-scaled data. The Massof algorithm for approximation of the Rasch person measure performed well in this group of low-vision patients. The validity of the subscales VFQ-25 should be reconsidered.

Determining blood and plasma volumes using bioelectrical response spectroscopy

NASA Technical Reports Server (NTRS)

Siconolfi, S. F.; Nusynowitz, M. L.; Suire, S. S.; Moore, A. D. Jr; Leig, J.

1996-01-01

We hypothesized that an electric field (inductance) produced by charged blood components passing through the many branches of arteries and veins could assess total blood volume (TBV) or plasma volume (PV). Individual (N = 29) electrical circuits (inductors, two resistors, and a capacitor) were determined from bioelectrical response spectroscopy (BERS) using a Hewlett Packard 4284A Precision LCR Meter. Inductance, capacitance, and resistance from the circuits of 19 subjects modeled TBV (sum of PV and computed red cell volume) and PV (based on 125I-albumin). Each model (N = 10, cross validation group) had good validity based on 1) mean differences (-2.3 to 1.5%) between the methods that were not significant and less than the propagated errors (+/- 5.2% for TBV and PV), 2) high correlations (r > 0.92) with low SEE (< 7.7%) between dilution and BERS assessments, and 3) Bland-Altman pairwise comparisons that indicated "clinical equivalency" between the methods. Given the limitation of this study (10 validity subjects), we concluded that BERS models accurately assessed TBV and PV. Further evaluations of the models' validities are needed before they are used in clinical or research settings.

QuEChERS GC-MS validation and monitoring of pesticide residues in different foods in the tomato classification group.

PubMed

Ramírez Restrepo, Andrés; Gallo Ortiz, Andrés Fernando; Hoyos Ossa, Duvan Esteban; Peñuela Mesa, Gustavo Antonio

2014-09-01

The objective of this study was to validate (SANCO/12495/2011 and NTC-ISO/IEC 17025) multi-residue multi-class methods using QuEChERS sample preparation and GC-MS for the analysis of regulated pesticides in tomatoes (Solanum lycopersicum), tamarillos (Solanum betaceum) and goldenberries (Physalis peruviana). These Latin American products are representative and widely produced in Antioquia (Colombia). Sample preparation followed the UNE-EN 15662 method (150 mg MgSO4, 25mg primary secondary amines and 25mg of octadecylsiloxane for cleanup; graphitized carbon black was added for tomatoes). Extracts were injected using a programmed temperature-vaporizing injector. The residues were validated over a range from 0.02 mg/kg to 0.20 mg/kg, with 24 analytes validated in tomatoes, 33 in tamarillos and 28 in goldenberries. An initial risk assessment was enabled by monitoring 24 samples in the municipalities of El Peñol, Marinilla and San Vicente Ferrer. Risks were found for tomatoes, but no significant risks were found for tamarillos or goldenberries. Copyright © 2014 Elsevier Ltd. All rights reserved.

Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context

PubMed Central

Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; da Silva, Daniel Dutra Romualdo; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

2016-01-01

ABSTRACT Objective: to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. Method: this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis: Results: the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. Conclusion: a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. PMID:27508911

The local lymph node assay and the assessment of relative potency: status of validation.

PubMed

Basketter, David A; Gerberick, Frank; Kimber, Ian

2007-08-01

For the prediction of skin sensitization potential, the local lymph node assay (LLNA) is a fully validated alternative to guinea-pig tests. More recently, information from LLNA dose-response analyses has been used to assess the relative potency of skin sensitizing chemicals. These data are then deployed for risk assessment and risk management. In this commentary, the utility and validity of these relative potency measurements are reviewed. It is concluded that the LLNA does provide a valuable assessment of relative sensitizing potency in the form of the estimated concentration of a chemical required to produce a threefold stimulation of draining lymph node cell proliferation compared with concurrent controls (EC3 value) and that all reasonable validation requirements have been addressed successfully. EC3 measurements are reproducible in both intra- and interlaboratory evaluations and are stable over time. It has been shown also, by several independent groups, that EC3 values correlate closely with data on relative human skin sensitization potency. Consequently, the recommendation made here is that LLNA EC3 measurements should now be regarded as a validated method for the determination of the relative potency of skin sensitizing chemicals, a conclusion that has already been reached by a number of independent expert groups.

A Spanish Validation of the Canadian Adolescent Gambling Inventory (CAGI)

PubMed Central

Jiménez-Murcia, Susana; Granero, Roser; Stinchfield, Randy; Tremblay, Joël; del Pino-Gutiérrez, Amparo; Moragas, Laura; Savvidou, Lamprini G.; Fernández-Aranda, Fernando; Aymamí, Neus; Gómez-Peña, Mónica; Tárrega, Salomé; Gunnard, Katarina; Martín-Romera, Virginia; Steward, Trevor; Mestre-Bach, Gemma; Menchón, José M.

2017-01-01

Aims: Large-scale epidemiological studies show a significant prevalence of gambling disorder (GD) during adolescence and emerging adulthood, and highlight the need to identify gambling-related behaviors at early ages. However, there are only a handful of screening instruments for this population and many studies measuring youth gambling problems use adult instruments that may not be developmentally appropriate. The aim of this study was to validate a Spanish version of the Canadian Adolescent Gambling Inventory (CAGI) among late adolescent and young adults and to explore its psychometric properties. Methods: The sample (16–29 years old) included a clinical group (n = 55) with GD patients and a control group (n = 340). Results: Exploratory factor analysis yielded one factor as the best model. This 24-item scale demonstrated satisfactory reliability (internal consistency, Cronbach’s alpha, α = 0.91), satisfactory convergent validity as measured by correlation with South Oaks Gambling Screen (r = 0.74), and excellent classification accuracy (AUC = 0.99; sensitivity = 0.98; and specificity = 0.99). Conclusion: Our results provide empirical support for our validation of the Spanish version of the CAGI. We uphold that the Spanish CAGI can be used as a brief, reliable, and valid instrument to assess gambling problems in Spanish youth. PMID:28223961

Validation of Direct Analysis Real Time source/Time-of-Flight Mass Spectrometry for organophosphate quantitation on wafer surface.

PubMed

Hayeck, Nathalie; Ravier, Sylvain; Gemayel, Rachel; Gligorovski, Sasho; Poulet, Irène; Maalouly, Jacqueline; Wortham, Henri

2015-11-01

Microelectronic wafers are exposed to airborne molecular contamination (AMC) during the fabrication process of microelectronic components. The organophosphate compounds belonging to the dopant group are one of the most harmful groups. Once adsorbed on the wafer surface these compounds hardly desorb and could diffuse in the bulk of the wafer and invert the wafer from p-type to n-type. The presence of these compounds on wafer surface could have electrical effect on the microelectronic components. For these reasons, it is of importance to control the amount of these compounds on the surface of the wafer. As a result, a fast quantitative and qualitative analytical method, nondestructive for the wafers, is needed to be able to adjust the process and avoid the loss of an important quantity of processed wafers due to the contamination by organophosphate compounds. Here we developed and validated an analytical method for the determination of organic compounds adsorbed on the surface of microelectronic wafers using the Direct Analysis in Real Time-Time of Flight-Mass Spectrometry (DART-ToF-MS) system. Specifically, the developed methodology concerns the organophosphate group. Copyright © 2015 Elsevier B.V. All rights reserved.

Complete characterization of the stability of cluster synchronization in complex dynamical networks.

PubMed

Sorrentino, Francesco; Pecora, Louis M; Hagerstrom, Aaron M; Murphy, Thomas E; Roy, Rajarshi

2016-04-01

Synchronization is an important and prevalent phenomenon in natural and engineered systems. In many dynamical networks, the coupling is balanced or adjusted to admit global synchronization, a condition called Laplacian coupling. Many networks exhibit incomplete synchronization, where two or more clusters of synchronization persist, and computational group theory has recently proved to be valuable in discovering these cluster states based on the topology of the network. In the important case of Laplacian coupling, additional synchronization patterns can exist that would not be predicted from the group theory analysis alone. Understanding how and when clusters form, merge, and persist is essential for understanding collective dynamics, synchronization, and failure mechanisms of complex networks such as electric power grids, distributed control networks, and autonomous swarming vehicles. We describe a method to find and analyze all of the possible cluster synchronization patterns in a Laplacian-coupled network, by applying methods of computational group theory to dynamically equivalent networks. We present a general technique to evaluate the stability of each of the dynamically valid cluster synchronization patterns. Our results are validated in an optoelectronic experiment on a five-node network that confirms the synchronization patterns predicted by the theory.

An Emic, Mixed Methods Approach to Defining and Measuring Positive Parenting Among Low-Income, Black Families

PubMed Central

McWayne, Christine; Mattis, Jacqueline S.; Wright, Linnie E. Green; Limlingan, Maria Cristina; Harris, Elise

2017-01-01

Research Findings This within-group exploratory sequential mixed methods investigation sought to identify how ethnically diverse, urban-residing, low-income Black families conceptualize positive parenting. During the item development phase 119 primary caregivers from Head Start programs participated in focus groups and interviews. These qualitative data were content analyzed using a three-stage iterative process that resulted in the development of a final set of 72 items for a paper-and-pencil measure. In the measure validation phase of the study initial construct validity of the 72-item measure was assessed with an independent sample of 665 respondents. Common factor analyses revealed five dimensions of positive parenting on the Black Parenting Strengths in Context (BPSC) scale that related in expected ways with other parent self-report measures. Practice and Policy BPSC dimensions provide initial support for a more nuanced operationalization of positive parenting than currently exists in any single scale for use with this group, and hold promise for better honoring the culture- and context-specific parenting goals and practices that low-income, Black parents subjectively view as important for producing healthy developmental outcomes for their children. PMID:29333053

An adaptation of the MMPI-2 Meyers Index for the MMPI-2-RF.

PubMed

Meyers, John E; Miller, Ronald M; Haws, Nathan A; Murphy-Tafiti, Jason L; Curtis, Thomas D; Rupp, Zachary W; Smart, Taylor A; Thompson, Lisa M

2014-01-01

Using an overall sample of 278 individuals who had taken the Minnesota Multiphasic Personality Inventory-Second Edition (MMPI-2) and who had clear diagnostic information available in their medical records, the Meyers Index (MI) for the MMPI-2 (Meyers, Millis, & Volkert, 2002 ) was calculated for each individual, and a new version of the MI created for the MMPI-2 Restructured Form (MMPI-2-RF) was calculated. The MI is a method of combining multiple MMPI-2 validity scales into a single weighted index to assess exaggerated self-report on the MMPI-2. The new index is intended to provide the same type of global assessment of validity but for the MMPI-2-RF (MI-r). The MI and the MI-r were compared at both individual and group levels and were found to correlate well (r = .87). Diagnostic groups of litigants and nonlitigants of traumatic brain injury, chronic pain, and posttraumatic stress disorder were also examined; and the performance of the MI and the MI-r were similar. Similarly, the pass and fail agreement rate for the two scales was 93%. The results indicate that the MI and MI-r perform very similarly and are good methods of assessing overall validity of MMPI-2 and MMPI-2-RF test performance.

Experimental rhinovirus infection in volunteers.

PubMed

Bardin, P G; Sanderson, G; Robinson, B S; Holgate, S T; Tyrrell, D A

1996-11-01

Experimental viral disease studies in volunteers have clarified many aspects of the pathogenesis of human viral disease. Recently, interest has focused on rhinovirus-associated asthma exacerbations, and new volunteer studies have suggested that airway responsiveness (AR) is enhanced during a cold. For scientific, ethical and safety reasons, it is important to use validated methods for the preparation of a virus inoculum and that the particular virological characteristics and host responses should not be altered. We have prepared a new human rhinovirus (HRV) inoculum using recent guidelines and assessed whether disease characteristics (for example, severity of colds or changes in AR) were retained. Studies were conducted in 25 clinically healthy volunteers using a validated HRV inoculum in the first 17 and a new inoculum in the subsequent eight subjects. Severity of cold symptoms, nasal wash albumin levels and airway responsiveness were measured, and the new inoculum was prepared from nasal washes obtained during the cold. The new inoculum was tested using standard virological and serological techniques, as well as a polymerase chain reaction for Mycoplasma pneumoniae. No contaminating viruses or organisms were detected and the methods suggested were workable. Good clinical colds developed in 20 of the 25 subjects and median symptom scores were similar in the validated and new inoculum groups (18 and 17.5, respectively; p=0.19). All subjects shed virus, and there were no differences noted in viral culture scores, nasal wash albumin and rates of seroconversion in the two groups. Although airway responsiveness increased in both groups (p=0.02 and p=0.05), the degree of change was similar. We have performed experimental rhinovirus infection studies and demonstrated similar clinical disease in two inoculum groups. Amplified airway responsiveness was induced; continuing studies will define the mechanisms and suggest modes of treatment.

Physiotherapy for patients with soft tissue shoulder disorders: a systematic review of randomised clinical trials.

PubMed Central

van der Heijden, G. J.; van der Windt, D. A.; de Winter, A. F.

1997-01-01

OBJECTIVE: To assess the effectiveness of physiotherapy for patients with soft tissue shoulder disorders. DESIGN: A systematic computerised literature search of Medline and Embase, supplemented with citation tracking, for relevant trials with random allocation published before 1996. SUBJECTS: Patients treated with physiotherapy for disorders of soft tissue of the shoulder. MAIN OUTCOME MEASURES: Success rates, mobility, pain, functional status. RESULTS: Six of the 20 assessed trials satisfied at least five of eight validity criteria. Assessment of methods was often hampered by insufficient information on various validity criteria, and trials were often flawed by lack of blinding, high proportions of withdrawals from treatment, and high proportions of missing values. Trial sizes were small: only six trials included intervention groups of more than 25 patients. Ultrasound therapy, evaluated in six trials, was not shown to be effective. Four other trials favoured physiotherapy (laser therapy or manipulation), but the validity of their methods was unsatisfactory. CONCLUSIONS: There is evidence that ultrasound therapy is ineffective in the treatment of soft tissue shoulder disorders. Due to small trial sizes and unsatisfactory methods, evidence for the effectiveness of other methods of physiotherapy is inconclusive. For all methods of treatment, trials were too heterogeneous with respect to included patients, index and reference treatments, and follow up to merit valid statistical pooling. Future studies should show whether physiotherapy is superior to treatment with drugs, steroid injections, or a wait and see policy. PMID:9233322

Spanish version of the Thought-Action Fusion Questionnaire and its application in eating disorders

PubMed Central

Jáuregui-Lobera, I; Santed-Germán, Ma; Bolaños-Ríos, P; Garrido-Casals, O

2013-01-01

Purpose The aims of the study were to analyze the psychometric properties of the Spanish version of the Thought-Action Fusion Questionnaire (TAF-SP), as well as to determine its validity by evaluating the relationship of the TAF-SP to different instruments. Patients and methods Two groups were studied: one comprising 146 patients with eating disorders; and another a group of 200 students. Results Three factors were obtained: TAF–Moral; TAF–Likelihood-others; and TAF–Likelihood-oneself. The internal consistency of the TAF-SP was determined by means of Cronbach’s α coefficient, with values ranging between 0.84–0.95. The correlations with other instruments refected adequate validity. The three-factor structure was tested by means of a linear structural equation model, and the structure fit satisfactorily. Differences in TAF-SP scores between the diagnostic subgroups were also analyzed. Conclusion The TAF-SP meets the psychometric requirements for measuring thought-action fusion and shows adequate internal consistency and validity. PMID:24043960

Method for appraising model validity of randomised controlled trials of homeopathic treatment: multi-rater concordance study

PubMed Central

2012-01-01

Background A method for assessing the model validity of randomised controlled trials of homeopathy is needed. To date, only conventional standards for assessing intrinsic bias (internal validity) of trials have been invoked, with little recognition of the special characteristics of homeopathy. We aimed to identify relevant judgmental domains to use in assessing the model validity of homeopathic treatment (MVHT). We define MVHT as the extent to which a homeopathic intervention and the main measure of its outcome, as implemented in a randomised controlled trial (RCT), reflect 'state-of-the-art' homeopathic practice. Methods Using an iterative process, an international group of experts developed a set of six judgmental domains, with associated descriptive criteria. The domains address: (I) the rationale for the choice of the particular homeopathic intervention; (II) the homeopathic principles reflected in the intervention; (III) the extent of homeopathic practitioner input; (IV) the nature of the main outcome measure; (V) the capability of the main outcome measure to detect change; (VI) the length of follow-up to the endpoint of the study. Six papers reporting RCTs of homeopathy of varying design were randomly selected from the literature. A standard form was used to record each assessor's independent response per domain, using the optional verdicts 'Yes', 'Unclear', 'No'. Concordance among the eight verdicts per domain, across all six papers, was evaluated using the kappa (κ) statistic. Results The six judgmental domains enabled MVHT to be assessed with 'fair' to 'almost perfect' concordance in each case. For the six RCTs examined, the method allowed MVHT to be classified overall as 'acceptable' in three, 'unclear' in two, and 'inadequate' in one. Conclusion Future systematic reviews of RCTs in homeopathy should adopt the MVHT method as part of a complete appraisal of trial validity. PMID:22510227

Development and Validation of a qRT-PCR Classifier for Lung Cancer Prognosis

PubMed Central

Chen, Guoan; Kim, Sinae; Taylor, Jeremy MG; Wang, Zhuwen; Lee, Oliver; Ramnath, Nithya; Reddy, Rishindra M; Lin, Jules; Chang, Andrew C; Orringer, Mark B; Beer, David G

2011-01-01

Purpose This prospective study aimed to develop a robust and clinically-applicable method to identify high-risk early stage lung cancer patients and then to validate this method for use in future translational studies. Patients and Methods Three published Affymetrix microarray data sets representing 680 primary tumors were used in the survival-related gene selection procedure using clustering, Cox model and random survival forest (RSF) analysis. A final set of 91 genes was selected and tested as a predictor of survival using a qRT-PCR-based assay utilizing an independent cohort of 101 lung adenocarcinomas. Results The RSF model built from 91 genes in the training set predicted patient survival in an independent cohort of 101 lung adenocarcinomas, with a prediction error rate of 26.6%. The mortality risk index (MRI) was significantly related to survival (Cox model p < 0.00001) and separated all patients into low, medium, and high-risk groups (HR = 1.00, 2.82, 4.42). The MRI was also related to survival in stage 1 patients (Cox model p = 0.001), separating patients into low, medium, and high-risk groups (HR = 1.00, 3.29, 3.77). Conclusions The development and validation of this robust qRT-PCR platform allows prediction of patient survival with early stage lung cancer. Utilization will now allow investigators to evaluate it prospectively by incorporation into new clinical trials with the goal of personalized treatment of lung cancer patients and improving patient survival. PMID:21792073

Developing a preliminary 'never event' list for general practice using consensus-building methods.

PubMed

de Wet, Carl; O'Donnell, Catherine; Bowie, Paul

2014-03-01

The 'never event' concept has been implemented in many acute hospital settings to help prevent serious patient safety incidents. Benefits include increasing awareness of highly important patient safety risks among the healthcare workforce, promoting proactive implementation of preventive measures, and facilitating incident reporting. To develop a preliminary list of never events for general practice. Application of a range of consensus-building methods in Scottish and UK general practices. A total of 345 general practice team members suggested potential never events. Next, 'informed' staff (n =15) developed criteria for defining never events and applied the criteria to create a list of candidate never events. Finally, UK primary care patient safety 'experts' (n = 17) reviewed, refined, and validated a preliminary list via a modified Delphi group and by completing a content validity index exercise. There were 721 written suggestions received as potential never events. Thematic categorisation reduced this to 38. Five criteria specific to general practice were developed and applied to produce 11 candidate never events. The expert group endorsed a preliminary list of 10 items with a content validity index (CVI) score of >80%. A preliminary list of never events was developed for general practice through practitioner experience and consensus-building methods. This is an important first step to determine the potential value of the never event concept in this setting. It is now intended to undertake further testing of this preliminary list to assess its acceptability, feasibility, and potential usefulness as a safety improvement intervention.

Simultaneous quantification and semi-quantification of ginkgolic acids and their metabolites in rat plasma by UHPLC-LTQ-Orbitrap-MS and its application to pharmacokinetics study.

PubMed

Qian, Yiyun; Zhu, Zhenhua; Duan, Jin-Ao; Guo, Sheng; Shang, Erxin; Tao, Jinhua; Su, Shulan; Guo, Jianming

2017-01-15

A highly sensitive method using ultra-high-pressure liquid chromatography coupled with linear ion trap-Orbitrap tandem mass spectrometry (UHPLC-LTQ-Orbitrap-MS) has been developed and validated for the simultaneous identification and quantification of ginkgolic acids and semi-quantification of their metabolites in rat plasma. For the five selected ginkgolic acids, the method was found to be with good linearities (r>0.9991), good intra- and inter-day precisions (RSD<15%), and good accuracies (RE, from -10.33% to 4.92%) as well. Extraction recoveries, matrix effects and stabilities for rat plasm samples were within the required limits. The validated method was successfully applied to investigate the pharmacokinetics of the five ginkgolic acids in rat plasma after oral administration of 3 dosage groups (900mg/kg, 300mg/kg and 100mg/kg). Meanwhile, six metabolites of GA (15:1) and GA (17:1) were identified by comparison of MS data with reported values. The results of validation in terms of linear ranges, precisions and stabilities were established for semi-quantification of metabolites. The curves of relative changes of these metabolites during the metabolic process were constructed by plotting the peak area ratios of metabolites to salicylic acid (internal standard, IS), respectively. Double peaks were observed in all 3 dose groups. Different type of metabolites and different dosage of each metabolite both resulted in different T max . Copyright © 2016 Elsevier B.V. All rights reserved.

Determination and importance of temperature dependence of retention coefficient (RPHPLC) in QSAR model of nitrazepams' partition coefficient in bile acid micelles.

PubMed

Posa, Mihalj; Pilipović, Ana; Lalić, Mladena; Popović, Jovan

2011-02-15

Linear dependence between temperature (t) and retention coefficient (k, reversed phase HPLC) of bile acids is obtained. Parameters (a, intercept and b, slope) of the linear function k=f(t) highly correlate with bile acids' structures. Investigated bile acids form linear congeneric groups on a principal component (calculated from k=f(t)) score plot that are in accordance with conformations of the hydroxyl and oxo groups in a bile acid steroid skeleton. Partition coefficient (K(p)) of nitrazepam in bile acids' micelles is investigated. Nitrazepam molecules incorporated in micelles show modified bioavailability (depo effect, higher permeability, etc.). Using multiple linear regression method QSAR models of nitrazepams' partition coefficient, K(p) are derived on the temperatures of 25°C and 37°C. For deriving linear regression models on both temperatures experimentally obtained lipophilicity parameters are included (PC1 from data k=f(t)) and in silico descriptors of the shape of a molecule while on the higher temperature molecular polarisation is introduced. This indicates the fact that the incorporation mechanism of nitrazepam in BA micelles changes on the higher temperatures. QSAR models are derived using partial least squares method as well. Experimental parameters k=f(t) are shown to be significant predictive variables. Both QSAR models are validated using cross validation and internal validation method. PLS models have slightly higher predictive capability than MLR models. Copyright © 2010 Elsevier B.V. All rights reserved.

Elaboration and Validation of the Medication Prescription Safety Checklist 1

PubMed Central

Pires, Aline de Oliveira Meireles; Ferreira, Maria Beatriz Guimarães; do Nascimento, Kleiton Gonçalves; Felix, Márcia Marques dos Santos; Pires, Patrícia da Silva; Barbosa, Maria Helena

2017-01-01

ABSTRACT Objective: to elaborate and validate a checklist to identify compliance with the recommendations for the structure of medication prescriptions, based on the Protocol of the Ministry of Health and the Brazilian Health Surveillance Agency. Method: methodological research, conducted through the validation and reliability analysis process, using a sample of 27 electronic prescriptions. Results: the analyses confirmed the content validity and reliability of the tool. The content validity, obtained by expert assessment, was considered satisfactory as it covered items that represent the compliance with the recommendations regarding the structure of the medication prescriptions. The reliability, assessed through interrater agreement, was excellent (ICC=1.00) and showed perfect agreement (K=1.00). Conclusion: the Medication Prescription Safety Checklist showed to be a valid and reliable tool for the group studied. We hope that this study can contribute to the prevention of adverse events, as well as to the improvement of care quality and safety in medication use. PMID:28793128

INTERPRETING PHYSICAL AND BEHAVIORAL HEALTH SCORES FROM NEW WORK DISABILITY INSTRUMENTS

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Chan, Leighton; Rasch, Elizabeth K.; McDonough, Christine M.; Brandt, Diane E.; Bogusz, Kara; Jette, Alan M.

2015-01-01

Objective To develop a system to guide interpretation of scores generated from 2 new instruments measuring work-related physical and behavioral health functioning (Work Disability – Physical Function (WD-PF) and WD – Behavioral Function (WD-BH)). Design Cross-sectional, secondary data from 3 independent samples to develop and validate the functional levels for physical and behavioral health functioning. Subjects Physical group: 999 general adult subjects, 1,017 disability applicants and 497 work-disabled subjects. Behavioral health group: 1,000 general adult subjects, 1,015 disability applicants and 476 work-disabled subjects. Methods Three-phase analytic approach including item mapping, a modified-Delphi technique, and known-groups validation analysis were used to develop and validate cut-points for functional levels within each of the WD-PF and WD-BH instrument’s scales. Results Four and 5 functional levels were developed for each of the scales in the WD-PF and WD-BH instruments. Distribution of the comparative samples was in the expected direction: the general adult samples consistently demonstrated scores at higher functional levels compared with the claimant and work-disabled samples. Conclusion Using an item-response theory-based methodology paired with a qualitative process appears to be a feasible and valid approach for translating the WD-BH and WD-PF scores into meaningful levels useful for interpreting a person’s work-related physical and behavioral health functioning. PMID:25729901

Validation of a new ELISA method for in vitro potency testing of hepatitis A vaccines.

PubMed

Morgeaux, S; Variot, P; Daas, A; Costanzo, A

2013-01-01

The goal of the project was to standardise a new in vitro method in replacement of the existing standard method for the determination of hepatitis A virus antigen content in hepatitis A vaccines (HAV) marketed in Europe. This became necessary due to issues with the method used previously, requiring the use of commercial test kits. The selected candidate method, not based on commercial kits, had already been used for many years by an Official Medicines Control Laboratory (OMCL) for routine testing and batch release of HAV. After a pre-qualification phase (Phase 1) that showed the suitability of the commercially available critical ELISA reagents for the determination of antigen content in marketed HAV present on the European market, an international collaborative study (Phase 2) was carried out in order to fully validate the method. Eleven laboratories took part in the collaborative study. They performed assays with the candidate standard method and, in parallel, for comparison purposes, with their own in-house validated methods where these were available. The study demonstrated that the new assay provides a more reliable and reproducible method when compared to the existing standard method. A good correlation of the candidate standard method with the in vivo immunogenicity assay in mice was shown previously for both potent and sub-potent (stressed) vaccines. Thus, the new standard method validated during the collaborative study may be implemented readily by manufacturers and OMCLs for routine batch release but also for in-process control or consistency testing. The new method was approved in October 2012 by Group of Experts 15 of the European Pharmacopoeia (Ph. Eur.) as the standard method for in vitro potency testing of HAV. The relevant texts will be revised accordingly. Critical reagents such as coating reagent and detection antibodies have been adopted by the Ph. Eur. Commission and are available from the EDQM as Ph. Eur. Biological Reference Reagents (BRRs).

Considerations Underlying the Use of Mixed Group Validation

ERIC Educational Resources Information Center

Jewsbury, Paul A.; Bowden, Stephen C.

2013-01-01

Mixed Group Validation (MGV) is an approach for estimating the diagnostic accuracy of tests. MGV is a promising alternative to the more commonly used Known Groups Validation (KGV) approach for estimating diagnostic accuracy. The advantage of MGV lies in the fact that the approach does not require a perfect external validity criterion or gold…

Tutorial in Biostatistics: Instrumental Variable Methods for Causal Inference*

PubMed Central

Baiocchi, Michael; Cheng, Jing; Small, Dylan S.

2014-01-01

A goal of many health studies is to determine the causal effect of a treatment or intervention on health outcomes. Often, it is not ethically or practically possible to conduct a perfectly randomized experiment and instead an observational study must be used. A major challenge to the validity of observational studies is the possibility of unmeasured confounding (i.e., unmeasured ways in which the treatment and control groups differ before treatment administration which also affect the outcome). Instrumental variables analysis is a method for controlling for unmeasured confounding. This type of analysis requires the measurement of a valid instrumental variable, which is a variable that (i) is independent of the unmeasured confounding; (ii) affects the treatment; and (iii) affects the outcome only indirectly through its effect on the treatment. This tutorial discusses the types of causal effects that can be estimated by instrumental variables analysis; the assumptions needed for instrumental variables analysis to provide valid estimates of causal effects and sensitivity analysis for those assumptions; methods of estimation of causal effects using instrumental variables; and sources of instrumental variables in health studies. PMID:24599889

An early-biomarker algorithm predicts lethal graft-versus-host disease and survival

PubMed Central

Hartwell, Matthew J.; Özbek, Umut; Holler, Ernst; Major-Monfried, Hannah; Reddy, Pavan; Aziz, Mina; Hogan, William J.; Ayuk, Francis; Efebera, Yvonne A.; Hexner, Elizabeth O.; Bunworasate, Udomsak; Qayed, Muna; Ordemann, Rainer; Wölfl, Matthias; Mielke, Stephan; Chen, Yi-Bin; Devine, Steven; Jagasia, Madan; Kitko, Carrie L.; Litzow, Mark R.; Kröger, Nicolaus; Locatelli, Franco; Morales, George; Nakamura, Ryotaro; Reshef, Ran; Rösler, Wolf; Weber, Daniela; Yanik, Gregory A.; Levine, John E.; Ferrara, James L.M.

2017-01-01

BACKGROUND. No laboratory test can predict the risk of nonrelapse mortality (NRM) or severe graft-versus-host disease (GVHD) after hematopoietic cellular transplantation (HCT) prior to the onset of GVHD symptoms. METHODS. Patient blood samples on day 7 after HCT were obtained from a multicenter set of 1,287 patients, and 620 samples were assigned to a training set. We measured the concentrations of 4 GVHD biomarkers (ST2, REG3α, TNFR1, and IL-2Rα) and used them to model 6-month NRM using rigorous cross-validation strategies to identify the best algorithm that defined 2 distinct risk groups. We then applied the final algorithm in an independent test set (n = 309) and validation set (n = 358). RESULTS. A 2-biomarker model using ST2 and REG3α concentrations identified patients with a cumulative incidence of 6-month NRM of 28% in the high-risk group and 7% in the low-risk group (P < 0.001). The algorithm performed equally well in the test set (33% vs. 7%, P < 0.001) and the multicenter validation set (26% vs. 10%, P < 0.001). Sixteen percent, 17%, and 20% of patients were at high risk in the training, test, and validation sets, respectively. GVHD-related mortality was greater in high-risk patients (18% vs. 4%, P < 0.001), as was severe gastrointestinal GVHD (17% vs. 8%, P < 0.001). The same algorithm can be successfully adapted to define 3 distinct risk groups at GVHD onset. CONCLUSION. A biomarker algorithm based on a blood sample taken 7 days after HCT can consistently identify a group of patients at high risk for lethal GVHD and NRM. FUNDING. The National Cancer Institute, American Cancer Society, and the Doris Duke Charitable Foundation. PMID:28194439

Reliability and Validity of a Survey to Measure Bowel Function and Quality of Life in Long-term Rectal Cancer Survivors

PubMed Central

Wendel, Christopher S.; Grant, Marcia; Herrinton, Lisa; Temple, Larissa K. F.; Hornbrook, Mark C.; McMullen, Carmit K.; Bulkley, Joanna E.; Altschuler, Andrea; Krouse, Robert S.

2014-01-01

Purpose Examine reliability and validity of a specialized health-related quality of life questionnaire for rectal cancer (RC) survivors (≥5 years post diagnosis). Methods We mailed 1,063 Kaiser Permanente (KP) RC survivors (313 ostomy, 750 anastomosis) a questionnaire containing the Modified City of Hope Quality of Life-Ostomy (mCOH-QOL-O), SF-12v2, Duke–UNC Functional Social Support Questionnaire (FSSQ), and Memorial Sloan-Kettering Cancer Center Bowel Function Index (BFI). We adapted certain BFI items for use by subjects with intestinal ostomies. We evaluated reliability for all instruments with inter-item correlations and Cronbach’s alpha. We assessed construct validity only for the BFI in the ostomy group, because such use has not been reported. Results The overall response rate was 60.5% (577 respondents/953 eligible). Compared to nonresponders, participants were on average 2 years younger and more likely non-Hispanic white, resided in educationally nondeprived areas, and had KP membership through a group. The mCOH-QOL-O, SF-12, and FSSQ were found to be highly reliable for RC survivors. In the ostomy group, BFI Urgency/Soilage and Dietary subscales were found to be reliable, but Frequency was not. Factor analysis supported the construct of Urgency/Soilage and Dietary subscales in the ostomy group, although one item had a moderate correlation with all three factors. The BFI also demonstrated good concurrent validity with other instruments in the ostomy group. Conclusions With possible exception of the BFI Frequency subscale in populations with ostomies, components of our survey can be used for the entire population of RC survivors, no matter whether they received anastomosis or ostomy. PMID:24890826

Validity of a Semi-Quantitative Food Frequency Questionnaire for Collegiate Athletes

PubMed Central

Sasaki, Kazuto; Suzuki, Yoshio; Oguma, Nobuhide; Ishihara, Junko; Nakai, Ayumi; Yasuda, Jun; Yokoyama, Yuri; Yoshizaki, Takahiro; Tada, Yuki; Hida, Azumi; Kawano, Yukari

2016-01-01

Background Food frequency questionnaires (FFQs) have been developed and validated for various populations. To our knowledge, however, no FFQ has been validated for young athletes. Here, we investigated whether an FFQ that was developed and validated to estimate dietary intake in middle-aged persons was also valid for estimating that in young athletes. Methods We applied an FFQ that had been developed for the Japan Public Health Center-based Prospective Cohort Study with modification to the duration of recollection. A total of 156 participants (92 males) completed the FFQ and a 3-day non-consecutive 24-hour dietary recall (24hDR). Validity of the mean estimates was evaluated by calculating the percentage differences between the 24hDR and FFQ. Ranking estimation was validated using Spearman’s correlation coefficient (CC), and the degree of miscategorization was determined by joint classification. Results The FFQ underestimated energy intake by approximately 10% for both males and females. For 35 nutrients, the median (range) deattenuated CC was 0.30 (0.10 to 0.57) for males and 0.32 (−0.08 to 0.62) for females. For 19 food groups, the median (range) deattenuated CC was 0.32 (0.17 to 0.72) for males and 0.34 (−0.11 to 0.58) for females. For both nutrient and food group intakes, cross-classification analysis indicated extreme miscategorization rates of 3% to 5%. Conclusions An FFQ developed and validated for middle-aged persons had comparable validity among young athletes. This FFQ might be useful for assessing habitual dietary intake in collegiate athletes, especially for calcium, vitamin C, vegetables, fruits, and milk and dairy products. PMID:26902164

Measurement of multiple nicotine dependence domains among cigarette, non-cigarette and poly-tobacco users: Insights from item response theory.

PubMed

Strong, David R; Messer, Karen; Hartman, Sheri J; Conway, Kevin P; Hoffman, Allison C; Pharris-Ciurej, Nikolas; White, Martha; Green, Victoria R; Compton, Wilson M; Pierce, John

2015-07-01

Nicotine dependence (ND) is a key construct that organizes physiological and behavioral symptoms associated with persistent nicotine intake. Measurement of ND has focused primarily on cigarette smokers. Thus, validation of brief instruments that apply to a broad spectrum of tobacco product users is needed. We examined multiple domains of ND in a longitudinal national study of the United States population, the United States National Epidemiological Survey of Alcohol and Related Conditions (NESARC). We used methods based in item response theory to identify and validate increasingly brief measures of ND that included symptoms to assess ND similarly among cigarette, cigar, smokeless, and poly tobacco users. Confirmatory factor analytic models supported a single, primary dimension underlying symptoms of ND across tobacco use groups. Differential Item Functioning (DIF) analysis generated little support for systematic differences in response to symptoms of ND across tobacco use groups. We established significant concurrent and predictive validity of brief 3- and 5-symptom indices for measuring ND. Measuring ND across tobacco use groups with a common set of symptoms facilitates evaluation of tobacco use in an evolving marketplace of tobacco and nicotine products. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

A Simple Tool for Diet Evaluation in Primary Health Care: Validation of a 16-Item Food Intake Questionnaire

PubMed Central

Hemiö, Katri; Pölönen, Auli; Ahonen, Kirsti; Kosola, Mikko; Viitasalo, Katriina; Lindström, Jaana

2014-01-01

Our aim was to validate a 16-item food intake questionnaire (16-FIQ) and create an easy to use method to estimate patients’ nutrient intake in primary health care. Participants (52 men, 25 women) completed a 7-day food record and a 16-FIQ. Food and nutrient intakes were calculated and compared using Spearman correlation. Further, nutrient intakes were compared using kappa-statistics and exact and opposite agreement of intake tertiles. The results indicated that the 16-FIQ reliably categorized individuals according to their nutrient intakes. Methods to estimate nutrient intake based on the answers given in 16-FIQ were created. In linear regression models nutrient intake estimates from the food records were used as the dependent variables and sum variables derived from the 16-FIQ were used as the independent variables. Valid regression models were created for the energy proportion of fat, saturated fat, and sucrose and the amount of fibre (g), vitamin C (mg), iron (mg), and vitamin D (μg) intake. The 16-FIQ is a valid method for estimating nutrient intakes in group level. In addition, the 16-FIQ could be a useful tool to facilitate identification of people in need of dietary counselling and to monitor the effect of counselling in primary health care. PMID:24599042

Assessing uncertainty in sighting records: an example of the Barbary lion.

PubMed

Lee, Tamsin E; Black, Simon A; Fellous, Amina; Yamaguchi, Nobuyuki; Angelici, Francesco M; Al Hikmani, Hadi; Reed, J Michael; Elphick, Chris S; Roberts, David L

2015-01-01

As species become rare and approach extinction, purported sightings can be controversial, especially when scarce management resources are at stake. We consider the probability that each individual sighting of a series is valid. Obtaining these probabilities requires a strict framework to ensure that they are as accurately representative as possible. We used a process, which has proven to provide accurate estimates from a group of experts, to obtain probabilities for the validation of 32 sightings of the Barbary lion. We consider the scenario where experts are simply asked whether a sighting was valid, as well as asking them to score the sighting based on distinguishablity, observer competence, and verifiability. We find that asking experts to provide scores for these three aspects resulted in each sighting being considered more individually, meaning that this new questioning method provides very different estimated probabilities that a sighting is valid, which greatly affects the outcome from an extinction model. We consider linear opinion pooling and logarithm opinion pooling to combine the three scores, and also to combine opinions on each sighting. We find the two methods produce similar outcomes, allowing the user to focus on chosen features of each method, such as satisfying the marginalisation property or being externally Bayesian.

Reliability and validity of a quantitative color scale to evaluate masticatory performance using color-changeable chewing gum.

PubMed

Hama, Yohei; Kanazawa, Manabu; Minakuchi, Shunsuke; Uchida, Tatsuro; Sasaki, Yoshiyuki

2014-03-19

In the present study, we developed a novel color scale for visual assessment, conforming to theoretical color changes of a gum, to evaluate masticatoryperformance; moreover, we investigated the reliability and validity of this evaluation method using the color scale. Ten participants (aged 26.30 years) with natural dentition chewed the gum at several chewing strokes. Changes in color were measured using a colorimeter, and then, linearregression expressions that represented changes in gum color were derived. The color scale was developed using these regression expressions. Thirty-two chewed gums were evaluated using colorimeter and were assessed three times using the color scale by six dentists aged 25.27 (mean, 25.8) years, six preclinical dental students aged 21.23 (mean, 22.2) years, and six elderly individuals aged 68.84 (mean, 74.0) years. The intrarater and interrater reliability of evaluations was assessed using intraclass correlation coefficients. Validity of the method compared with a colorimeter was assessed using Spearman's rank correlation coefficient. All intraclass correlation coefficients were > 0.90, and Spearman's rank-correlation coefficients were > 0.95 in all groups. These results indicated that the evaluation method of the color-changeable chewing gum using the newly developed color scale is reliable and valid.

Similarity regularized sparse group lasso for cup to disc ratio computation.

PubMed

Cheng, Jun; Zhang, Zhuo; Tao, Dacheng; Wong, Damon Wing Kee; Liu, Jiang; Baskaran, Mani; Aung, Tin; Wong, Tien Yin

2017-08-01

Automatic cup to disc ratio (CDR) computation from color fundus images has shown to be promising for glaucoma detection. Over the past decade, many algorithms have been proposed. In this paper, we first review the recent work in the area and then present a novel similarity-regularized sparse group lasso method for automated CDR estimation. The proposed method reconstructs the testing disc image based on a set of reference disc images by integrating the similarity between testing and the reference disc images with the sparse group lasso constraints. The reconstruction coefficients are then used to estimate the CDR of the testing image. The proposed method has been validated using 650 images with manually annotated CDRs. Experimental results show an average CDR error of 0.0616 and a correlation coefficient of 0.7, outperforming other methods. The areas under curve in the diagnostic test reach 0.843 and 0.837 when manual and automatically segmented discs are used respectively, better than other methods as well.

Short forms of the Child Perceptions Questionnaire for 11–14-year-old children (CPQ11–14): Development and initial evaluation

PubMed Central

Jokovic, Aleksandra; Locker, David; Guyatt, Gordan

2006-01-01

Background The Child Perceptions Questionnaire for children aged 11 to 14 years (CPQ11–14) is a 37-item measure of oral-health-related quality of life (OHRQoL) encompassing four domains: oral symptoms, functional limitations, emotional and social well-being. To facilitate its use in clinical settings and population-based health surveys, it was shortened to 16 and 8 items. Item impact and stepwise regression methods were used to produce each version. This paper describes the developmental process, compares the discriminative properties of the resulting four short-forms and evaluates their precision relative to the original CPQ11–14. Methods The item impact method used data from the CPQ11–14 item reduction study to select the questions with the highest impact scores in each domain. The regression method, where the dependent variable was the overall CPQ11–14 score and the independent variables its individual questions, was applied to the data collected in the validity study for the CPQ11–14. The measurement properties (i.e. criterion validity, construct validity, internal consistency reliability and test-retest reliability) of all 4 short-forms were evaluated using the data from the validity and reliability studies for the CPQ11–14. Results All short forms detected substantial variability in children's OHRQoL. The mean scores on the two 16-item questionnaires were almost identical, while on the two 8-item questionnaires they differed by only one score point. The mean scores standardized to 0–100 were higher on the short forms than the original CPQ11–14 (p < 0.001). There were strong significant correlations between all short-form scores and CPQ11–14 scores (0.87–0.98; p < 0.001). Hypotheses concerning construct validity were confirmed: the short-forms' scores were highest in the oro-facial, lower in the orthodontic and lowest in the paediatric dentistry group; all short-form questionnaires were positively correlated with the ratings of oral health and overall well-being, with the correlation coefficient being higher for the latter. The relative validity coefficients were 0.85 to 1.18. Cronbach's alpha and intraclass correlation coefficients ranged 0.71–0.83 and 0.71–0.77, respectively. Conclusion All short forms demonstrated excellent criterion validity and good construct validity. The reliability coefficients exceeded standards for group-level comparisons. However, these are preliminary findings based on the convenience sampling and further testing in replicated studies involving clinical and general samples of children in various settings is necessary to establish measurement sensitivity and discriminative properties of these questionnaires. PMID:16423298

Analysis of Nonequivalent Assessments across Different Linguistic Groups Using a Mixed Methods Approach: Understanding the Causes of Differential Item Functioning by Cognitive Interviewing

ERIC Educational Resources Information Center

Benítez, Isabel; Padilla, José-Luis

2014-01-01

Differential item functioning (DIF) can undermine the validity of cross-lingual comparisons. While a lot of efficient statistics for detecting DIF are available, few general findings have been found to explain DIF results. The objective of the article was to study DIF sources by using a mixed method design. The design involves a quantitative phase…

Unsupervised discovery of microbial population structure within metagenomes using nucleotide base composition

PubMed Central

Saeed, Isaam; Tang, Sen-Lin; Halgamuge, Saman K.

2012-01-01

An approach to infer the unknown microbial population structure within a metagenome is to cluster nucleotide sequences based on common patterns in base composition, otherwise referred to as binning. When functional roles are assigned to the identified populations, a deeper understanding of microbial communities can be attained, more so than gene-centric approaches that explore overall functionality. In this study, we propose an unsupervised, model-based binning method with two clustering tiers, which uses a novel transformation of the oligonucleotide frequency-derived error gradient and GC content to generate coarse groups at the first tier of clustering; and tetranucleotide frequency to refine these groups at the secondary clustering tier. The proposed method has a demonstrated improvement over PhyloPythia, S-GSOM, TACOA and TaxSOM on all three benchmarks that were used for evaluation in this study. The proposed method is then applied to a pyrosequenced metagenomic library of mud volcano sediment sampled in southwestern Taiwan, with the inferred population structure validated against complementary sequencing of 16S ribosomal RNA marker genes. Finally, the proposed method was further validated against four publicly available metagenomes, including a highly complex Antarctic whale-fall bone sample, which was previously assumed to be too complex for binning prior to functional analysis. PMID:22180538

Validation on milk and sprouts of EN ISO 16654:2001 - Microbiology of food and animal feeding stuffs - Horizontal method for the detection of Escherichia coli O157.

PubMed

Tozzoli, Rosangela; Maugliani, Antonella; Michelacci, Valeria; Minelli, Fabio; Caprioli, Alfredo; Morabito, Stefano

2018-05-08

In 2006, the European Committee for standardisation (CEN)/Technical Committee 275 - Food analysis - Horizontal methods/Working Group 6 - Microbiology of the food chain (TC275/WG6), launched the project of validating the method ISO 16654:2001 for the detection of Escherichia coli O157 in foodstuff by the evaluation of its performance, in terms of sensitivity and specificity, through collaborative studies. Previously, a validation study had been conducted to assess the performance of the Method No 164 developed by the Nordic Committee for Food Analysis (NMKL), which aims at detecting E. coli O157 in food as well, and is based on a procedure equivalent to that of the ISO 16654:2001 standard. Therefore, CEN established that the validation data obtained for the NMKL Method 164 could be exploited for the ISO 16654:2001 validation project, integrated with new data obtained through two additional interlaboratory studies on milk and sprouts, run in the framework of the CEN mandate No. M381. The ISO 16654:2001 validation project was led by the European Union Reference Laboratory for Escherichia coli including VTEC (EURL-VTEC), which organized the collaborative validation study on milk in 2012 with 15 participating laboratories and that on sprouts in 2014, with 14 participating laboratories. In both studies, a total of 24 samples were tested by each laboratory. Test materials were spiked with different concentration of E. coli O157 and the 24 samples corresponded to eight replicates of three levels of contamination: zero, low and high spiking level. The results submitted by the participating laboratories were analyzed to evaluate the sensitivity and specificity of the ISO 16654:2001 method when applied to milk and sprouts. The performance characteristics calculated on the data of the collaborative validation studies run under the CEN mandate No. M381 returned sensitivity and specificity of 100% and 94.4%, respectively for the milk study. As for sprouts matrix, the sensitivity resulted in 75.9% in the low level of contamination samples and 96.4% in samples spiked with high level of E. coli O157 and specificity was calculated as 99.1%. Copyright © 2018 Elsevier B.V. All rights reserved.

A citizen science based survey method for estimating the density of urban carnivores.

PubMed

Scott, Dawn M; Baker, Rowenna; Charman, Naomi; Karlsson, Heidi; Yarnell, Richard W; Mill, Aileen C; Smith, Graham C; Tolhurst, Bryony A

2018-01-01

Globally there are many examples of synanthropic carnivores exploiting growth in urbanisation. As carnivores can come into conflict with humans and are potential vectors of zoonotic disease, assessing densities in suburban areas and identifying factors that influence them are necessary to aid management and mitigation. However, fragmented, privately owned land restricts the use of conventional carnivore surveying techniques in these areas, requiring development of novel methods. We present a method that combines questionnaire distribution to residents with field surveys and GIS, to determine relative density of two urban carnivores in England, Great Britain. We determined the density of: red fox (Vulpes vulpes) social groups in 14, approximately 1km2 suburban areas in 8 different towns and cities; and Eurasian badger (Meles meles) social groups in three suburban areas of one city. Average relative fox group density (FGD) was 3.72 km-2, which was double the estimates for cities with resident foxes in the 1980's. Density was comparable to an alternative estimate derived from trapping and GPS-tracking, indicating the validity of the method. However, FGD did not correlate with a national dataset based on fox sightings, indicating unreliability of the national data to determine actual densities or to extrapolate a national population estimate. Using species-specific clustering units that reflect social organisation, the method was additionally applied to suburban badgers to derive relative badger group density (BGD) for one city (Brighton, 2.41 km-2). We demonstrate that citizen science approaches can effectively obtain data to assess suburban carnivore density, however publicly derived national data sets need to be locally validated before extrapolations can be undertaken. The method we present for assessing densities of foxes and badgers in British towns and cities is also adaptable to other urban carnivores elsewhere. However this transferability is contingent on species traits meeting particular criteria, and on resident responsiveness.

A citizen science based survey method for estimating the density of urban carnivores

PubMed Central

Baker, Rowenna; Charman, Naomi; Karlsson, Heidi; Yarnell, Richard W.; Mill, Aileen C.; Smith, Graham C.; Tolhurst, Bryony A.

2018-01-01

Globally there are many examples of synanthropic carnivores exploiting growth in urbanisation. As carnivores can come into conflict with humans and are potential vectors of zoonotic disease, assessing densities in suburban areas and identifying factors that influence them are necessary to aid management and mitigation. However, fragmented, privately owned land restricts the use of conventional carnivore surveying techniques in these areas, requiring development of novel methods. We present a method that combines questionnaire distribution to residents with field surveys and GIS, to determine relative density of two urban carnivores in England, Great Britain. We determined the density of: red fox (Vulpes vulpes) social groups in 14, approximately 1km2 suburban areas in 8 different towns and cities; and Eurasian badger (Meles meles) social groups in three suburban areas of one city. Average relative fox group density (FGD) was 3.72 km-2, which was double the estimates for cities with resident foxes in the 1980’s. Density was comparable to an alternative estimate derived from trapping and GPS-tracking, indicating the validity of the method. However, FGD did not correlate with a national dataset based on fox sightings, indicating unreliability of the national data to determine actual densities or to extrapolate a national population estimate. Using species-specific clustering units that reflect social organisation, the method was additionally applied to suburban badgers to derive relative badger group density (BGD) for one city (Brighton, 2.41 km-2). We demonstrate that citizen science approaches can effectively obtain data to assess suburban carnivore density, however publicly derived national data sets need to be locally validated before extrapolations can be undertaken. The method we present for assessing densities of foxes and badgers in British towns and cities is also adaptable to other urban carnivores elsewhere. However this transferability is contingent on species traits meeting particular criteria, and on resident responsiveness. PMID:29787598

Feasibility of the Two-Point Method for Determining the One-Repetition Maximum in the Bench Press Exercise.

PubMed

García-Ramos, Amador; Haff, Guy Gregory; Pestaña-Melero, Francisco Luis; Pérez-Castilla, Alejandro; Rojas, Francisco Javier; Balsalobre-Fernández, Carlos; Jaric, Slobodan

2017-09-05

This study compared the concurrent validity and reliability of previously proposed generalized group equations for estimating the bench press (BP) one-repetition maximum (1RM) with the individualized load-velocity relationship modelled with a two-point method. Thirty men (BP 1RM relative to body mass: 1.08 0.18 kg·kg -1 ) performed two incremental loading tests in the concentric-only BP exercise and another two in the eccentric-concentric BP exercise to assess their actual 1RM and load-velocity relationships. A high velocity (≈ 1 m·s -1 ) and a low velocity (≈ 0.5 m·s -1 ) was selected from their load-velocity relationships to estimate the 1RM from generalized group equations and through an individual linear model obtained from the two velocities. The directly measured 1RM was highly correlated with all predicted 1RMs (r range: 0.847-0.977). The generalized group equations systematically underestimated the actual 1RM when predicted from the concentric-only BP (P <0.001; effect size [ES] range: 0.15-0.94), but overestimated it when predicted from the eccentric-concentric BP (P <0.001; ES range: 0.36-0.98). Conversely, a low systematic bias (range: -2.3-0.5 kg) and random errors (range: 3.0-3.8 kg), no heteroscedasticity of errors (r 2 range: 0.053-0.082), and trivial ES (range: -0.17-0.04) were observed when the prediction was based on the two-point method. Although all examined methods reported the 1RM with high reliability (CV≤5.1%; ICC≥0.89), the direct method was the most reliable (CV<2.0%; ICC≥0.98). The quick, fatigue-free, and practical two-point method was able to predict the BP 1RM with high reliability and practically perfect validity, and therefore we recommend its use over generalized group equations.

Validation of the Use of Dried Blood Spot (DBS) Method to Assess Vitamin A Status

PubMed Central

Fallah, Elham; Peighambardoust, Seyed Hadi

2012-01-01

Background: Vitamin A deficiency is an important dietary deficiency in the world. Thus, the ne¬cessity of screening for deficient populations is obvious. This paper introduces a fast, cheap and relatively reliable method called “dried blood spot” (DBS) method in screening the deficient populations. The validity of this method for retinol measurement was investigated. Method: The “precision” and “agreement” criteria of the DBS method were assessed. The preci¬sion was calculated and compared with those of plasma using F-test. The agreement was eva¬luated using Bland-Altman plot. Results: The imprecision of retinol measurements in dried spots was not significantly different from those of the control (plasma). A good correlation coefficient (r2=0.78) was obtained for dried spots’ retinol measurements versus plasma’s retinol analysis (P < 0.01). Paired t-test showed no significant difference between the DBS and retinol methods on a group level. Imprecision of DBS measurement was acceptable, compared to that of the plasma method. The difference be¬tween these two methods was not statistically significant on a group level. Conclusion: Application of DBS standard samples, in which a part of the plasma was replaced with the artificial plasma, was shown to be a reliable calibration mean for retinol measurements in DBS samples. Retinol in dried spots was stable for 90 days. Overall, the DBS method provided a precise measurement of retinol, showing results that were comparable with the measurement of retinol in plasma. PMID:24688932

The LEAP™ Gesture Interface Device and Take-Home Laparoscopic Simulators: A Study of Construct and Concurrent Validity.

PubMed

Partridge, Roland W; Brown, Fraser S; Brennan, Paul M; Hennessey, Iain A M; Hughes, Mark A

2016-02-01

To assess the potential of the LEAP™ infrared motion tracking device to map laparoscopic instrument movement in a simulated environment. Simulator training is optimized when augmented by objective performance feedback. We explore the potential LEAP has to provide this in a way compatible with affordable take-home simulators. LEAP and the previously validated InsTrac visual tracking tool mapped expert and novice performances of a standardized simulated laparoscopic task. Ability to distinguish between the 2 groups (construct validity) and correlation between techniques (concurrent validity) were the primary outcome measures. Forty-three expert and 38 novice performances demonstrated significant differences in LEAP-derived metrics for instrument path distance (P < .001), speed (P = .002), acceleration (P < .001), motion smoothness (P < .001), and distance between the instruments (P = .019). Only instrument path distance demonstrated a correlation between LEAP and InsTrac tracking methods (novices: r = .663, P < .001; experts: r = .536, P < .001). Consistency of LEAP tracking was poor (average % time hands not tracked: 31.9%). The LEAP motion device is able to track the movement of hands using instruments in a laparoscopic box simulator. Construct validity is demonstrated by its ability to distinguish novice from expert performances. Only time and instrument path distance demonstrated concurrent validity with an existing tracking method however. A number of limitations to the tracking method used by LEAP have been identified. These need to be addressed before it can be considered an alternative to visual tracking for the delivery of objective performance metrics in take-home laparoscopic simulators. © The Author(s) 2015.

A Pilot Study of a Novel Method of Measuring Stigma about Depression Developed for Latinos in the Faith-Based Setting.

PubMed

Caplan, Susan

2016-08-01

In order to understand the effects of interventions designed to reduce stigma about mental illness, we need valid measures. However, the validity of commonly used measures is compromised by social desirability bias. The purpose of this pilot study was to test an anonymous method of measuring stigma in the community setting. The method of data collection, Preguntas con Cartas (Questions with Cards) used numbered playing cards to conduct anonymous group polling about stigmatizing beliefs during a mental health literacy intervention. An analysis of the difference between Preguntas con Cartas stigma votes and corresponding face-to-face individual survey results for the same seven stigma questions indicated that there was a statistically significant differences in the distributions between the two methods of data collection (χ(2) = 8.27, p = 0.016). This exploratory study has shown the potential effectiveness of Preguntas con Cartas as a novel method of measuring stigma in the community-based setting.

Fracture toughness testing of Linde 1092 reactor vessel welds in the transition range using Charpy-sized specimens

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pavinich, W.A.; Yoon, K.K.; Hour, K.Y.

1999-10-01

The present reference toughness method for predicting the change in fracture toughness can provide over estimates of these values because of uncertainties in initial RT{sub NDT} and shift correlations. It would be preferable to directly measure fracture toughness. However, until recently, no standard method was available to characterize fracture toughness in the transition range. ASTM E08 has developed a draft standard that shows promise for providing lower bound transition range fracture toughness using the master curve approach. This method has been successfully implemented using 1T compact fracture specimens. Combustion Engineering reactor vessel surveillance programs do not have compact fracture specimens.more » Therefore, the CE Owners Group developed a program to validate the master curve method for Charpy-sized and reconstituted Charpy-sized specimens for future application on irradiated specimens. This method was validated for Linde 1092 welds using unirradiated Charpy-sized and reconstituted Charpy-sized specimens by comparison of results with those from compact fracture specimens.« less

Application of Taxonomic Modeling to Microbiota Data Mining for Detection of Helminth Infection in Global Populations.

PubMed

Torbati, Mahbaneh Eshaghzadeh; Mitreva, Makedonka; Gopalakrishnan, Vanathi

2016-12-01

Human microbiome data from genomic sequencing technologies is fast accumulating, giving us insights into bacterial taxa that contribute to health and disease. The predictive modeling of such microbiota count data for the classification of human infection from parasitic worms, such as helminths, can help in the detection and management across global populations. Real-world datasets of microbiome experiments are typically sparse, containing hundreds of measurements for bacterial species, of which only a few are detected in the bio-specimens that are analyzed. This feature of microbiome data produces the challenge of needing more observations for accurate predictive modeling and has been dealt with previously, using different methods of feature reduction. To our knowledge, integrative methods, such as transfer learning, have not yet been explored in the microbiome domain as a way to deal with data sparsity by incorporating knowledge of different but related datasets. One way of incorporating this knowledge is by using a meaningful mapping among features of these datasets. In this paper, we claim that this mapping would exist among members of each individual cluster, grouped based on phylogenetic dependency among taxa and their association to the phenotype. We validate our claim by showing that models incorporating associations in such a grouped feature space result in no performance deterioration for the given classification task. In this paper, we test our hypothesis by using classification models that detect helminth infection in microbiota of human fecal samples obtained from Indonesia and Liberia countries. In our experiments, we first learn binary classifiers for helminth infection detection by using Naive Bayes, Support Vector Machines, Multilayer Perceptrons, and Random Forest methods. In the next step, we add taxonomic modeling by using the SMART-scan module to group the data, and learn classifiers using the same four methods, to test the validity of the achieved groupings. We observed a 6% to 23% and 7% to 26% performance improvement based on the Area Under the receiver operating characteristic (ROC) Curve (AUC) and Balanced Accuracy (Bacc) measures, respectively, over 10 runs of 10-fold cross-validation. These results show that using phylogenetic dependency for grouping our microbiota data actually results in a noticeable improvement in classification performance for helminth infection detection. These promising results from this feasibility study demonstrate that methods such as SMART-scan can be utilized in the future for knowledge transfer from different but related microbiome datasets by phylogenetically-related functional mapping, to enable novel integrative biomarker discovery.

Water Vapor Measurement and Compensation in the Near and Mid-infrared with the Keck Interferometer Nuller

NASA Technical Reports Server (NTRS)

Koresko, Chris D.; Colavita, Mark M.; Serabyn, Eugene; Booth, Andrew; Garcia, Jean I.

2006-01-01

A viewgraph presentation describing the methods, motivation and methods for water vapor measurement with the Keck interferometer near and mid infrared radiation band is shown. The topics include: 1) Motivation: Why measure H2O?; 2) Method: How do we measure H2O?; 3) Data: Phase and Group Delays for the K and N Bands; 4) Predicted and Actual Nband Phase and Dispersion; and 5) Validation of Atmospheric Turbulence Models with KI Data.

Validation Methods Research for Fault-Tolerant Avionics and Control Systems Sub-Working Group Meeting. CARE 3 peer review

NASA Technical Reports Server (NTRS)

Trivedi, K. S. (Editor); Clary, J. B. (Editor)

1980-01-01

A computer aided reliability estimation procedure (CARE 3), developed to model the behavior of ultrareliable systems required by flight-critical avionics and control systems, is evaluated. The mathematical models, numerical method, and fault-tolerant architecture modeling requirements are examined, and the testing and characterization procedures are discussed. Recommendations aimed at enhancing CARE 3 are presented; in particular, the need for a better exposition of the method and the user interface is emphasized.

Psychometric properties of the 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25), Japanese version.

PubMed

Suzukamo, Yoshimi; Oshika, Tetsuro; Yuzawa, Mitsuko; Tokuda, Yoshihiro; Tomidokoro, Atsuo; Oki, Kotaro; Mangione, Carol M; Green, Joseph; Fukuhara, Shunichi

2005-10-26

The importance of evaluating the outcomes of health care from the standpoint of the patient is now widely recognized. The purpose of this study is to develop and test a Japanese version of the National Eye Institute Visual Function Questionnaire (NEI VFQ-25). A Japanese version was developed with a previously standardized method. The questionnaire and optional items were completed by 245 patients with cataracts, glaucoma, or age-related macular degeneration, by 110 others before and after cataract surgery, and by a reference group (n = 31). We computed rates of missing data, measured reproducibility and internal consistency reliability, and tested for convergent and discriminant validity, concurrent validity, known-groups validity, factor structure, and responsiveness to change. Based on information from the participants, some items were changed to 2-step items (asking if an activity was done, and if it was done, then asking how difficult it was). The near-vision and distance-vision subscales each had 1 item that was endorsed by very few participants, so these items were replaced with items that were optional in the English version. For example, more than 60% of participants did not drive, so the driving question was excluded. Reliability and validity were adequate for all subscales except driving, ocular pain, color vision, and peripheral vision. With cataract surgery, most scores improved by at least 20 points. With minor modifications from the English version, the Japanese NEI VFQ-25 can give reliable, valid, responsive data on vision-related quality of life, for group-level comparisons or for tracking therapeutic outcomes.

Preliminary Evaluation of an Educational Outcomes Assessment Process for Dental Interpretive Radiography.

ERIC Educational Resources Information Center

Weems, Richard A.; And Others

1992-01-01

A procedure for testing the ability of dental students to detect presence and depth of dental caries was evaluated. Students (n=40) from four experience groups examined radiographs obtained from a model. Results indicated that this method of assessing student competence in radiographic interpretation is valid. (MSE)

41 CFR 60-3.15 - Documentation of impact and validity evidence.

Code of Federal Regulations, 2011 CFR

2011-07-01

... group should be described (essential). (6) Sample description. A description of how the research sample... research sample compares with the relevant labor market or work force, the method by which the relevant... quantitative data which identify or define the job constructs, such as factor analyses, should be provided...

41 CFR 60-3.15 - Documentation of impact and validity evidence.

Code of Federal Regulations, 2013 CFR

2013-07-01

... group should be described (essential). (6) Sample description. A description of how the research sample... research sample compares with the relevant labor market or work force, the method by which the relevant... quantitative data which identify or define the job constructs, such as factor analyses, should be provided...

41 CFR 60-3.15 - Documentation of impact and validity evidence.

Code of Federal Regulations, 2010 CFR

2010-07-01

... group should be described (essential). (6) Sample description. A description of how the research sample... research sample compares with the relevant labor market or work force, the method by which the relevant... quantitative data which identify or define the job constructs, such as factor analyses, should be provided...

41 CFR 60-3.15 - Documentation of impact and validity evidence.

Code of Federal Regulations, 2014 CFR

2014-07-01

... group should be described (essential). (6) Sample description. A description of how the research sample... research sample compares with the relevant labor market or work force, the method by which the relevant... quantitative data which identify or define the job constructs, such as factor analyses, should be provided...

41 CFR 60-3.15 - Documentation of impact and validity evidence.

Code of Federal Regulations, 2012 CFR

2012-07-01

... group should be described (essential). (6) Sample description. A description of how the research sample... research sample compares with the relevant labor market or work force, the method by which the relevant... quantitative data which identify or define the job constructs, such as factor analyses, should be provided...

Detecting Symptom Exaggeration in Combat Veterans Using the MMPI-2 Symptom Validity Scales: A Mixed Group Validation

ERIC Educational Resources Information Center

Tolin, David F.; Steenkamp, Maria M.; Marx, Brian P.; Litz, Brett T.

2010-01-01

Although validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. G. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989) have proven useful in the detection of symptom exaggeration in criterion-group validation (CGV) studies, usually comparing instructed feigners with known patient groups, the…

Using qualitative methods in developing an instrument to identify barriers to self-care among persons with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Villa-Estrada, Francisca; Morilla-Herrera, Juan Carlos; Cuevas-Fernández-Gallego, Magdalena; Morales-Asencio, José Miguel

2015-04-01

To develop a questionnaire to address barriers and self-care behaviour among persons with type 2 diabetes mellitus. Several instruments are available in the literature to measure barriers to self-care in this population, but many of them present limitations in its psychometric validation process, and lack of theoretical background. Content validation study using multiple qualitative methods. A systematic review was conducted, and two focus groups with fifteen participants (n = 15) were analysed to identify key topics and categories concerning barriers and self-care behaviour. These categories were used to generate items that were subjected to expert scrutiny, using the Delphi technique. The resulting list of items was tested for readability and comprehension by nine diabetic patients (n = 9), through cognitive interviews. The whole process was conducted in accordance with the Theory of Planned Behaviour. The mean age (standard deviation) of participants in the focus groups and cognitive interviews was 66·05 (8·47) and 63·11 (6·13) years, respectively. 46·7% of the members of the focus groups and 44·4% of those interviewed were female, and the mean duration (standard deviation) of their diabetes was 6·53 (3·17) and 4·89 (3·84) years, respectively. After the qualitative analysis, 27 codes were obtained. Thereafter, items were generated in accordance with the dimensions of this theory: attitudes towards the behaviour (n = 23), social norms (n = 13), perceived behavioural control (n = 17) and behavioural intention (n = 15). A rigorous process of content validation with multiple methods was implemented to obtain an instrument aimed at addressing barriers and self-care behaviour of patients with type 2 Diabetes Mellitus. An instrument theoretically rooted and supported on professional and patients' views is available to assess self-care behaviours in patients with type 2 Diabetes Mellitus. The evaluation of its reliability and construct validity will determine the instrument's value and practical application in the clinical context. © 2014 John Wiley & Sons Ltd.

Development and validation of the Measure of Indigenous Racism Experiences (MIRE)

PubMed Central

Paradies, Yin C; Cunningham, Joan

2008-01-01

Background In recent decades there has been increasing evidence of a relationship between self-reported racism and health. Although a plethora of instruments to measure racism have been developed, very few have been described conceptually or psychometrically Furthermore, this research field has been limited by a dearth of instruments that examine reactions/responses to racism and by a restricted focus on African American populations. Methods In response to these limitations, the 31-item Measure of Indigenous Racism Experiences (MIRE) was developed to assess self-reported racism for Indigenous Australians. This paper describes the development of the MIRE together with an opportunistic examination of its content, construct and convergent validity in a population health study involving 312 Indigenous Australians. Results Focus group research supported the content validity of the MIRE, and inter-item/scale correlations suggested good construct validity. A good fit with a priori conceptual dimensions was demonstrated in factor analysis, and convergence with a separate item on discrimination was satisfactory. Conclusion The MIRE has considerable utility as an instrument that can assess multiple facets of racism together with responses/reactions to racism among indigenous populations and, potentially, among other ethnic/racial groups. PMID:18426602

Symptom validity testing in memory clinics: Hippocampal-memory associations and relevance for diagnosing mild cognitive impairment.

PubMed

Rienstra, Anne; Groot, Paul F C; Spaan, Pauline E J; Majoie, Charles B L M; Nederveen, Aart J; Walstra, Gerard J M; de Jonghe, Jos F M; van Gool, Willem A; Olabarriaga, Silvia D; Korkhov, Vladimir V; Schmand, Ben

2013-01-01

Patients with mild cognitive impairment (MCI) do not always convert to dementia. In such cases, abnormal neuropsychological test results may not validly reflect cognitive symptoms due to brain disease, and the usual brain-behavior relationships may be absent. This study examined symptom validity in a memory clinic sample and its effect on the associations between hippocampal volume and memory performance. Eleven of 170 consecutive patients (6.5%; 13% of patients younger than 65 years) referred to memory clinics showed noncredible performance on symptom validity tests (SVTs, viz. Word Memory Test and Test of Memory Malingering). They were compared to a demographically matched group (n = 57) selected from the remaining patients. Hippocampal volume, measured by an automated volumetric method (Freesurfer), was correlated with scores on six verbal memory tests. The median correlation was r = .49 in the matched group. However, the relation was absent (median r = -.11) in patients who failed SVTs. Memory clinic samples may include patients who show noncredible performance, which invalidates their MCI diagnosis. This underscores the importance of applying SVTs in evaluating patients with cognitive complaints that may signify a predementia stage, especially when these patients are relatively young.

Online Dietary Intake Estimation: The Food4Me Food Frequency Questionnaire

PubMed Central

Forster, Hannah; Fallaize, Rosalind; Gallagher, Caroline; O’Donovan, Clare B; Woolhead, Clara; Walsh, Marianne C; Macready, Anna L; Lovegrove, Julie A; Mathers, John C; Gibney, Michael J; Brennan, Lorraine

2014-01-01

Background Dietary assessment methods are important tools for nutrition research. Online dietary assessment tools have the potential to become invaluable methods of assessing dietary intake because, compared with traditional methods, they have many advantages including the automatic storage of input data and the immediate generation of nutritional outputs. Objective The aim of this study was to develop an online food frequency questionnaire (FFQ) for dietary data collection in the “Food4Me” study and to compare this with the validated European Prospective Investigation of Cancer (EPIC) Norfolk printed FFQ. Methods The Food4Me FFQ used in this analysis was developed to consist of 157 food items. Standardized color photographs were incorporated in the development of the Food4Me FFQ to facilitate accurate quantification of the portion size of each food item. Participants were recruited in two centers (Dublin, Ireland and Reading, United Kingdom) and each received the online Food4Me FFQ and the printed EPIC-Norfolk FFQ in random order. Participants completed the Food4Me FFQ online and, for most food items, participants were requested to choose their usual serving size among seven possibilities from a range of portion size pictures. The level of agreement between the two methods was evaluated for both nutrient and food group intakes using the Bland and Altman method and classification into quartiles of daily intake. Correlations were calculated for nutrient and food group intakes. Results A total of 113 participants were recruited with a mean age of 30 (SD 10) years (40.7% male, 46/113; 59.3%, 67/113 female). Cross-classification into exact plus adjacent quartiles ranged from 77% to 97% at the nutrient level and 77% to 99% at the food group level. Agreement at the nutrient level was highest for alcohol (97%) and lowest for percent energy from polyunsaturated fatty acids (77%). Crude unadjusted correlations for nutrients ranged between .43 and .86. Agreement at the food group level was highest for “other fruits” (eg, apples, pears, oranges) and lowest for “cakes, pastries, and buns”. For food groups, correlations ranged between .41 and .90. Conclusions The results demonstrate that the online Food4Me FFQ has good agreement with the validated printed EPIC-Norfolk FFQ for assessing both nutrient and food group intakes, rendering it a useful tool for ranking individuals based on nutrient and food group intakes. PMID:24911957

The validity of the 12-item Bem Sex Role Inventory in older Spanish population: an examination of the androgyny model.

PubMed

Vafaei, Afshin; Alvarado, Beatriz; Tomás, Concepcion; Muro, Carmen; Martinez, Beatriz; Zunzunegui, Maria Victoria

2014-01-01

The Bem Sex Role Inventory (BSRI) is the most commonly used and validated gender role measurement tool across countries and age groups. However, it has been rarely validated in older adults and sporadically used in aging and health studies. Perceived gender role is a crucial part of a person's identity and an established determinant of health. Androgyny model suggests that those with high levels of both masculinity and femininity (androgynous) are more adaptive and hence have better health. Our objectives were to explore the validity of BSRI in an older Spanish population, to compare different standard methods of measuring gender roles, and to examine their impact on health indicators. The BSRI and health indicator questions were completed by 120 community-dwelling adults aged 65+ living in Aragon, Spain. Exploratory factor analysis was performed to examine psychometric properties of the BSRI. Androgyny was measured by three approaches: geometric mean, t-ratio, and traditional four-gender groups classification. Relationships between health indicators and gender roles were explored. Factor analysis resulted in two-factor solution consistent with the original masculine and feminine items with high loadings and good reliability. There were no associations between biological sex and gender roles. Different gender role measurement approaches classified participants differently into gender role groups. Overall, androgyny was associated with better mobility and physical and mental health. The traditional four groups approach showed higher compatibility with the androgyny model and was better able to disentangle the differential impact of gender roles on health. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Application of the OMERACT filter to measures of core outcome domains in recent clinical studies of acute gout

PubMed Central

Taylor, William J; Redden, David; Dalbeth, Nicola; Schumacher, H Ralph; Edwards, N Lawrence; Simon, Lee S; John, Markus R; Essex, Margaret N; Watson, Douglas J; Evans, Robert; Rome, Keith; Singh, Jasvinder A

2014-01-01

Objective To determine the extent to which instruments that measure core outcome domains in acute gout fulfil the OMERACT filter requirements of truth, discrimination and feasibility. Methods Patient-level data from four randomised controlled trials of agents designed to treat acute gout and one observational study of acute gout were analysed. For each available measure construct validity, test-retest reliability, within-group change using effect size, between-group change using the Kruskall-Wallis statistic and repeated measures generalised estimating equations were assessed. Floor and ceiling effects were also assessed and MCID was estimated. These analyses were presented to participants at OMERACT 11 to help inform voting for possible endorsement. Results There was evidence for construct validity and discriminative ability for 3 measures of pain (0 to 4 Likert, 0 to 10 numeric rating scale, 0 to 100 mm visual analogue scale). Likewise, there appears to be sufficient evidence for a 4-point Likert scale to possess construct validity and discriminative ability for physician assessment of joint swelling and joint tenderness. There was some evidence for construct validity and within-group discriminative ability for the Health Assessment Questionnaire as a measure of activity limitations, but not for discrimination between groups allocated to different treatment. Conclusions There is sufficient evidence to support measures of pain (using Likert, numeric rating scale or visual analogue scales), joint tenderness and swelling (using Likert scale) as fulfilling the requirements of the OMERACT filter. Further research on a measure of activity limitations in acute gout clinical trials is required. PMID:24429178

Development and validation of a melanoma risk score based on pooled data from 16 case-control studies

PubMed Central

Davies, John R; Chang, Yu-mei; Bishop, D Timothy; Armstrong, Bruce K; Bataille, Veronique; Bergman, Wilma; Berwick, Marianne; Bracci, Paige M; Elwood, J Mark; Ernstoff, Marc S; Green, Adele; Gruis, Nelleke A; Holly, Elizabeth A; Ingvar, Christian; Kanetsky, Peter A; Karagas, Margaret R; Lee, Tim K; Le Marchand, Loïc; Mackie, Rona M; Olsson, Håkan; Østerlind, Anne; Rebbeck, Timothy R; Reich, Kristian; Sasieni, Peter; Siskind, Victor; Swerdlow, Anthony J; Titus, Linda; Zens, Michael S; Ziegler, Andreas; Gallagher, Richard P.; Barrett, Jennifer H; Newton-Bishop, Julia

2015-01-01

Background We report the development of a cutaneous melanoma risk algorithm based upon 7 factors; hair colour, skin type, family history, freckling, nevus count, number of large nevi and history of sunburn, intended to form the basis of a self-assessment webtool for the general public. Methods Predicted odds of melanoma were estimated by analysing a pooled dataset from 16 case-control studies using logistic random coefficients models. Risk categories were defined based on the distribution of the predicted odds in the controls from these studies. Imputation was used to estimate missing data in the pooled datasets. The 30th, 60th and 90th centiles were used to distribute individuals into four risk groups for their age, sex and geographic location. Cross-validation was used to test the robustness of the thresholds for each group by leaving out each study one by one. Performance of the model was assessed in an independent UK case-control study dataset. Results Cross-validation confirmed the robustness of the threshold estimates. Cases and controls were well discriminated in the independent dataset (area under the curve 0.75, 95% CI 0.73-0.78). 29% of cases were in the highest risk group compared with 7% of controls, and 43% of controls were in the lowest risk group compared with 13% of cases. Conclusion We have identified a composite score representing an estimate of relative risk and successfully validated this score in an independent dataset. Impact This score may be a useful tool to inform members of the public about their melanoma risk. PMID:25713022

Psychological collectivism: a measurement validation and linkage to group member performance.

PubMed

Jackson, Christine L; Colquitt, Jason A; Wesson, Michael J; Zapata-Phelan, Cindy P

2006-07-01

The 3 studies presented here introduce a new measure of the individual-difference form of collectivism. Psychological collectivism is conceptualized as a multidimensional construct with the following 5 facets: preference for in-groups, reliance on in-groups, concern for in-groups, acceptance of in-group norms, and prioritization of in-group goals. Study 1 developed and tested the new measure in a sample of consultants. Study 2 cross-validated the measure using an alumni sample of a Southeastern university, assessing its convergent validity with other collectivism measures. Study 3 linked scores on the measure to 4 dimensions of group member performance (task performance, citizenship behavior, counterproductive behavior, and withdrawal behavior) in a computer software firm and assessed discriminant validity using the Big Five. The results of the studies support the construct validity of the measure and illustrate the potential value of collectivism as a predictor of group member performance. ((c) 2006 APA, all rights reserved).

Simultaneous estimation of cross-validation errors in least squares collocation applied for statistical testing and evaluation of the noise variance components

NASA Astrophysics Data System (ADS)

Behnabian, Behzad; Mashhadi Hossainali, Masoud; Malekzadeh, Ahad

2018-02-01

The cross-validation technique is a popular method to assess and improve the quality of prediction by least squares collocation (LSC). We present a formula for direct estimation of the vector of cross-validation errors (CVEs) in LSC which is much faster than element-wise CVE computation. We show that a quadratic form of CVEs follows Chi-squared distribution. Furthermore, a posteriori noise variance factor is derived by the quadratic form of CVEs. In order to detect blunders in the observations, estimated standardized CVE is proposed as the test statistic which can be applied when noise variances are known or unknown. We use LSC together with the methods proposed in this research for interpolation of crustal subsidence in the northern coast of the Gulf of Mexico. The results show that after detection and removing outliers, the root mean square (RMS) of CVEs and estimated noise standard deviation are reduced about 51 and 59%, respectively. In addition, RMS of LSC prediction error at data points and RMS of estimated noise of observations are decreased by 39 and 67%, respectively. However, RMS of LSC prediction error on a regular grid of interpolation points covering the area is only reduced about 4% which is a consequence of sparse distribution of data points for this case study. The influence of gross errors on LSC prediction results is also investigated by lower cutoff CVEs. It is indicated that after elimination of outliers, RMS of this type of errors is also reduced by 19.5% for a 5 km radius of vicinity. We propose a method using standardized CVEs for classification of dataset into three groups with presumed different noise variances. The noise variance components for each of the groups are estimated using restricted maximum-likelihood method via Fisher scoring technique. Finally, LSC assessment measures were computed for the estimated heterogeneous noise variance model and compared with those of the homogeneous model. The advantage of the proposed method is the reduction in estimated noise levels for those groups with the fewer number of noisy data points.

Comparison of multianalyte proficiency test results by sum of ranking differences, principal component analysis, and hierarchical cluster analysis.

PubMed

Škrbić, Biljana; Héberger, Károly; Durišić-Mladenović, Nataša

2013-10-01

Sum of ranking differences (SRD) was applied for comparing multianalyte results obtained by several analytical methods used in one or in different laboratories, i.e., for ranking the overall performances of the methods (or laboratories) in simultaneous determination of the same set of analytes. The data sets for testing of the SRD applicability contained the results reported during one of the proficiency tests (PTs) organized by EU Reference Laboratory for Polycyclic Aromatic Hydrocarbons (EU-RL-PAH). In this way, the SRD was also tested as a discriminant method alternative to existing average performance scores used to compare mutlianalyte PT results. SRD should be used along with the z scores--the most commonly used PT performance statistics. SRD was further developed to handle the same rankings (ties) among laboratories. Two benchmark concentration series were selected as reference: (a) the assigned PAH concentrations (determined precisely beforehand by the EU-RL-PAH) and (b) the averages of all individual PAH concentrations determined by each laboratory. Ranking relative to the assigned values and also to the average (or median) values pointed to the laboratories with the most extreme results, as well as revealed groups of laboratories with similar overall performances. SRD reveals differences between methods or laboratories even if classical test(s) cannot. The ranking was validated using comparison of ranks by random numbers (a randomization test) and using seven folds cross-validation, which highlighted the similarities among the (methods used in) laboratories. Principal component analysis and hierarchical cluster analysis justified the findings based on SRD ranking/grouping. If the PAH-concentrations are row-scaled, (i.e., z scores are analyzed as input for ranking) SRD can still be used for checking the normality of errors. Moreover, cross-validation of SRD on z scores groups the laboratories similarly. The SRD technique is general in nature, i.e., it can be applied to any experimental problem in which multianalyte results obtained either by several analytical procedures, analysts, instruments, or laboratories need to be compared.

Galileo FOC Satellite Group Delay Estimation based on Raw Method and published IOV Metadata

NASA Astrophysics Data System (ADS)

Reckeweg, Florian; Schönemann, Erik; Springer, Tim; Enderle, Werner

2017-04-01

In December 2016, the European GNSS Agency (GSA) published the Galileo In-Orbit Validation (IOV) satellite metadata. These metadata include among others the so-called Galileo satellite group delays, which were measured in an absolute sense by the satellite manufacturer on-ground for all three Galileo frequency bands E1, E5 and E6. Therewith Galileo is the first Global Navigation Satellite System (GNSS) for which absolute calibration values for satellite on-board group delays have been published. The different satellite group delays for the three frequency bands lead to the fact that the signals will not be transmitted at exactly the same epoch. Up to now, due to the lack of absolute group delays, it is common practice in GNSS analyses to estimate and apply the differences of these satellite group delays, commonly known as differential code biases (DCBs). However, this has the drawback that the determination of the "raw" clock and the absolute ionosphere is not possible. The use of absolute bias calibrations for satellites and receivers is a major step into the direction of more realistic (in a physical sense) clock and atmosphere estimates. The Navigation Support Office at the European Space Operation Centre (ESOC) was from the beginning involved in the validation process of the Galileo metadata. For the work presented in this presentation we will use the absolute bias calibrations of the Galileo IOV satellites to estimate and validate the absolute receiver group delays of the ESOC GNSS network and vice versa. The receiver group delays have exemplarily been calibrated in a calibration campaign with an IFEN GNSS Signal-Simulator at ESOC. Based on the calibrated network, making use of the ionosphere constraints given by the IOV satellites, GNSS raw observations are processed to estimate satellite group delays for the operational Galileo (Full Operational Capability) FOC satellites. In addition, "raw" satellite clock offsets are estimated, which are free of the ionosphere-free bias, which is inherent to all common satellite clock products, generated with the standard ionosphere-free linear combination processing approach. In the raw observation processing method, developed by the Navigation Support Office at ESOC, no differences or linear combinations of GNSS observations are formed and ionosphere parameters and multi-signal group delay parameters can be jointly estimated by making use of all available code and phase observations on multiple frequencies.

Group Sequential Testing of the Predictive Accuracy of a Continuous Biomarker with Unknown Prevalence

PubMed Central

Koopmeiners, Joseph S.; Feng, Ziding

2015-01-01

Group sequential testing procedures have been proposed as an approach to conserving resources in biomarker validation studies. Previously, Koopmeiners and Feng (2011) derived the asymptotic properties of the sequential empirical positive predictive value (PPV) and negative predictive value curves, which summarize the predictive accuracy of a continuous marker, under case-control sampling. A limitation of their approach is that the prevalence can not be estimated from a case-control study and must be assumed known. In this manuscript, we consider group sequential testing of the predictive accuracy of a continuous biomarker with unknown prevalence. First, we develop asymptotic theory for the sequential empirical PPV and NPV curves when the prevalence must be estimated, rather than assumed known in a case-control study. We then discuss how our results can be combined with standard group sequential methods to develop group sequential testing procedures and bias-adjusted estimators for the PPV and NPV curve. The small sample properties of the proposed group sequential testing procedures and estimators are evaluated by simulation and we illustrate our approach in the context of a study to validate a novel biomarker for prostate cancer. PMID:26537180

Development of the NIH PROMIS® Sexual Function and Satisfaction Measures in Patients with Cancer

PubMed Central

Flynn, Kathryn E.; Lin, Li; Cyranowski, Jill M.; Reeve, Bryce B.; Reese, Jennifer Barsky; Jeffery, Diana D.; Smith, Ashley Wilder; Porter, Laura S.; Dombeck, Carrie B.; Bruner, Deborah Watkins; Keefe, Francis J.; Weinfurt, Kevin P.

2013-01-01

Introduction We describe the development and validation of the PROMIS Sexual Function and Satisfaction (PROMIS SexFS) measures version 1.0 for cancer populations. Aim To develop a customizable self-report measure of sexual function and satisfaction as part of the U.S. National Institutes of Health PROMIS® Network. Methods Our multidisciplinary working group followed a comprehensive protocol for developing psychometrically robust patient reported outcome (PRO) measures including qualitative (scale development) and quantitative (psychometric evaluation) development. We performed an extensive literature review, conducted 16 focus groups with cancer patients and multiple discussions with clinicians, and evaluated candidate items in cognitive testing with patients. We administered items to 819 cancer patients. Items were calibrated using item response theory and evaluated for reliability and validity. Main Outcome Measures The PROMIS Sexual Function and Satisfaction (PROMIS SexFS) measures version 1.0 include 79 items in 11 domains: interest in sexual activity, lubrication, vaginal discomfort, erectile function, global satisfaction with sex life, orgasm, anal discomfort, therapeutic aids, sexual activities, interfering factors, and screener questions. Results In addition to content validity (patients indicate that items cover important aspects of their experiences) and face validity (patients indicate that items measure sexual function and satisfaction), the measure shows evidence for discriminant validity (domains discriminate between groups expected to be different), convergent validity (strong correlations between scores on PROMIS and scores on conceptually-similar older measures of sexual function), as well as favorable test-retest reliability among people not expected to change (inter-class correlations from 2 administrations of the instrument, 1 month apart). Conclusions The PROMIS SexFS offers researchers a reliable and valid set of tools to measure self-reported sexual function and satisfaction among diverse men and women. The measures are customizable; researchers can select the relevant domains and items comprising those domains for their study. PMID:23387911

Validation of a Novel Laparoscopic Adjustable Gastric Band Simulator

PubMed Central

Sankaranarayanan, Ganesh; Adair, James D.; Halic, Tansel; Gromski, Mark A.; Lu, Zhonghua; Ahn, Woojin; Jones, Daniel B.; De, Suvranu

2011-01-01

Background Morbid obesity accounts for more than 90,000 deaths per year in the United States. Laparoscopic adjustable gastric banding (LAGB) is the second most common weight loss procedure performed in the US and the most common in Europe and Australia. Simulation in surgical training is a rapidly advancing field that has been adopted by many to prepare surgeons for surgical techniques and procedures. Study Aim The aim of our study was to determine face, construct and content validity for a novel virtual reality laparoscopic adjustable gastric band simulator. Methods Twenty-eight subjects were categorized into two groups (Expert and Novice), determined by their skill level in laparoscopic surgery. Experts consisted of subjects who had at least four years of laparoscopic training and operative experience. Novices consisted of subjects with medical training, but with less than four years of laparoscopic training. The subjects performed the virtual reality laparoscopic adjustable band surgery simulator. They were automatically scored, according to various tasks. The subjects then completed a questionnaire to evaluate face and content validity. Results On a 5-point Likert scale (1 – lowest score, 5 – highest score), the mean score for visual realism was 4.00 ± 0.67 and the mean score for realism of the interface and tool movements was 4.07 ± 0.77 [Face Validity]. There were significant differences in the performance of the two subject groups (Expert and Novice), based on total scores (p<0.001) [Construct Validity]. Mean scores for utility of the simulator, as addressed by the Expert group, was 4.50 ± 0.71 [Content Validity]. Conclusion We created a virtual reality laparoscopic adjustable gastric band simulator. Our initial results demonstrate excellent face, construct and content validity findings. To our knowledge, this is the first virtual reality simulator with haptic feedback for training residents and surgeons in the laparoscopic adjustable gastric banding procedure. PMID:20734069

Preliminary Face and Construct Validation Study of a Virtual Basic Laparoscopic Skill Trainer

PubMed Central

Sankaranarayanan, Ganesh; Lin, Henry; Arikatla, Venkata S.; Mulcare, Maureen; Zhang, Likun; Derevianko, Alexandre; Lim, Robert; Fobert, David; Cao, Caroline; Schwaitzberg, Steven D.; Jones, Daniel B.

2010-01-01

Abstract Background The Virtual Basic Laparoscopic Skill Trainer (VBLaST™) is a developing virtual-reality–based surgical skill training system that incorporates several of the tasks of the Fundamentals of Laparoscopic Surgery (FLS) training system. This study aimed to evaluate the face and construct validity of the VBLaST™ system. Materials and Methods Thirty-nine subjects were voluntarily recruited at the Beth Israel Deaconess Medical Center (Boston, MA) and classified into two groups: experts (PGY 5, fellow and practicing surgeons) and novice (PGY 1–4). They were then asked to perform three FLS tasks, consisting of peg transfer, pattern cutting, and endoloop, on both the VBLaST and FLS systems. The VBLaST performance scores were automatically computed, while the FLS scores were rated by a trained evaluator. Face validity was assessed using a 5-point Likert scale, varying from not realistic/useful (1) to very realistic/useful (5). Results Face-validity scores showed that the VBLaST system was significantly realistic in portraying the three FLS tasks (3.95 ± 0.909), as well as the reality in trocar placement and tool movements (3.67 ± 0.874). Construct-validity results show that VBLaST was able to differentiate between the expert and novice group (P = 0.015). However, of the two tasks used for evaluating VBLaST, only the peg-transfer task showed a significant difference between the expert and novice groups (P = 0.003). Spearman correlation coefficient analysis between the two scores showed significant correlation for the peg-transfer task (Spearman coefficient 0.364; P = 0.023). Conclusions VBLaST demonstrated significant face and construct validity. A further set of studies, involving improvement to the current VBLaST system, is needed to thoroughly demonstrate face and construct validity for all the tasks. PMID:20201683

Full immersion simulation: validation of a distributed simulation environment for technical and non-technical skills training in Urology.

PubMed

Brewin, James; Tang, Jessica; Dasgupta, Prokar; Khan, Muhammad S; Ahmed, Kamran; Bello, Fernando; Kneebone, Roger; Jaye, Peter

2015-07-01

To evaluate the face, content and construct validity of the distributed simulation (DS) environment for technical and non-technical skills training in endourology. To evaluate the educational impact of DS for urology training. DS offers a portable, low-cost simulated operating room environment that can be set up in any open space. A prospective mixed methods design using established validation methodology was conducted in this simulated environment with 10 experienced and 10 trainee urologists. All participants performed a simulated prostate resection in the DS environment. Outcome measures included surveys to evaluate the DS, as well as comparative analyses of experienced and trainee urologist's performance using real-time and 'blinded' video analysis and validated performance metrics. Non-parametric statistical methods were used to compare differences between groups. The DS environment demonstrated face, content and construct validity for both non-technical and technical skills. Kirkpatrick level 1 evidence for the educational impact of the DS environment was shown. Further studies are needed to evaluate the effect of simulated operating room training on real operating room performance. This study has shown the validity of the DS environment for non-technical, as well as technical skills training. DS-based simulation appears to be a valuable addition to traditional classroom-based simulation training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

[Evaluation on the validity and reliability of the Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale (DSKAB)].

PubMed

Liu, Xiaoli; Dai, Long; Chen, Bo; Feng, Nongping; Wu, Qianhui; Lin, Yonghai; Zhang, Lan; Tan, Dong; Zhang, Jinhua; Tu, Huijuan; Li, Changfeng; Wang, Wenjuan

2016-01-01

To evaluate the validity and reliability of Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale (DSKAB). We selected 460 patients with diabetes in the community, used the scale which was after two rounds of the Delphi method and pilot study. Investigators surveyed the patients by the way of face to face. by draw lots, we selected 25 community diabetes randomly for repeating investigations after one week. The validity analyses included face validity, content validity, construct validity and discriminant validity. The reliability analyses included Cronbach's α coefficient, θ coefficient, Ω coefficient, split-half reliability and test-retest reliability. This study distributed a total of 460 questionnaires, reclaimed 442, qualified 432. The score of the scale was 254.59 ± 28.90, the scores of the knowledge, attitude, behavior sub-scales were 82.44 ± 11.24, 63.53 ± 5.77 and 108.61 ± 17.55, respectively. It had excellent face validity and content validity. The correlation coefficient was from 0.71 to 0.91 among three sub-scales and the scale, P<0.001. The common factor cumulative variance contribution rate of the scale and three sub-scales was from 57.28% to 67.19%, which achieved more than 50% of the approved standard, there was 25 common factors, 91 items of the total 98 items held factor loading ≥0.40 in its relevant common factor, it had good construct validity. The scores of high group and low group in three sub-scales were: knowledge (91.12 ± 3.62) and (69.96 ± 11.20), attitude (68.75 ± 4.51) and (58.79 ± 4.87), behavior (129.38 ± 8.53) and (89.65 ± 11.34),mean scores of three sub-scales were apparently different, which compared between high score group and low score group, the t value were - 19.45, -16.24 and -30.29, respectively, P<0.001, and it had good discriminant validity. The Cronbach's α coefficient of the scale and three sub-scales was from 0.79 to 0.93, the θ coefficient was from 0.86 to 0.95, the Ω coefficient was from 0.90 to 0.98, split-half reliability was from 0.89 to 0.95.Test-retest reliability of the scale was 0.51;the three sub-scales was from 0.46 to 0.52, P<0.05. The validity and reliability of the Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale are excellent, which is a suitable instrument to evaluate the self-management for patients with diabetes.

Qualitative to quantitative: linked trajectory of method triangulation in a study on HIV/AIDS in Goa, India.

PubMed

Bailey, Ajay; Hutter, Inge

2008-10-01

With 3.1 million people estimated to be living with HIV/AIDS in India and 39.5 million people globally, the epidemic has posed academics the challenge of identifying behaviours and their underlying beliefs in the effort to reduce the risk of HIV transmission. The Health Belief Model (HBM) is frequently used to identify risk behaviours and adherence behaviour in the field of HIV/AIDS. Risk behaviour studies that apply HBM have been largely quantitative and use of qualitative methodology is rare. The marriage of qualitative and quantitative methods has never been easy. The challenge is in triangulating the methods. Method triangulation has been largely used to combine insights from the qualitative and quantitative methods but not to link both the methods. In this paper we suggest a linked trajectory of method triangulation (LTMT). The linked trajectory aims to first gather individual level information through in-depth interviews and then to present the information as vignettes in focus group discussions. We thus validate information obtained from in-depth interviews and gather emic concepts that arise from the interaction. We thus capture both the interpretation and the interaction angles of the qualitative method. Further, using the qualitative information gained, a survey is designed. In doing so, the survey questions are grounded and contextualized. We employed this linked trajectory of method triangulation in a study on the risk assessment of HIV/AIDS among migrant and mobile men. Fieldwork was carried out in Goa, India. Data come from two waves of studies, first an explorative qualitative study (2003), second a larger study (2004-2005), including in-depth interviews (25), focus group discussions (21) and a survey (n=1259). By employing the qualitative to quantitative LTMT we can not only contextualize the existing concepts of the HBM, but also validate new concepts and identify new risk groups.

How are scientific thinking skills best developed? Direct instruction vs. inquiry practice

NASA Astrophysics Data System (ADS)

Dean, David Worth, Jr.

Despite its support and adoption by most major scientific and educational organizations, some researchers have questioned whether inquiry learning is indeed the best method for acquiring the skills of inquiry. Klahr and colleagues have investigated the development of the control of variables strategy, or controlled comparison (CC), and claim that a brief session of direct instruction, characterized by explicit training of CC, as opposed to allowing children to discover CC through inquiry learning, is sufficient for acquisition, maintenance, and transfer of this core aspect of inquiry. Kuhn and colleagues, however, argue that direct instruction may be insufficient for development of the metastrategic level of understanding necessary to adequately maintain and transfer inquiry skills. In the present study, I attempt to identify the intervention most effective in supporting acquisition, maintenance, and transfer of these skills. Three groups of students received either a direct instruction session followed by standard classroom instruction (DI-only), an introductory session (without direct instruction) followed by practice sessions only (PR-only), or a direct instruction session followed by practice sessions (DI+PR). Practice sessions involved the use of a computer-based inquiry task requiring students to investigate the effects of five potential causal variables on an outcome. The two practice groups worked with this program during 12 sessions over nine weeks. They worked with structurally identical software programs during five weekly maintenance sessions. During this time, the DI-only group received standard classroom instruction. All groups were assessed on familiar and unfamiliar computer-based inquiry tasks at the conclusion of intervention (immediate assessment) and maintenance sessions (delayed assessment). Students in the two practice groups demonstrated improvement in an integrative measure of inquiry skill (valid intent, valid strategy, valid inference, and valid explanation, in combination) as well as most component measures of this skill. Performance of the two practice groups was superior to that of the DI-only group. Direct instruction conferred no additional benefit to the group receiving both direct instruction and practice compared to the practice-only group. Examined over an extended time interval, the merits of brief direct instruction are thus brought into question.

Developing an assessment based on physical fitness age to evaluate motor function in frail and healthy elderly women

PubMed Central

Nakagaichi, Masaki; Anan, Yuya; Hikiji, Yuto; Uratani, Sou

2018-01-01

Objectives The purpose of this study was to identify a method for assessing physical fitness age that is easy to use with both frail and healthy elderly women and to examine its validity. Methods Principal component analysis was used to develop a formula of physical fitness age from four motor function variables. The subjects comprised 688 (75.7±6.0 years) elderly women, in order to develop a physical fitness scale. The formula for calculating physical fitness age was expressed as physical fitness age =−0.419× grip strength −0.096× balancing on one leg with eyes open −0.737×30 s chair stand +0.503× figure-of-8 walking test +0.47× chronological age +52.68. Results Measures obtained from subjects in the frail elderly (n=11, 73.0±2.3 years) and exercise (n=10, 70.8±3.1 years) groups were used to examine the validity of the assessment. The mean physical fitness age of the frail elderly group (79.0±3.7 years) was significantly higher than its mean chronological age (73.0±2.3 years, p<0.05). The mean physical fitness age of the exercise group (65.6±3.1 years) was significantly lower than the chronological age (70.8±3.1 years, p<0.05). Conclusion These findings confirm that physical fitness age scores are applicable to frail and healthy elderly women. Physical fitness age is a valid measure of motor function in elderly women. PMID:29416326

Validation of a Novel Virtual Reality Simulator for Robotic Surgery

PubMed Central

Schreuder, Henk W. R.; Persson, Jan E. U.; Wolswijk, Richard G. H.; Ihse, Ingmar; Schijven, Marlies P.; Verheijen, René H. M.

2014-01-01

Objective. With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. Methods. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Results. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were “time to complete” and “economy of motion” (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Conclusions. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery. PMID:24600328

Development of a Brief Questionnaire to Assess Contraceptive Intent

PubMed Central

Raine-Bennett, Tina R; Rocca, Corinne H

2015-01-01

Objective We sought to develop and validate an instrument that can enable providers to identify young women who may be at risk of contraceptive non-adherence. Methods Item response theory based methods were used to evaluate the psychometric properties of the Contraceptive Intent Questionnaire, a 15-item self-administered questionnaire, based on theory and prior qualitative and quantitative research. The questionnaire was administered to 200 women aged 15–24 years who were initiating contraceptives. We assessed item fit to the item response model, internal consistency, internal structure validity, and differential item functioning. Results All items fit a one-dimensional model. The separation reliability coefficient was 0.73. Participants’ overall scores covered the full range of the scale (0–15), and items appropriately matched the range of participants’ contraceptive intent. Items met the criteria for internal structure validity and most items functioned similarly between groups of women. Conclusion The Contraceptive Intent Questionnaire appears to be a reliable and valid tool. Future testing is needed to assess predictive ability and clinical utility. Practice Implications The Contraceptive Intent Questionnaire may serve as a valid tool to help providers identify women who may have problems with contraceptive adherence, as well as to pinpoint areas in which counseling may be directed. PMID:26104994

A review of the latest guidelines for NIBP device validation.

PubMed

Alpert, Bruce S; Quinn, David E; Friedman, Bruce A

2013-12-01

The current ISO Standard is accepted as the National Standard in almost every industrialized nation. An overview of the most recently adopted standards is provided. Standards writing groups including the Advancement of Medical Instrumentation Sphygmomanometer Committee and ISO JWG7 are working to expand standardized evaluation methods to include the evaluation of devices intended for use in environments where motion artifact is common. An Association for the Advancement of Medical Instrumentation task group on noninvasive blood pressure measurement in the presence of motion artifact has published a technical information report containing research and standardized methods for the evaluation of blood pressure device performance in the presence of motion artifact.

Construct Validity of Fresh Frozen Human Cadaver as a Training Model in Minimal Access Surgery

PubMed Central

Macafee, David; Pranesh, Nagarajan; Horgan, Alan F.

2012-01-01

Background: The construct validity of fresh human cadaver as a training tool has not been established previously. The aims of this study were to investigate the construct validity of fresh frozen human cadaver as a method of training in minimal access surgery and determine if novices can be rapidly trained using this model to a safe level of performance. Methods: Junior surgical trainees, novices (<3 laparoscopic procedure performed) in laparoscopic surgery, performed 10 repetitions of a set of structured laparoscopic tasks on fresh frozen cadavers. Expert laparoscopists (>100 laparoscopic procedures) performed 3 repetitions of identical tasks. Performances were scored using a validated, objective Global Operative Assessment of Laparoscopic Skills scale. Scores for 3 consecutive repetitions were compared between experts and novices to determine construct validity. Furthermore, to determine if the novices reached a safe level, a trimmed mean of the experts score was used to define a benchmark. Mann-Whitney U test was used for construct validity analysis and 1-sample t test to compare performances of the novice group with the benchmark safe score. Results: Ten novices and 2 experts were recruited. Four out of 5 tasks (nondominant to dominant hand transfer; simulated appendicectomy; intracorporeal and extracorporeal knot tying) showed construct validity. Novices’ scores became comparable to benchmark scores between the eighth and tenth repetition. Conclusion: Minimal access surgical training using fresh frozen human cadavers appears to have construct validity. The laparoscopic skills of novices can be accelerated through to a safe level within 8 to 10 repetitions. PMID:23318058

A permutation testing framework to compare groups of brain networks.

PubMed

Simpson, Sean L; Lyday, Robert G; Hayasaka, Satoru; Marsh, Anthony P; Laurienti, Paul J

2013-01-01

Brain network analyses have moved to the forefront of neuroimaging research over the last decade. However, methods for statistically comparing groups of networks have lagged behind. These comparisons have great appeal for researchers interested in gaining further insight into complex brain function and how it changes across different mental states and disease conditions. Current comparison approaches generally either rely on a summary metric or on mass-univariate nodal or edge-based comparisons that ignore the inherent topological properties of the network, yielding little power and failing to make network level comparisons. Gleaning deeper insights into normal and abnormal changes in complex brain function demands methods that take advantage of the wealth of data present in an entire brain network. Here we propose a permutation testing framework that allows comparing groups of networks while incorporating topological features inherent in each individual network. We validate our approach using simulated data with known group differences. We then apply the method to functional brain networks derived from fMRI data.

Novel Equations for Estimating Lean Body Mass in Patients With Chronic Kidney Disease.

PubMed

Tian, Xue; Chen, Yuan; Yang, Zhi-Kai; Qu, Zhen; Dong, Jie

2018-05-01

Simplified methods to estimate lean body mass (LBM), an important nutritional measure representing muscle mass and somatic protein, are lacking in nondialyzed patients with chronic kidney disease (CKD). We developed and tested 2 reliable equations for estimation of LBM in daily clinical practice. The development and validation groups both included 150 nondialyzed patients with CKD Stages 3 to 5. Two equations for estimating LBM based on mid-arm muscle circumference (MAMC) or handgrip strength (HGS) were developed and validated in CKD patients with dual-energy x-ray absorptiometry as referenced gold method. We developed and validated 2 equations for estimating LBM based on HGS and MAMC. These equations, which also incorporated sex, height, and weight, were developed and validated in CKD patients. The new equations were found to exhibit only small biases when compared with dual-energy x-ray absorptiometry, with median differences of 0.94 and 0.46 kg observed in the HGS and MAMC equations, respectively. Good precision and accuracy were achieved for both equations, as reflected by small interquartile ranges in the differences and in the percentages of estimates that were 20% of measured LBM. The bias, precision, and accuracy of each equation were found to be similar when it was applied to groups of patients divided by the median measured LBM, the median ratio of extracellular to total body water, and the stages of CKD. LBM estimated from MAMC or HGS were found to provide accurate estimates of LBM in nondialyzed patients with CKD. Copyright © 2017 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

Workshop Report: Crystal City VI-Bioanalytical Method Validation for Biomarkers.

PubMed

Arnold, Mark E; Booth, Brian; King, Lindsay; Ray, Chad

2016-11-01

With the growing focus on translational research and the use of biomarkers to drive drug development and approvals, biomarkers have become a significant area of research within the pharmaceutical industry. However, until the US Food and Drug Administration's (FDA) 2013 draft guidance on bioanalytical method validation included consideration of biomarker assays using LC-MS and LBA, those assays were created, validated, and used without standards of performance. This lack of expectations resulted in the FDA receiving data from assays of varying quality in support of efficacy and safety claims. The AAPS Crystal City VI (CC VI) Workshop in 2015 was held as the first forum for industry-FDA discussion around the general issues of biomarker measurements (e.g., endogenous levels) and specific technology strengths and weaknesses. The 2-day workshop served to develop a common understanding among the industrial scientific community of the issues around biomarkers, informed the FDA of the current state of the science, and will serve as a basis for further dialogue as experience with biomarkers expands with both groups.

Differences in MMPI-2 FBS and RBS scores in brain injury, probable malingering, and conversion disorder groups: a preliminary study.

PubMed

Peck, C P; Schroeder, R W; Heinrichs, R J; Vondran, E J; Brockman, C J; Webster, B K; Baade, L E

2013-01-01

This study examined differences in raw scores on the Symptom Validity Scale and Response Bias Scale (RBS) from the Minnesota Multiphasic Personality Inventory-2 in three criterion groups: (i) valid traumatic brain injured, (ii) invalid traumatic brain injured, and (iii) psychogenic non-epileptic seizure disorders. Results indicate that a >30 raw score cutoff for the Symptom Validity Scale accurately identified 50% of the invalid traumatic brain injured group, while misclassifying none of the valid traumatic brain injured group and 6% of the psychogenic non-epileptic seizure disorder group. Using a >15 RBS raw cutoff score accurately classified 50% of the invalid traumatic brain injured group and misclassified fewer than 10% of the valid traumatic brain injured and psychogenic non-epileptic seizure disorder groups. These cutoff scores used conjunctively did not misclassify any members of the psychogenic non-epileptic seizure disorder or valid traumatic brain injured groups, while accurately classifying 44% of the invalid traumatic brain injured individuals. Findings from this preliminary study suggest that the conjunctive use of the Symptom Validity Scale and the RBS from the Minnesota Multiphasic Personality Inventory-2 may be useful in differentiating probable malingering from individuals with brain injuries and conversion disorders.

Stakeholder validation of a model of readiness for transition to adult care.

PubMed

Schwartz, Lisa A; Brumley, Lauren D; Tuchman, Lisa K; Barakat, Lamia P; Hobbie, Wendy L; Ginsberg, Jill P; Daniel, Lauren C; Kazak, Anne E; Bevans, Katherine; Deatrick, Janet A

2013-10-01

That too few youth with special health care needs make the transition to adult-oriented health care successfully may be due, in part, to lack of readiness to transfer care. There is a lack of theoretical models to guide development and implementation of evidence-based guidelines, assessments, and interventions to improve transition readiness. To further validate the Social-ecological Model of Adolescent and Young Adult Readiness to Transition (SMART) via feedback from stakeholders (patients, parents, and providers) from a medically diverse population in need of life-long follow-up care, survivors of childhood cancer. Mixed-methods participatory research design. A large Mid-Atlantic children's hospital. Adolescent and young adult survivors of childhood cancer (n = 14), parents (n = 18), and pediatric providers (n = 10). Patients and parents participated in focus groups; providers participated in individual semi-structured interviews. Validity of SMART was assessed 3 ways: (1) ratings on importance of SMART components for transition readiness using a 5-point scale (0-4; ratings >2 support validity), (2) nominations of 3 "most important" components, and (3) directed content analysis of focus group/interview transcripts. Qualitative data supported the validity of SMART, with minor modifications to definitions of components. Quantitative ratings met criteria for validity; stakeholders endorsed all components of SMART as important for transition. No additional SMART variables were suggested by stakeholders and the "most important" components varied by stakeholders, thus supporting the comprehensiveness of SMART and need to involve multiple perspectives. SMART represents a comprehensive and empirically validated framework for transition research and program planning, supported by survivors of childhood cancer, parents, and pediatric providers. Future research should validate SMART among other populations with special health care needs.

The Main Concept Analysis: Validation and sensitivity in differentiating discourse produced by unimpaired English speakers from individuals with aphasia and dementia of Alzheimer type.

PubMed

Kong, Anthony Pak-Hin; Whiteside, Janet; Bargmann, Peggy

2016-10-01

Discourse from speakers with dementia and aphasia is associated with comparable but not identical deficits, necessitating appropriate methods to differentiate them. The current study aims to validate the Main Concept Analysis (MCA) to be used for eliciting and quantifying discourse among native typical English speakers and to establish its norm, and investigate the validity and sensitivity of the MCA to compare discourse produced by individuals with fluent aphasia, non-fluent aphasia, or dementia of Alzheimer's type (DAT), and unimpaired elderly. Discourse elicited through a sequential picture description task was collected from 60 unimpaired participants to determine the MCA scoring criteria; 12 speakers with fluent aphasia, 12 with non-fluent aphasia, 13 with DAT, and 20 elderly participants from the healthy group were compared on the finalized MCA. Results of MANOVA revealed significant univariate omnibus effects of speaker group as an independent variable on each main concept index. MCA profiles differed significantly between all participant groups except dementia versus fluent aphasia. Correlations between the MCA performances and the Western Aphasia Battery and Cognitive Linguistic Quick Test were found to be statistically significant among the clinical groups. The MCA was appropriate to be used among native speakers of English. The results also provided further empirical evidence of discourse deficits in aphasia and dementia. Practitioners can use the MCA to evaluate discourse production systemically and objectively.

Serial album validation for promotion of infant body weight control

PubMed Central

Saraiva, Nathalia Costa Gonzaga; Medeiros, Carla Campos Muniz; de Araujo, Thelma Leite

2018-01-01

ABSTRACT Objective: to validate the content and appearance of a serial album for children aged from 7 to 10 years addressing the topic of prevention and control of body weight. Method: methodological study with descriptive nature. The validation process was attended by 33 specialists in educational technologies and/or in excess of infantile weight. The agreement index of 80% was the minimum considered to guarantee the validation of the material. Results: most of the specialists had a doctoral degree and a graduate degree in nursing. Regarding content, illustrations, layout and relevance, all items were validated and 69.7% of the experts considered the album as great. The overall agreement validation index for the educational technology was 0.88. Only the script-sheet 3 did not reach the cutoff point of the content validation index. Changes were made to the material, such as title change, inclusion of the school context and insertion of nutritionist and physical educator in the story narrated in the album. Conclusion: the proposed serial album was considered valid by experts regarding content and appearance, suggesting that this technology has the potential to contribute in health education by promoting healthy weight in the age group of 7 to 10 years. PMID:29791665

Can the Fatigue Severity Scale 7-item version be used across different patient populations as a generic fatigue measure - a comparative study using a Rasch model approach

PubMed Central

2014-01-01

Background Fatigue is a disabling symptom associated with reduced quality of life in various populations living with chronic illnesses. The transfer of knowledge about fatigue from one group to another is crucial in both research and healthcare. Outcomes should be validly and reliably comparable between groups and should not be unduly influenced by diagnostic variations. The present study evaluates whether the Fatigue Severity Scale 7-item version (FSS-7) demonstrates similar item hierarchy across people with multiple sclerosis, stroke or HIV/AIDS to ensure valid comparisons between groups, and provide further evidence of internal scale validity. Methods A secondary comparative analysis was performed using data from three different studies of three different chronic illnesses: multiple sclerosis, stroke and HIV/AIDS. Each of these studies had previously concluded that the FSS-7 has better psychometric properties than the original FSS for measuring fatigue interference. Data from 224 people with multiple sclerosis, 104 people with stroke and 316 people with HIV/AIDS were examined. Item response theory and a Rasch model were chosen to analyze the similarity of the FSS-7 item hierarchy across the three diagnostic groups Results Cross-sample differences were found for items #3, #5, #6 and #9 for two of the three samples, which raise questions about item validity across groups. However, disease-specific and disease-generic Rasch measures were similar across samples, indicating that individual fatigue interference measures in these three chronic illnesses might still be reliably comparable using the FSS-7. Conclusions Some items performed differently between the three samples but did not bias person measures, thereby indicating that fatigue interference in these illnesses might still be reliably compared using FSS-7 scores. However, caution is warranted when comparing fatigue raw sum scores directly across diagnostic groups using the FSS-7. Further studies of the scale are needed in other types of chronic illnesses. PMID:24559076

A Study on the Validity of a Computer-Based Game to Assess Cognitive Processes, Reward Mechanisms, and Time Perception in Children Aged 4-8 Years

PubMed Central

Hurks, Petra PM; Aldenkamp, Albert P; van der Spek, Erik D; Rauterberg, GWM; Vles, Johan SH; Hendriksen, Jos GM

2016-01-01

Background A computer-based game, named Timo’s Adventure, was developed to assess specific cognitive functions (eg, attention, planning, and working memory), time perception, and reward mechanisms in young school-aged children. The game consists of 6 mini-games embedded in a story line and includes fantasy elements to enhance motivation. Objective The aim of this study was to investigate the validity of Timo’s Adventure in normally developing children and in children with attention-deficit/hyperactivity disorder (ADHD). Methods A total of 96 normally developing children aged 4-8 years and 40 children with ADHD were assessed using the game. Clinical validity was investigated by examining the effects of age on performances within the normally developing children, as well as performance differences between the healthy controls and the ADHD group. Results Our analyses in the normally developing children showed developmental effects; that is, older children made fewer inhibition mistakes (r=−.33, P=.001), had faster (and therefore better) reaction times (r=−.49, P<.001), and were able to produce time intervals more accurately than younger children (ρ=.35, P<.001). Discriminant analysis showed that Timo’s Adventure was accurate in most classifications whether a child belonged to the ADHD group or the normally developing group: 78% (76/97) of the children were correctly classified as having ADHD or as being in the normally developing group. The classification results showed that 72% (41/57) children in the control group were correctly classified, and 88% (35/40) of the children in the ADHD group were correctly classified as having ADHD. Sensitivity (0.89) and specificity (0.69) of Timo’s Adventure were satisfying. Conclusions Computer-based games seem to be a valid tool to assess specific strengths and weaknesses in young children with ADHD. PMID:27658428

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

Automated Gait Analysis Through Hues and Areas (AGATHA): a method to characterize the spatiotemporal pattern of rat gait

PubMed Central

Kloefkorn, Heidi E.; Pettengill, Travis R.; Turner, Sara M. F.; Streeter, Kristi A.; Gonzalez-Rothi, Elisa J.; Fuller, David D.; Allen, Kyle D.

2016-01-01

While rodent gait analysis can quantify the behavioral consequences of disease, significant methodological differences exist between analysis platforms and little validation has been performed to understand or mitigate these sources of variance. By providing the algorithms used to quantify gait, open-source gait analysis software can be validated and used to explore methodological differences. Our group is introducing, for the first time, a fully-automated, open-source method for the characterization of rodent spatiotemporal gait patterns, termed Automated Gait Analysis Through Hues and Areas (AGATHA). This study describes how AGATHA identifies gait events, validates AGATHA relative to manual digitization methods, and utilizes AGATHA to detect gait compensations in orthopaedic and spinal cord injury models. To validate AGATHA against manual digitization, results from videos of rodent gait, recorded at 1000 frames per second (fps), were compared. To assess one common source of variance (the effects of video frame rate), these 1000 fps videos were re-sampled to mimic several lower fps and compared again. While spatial variables were indistinguishable between AGATHA and manual digitization, low video frame rates resulted in temporal errors for both methods. At frame rates over 125 fps, AGATHA achieved a comparable accuracy and precision to manual digitization for all gait variables. Moreover, AGATHA detected unique gait changes in each injury model. These data demonstrate AGATHA is an accurate and precise platform for the analysis of rodent spatiotemporal gait patterns. PMID:27554674

Automated Gait Analysis Through Hues and Areas (AGATHA): A Method to Characterize the Spatiotemporal Pattern of Rat Gait.

PubMed

Kloefkorn, Heidi E; Pettengill, Travis R; Turner, Sara M F; Streeter, Kristi A; Gonzalez-Rothi, Elisa J; Fuller, David D; Allen, Kyle D

2017-03-01

While rodent gait analysis can quantify the behavioral consequences of disease, significant methodological differences exist between analysis platforms and little validation has been performed to understand or mitigate these sources of variance. By providing the algorithms used to quantify gait, open-source gait analysis software can be validated and used to explore methodological differences. Our group is introducing, for the first time, a fully-automated, open-source method for the characterization of rodent spatiotemporal gait patterns, termed Automated Gait Analysis Through Hues and Areas (AGATHA). This study describes how AGATHA identifies gait events, validates AGATHA relative to manual digitization methods, and utilizes AGATHA to detect gait compensations in orthopaedic and spinal cord injury models. To validate AGATHA against manual digitization, results from videos of rodent gait, recorded at 1000 frames per second (fps), were compared. To assess one common source of variance (the effects of video frame rate), these 1000 fps videos were re-sampled to mimic several lower fps and compared again. While spatial variables were indistinguishable between AGATHA and manual digitization, low video frame rates resulted in temporal errors for both methods. At frame rates over 125 fps, AGATHA achieved a comparable accuracy and precision to manual digitization for all gait variables. Moreover, AGATHA detected unique gait changes in each injury model. These data demonstrate AGATHA is an accurate and precise platform for the analysis of rodent spatiotemporal gait patterns.

Health Auctions: a Valuation Experiment (HAVE) study protocol.

PubMed

Kularatna, Sanjeewa; Petrie, Dennis; Scuffham, Paul A; Byrnes, Joshua

2016-04-07

Quality-adjusted life years are derived using health state utility weights which adjust for the relative value of living in each health state compared with living in perfect health. Various techniques are used to estimate health state utility weights including time-trade-off and standard gamble. These methods have exhibited limitations in terms of complexity, validity and reliability. A new composite approach using experimental auctions to value health states is introduced in this protocol. A pilot study will test the feasibility and validity of using experimental auctions to value health states in monetary terms. A convenient sample (n=150) from a population of university staff and students will be invited to participate in 30 auction sets with a group of 5 people in each set. The 9 health states auctioned in each auction set will come from the commonly used EQ-5D-3L instrument. At most participants purchase 2 health states, and the participant who acquires the 2 'best' health states on average will keep the amount of money they do not spend in acquiring those health states. The value (highest bid and average bid) of each of the 24 health states will be compared across auctions to test for reliability across auction groups and across auctioneers. A test retest will be conducted for 10% of the sample to assess reliability of responses for health states auctions. Feasibility of conducting experimental auctions to value health states will also be examined. The validity of estimated health states values will be compared with published utility estimates from other methods. This pilot study will explore the feasibility, reliability and validity in using experimental auction for valuing health states. Ethical clearance was obtained from Griffith University ethics committee. The results will be disseminated in peer-reviewed journals and major international conferences. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Validation and Reliability of a Smartphone Application for the International Prostate Symptom Score Questionnaire: A Randomized Repeated Measures Crossover Study

PubMed Central

Shim, Sung Ryul; Sun, Hwa Yeon; Ko, Young Myoung; Chun, Dong-Il; Yang, Won Jae

2014-01-01

Background Smartphone-based assessment may be a useful diagnostic and monitoring tool for patients. There have been many attempts to create a smartphone diagnostic tool for clinical use in various medical fields but few have demonstrated scientific validity. Objective The purpose of this study was to develop a smartphone application of the International Prostate Symptom Score (IPSS) and to demonstrate its validity and reliability. Methods From June 2012 to May 2013, a total of 1581 male participants (≥40 years old), with or without lower urinary tract symptoms (LUTS), visited our urology clinic via the health improvement center at Soonchunhyang University Hospital (Republic of Korea) and were enrolled in this study. A randomized repeated measures crossover design was employed using a smartphone application of the IPSS and the conventional paper form of the IPSS. Paired t test under a hypothesis of non-inferior trial was conducted. For the reliability test, the intraclass correlation coefficient (ICC) was measured. Results The total score of the IPSS (P=.289) and each item of the IPSS (P=.157-1.000) showed no differences between the paper version and the smartphone version of the IPSS. The mild, moderate, and severe LUTS groups showed no differences between the two versions of the IPSS. A significant correlation was noted in the total group (ICC=.935, P<.001). The mild, moderate, and severe LUTS groups also showed significant correlations (ICC=.616, .549, and .548 respectively, all P<.001).There was selection bias in this study, as only participants who had smartphones could participate. Conclusions The validity and reliability of the smartphone application version were comparable to the conventional paper version of the IPSS. The smartphone application of the IPSS could be an effective method for measuring lower urinary tract symptoms. PMID:24513507

Development and validation of Australian aphasia rehabilitation best practice statements using the RAND/UCLA appropriateness method.

PubMed

Power, Emma; Thomas, Emma; Worrall, Linda; Rose, Miranda; Togher, Leanne; Nickels, Lyndsey; Hersh, Deborah; Godecke, Erin; O'Halloran, Robyn; Lamont, Sue; O'Connor, Claire; Clarke, Kim

2015-07-02

To develop and validate a national set of best practice statements for use in post-stroke aphasia rehabilitation. Literature review and statement validation using the RAND/UCLA Appropriateness Method (RAM). A national Community of Practice of over 250 speech pathologists, researchers, consumers and policymakers developed a framework consisting of eight areas of care in aphasia rehabilitation. This framework provided the structure for the development of a care pathway containing aphasia rehabilitation best practice statements. Nine speech pathologists with expertise in aphasia rehabilitation participated in two rounds of RAND/UCLA appropriateness ratings of the statements. Panellists consisted of researchers, service managers, clinicians and policymakers. Statements that achieved a high level of agreement and an overall median score of 7-9 on a nine-point scale were rated as 'appropriate'. 74 best practice statements were extracted from the literature and rated across eight areas of care (eg, receiving the right referrals, providing intervention). At the end of Round 1, 71 of the 74 statements were rated as appropriate, no statements were rated as inappropriate, and three statements were rated as uncertain. All 74 statements were then rated again in the face-to-face second round. 16 statements were added through splitting existing items or adding new statements. Seven statements were deleted leaving 83 statements. Agreement was reached for 82 of the final 83 statements. This national set of 82 best practice statements across eight care areas for the rehabilitation of people with aphasia is the first to be validated by an expert panel. These statements form a crucial component of the Australian Aphasia Rehabilitation Pathway (AARP) (http://www.aphasiapathway.com.au) and provide the basis for more consistent implementation of evidence-based practice in stroke rehabilitation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Testing the feasibility of eliciting preferences for health states from adolescents using direct methods.

PubMed

Crump, R Trafford; Lau, Ryan; Cox, Elizabeth; Currie, Gillian; Panepinto, Julie

2018-06-22

Measuring adolescents' preferences for health states can play an important role in evaluating the delivery of pediatric healthcare. However, formal evaluation of the common direct preference elicitation methods for health states has not been done with adolescents. Therefore, the purpose of this study is to test how these methods perform in terms of their feasibility, reliability, and validity for measuring health state preferences in adolescents. This study used a web-based survey of adolescents, 18 years of age or younger, living in the United States. The survey included four health states, each comprised of six attributes. Preferences for these health states were elicited using the visual analogue scale, time trade-off, and standard gamble. The feasibility, test-retest reliability, and construct validity of each of these preference elicitation methods were tested and compared. A total of 144 participants were included in this study. Using a web-based survey format to elicit preferences for health states from adolescents was feasible. A majority of participants completed all three elicitation methods, ranked those methods as being easy, with very few requiring assistance from someone else. However, all three elicitation methods demonstrated weak test-retest reliability, with Kendall's tau-a values ranging from 0.204 to 0.402. Similarly, all three methods demonstrated poor construct validity, with 9-50% of all rankings aligning with our expectations. There were no significant differences across age groups. Using a web-based survey format to elicit preferences for health states from adolescents is feasible. However, the reliability and construct validity of the methods used to elicit these preferences when using this survey format are poor. Further research into the effects of a web-based survey approach to eliciting preferences for health states from adolescents is needed before health services researchers or pediatric clinicians widely employ these methods.

Validation of the M. D. Anderson Symptom Inventory multiple myeloma module

PubMed Central

2013-01-01

Background The symptom burden associated with multiple myeloma (MM) is often severe. Presently, no instrument comprehensively assesses disease-related and treatment-related symptoms in patients with MM. We sought to validate a module of the M. D. Anderson Symptom Inventory (MDASI) developed specifically for patients with MM (MDASI-MM). Methods The MDASI-MM was developed with clinician input, cognitive debriefing, and literature review, and administered to 132 patients undergoing induction chemotherapy or stem cell transplantation. We demonstrated the MDASI-MM’s reliability (Cronbach α values); criterion validity (item and subscale correlations between the MDASI-MM and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-C30) and the EORTC MM module (QLQ-MY20)), and construct validity (differences between groups by performance status). Ratings from transplant patients were examined to demonstrate the MDASI-MM’s sensitivity in detecting the acute worsening of symptoms post-transplantation. Results The MDASI-MM demonstrated excellent correlations with subscales of the 2 EORTC instruments, strong ability to distinguish clinically different patient groups, high sensitivity in detecting change in patients’ performance status, and high reliability. Cognitive debriefing confirmed that the MDASI-MM encompasses the breadth of symptoms relevant to patients with MM. Conclusion The MDASI-MM is a valid, reliable, comprehensive-yet-concise tool that is recommended as a uniform symptom assessment instrument for patients with MM. PMID:23384030

Validating a Prognostic Scoring System for Postmastectomy Locoregional Recurrence in Breast Cancer

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cheng, Skye Hung-Chun, E-mail: skye@kfsyscc.org; Clinical Research Office, Koo Foundation Sun Yat-Sen Cancer Center, Taipei, Taiwan; Department of Radiation Oncology, Duke University Medical Center, Durham, North Carolina

2013-03-15

Purpose: This study is designed to validate a previously developed locoregional recurrence risk (LRR) scoring system and further define which groups of patients with breast cancer would benefit from postmastectomy radiation therapy (PMRT). Methods and Materials: An LRR risk scoring system was developed previously at our institution using breast cancer patients initially treated with modified radical mastectomy between 1990 and 2001. The LRR score comprised 4 factors: patient age, lymphovascular invasion, estrogen receptor negativity, and number of involved lymph nodes. We sought to validate the original study by examining a new dataset of 1545 patients treated between 2002 and 2007. Results:more » The 1545 patients were scored according to the previously developed criteria: 920 (59.6%) were low risk (score 0-1), 493 (31.9%) intermediate risk (score 2-3), and 132 (8.5%) were high risk (score ≥4). The 5-year locoregional control rates with and without PMRT in low-risk, intermediate-risk, and high-risk groups were 98% versus 97% (P=.41), 97% versus 91% (P=.0005), and 89% versus 50% (P=.0002) respectively. Conclusions: This analysis of an additional 1545 patients treated between 2002 and 2007 validates our previously reported LRR scoring system and suggests appropriate patients for whom PMRT will be beneficial. Independent validation of this scoring system by other institutions is recommended.« less

Multiattribute health utility scoring for the computerized adaptive measure CAT-5D-QOL was developed and validated.

PubMed

Kopec, Jacek A; Sayre, Eric C; Rogers, Pamela; Davis, Aileen M; Badley, Elizabeth M; Anis, Aslam H; Abrahamowicz, Michal; Russell, Lara; Rahman, Md Mushfiqur; Esdaile, John M

2015-10-01

The CAT-5D-QOL is a previously reported item response theory (IRT)-based computerized adaptive tool to measure five domains (attributes) of health-related quality of life. The objective of this study was to develop and validate a multiattribute health utility (MAHU) scoring method for this instrument. The MAHU scoring system was developed in two stages. In phase I, we obtained standard gamble (SG) utilities for 75 hypothetical health states in which only one domain varied (15 states per domain). In phase II, we obtained SG utilities for 256 multiattribute states. We fit a multiplicative regression model to predict SG utilities from the five IRT domain scores. The prediction model was constrained using data from phase I. We validated MAHU scores by comparing them with the Health Utilities Index Mark 3 (HUI3) and directly measured utilities and by assessing between-group discrimination. MAHU scores have a theoretical range from -0.842 to 1. In the validation study, the scores were, on average, higher than HUI3 utilities and lower than directly measured SG utilities. MAHU scores correlated strongly with the HUI3 (Spearman ρ = 0.78) and discriminated well between groups expected to differ in health status. Results reported here provide initial evidence supporting the validity of the MAHU scoring system for the CAT-5D-QOL. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and validation of a food frequency questionnaire for dietary intake assessment among multi-ethnic primary school-aged children

PubMed Central

Fatihah, Fadil; Ng, Boon Koon; Hazwanie, Husin; Norimah, A Karim; Shanita, Safii Nik; Ruzita, Abd Talib; Poh, Bee Koon

2015-01-01

INTRODUCTION This study aimed to develop and validate a food frequency questionnaire (FFQ) to assess habitual diets of multi-ethnic Malaysian children aged 7–12 years. METHODS A total of 236 primary school children participated in the development of the FFQ and 209 subjects participated in the validation study, with a subsample of 30 subjects participating in the reproducibility study. The FFQ, consisting of 94 food items from 12 food groups, was compared with a three-day dietary record (3DR) as the reference method. The reproducibility of the FFQ was assessed through repeat administration (FFQ2), seven days after the first administration (FFQ1). RESULTS The results of the validation study demonstrated good acceptance of the FFQ. Mean intake of macronutrients in FFQ1 and 3DR correlated well, although the FFQ intake data tended to be higher. Cross-classification of nutrient intake between the two methods showed that < 7% of subjects were grossly misclassified. Moderate correlations noted between the two methods ranged from r = 0.310 (p < 0.001) for fat to r = 0.497 (p < 0.001) for energy. The reproducibility of the FFQ, as assessed by Cronbach’s alpha, ranged from 0.61 (protein) to 0.70 (energy, carbohydrates and fat). Spearman’s correlations between FFQ1 and FFQ2 ranged from rho = 0.333 (p = 0.072) for protein to rho = 0.479 (p < 0.01) for fat. CONCLUSION These findings indicate that the FFQ is valid and reliable for measuring the average intake of energy and macronutrients in a population of multi-ethnic children aged 7–12 years in Malaysia. PMID:26702165

Further interest of miniexon multiplex PCR for a rapid typing of Trypanosoma cruzi DTU groups.

PubMed

Aliaga, Claudia; Brenière, Simone Frédérique; Barnabé, Christian

2011-07-01

In order to validate a rapid typing of Trypanosoma cruzi DTUs, the miniexon multiplex PCR was tested for the first time, on a large and diversified sample of 70 strains belonging to all current DTUs (TcI to TcVI). Three DTU groups have been distinguished by specific PCR molecular weight, TcI (200bp), TcII, V, VI (250bp) and TcIII and IV (150bp) with no incorrect grouping. These groups are epidemiologically and genetically relevant; moreover the method is easy and cheap and allows direct identification of parasites from triatomine faeces. Copyright © 2010 Elsevier B.V. All rights reserved.

An Icelandic Version of McMasters Family Assessment Device (FAD)

ERIC Educational Resources Information Center

Juliusdottir, Gudlaug M.; Olafsdottir, Hrefna

2015-01-01

Purpose: An analysis of the psychometric properties of an Icelandic version of McMasters Family Assessment Device (FAD) was conducted in this study. Method: Two groups, clinical and nonclinical, comprising of 529 parents answered the FAD. The study examined the internal reliability and discriminant validity of the instrument in addition to…

Ethnic-Racial Attitudes, Images, and Behavior by Verbal Associations. Technical Report.

ERIC Educational Resources Information Center

Szalay, Lorand B.; And Others

The investigations focused on two main subject areas. The first series of experiments explored the validity of verbal association based inferences as an attitude measure and predictor of behavior. When compared with paper-and-pencil methods, the association based attitude index (EDI) showed high positive correlation as a group measure and medium…

A Controlled Evaluation of the Distress Criterion for Binge Eating Disorder

ERIC Educational Resources Information Center

Grilo, Carlos M.; White, Marney A.

2011-01-01

Objective: Research has examined various aspects of the validity of the research criteria for binge eating disorder (BED) but has yet to evaluate the utility of Criterion C, "marked distress about binge eating." This study examined the significance of the marked distress criterion for BED using 2 complementary comparison groups. Method:…

Cognitive Anxiety: A Method of Content Analysis for Verbal Samples

ERIC Educational Resources Information Center

Viney, Linda L.; Westbrook, Mary

1976-01-01

Five groups--second year students, psychiatric inpatients, incoming students, mothers, and relocated women were tested with verbal samples to examine the effects of cognitive anxiety as a construct implying a reaction to being unable to anticipate and integrate experiences meaningfully. The measure used was found to be valid. (Author/DEP)

Project "School:" A Handbook of a Validated Developmental Dropout Prevention Program's Methods and Procedures.

ERIC Educational Resources Information Center

Hooban, Louis; Pugsley, Robert

Project SCHOOL (School Concerned with Helping Others' Objectives and Learning) is a program developed to prevent dropping out through group counseling, parent counseling, and positive reinforcement. Project SCHOOL operates as a dropout prevention program in grades 1-12. Teachers and counselors, using a locally developed check list and other…

Development of the Gross Motor Function Classification System (1997)

ERIC Educational Resources Information Center

Morris, Christopher

2008-01-01

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

Construction and Validation of an Instrument to Measure Environmental Orientations in a Diverse Group of Children

ERIC Educational Resources Information Center

Larson, Lincoln R.; Green, Gary T.; Castleberry, Steven B.

2011-01-01

An understanding of children's environmental orientations is of critical importance as opportunities for authentic contact with nature diminish. Current instruments for measuring children's environmental attitudes are complex, and few have been tested across diverse audiences. This study employed a mixed-methods approach that included pilot tests,…

Diffuse-reflectance fourier-transform mid-infrared spectroscopy as a method of characterizing changes in soil organic matter

USDA-ARS?s Scientific Manuscript database

Diffuse-Reflectance Fourier-Transform Mid-Infrared Spectroscopy (MidIR) can identify the presence of important organic functional groups in soil organic matter (SOM). Soils contain myriad organic and inorganic components that absorb in the MidIR so spectral interpretation needs to be validated in or...

No More Excuses: New Research on Assessing Students with Disabilities

ERIC Educational Resources Information Center

Sireci, Stephen G.

2009-01-01

The articles in this special issue of the "Journal of Applied Testing Technology" represent significant steps forward in the area of evaluating the validity of methods for assessing the educational achievement of students with disabilities. The studies address some of the most difficult student groups to assess--students with learning…

Evaluation of Executive Functioning in People with Intellectual Disabilities

ERIC Educational Resources Information Center

Willner, P.; Bailey, R.; Parry, R.; Dymond, S.

2010-01-01

Background: Executive functioning (EF) is an important concept in cognitive psychology that has rarely been studied in people with intellectual disabilities (IDs). The aim of this study was to examine the validity of two test batteries and the structure of EF in this client group. Methods: We administered the children's version of the Behavioural…

A Scoping Review of Treatments for Older Adults with Substance Use Problems

ERIC Educational Resources Information Center

Mowbray, Orion; Quinn, Adam

2016-01-01

Objectives: To identify effective treatment services for older, substance-using adults, an examination of the evidence associated with interventions for this group is presented. Methods: Using explicit, validated criteria to identify effective interventions, 22 publications were included in a review and were subject to a critical appraisal of…

Natural language processing in pathology: a scoping review.

PubMed

Burger, Gerard; Abu-Hanna, Ameen; de Keizer, Nicolette; Cornet, Ronald

2016-07-22

Encoded pathology data are key for medical registries and analyses, but pathology information is often expressed as free text. We reviewed and assessed the use of NLP (natural language processing) for encoding pathology documents. Papers addressing NLP in pathology were retrieved from PubMed, Association for Computing Machinery (ACM) Digital Library and Association for Computational Linguistics (ACL) Anthology. We reviewed and summarised the study objectives; NLP methods used and their validation; software implementations; the performance on the dataset used and any reported use in practice. The main objectives of the 38 included papers were encoding and extraction of clinically relevant information from pathology reports. Common approaches were word/phrase matching, probabilistic machine learning and rule-based systems. Five papers (13%) compared different methods on the same dataset. Four papers did not specify the method(s) used. 18 of the 26 studies that reported F-measure, recall or precision reported values of over 0.9. Proprietary software was the most frequently mentioned category (14 studies); General Architecture for Text Engineering (GATE) was the most applied architecture overall. Practical system use was reported in four papers. Most papers used expert annotation validation. Different methods are used in NLP research in pathology, and good performances, that is, high precision and recall, high retrieval/removal rates, are reported for all of these. Lack of validation and of shared datasets precludes performance comparison. More comparative analysis and validation are needed to provide better insight into the performance and merits of these methods. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Prospective Validation of Objective Prognostic Score for Advanced Cancer Inpatients in South Korea: A Multicenter Study.

PubMed

Yoon, Seok Joon; Suh, Sang-Yeon; Lee, Yong Joo; Park, Jeanno; Hwang, Sunwook; Lee, Sanghee Shiny; Ahn, Hong Yup; Koh, Su-Jin; Park, Keon Uk

2017-01-01

Objective Prognostic Score (OPS) was developed as an easy and simple prognosticating tool in South Korea. It has been validated retrospectively in a single center in South Korea. We aimed to validate the OPS prospectively for advanced cancer inpatients in South Korea using a multicenter study. This was a prospective cohort study. We enrolled 243 advanced cancer patients admitted in five palliative care units in South Korea from May 2013 till March 2015. Seven members of the Korean Palliative Medicine Research Network who are experts of palliative care led the study. Clinical variables (dyspnea/anorexia/performance status) and laboratory variables (total leukocyte counts/serum total bilirubin/serum creatinine/lactate dehydrogenase) were collected at the enrollment. Survival time was calculated as days from enrollment to death during admission. A total of 217 patients were included in the final analysis (feasibility: 89.3%). Survival time of the higher OPS group (OPS ≥3) and the lower OPS group (OPS <3) was 10.0 (95% confidence interval (CI) 7.72-12.28) days and 32.0 (95% CI 25.44-38.56) days, respectively. There were significant differences between the 2 groups (p < 0.001). Overall accuracy of OPS ≥3 for predicting survival less than three weeks was 71.0%. OPS was successfully validated using a prospective multicenter study in South Korea. It is a useful method to predict three-week survival of Korean inpatients with advanced cancer.

Sherlock Holmes and child psychopathology assessment approaches: the case of the false-positive.

PubMed

Jensen, P S; Watanabe, H

1999-02-01

To explore the relative value of various methods of assessing childhood psychopathology, the authors compared 4 groups of children: those who met criteria for one or more DSM diagnoses and scored high on parent symptom checklists, those who met psychopathology criteria on either one of these two assessment approaches alone, and those who met no psychopathology assessment criterion. Parents of 201 children completed the Child Behavior Checklist (CBCL), after which children and parents were administered the Diagnostic Interview Schedule for Children (version 2.1). Children and parents also completed other survey measures and symptom report inventories. The 4 groups of children were compared against "external validators" to examine the merits of "false-positive" and "false-negative" cases. True-positive cases (those that met DSM criteria and scored high on the CBCL) differed significantly from the true-negative cases on most external validators. "False-positive" and "false-negative" cases had intermediate levels of most risk factors and external validators. "False-positive" cases were not normal per se because they scored significantly above the true-negative group on a number of risk factors and external validators. A similar but less marked pattern was noted for "false-negatives." Findings call into question whether cases with high symptom checklist scores despite no formal diagnoses should be considered "false-positive." Pending the availability of robust markers for mental illness, researchers and clinicians must resist the tendency to reify diagnostic categories or to engage in arcane debates about the superiority of one assessment approach over another.

A new age-based formula for estimating weight of Korean children.

PubMed

Park, Jungho; Kwak, Young Ho; Kim, Do Kyun; Jung, Jae Yun; Lee, Jin Hee; Jang, Hye Young; Kim, Hahn Bom; Hong, Ki Jeong

2012-09-01

The objective of this study was to develop and validate a new age-based formula for estimating body weights of Korean children. We obtained body weight and age data from a survey conducted in 2005 by the Korean Pediatric Society that was performed to establish normative values for Korean children. Children aged 0-14 were enrolled, and they were divided into three groups according to age: infants (<12 months), preschool-aged (1-4 years) and school-aged children (5-14 years). Seventy-five percent of all subjects were randomly selected to make a derivation set. Regression analysis was performed in order to produce equations that predict the weight from the age for each group. The linear equations derived from this analysis were simplified to create a weight estimating formula for Korean children. This formula was then validated using the remaining 25% of the study subjects with mean percentage error and absolute error. To determine whether a new formula accurately predicts actual weights of Korean children, we also compared this new formula to other weight estimation methods (APLS, Shann formula, Leffler formula, Nelson formula and Broselow tape). A total of 124,095 children's data were enrolled, and 19,854 (16.0%), 40,612 (32.7%) and 63,629 (51.3%) were classified as infants, preschool-aged and school-aged groups, respectively. Three equations, (age in months+9)/2, 2×(age in years)+9 and 4×(age in years)-1 were derived for infants, pre-school and school-aged groups, respectively. When these equations were applied to the validation set, the actual average weight of those children was 0.4kg heavier than our estimated weight (95% CI=0.37-0.43, p<0.001). The mean percentage error of our model (+0.9%) was lower than APLS (-11.5%), Shann formula (-8.6%), Leffler formula (-1.7%), Nelson formula (-10.0%), Best Guess formula (+5.0%) and Broselow tape (-4.8%) for all age groups. We developed and validated a simple formula to estimate body weight from the age of Korean children and found that this new formula was more accurate than other weight estimating methods. However, care should be taken when applying this formula to older children because of a large standard deviation of estimated weight. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Teaching acute care nurses cognitive assessment using LOCFAS: what's the best method?

PubMed

Flannery, J; Land, K

2001-02-01

The Levels of Cognitive Functioning Assessment Scale (LOCFAS) is a behavioral checklist used by nurses in the acute care setting to assess the level of cognitive functioning in severely brain-injured patients in the early post-trauma period. Previous research studies have supported the reliability and validity of LOCFAS. For LOCFAS to become a more firmly established method of cognitive assessment, nurses must become familiar with and proficient in the use of this instrument. The purpose of this study was to find the most effective method of instruction by comparing three methods: a self-directed manual, a teaching video, and a classroom presentation. Videotaped vignettes of actual brain-injured patients were presented at the end of each training session, and participants were required to categorize these videotaped patients by using LOCFAS. High levels of reliability were observed for both the self-directed manual group and the teaching video group, but an overall lower level of reliability was observed for the classroom presentation group. Examination of the accuracy of overall LOCFAS ratings revealed a significant difference for instructional groups; the accuracy of the classroom presentation group was significantly lower than that of either the self-directed manual group or the teaching video group. The three instructional groups also differed on the average accuracy of ratings of the individual behaviors; the accuracy of the classroom presentation group was significantly lower than that of the teaching video group, whereas the self-directed manual group fell in between. Nurses also rated the instructional methods across a number of evaluative dimensions on a 5-point Likert-type scale. Evaluative statements ranged from average to good, with no significant differences among instructional methods.

LandScape: a simple method to aggregate p-values and other stochastic variables without a priori grouping.

PubMed

Wiuf, Carsten; Schaumburg-Müller Pallesen, Jonatan; Foldager, Leslie; Grove, Jakob

2016-08-01

In many areas of science it is custom to perform many, potentially millions, of tests simultaneously. To gain statistical power it is common to group tests based on a priori criteria such as predefined regions or by sliding windows. However, it is not straightforward to choose grouping criteria and the results might depend on the chosen criteria. Methods that summarize, or aggregate, test statistics or p-values, without relying on a priori criteria, are therefore desirable. We present a simple method to aggregate a sequence of stochastic variables, such as test statistics or p-values, into fewer variables without assuming a priori defined groups. We provide different ways to evaluate the significance of the aggregated variables based on theoretical considerations and resampling techniques, and show that under certain assumptions the FWER is controlled in the strong sense. Validity of the method was demonstrated using simulations and real data analyses. Our method may be a useful supplement to standard procedures relying on evaluation of test statistics individually. Moreover, by being agnostic and not relying on predefined selected regions, it might be a practical alternative to conventionally used methods of aggregation of p-values over regions. The method is implemented in Python and freely available online (through GitHub, see the Supplementary information).

Application of the Optimized Summed Scored Attributes Method to Sex Estimation in Asian Crania.

PubMed

Tallman, Sean D; Go, Matthew C

2018-05-01

The optimized summed scored attributes (OSSA) method was recently introduced and validated for nonmetric ancestry estimation between American Black and White individuals. The method proceeds by scoring, dichotomizing, and subsequently summing ordinal morphoscopic trait scores to maximize between-group differences. This study tests the applicability of the OSSA method for sex estimation using five cranial traits given the methodological similarities between classifying sex and ancestry. A large sample of documented crania from Japan and Thailand (n = 744 males, 320 females) are used to develop a heuristically selected OSSA sectioning point of ≤1 separating males and females. This sectioning point is validated using a holdout sample of Japanese, Thai, and Filipino (n = 178 males, 82 females) individuals. The results indicate a general correct classification rate of 82% using all five traits, and 81% when excluding the mental eminence. Designating an OSSA score of 2 as indeterminate is recommended. © 2017 American Academy of Forensic Sciences.

Cluster analysis of molecular simulation trajectories for systems where both conformation and orientation of the sampled states are important.

PubMed

Abramyan, Tigran M; Snyder, James A; Thyparambil, Aby A; Stuart, Steven J; Latour, Robert A

2016-08-05

Clustering methods have been widely used to group together similar conformational states from molecular simulations of biomolecules in solution. For applications such as the interaction of a protein with a surface, the orientation of the protein relative to the surface is also an important clustering parameter because of its potential effect on adsorbed-state bioactivity. This study presents cluster analysis methods that are specifically designed for systems where both molecular orientation and conformation are important, and the methods are demonstrated using test cases of adsorbed proteins for validation. Additionally, because cluster analysis can be a very subjective process, an objective procedure for identifying both the optimal number of clusters and the best clustering algorithm to be applied to analyze a given dataset is presented. The method is demonstrated for several agglomerative hierarchical clustering algorithms used in conjunction with three cluster validation techniques. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Sarma-based key-group method for rock slope reliability analyses

NASA Astrophysics Data System (ADS)

Yarahmadi Bafghi, A. R.; Verdel, T.

2005-08-01

The methods used in conducting static stability analyses have remained pertinent to this day for reasons of both simplicity and speed of execution. The most well-known of these methods for purposes of stability analysis of fractured rock masses is the key-block method (KBM).This paper proposes an extension to the KBM, called the key-group method (KGM), which combines not only individual key-blocks but also groups of collapsable blocks into an iterative and progressive analysis of the stability of discontinuous rock slopes. To take intra-group forces into account, the Sarma method has been implemented within the KGM in order to generate a Sarma-based KGM, abbreviated SKGM. We will discuss herein the hypothesis behind this new method, details regarding its implementation, and validation through comparison with results obtained from the distinct element method.Furthermore, as an alternative to deterministic methods, reliability analyses or probabilistic analyses have been proposed to take account of the uncertainty in analytical parameters and models. The FOSM and ASM probabilistic methods could be implemented within the KGM and SKGM framework in order to take account of the uncertainty due to physical and mechanical data (density, cohesion and angle of friction). We will then show how such reliability analyses can be introduced into SKGM to give rise to the probabilistic SKGM (PSKGM) and how it can be used for rock slope reliability analyses. Copyright

Validation of Reverse-Engineered and Additive-Manufactured Microsurgical Instrument Prototype.

PubMed

Singh, Ramandeep; Suri, Ashish; Anand, Sneh; Baby, Britty

2016-12-01

With advancements in imaging techniques, neurosurgical procedures are becoming highly precise and minimally invasive, thus demanding development of new ergonomically aesthetic instruments. Conventionally, neurosurgical instruments are manufactured using subtractive manufacturing methods. Such a process is complex, time-consuming, and impractical for prototype development and validation of new designs. Therefore, an alternative design process has been used utilizing blue light scanning, computer-aided designing, and additive manufacturing direct metal laser sintering (DMLS) for microsurgical instrument prototype development. Deviations of DMLS-fabricated instrument were studied by superimposing scan data of fabricated instrument with the computer-aided designing model. Content and concurrent validity of the fabricated prototypes was done by a group of 15 neurosurgeons by performing sciatic nerve anastomosis in small laboratory animals. Comparative scoring was obtained for the control and study instrument. T test was applied to the individual parameters and P values for force (P < .0001) and surface roughness (P < .01) were found to be statistically significant. These 2 parameters were further analyzed using objective measures. Results depicts that additive manufacturing by DMLS provides an effective method for prototype development. However, direct application of these additive-manufactured instruments in the operating room requires further validation. © The Author(s) 2016.

A systematic review of the quality of homeopathic clinical trials

PubMed Central

Jonas, Wayne B; Anderson, Rachel L; Crawford, Cindy C; Lyons, John S

2001-01-01

Background While a number of reviews of homeopathic clinical trials have been done, all have used methods dependent on allopathic diagnostic classifications foreign to homeopathic practice. In addition, no review has used established and validated quality criteria allowing direct comparison of the allopathic and homeopathic literature. Methods In a systematic review, we compared the quality of clinical-trial research in homeopathy to a sample of research on conventional therapies using a validated and system-neutral approach. All clinical trials on homeopathic treatments with parallel treatment groups published between 1945–1995 in English were selected. All were evaluated with an established set of 33 validity criteria previously validated on a broad range of health interventions across differing medical systems. Criteria covered statistical conclusion, internal, construct and external validity. Reliability of criteria application is greater than 0.95. Results 59 studies met the inclusion criteria. Of these, 79% were from peer-reviewed journals, 29% used a placebo control, 51% used random assignment, and 86% failed to consider potentially confounding variables. The main validity problems were in measurement where 96% did not report the proportion of subjects screened, and 64% did not report attrition rate. 17% of subjects dropped out in studies where this was reported. There was practically no replication of or overlap in the conditions studied and most studies were relatively small and done at a single-site. Compared to research on conventional therapies the overall quality of studies in homeopathy was worse and only slightly improved in more recent years. Conclusions Clinical homeopathic research is clearly in its infancy with most studies using poor sampling and measurement techniques, few subjects, single sites and no replication. Many of these problems are correctable even within a "holistic" paradigm given sufficient research expertise, support and methods. PMID:11801202

Development of the movement domain in the global body examination.

PubMed

Kvåle, Alice; Bunkan, Berit Heir; Opjordsmoen, Stein; Friis, Svein

2012-01-01

The purpose of this study was to develop a new Movement domain, based on 16 items from the Global Physiotherapy Examination-52 (GPE-52) and 18 items from the Comprehensive Body Examination (CBE). Furthermore, we examined how well the new domain and its scales would discriminate between healthy individuals and different groups of patients, compared to the original methods. Two physiotherapists, each using one method, independently examined 132 individuals (34 healthy, 32 with localized pain, 32 with generalized pain, and 34 with psychoses). The number of items was reduced by means of correlational and exploratory factor analysis. Internal consistency was examined with Cronbach's alpha. For examination of discriminative validity, Mann-Whitney U-test and Area under the Curve (AUC) were used. The initial 34 items were reduced to two subscales with 13 items: one for range of movement and balance and one for flexibility. Cronbach's alpha was 0.84 and 0.87 for the two subscales. The new subscales showed very good to excellent discriminating ability between healthy persons and the different patient groups (p < 0.001; AUC 0.82-0.95). Furthermore, patients with localized pain had significantly less movement aberrations than the other patient groups. The new Movement domain had fewer items than the GPE-52 and CBE, without losing discriminative validity.

Cost Minimization Using an Artificial Neural Network Sleep Apnea Prediction Tool for Sleep Studies

PubMed Central

Teferra, Rahel A.; Grant, Brydon J. B.; Mindel, Jesse W.; Siddiqi, Tauseef A.; Iftikhar, Imran H.; Ajaz, Fatima; Aliling, Jose P.; Khan, Meena S.; Hoffmann, Stephen P.

2014-01-01

Rationale: More than a million polysomnograms (PSGs) are performed annually in the United States to diagnose obstructive sleep apnea (OSA). Third-party payers now advocate a home sleep test (HST), rather than an in-laboratory PSG, as the diagnostic study for OSA regardless of clinical probability, but the economic benefit of this approach is not known. Objectives: We determined the diagnostic performance of OSA prediction tools including the newly developed OSUNet, based on an artificial neural network, and performed a cost-minimization analysis when the prediction tools are used to identify patients who should undergo HST. Methods: The OSUNet was trained to predict the presence of OSA in a derivation group of patients who underwent an in-laboratory PSG (n = 383). Validation group 1 consisted of in-laboratory PSG patients (n = 149). The network was trained further in 33 patients who underwent HST and then was validated in a separate group of 100 HST patients (validation group 2). Likelihood ratios (LRs) were compared with two previously published prediction tools. The total costs from the use of the three prediction tools and the third-party approach within a clinical algorithm were compared. Measurements and Main Results: The OSUNet had a higher +LR in all groups compared with the STOP-BANG and the modified neck circumference (MNC) prediction tools. The +LRs for STOP-BANG, MNC, and OSUNet in validation group 1 were 1.1 (1.0–1.2), 1.3 (1.1–1.5), and 2.1 (1.4–3.1); and in validation group 2 they were 1.4 (1.1–1.7), 1.7 (1.3–2.2), and 3.4 (1.8–6.1), respectively. With an OSA prevalence less than 52%, the use of all three clinical prediction tools resulted in cost savings compared with the third-party approach. Conclusions: The routine requirement of an HST to diagnose OSA regardless of clinical probability is more costly compared with the use of OSA clinical prediction tools that identify patients who should undergo this procedure when OSA is expected to be present in less than half of the population. With OSA prevalence less than 40%, the OSUNet offers the greatest savings, which are substantial when the number of sleep studies done annually is considered. PMID:25068704

[Risk factor analysis of the patients with solitary pulmonary nodules and establishment of a prediction model for the probability of malignancy].

PubMed

Wang, X; Xu, Y H; Du, Z Y; Qian, Y J; Xu, Z H; Chen, R; Shi, M H

2018-02-23

Objective: This study aims to analyze the relationship among the clinical features, radiologic characteristics and pathological diagnosis in patients with solitary pulmonary nodules, and establish a prediction model for the probability of malignancy. Methods: Clinical data of 372 patients with solitary pulmonary nodules who underwent surgical resection with definite postoperative pathological diagnosis were retrospectively analyzed. In these cases, we collected clinical and radiologic features including gender, age, smoking history, history of tumor, family history of cancer, the location of lesion, ground-glass opacity, maximum diameter, calcification, vessel convergence sign, vacuole sign, pleural indentation, speculation and lobulation. The cases were divided to modeling group (268 cases) and validation group (104 cases). A new prediction model was established by logistic regression analying the data from modeling group. Then the data of validation group was planned to validate the efficiency of the new model, and was compared with three classical models(Mayo model, VA model and LiYun model). With the calculated probability values for each model from validation group, SPSS 22.0 was used to draw the receiver operating characteristic curve, to assess the predictive value of this new model. Results: 112 benign SPNs and 156 malignant SPNs were included in modeling group. Multivariable logistic regression analysis showed that gender, age, history of tumor, ground -glass opacity, maximum diameter, and speculation were independent predictors of malignancy in patients with SPN( P <0.05). We calculated a prediction model for the probability of malignancy as follow: p =e(x)/(1+ e(x)), x=-4.8029-0.743×gender+ 0.057×age+ 1.306×history of tumor+ 1.305×ground-glass opacity+ 0.051×maximum diameter+ 1.043×speculation. When the data of validation group was added to the four-mathematical prediction model, The area under the curve of our mathematical prediction model was 0.742, which is greater than other models (Mayo 0.696, VA 0.634, LiYun 0.681), while the differences between any two of the four models were not significant ( P >0.05). Conclusions: Age of patient, gender, history of tumor, ground-glass opacity, maximum diameter and speculation are independent predictors of malignancy in patients with solitary pulmonary nodule. This logistic regression prediction mathematic model is not inferior to those classical models in estimating the prognosis of SPNs.

Developing and Using Vignettes to Explore the Relationship Between Risk Management Practice and Recovery-Oriented Care in Mental Health Services.

PubMed

Holley, Jessica; Gillard, Steven

2018-02-01

There is a lack of literature evaluating the development and use of vignettes to explore contested constructs in qualitative health care research where a conventional interview schedule might impose assumptions on the data collected. We describe the development and validation of vignettes in a study exploring mental health worker and service user understandings of risk and recovery in U.K. mental health services. Focus groups with mental health workers and service users explored study questions from experiential perspectives. Themes identified in the groups were combined with existing empirical literature to develop a set of vignettes. Feedback focus groups were conducted to validate and amend the vignettes. Following use in research interviews, results suggested that the vignettes had successfully elicited data on issues of risk and recovery in mental health services. Further research using creative, comparative methods is needed to fully understand how vignettes can best be used in qualitative health care research.

Development of an objective assessment tool for total laparoscopic hysterectomy: A Delphi method among experts and evaluation on a virtual reality simulator

PubMed Central

Knight, Sophie; Aggarwal, Rajesh; Agostini, Aubert; Loundou, Anderson; Berdah, Stéphane

2018-01-01

Introduction Total Laparoscopic hysterectomy (LH) requires an advanced level of operative skills and training. The aim of this study was to develop an objective scale specific for the assessment of technical skills for LH (H-OSATS) and to demonstrate feasibility of use and validity in a virtual reality setting. Material and methods The scale was developed using a hierarchical task analysis and a panel of international experts. A Delphi method obtained consensus among experts on relevant steps that should be included into the H-OSATS scale for assessment of operative performances. Feasibility of use and validity of the scale were evaluated by reviewing video recordings of LH performed on a virtual reality laparoscopic simulator. Three groups of operators of different levels of experience were assessed in a Marseille teaching hospital (10 novices, 8 intermediates and 8 experienced surgeons). Correlations with scores obtained using a recognised generic global rating tool (OSATS) were calculated. Results A total of 76 discrete steps were identified by the hierarchical task analysis. 14 experts completed the two rounds of the Delphi questionnaire. 64 steps reached consensus and were integrated in the scale. During the validation process, median time to rate each video recording was 25 minutes. There was a significant difference between the novice, intermediate and experienced group for total H-OSATS scores (133, 155.9 and 178.25 respectively; p = 0.002). H-OSATS scale demonstrated high inter-rater reliability (intraclass correlation coefficient [ICC] = 0.930; p<0.001) and test retest reliability (ICC = 0.877; p<0.001). High correlations were found between total H-OSATS scores and OSATS scores (rho = 0.928; p<0.001). Conclusion The H-OSATS scale displayed evidence of validity for assessment of technical performances for LH performed on a virtual reality simulator. The implementation of this scale is expected to facilitate deliberate practice. Next steps should focus on evaluating the validity of the scale in the operating room. PMID:29293635

Fatty acid ethyl esters (FAEEs) as markers for alcohol in meconium: method validation and implementation of a screening program for prenatal drug exposure.

PubMed

Hastedt, Martin; Krumbiegel, Franziska; Gapert, René; Tsokos, Michael; Hartwig, Sven

2013-09-01

Alcohol consumption during pregnancy is a widespread problem and can cause severe fetal damage. As the diagnosis of fetal alcohol syndrome is difficult, the implementation of a reliable marker for alcohol consumption during pregnancy into meconium drug screening programs would be invaluable. A previously published gas chromatography mass spectrometry method for the detection of fatty acid ethyl esters (FAEEs) as alcohol markers in meconium was optimized and newly validated for a sample size of 50 mg. This method was applied to 122 cases from a drug-using population. The meconium samples were also tested for common drugs of abuse. In 73 % of the cases, one or more drugs were found. Twenty percent of the samples tested positive for FAEEs at levels indicating significant alcohol exposure. Consequently, alcohol was found to be the third most frequently abused substance within the study group. This re-validated method provides an increase in testing sensitivity, is reliable and easily applicable as part of a drug screening program. It can be used as a non-invasive tool to detect high alcohol consumption in the last trimester of pregnancy. The introduction of FAEEs testing in meconium screening was found to be of particular use in a drug-using population.

Updated Prognostic Model for Predicting Overall Survival in First-Line Chemotherapy for Patients With Metastatic Castration-Resistant Prostate Cancer

PubMed Central

Halabi, Susan; Lin, Chen-Yen; Kelly, W. Kevin; Fizazi, Karim S.; Moul, Judd W.; Kaplan, Ellen B.; Morris, Michael J.; Small, Eric J.

2014-01-01

Purpose Prognostic models for overall survival (OS) for patients with metastatic castration-resistant prostate cancer (mCRPC) are dated and do not reflect significant advances in treatment options available for these patients. This work developed and validated an updated prognostic model to predict OS in patients receiving first-line chemotherapy. Methods Data from a phase III trial of 1,050 patients with mCRPC were used (Cancer and Leukemia Group B CALGB-90401 [Alliance]). The data were randomly split into training and testing sets. A separate phase III trial served as an independent validation set. Adaptive least absolute shrinkage and selection operator selected eight factors prognostic for OS. A predictive score was computed from the regression coefficients and used to classify patients into low- and high-risk groups. The model was assessed for its predictive accuracy using the time-dependent area under the curve (tAUC). Results The model included Eastern Cooperative Oncology Group performance status, disease site, lactate dehydrogenase, opioid analgesic use, albumin, hemoglobin, prostate-specific antigen, and alkaline phosphatase. Median OS values in the high- and low-risk groups, respectively, in the testing set were 17 and 30 months (hazard ratio [HR], 2.2; P < .001); in the validation set they were 14 and 26 months (HR, 2.9; P < .001). The tAUCs were 0.73 (95% CI, 0.70 to 0.73) and 0.76 (95% CI, 0.72 to 0.76) in the testing and validation sets, respectively. Conclusion An updated prognostic model for OS in patients with mCRPC receiving first-line chemotherapy was developed and validated on an external set. This model can be used to predict OS, as well as to better select patients to participate in trials on the basis of their prognosis. PMID:24449231

Internet-administered Health-related Quality of Life Questionnaires Compared With Pen and Paper in an Adolescent Scoliosis Population: A Randomized Crossover Study.

PubMed

Nitikman, Michael; Mulpuri, Kishore; Reilly, Christopher W

2017-03-01

Modern technology puts into question the effectiveness of using pen and paper as a means of collecting information from web-enabled patients. This study aimed to validate and test the reliability of using the Internet as a method of administering health-related quality of life questionnaires in a pediatric spine population. A prospective randomized crossover study was conducted. Patients aged 11 to 18 with idiopathic scoliosis were invited to participate, and informed consent was obtained from a scoliosis outpatient clinic setting. Participants were randomized to one of 4 groups determining the method of questionnaire administration [Scoliosis Research Society 30 (SRS-30) and Pediatric Outcomes Data Collection Instrument (PODCI)]. Both questionnaires were completed at 2 separate timepoints and 2 weeks apart to prevent recall bias. Groups included: Paper/Paper, Paper/Internet, Internet/Paper, and Internet/Internet. Paired-samples t tests were used to determine the test-retest reliability of each group. Analysis was stratified for surveys returned within or outside of the allotted 4-week timeframe following enrollment. Of the 96 participants who completed and returned both sets of questionnaires, 26 were allocated to the Paper/Paper group (27%), 20 to the Paper/Internet group (21%), 26 to the Internet/Paper group (27%), and 24 to the Internet/Internet group (25%). The second iteration of questionnaires was returned on time by 69 of the participants (71.2%). Of the late questionnaires, 18 (67%) were paper forms. Overall, no differences were observed between Internet-administered compared with pen and paper-administered questionnaires (P=0.206). No differences were observed within any group individually for either the SRS-30 or PODCI questionnaire. In addition, no significant differences were observed within groups for surveys returned within or outside of the 4-week timeframe. Eighty-four percent of the participants who completed both paper and Internet versions of the questionnaires reported a preference of the Internet. Internet administration of both the SRS-30 and PODCI questionnaires is a valid and reliable method of acquiring health-related quality of life information in this population LEVEL OF EVIDENCE:: Level II-therapeutic study.

The Validity of the Comparative Interrupted Time Series Design for Evaluating the Effect of School-Level Interventions.

PubMed

Jacob, Robin; Somers, Marie-Andree; Zhu, Pei; Bloom, Howard

2016-06-01

In this article, we examine whether a well-executed comparative interrupted time series (CITS) design can produce valid inferences about the effectiveness of a school-level intervention. This article also explores the trade-off between bias reduction and precision loss across different methods of selecting comparison groups for the CITS design and assesses whether choosing matched comparison schools based only on preintervention test scores is sufficient to produce internally valid impact estimates. We conduct a validation study of the CITS design based on the federal Reading First program as implemented in one state using results from a regression discontinuity design as a causal benchmark. Our results contribute to the growing base of evidence regarding the validity of nonexperimental designs. We demonstrate that the CITS design can, in our example, produce internally valid estimates of program impacts when multiple years of preintervention outcome data (test scores in the present case) are available and when a set of reasonable criteria are used to select comparison organizations (schools in the present case). © The Author(s) 2016.

Relative validity of a semiquantitative food frequency questionnaire designed for schoolchildren in western Greece

PubMed Central

Roumelioti, Maria; Leotsinidis, Michalis

2009-01-01

Background The use of food frequency questionnaires (FFQs) has become increasingly important in epidemiologic studies. During the past few decades, a wide variety of nutritional studies have used the semiquantitative FFQ as a tool for assessing and evaluating dietary intake. One of the main concerns in a dietary analysis is the validity of the collected dietary data. Methods This paper discusses several methodological and statistical issues related to the validation of a semiquantitative FFQ. This questionnaire was used to assess the nutritional habits of schoolchildren in western Greece. For validation purposes, we selected 200 schoolchildren and contacted their respective parents. We evaluated the relative validity of 400 FFQs (200 children's FFQs and 200 parents' FFQs). Results The correlations between the children's and the parents' questionnaire responses showed that the questionnaire we designed was appropriate for fulfilling the purposes of our study and in ranking subjects according to food group intake. Conclusion Our study shows that the semiquantitative FFQ provides a reasonably reliable measure of dietary intake and corroborates the relative validity of our questionnaire. PMID:19196469

Validation of a semi-quantitative food frequency questionnaire to assess food groups and nutrient intake.

PubMed

Macedo-Ojeda, Gabriela; Vizmanos-Lamotte, Barbara; Márquez-Sandoval, Yolanda Fabiola; Rodríguez-Rocha, Norma Patricia; López-Uriarte, Patricia Josefina; Fernández-Ballart, Joan D

2013-11-01

Semi-quantitative Food Frequency Questionnaires (FFQs) analyze average food and nutrient intake over extended periods to associate habitual dietary intake with health problems and chronic diseases. A tool of this nature applicable to both women and men is not presently available in Mexico. To validate a FFQ for adult men and women. The study was conducted on 97 participants, 61% were women. Two FFQs were administered (with a one-year interval) to measure reproducibility. To assess validity, the second FFQ was compared against dietary record (DR) covering nine days. Statistical analyses included Pearson correlations and Intraclass Correlation Coefficients (ICC). The de-attenuation of the ICC resulting from intraindividual variability was controlled. The validity analysis was complemented by comparing the classification ability of FFQ to that of DR through concordance between intake categories and Bland-Altman plots. Reproducibility: ICC values for food groups ranged 0.42-0.87; the range for energy and nutrients was between 0.34 and 0.82. ICC values for food groups ranged 0.35-0.84; the range for energy and nutrients was between 0.36 and 0.77. Most subjects (56.7-76.3%) classified in the same or adjacent quintile for energy and nutrients using both methods. Extreme misclassification was <6.3% for all items. Bland-Altman plots reveal high concordance between FFQ and DR. FFQ produced sufficient levels of reproducibility and validity to determine average daily intake over one year. These results will enable the analysis of possible associations with chronic diseases and dietary diagnoses in adult populations of men and women. Copyright AULA MEDICA EDICIONES 2013. Published by AULA MEDICA. All rights reserved.

Interpreting SF-12 mental component score: an investigation of its convergent validity with CESD-10.

PubMed

Yu, Doris S F; Yan, Elsie C W; Chow, Choi Kai

2015-09-01

To examine the convergent validity of Mental Component Scale of the Short-Form 12 (SF-12 MCS) with the Center for Epidemiologic Studies Depression Scale (CESD-10). The CESD-10 is a screening tool for probably clinically significant depression in the Chinese population. Data were obtained from a household survey carried out in Hong Kong. A two-stage stratified sampling method successfully interviewed 1795 adult subjects from 1239 households. Data on SF-12 MCS and the CESD-10 were extracted. Receiver operating characteristics (ROC) analyses were performed to examine the convergent validity of SF-12 MCS against the CESD-10 threshold for probably clinically significant depression for the younger to middle-aged, late middle-aged and older population cohorts. ROC analysis indicated the excellent convergent validity of SF-12 MCS with the CESD-10 threshold for identifying probably clinically significant depression, with the area under curve ranged from 0.81 to 0.85. The optimal cutoff scores for depression among the younger to middle age group, late middle age group and older age group were 48.1, 50.2 and 50.2, respectively, with sensitivities ranged from 77 to 83 % and specificities ranged from 73 to 78 %. Bootstrapping estimates of the mean difference indicated no significant difference in the optimal cutoff scores between these age cohorts. SF-12 is a widely adopted measure to capture the health profile of Chinese population. The study findings indicated the satisfactory performance of the SF-12 MCS in identifying probably clinical depression. Future study is warrant to examine the diagnostic validity of the SF-12 MCS by using gold standard to assess clinical depression.

Psychometric properties of the Late-Life Function and Disability Instrument: a systematic review

PubMed Central

2014-01-01

Background The choice of measure for use as a primary outcome in geriatric research is contingent upon the construct of interest and evidence for its psychometric properties. The Late-Life Function and Disability Instrument (LLFDI) has been widely used to assess functional limitations and disability in studies with older adults. The primary aim of this systematic review was to evaluate the current available evidence for the psychometric properties of the LLFDI. Methods Published studies of any design reporting results based on administration of the original version of the LLFDI in community-dwelling older adults were identified after searches of 9 electronic databases. Data related to construct validity (convergent/divergent and known-groups validity), test-retest reliability and sensitivity to change were extracted. Effect sizes were calculated for within-group changes and summarized graphically. Results Seventy-one studies including 17,301 older adults met inclusion criteria. Data supporting the convergent/divergent and known-groups validity for both the Function and Disability components were extracted from 30 and 18 studies, respectively. High test-retest reliability was found for the Function component, while results for the Disability component were more variable. Sensitivity to change of the LLFDI was confirmed based on findings from 25 studies. The basic lower extremity subscale and overall summary score of the Function component and limitation dimension of the Disability component were associated with the strongest relative effect sizes. Conclusions There is extensive evidence to support the construct validity and sensitivity to change of the LLFDI among various clinical populations of community-dwelling older adults. Further work is needed on predictive validity and values for clinically important change. Findings from this review can be used to guide the selection of the most appropriate LLFDI subscale for use an outcome measure in geriatric research and practice. PMID:24476510

Do we know what foundation year doctors think about patient safety incident reporting? Development of a Web based tool to assess attitude and knowledge.

PubMed

Robson, Jean; de Wet, Carl; McKay, John; Bowie, Paul

2011-11-01

Making healthcare safer is an international priority. Patient safety modules are now taught in medical schools, and methods to assess related student knowledge and attitudes have been developed. However, little is known about the attitudes and knowledge which foundation doctors are developing to patient safety and incident reporting in the healthcare workplace, since a specific assessment tool appears to be lacking. To develop, content validate and pilot test an online questionnaire survey to elicit foundation doctors' knowledge and experience of patient safety and incident reporting, and assess related attitudes and behaviours. Questionnaire content validity was facilitated through: a steering group; literature review; feedback from foundation year doctors and consultant staff; a modified Delphi group; and completion of a content validity index by experts. In 2010 a cross-sectional online survey of 110 foundation year 1 and 2 doctors was then undertaken in three Scottish NHS board areas, utilising the developed 25 item questionnaire. The questionnaire was validated, and piloted among 69 foundation year doctors who responded to the questionnaire. The pilot has provided valuable insights into trainee attitudes and experience. For example, 32 (48%) believed that most safety incidents were due to things that they could not do anything about; and 31 (43%) admitted to being involved in medication errors which were not formally reported. The pilot study was successful in taking the first steps to developing a validated survey questionnaire for a key staff group, foundation year doctors, in a priority area. However, the findings raise concerns about trainee experience of and attitudes to reporting, and the frequency with which incidents go unreported.

Father for the first time - development and validation of a questionnaire to assess fathers’ experiences of first childbirth (FTFQ)

PubMed Central

2012-01-01

Background A father’s experience of the birth of his first child is important not only for his birth-giving partner but also for the father himself, his relationship with the mother and the newborn. No validated questionnaire assessing first-time fathers' experiences during childbirth is currently available. Hence, the aim of this study was to develop and validate an instrument to assess first-time fathers’ experiences of childbirth. Method Domains and items were initially derived from interviews with first-time fathers, and supplemented by a literature search and a focus group interview with midwives. The comprehensibility, comprehension and relevance of the items were evaluated by four paternity research experts and a preliminary questionnaire was pilot tested in eight first-time fathers. A revised questionnaire was completed by 200 first-time fathers (response rate = 81%) Exploratory factor analysis using principal component analysis with varimax rotation was performed and multitrait scaling analysis was used to test scaling assumptions. External validity was assessed by means of known-groups analysis. Results Factor analysis yielded four factors comprising 22 items and accounting 48% of the variance. The domains found were Worry, Information, Emotional support and Acceptance. Multitrait analysis confirmed the convergent and discriminant validity of the domains; however, Cronbach’s alpha did not meet conventional reliability standards in two domains. The questionnaire was sensitive to differences between groups of fathers hypothesized to differ on important socio demographic or clinical variables. Conclusions The questionnaire adequately measures important dimensions of first-time fathers’ childbirth experience and may be used to assess aspects of fathers’ experiences during childbirth. To obtain the FTFQ and permission for its use, please contact the corresponding author. PMID:22594834

Towards a conceptual framework demonstrating the effectiveness of audiovisual patient descriptions (patient video cases): a review of the current literature

PubMed Central

2012-01-01

Background Technological advances have enabled the widespread use of video cases via web-streaming and online download as an educational medium. The use of real subjects to demonstrate acute pathology should aid the education of health care professionals. However, the methodology by which this effect may be tested is not clear. Methods We undertook a literature review of major databases, found relevant articles relevant to using patient video cases as educational interventions, extracted the methodologies used and assessed these methods for internal and construct validity. Results A review of 2532 abstracts revealed 23 studies meeting the inclusion criteria and a final review of 18 of relevance. Medical students were the most commonly studied group (10 articles) with a spread of learner satisfaction, knowledge and behaviour tested. Only two of the studies fulfilled defined criteria on achieving internal and construct validity. The heterogeneity of articles meant it was not possible to perform any meta-analysis. Conclusions Previous studies have not well classified which facet of training or educational outcome the study is aiming to explore and had poor internal and construct validity. Future research should aim to validate a particular outcome measure, preferably by reproducing previous work rather than adopting new methods. In particular cognitive processing enhancement, demonstrated in a number of the medical student studies, should be tested at a postgraduate level. PMID:23256787

Maximising harm reduction in early specialty training for general practice: validation of a safety checklist

PubMed Central

2012-01-01

Background Making health care safer is a key policy priority worldwide. In specialty training, medical educators may unintentionally impact on patient safety e.g. through failures of supervision; providing limited feedback on performance; and letting poorly developed behaviours continue unchecked. Doctors-in-training are also known to be susceptible to medical error. Ensuring that all essential educational issues are addressed during training is problematic given the scale of the tasks to be undertaken. Human error and the reliability of local systems may increase the risk of safety-critical topics being inadequately covered. However adherence to a checklist reminder may improve the reliability of task delivery and maximise harm reduction. We aimed to prioritise the most safety-critical issues to be addressed in the first 12-weeks of specialty training in the general practice environment and validate a related checklist reminder. Methods We used mixed methods with different groups of GP educators (n = 127) and specialty trainees (n = 9) in two Scottish regions to prioritise, develop and validate checklist content. Generation and refinement of checklist themes and items were undertaken on an iterative basis using a range of methods including small group work in dedicated workshops; a modified-Delphi process; and telephone interviews. The relevance of potential checklist items was rated using a 4-point scale content validity index to inform final inclusion. Results 14 themes (e.g. prescribing safely; dealing with medical emergency; implications of poor record keeping; and effective & safe communication) and 47 related items (e.g. how to safety-net face-to-face or over the telephone; knowledge of practice systems for results handling; recognition of harm in children) were judged to be essential safety-critical educational issues to be covered. The mean content validity index ratio was 0.98. Conclusion A checklist was developed and validated for educational supervisors to assist in the reliable delivery of safety-critical educational issues in the opening 12-week period of training, and aligned with national curriculum competencies. The tool can also be adapted for use as a self-assessment instrument by trainees to guide patient safety-related learning needs. Dissemination and implementation of the checklist and self-rating scale are proceeding on a national, voluntary basis with plans to evaluate its feasibility and educational impact. PMID:22721273

The Group Selection or Assessment Centre (AC) Approach to Personnel Selection: An Annotated Bibliography,

DTIC Science & Technology

1988-02-01

sponsors of ACs, e.g. their cost in terms of the time lost by senior managers because of their partici.nnts as assessors. Emhasises the need to address...American Psychologist. 37, 180-189. Reports use of the AC method to study the progress of a group of managers over a period of time . The study included...on 254 managers attending an AC, for changes in validities over time . Peer and assessor ratings, along with linear combinations, were found

Validation of a physical anthropology methodology using mandibles for gender estimation in a Brazilian population

PubMed Central

CARVALHO, Suzana Papile Maciel; BRITO, Liz Magalhães; de PAIVA, Luiz Airton Saavedra; BICUDO, Lucilene Arilho Ribeiro; CROSATO, Edgard Michel; de OLIVEIRA, Rogério Nogueira

2013-01-01

Validation studies of physical anthropology methods in the different population groups are extremely important, especially in cases in which the population variations may cause problems in the identification of a native individual by the application of norms developed for different communities. Objective This study aimed to estimate the gender of skeletons by application of the method of Oliveira, et al. (1995), previously used in a population sample from Northeast Brazil. Material and Methods The accuracy of this method was assessed for a population from Southeast Brazil and validated by statistical tests. The method used two mandibular measurements, namely the bigonial distance and the mandibular ramus height. The sample was composed of 66 skulls and the method was applied by two examiners. The results were statistically analyzed by the paired t test, logistic discriminant analysis and logistic regression. Results The results demonstrated that the application of the method of Oliveira, et al. (1995) in this population achieved very different outcomes between genders, with 100% for females and only 11% for males, which may be explained by ethnic differences. However, statistical adjustment of measurement data for the population analyzed allowed accuracy of 76.47% for males and 78.13% for females, with the creation of a new discriminant formula. Conclusion It was concluded that methods involving physical anthropology present high rate of accuracy for human identification, easy application, low cost and simplicity; however, the methodologies must be validated for the different populations due to differences in ethnic patterns, which are directly related to the phenotypic aspects. In this specific case, the method of Oliveira, et al. (1995) presented good accuracy and may be used for gender estimation in Brazil in two geographic regions, namely Northeast and Southeast; however, for other regions of the country (North, Central West and South), previous methodological adjustment is recommended as demonstrated in this study. PMID:24037076

A Simple Method to Measure Renal Function in Swine by the Plasma Clearance of Iohexol

PubMed Central

Luis-Lima, Sergio; García-Contreras, Consolación; Carrara, Fabiola; Negrín-Mena, Natalia; Jiménez-Sosa, Alejandro; Jiménez-Hernández, Hugo; Porrini, Esteban

2018-01-01

There is no simple method to measure glomerular filtration rate (GFR) in swine, an established model for studying renal disease. We developed a protocol to measure GFR in conscious swine by using the plasma clearance of iohexol. We used two groups, test and validation, with eight animals each. Ten milliliters of iohexol (6.47 g) was injected into the marginal auricular vein and blood samples (3 mL) were collected from the orbital sinus at different points after injection. GFR was determined using two models: two-compartment (CL2: all samples) and one-compartment (CL1: the last six samples). In the test group, CL1 overestimated CL2 by ~30%: CL2 = 245 ± 93 and CL1 = 308 ± 123 mL/min. This error was corrected by a first-order polynomial quadratic equation to CL1, which was considered the simplified method: SM = −47.909 + (1.176xCL1) − (0.00063968xCL12). The SM showed narrow limits of agreement with CL2, a concordance correlation of 0.97, and a total deviation index of 14.73%. Similar results were obtained for the validation group. This protocol is reliable, reproducible, can be performed in conscious animals, uses a single dose of the marker, and requires a reduced number of samples, and avoids urine collection. Finally, it presents a significant improvement in animal welfare conditions and handling necessities in experimental trials. PMID:29329247

Development of a Measure of Asthma-Specific Quality of Life among Adults

PubMed Central

Eberhart, Nicole K.; Sherbourne, Cathy D.; Edelen, Maria Orlando; Stucky, Brian D.; Sin, Nancy L.; Lara, Marielena

2014-01-01

Purpose A key goal in asthma treatment is improvement in quality of life (QoL), but existing measures often confound QoL with symptoms and functional impairment. The current study addresses these limitations and the need for valid patient-reported outcome measures by using state-of-the-art methods to develop an item bank assessing QoL in adults with asthma. This article describes the process for developing an initial item pool for field testing. Methods Five focus group interviews were conducted with a total of 50 asthmatic adults. We used “pile sorting/binning” and “winnowing” methods to identify key QoL dimensions and develop a pool of items based on statements made in the focus group interviews. We then conducted a literature review and consulted with an expert panel to ensure that no key concepts were omitted. Finally, we conducted individual cognitive interviews to ensure that items were well understood and inform final item refinement. Results 661 QoL statements were identified from focus group interview transcripts and subsequently used to generate a pool of 112 items in 16 different content areas. Conclusions Items covering a broad range of content were developed that can serve as a valid gauge of individuals’ perceptions of the effects of asthma and its treatment on their lives. These items do not directly measure symptoms or functional impairment, yet they include a broader range of content than most existent measures of asthma-specific QoL. PMID:24062237

Development and validation of procedures for assessment of competency of non-pharmacists in extemporaneous dispensing.

PubMed

Donnelly, Ryan F; McNally, Martin J; Barry, Johanne G

2009-02-01

To develop and validate procedures that may be suitable for assessment of competency of two groups of non-pharmacist staff (pharmacy students and trainee support staff) in extemporaneous dispensing. This is important given the prospect of remote supervision of community pharmacies in the UK. Analytical methods were validated according to International Conference on Harmonisation specifications and procedures were optimized to allow efficient drug extraction. This permitted straightforward determination of drug content in extemporaneously prepared lidocaine hydrochloride mouthwashes and norfloxacin creams and suspensions prepared by 10 participants recruited to represent the two groups of non-pharmacist staff. All 10 participants had completed the extemporaneous dispensing of all three products within 90 min. Extraction and analysis took approximately 15 min for each lidocaine hydrochloride mouthwash and 30 min for each diluted norfloxacin cream and norfloxacin suspension. The mean drug concentrations in lidocaine hydrochloride mouthwashes and diluted norfloxacin creams were within what are generally accepted as being pharmaceutically acceptable limits for drug content (100 +/- 5%) for both groups of participants. There was no significant difference in the mean drug concentration of norfloxacin suspensions prepared by the participant groups. However, it was notable that only one participant prepared a suspension containing a norfloxacin concentration that was within pharmaceutically acceptable limits (101.51%). A laboratory possessing suitable equipment and appropriately trained staff could cope readily with the large number of products prepared, for example, by a cohort of pre-registration students. Consequently, the validated procedures developed here could usefully be incorporated into the pre-registration examination for pharmacy students and a final qualifying examination for dispensers and pharmacy technicians. We believe that this is essential if the public and the profession are to have confidence in extemporaneous dispensing carried out in the absence of a pharmacist.

AN EXPLORATORY STUDY OF THE MOTIVATION IN SUICIDE ATTEMPTERS

PubMed Central

Unni, K.E. Sadanandan; Rotti, S.B.; Chandrasekaran, R.

1995-01-01

The motivation of one hundred cases of suicide attempters was assessed clinically depending purely on their subjective reports. They were grouped into two, viz., those who primarily wished for a change (here in after called WC) and those who unambiguously wished to die (hereinafter called WD). They were compared with regard to the details of the attempt, methods of attempt, psychiatric and sociodemographic profile. The WC group was observed to have taken less precaution against discovery of their attempt, had low lethality with regard to the method used and had more adjustment problems than psychiatric diseases. They clearly belonged to the low risk group. The WD group had all these findings in the contrary, which put them in the high risk category. This simple way of assessing suicide risk may be having a face validity in the sociocultural context of the present PMID:21743744

Psychometric evaluation of the Chinese version of the fear of intimacy with helping professionals scale

PubMed Central

Chan, Kin Sun

2018-01-01

Objectives This study aimed to evaluate the internal consistency, reliability, convergent validity, known-group comparisons, and structural validity of the Chinese version of Fear of Intimacy with Helping Professionals (C–FIS–HP) scale in Macau. Methods A cross-sectional design was used on a sample of 593 older people in 6 health centers. We used Chinese version of Exercise of Self-Care Agency Scale (C-ESCAS) and Morisky 4-item medication adherence scale to evaluate self-care actions and medication adherence. The internal consistency and reliability of C–FIS–HP were analyzed using the Spearman-Brown split-half reliability, Cronbach’s alpha, and test–retest reliability. Convergent validity was tested the construct of C–FIS–HP and self-care actions. Known-group comparisons differentiated predefined groups in an expected direction. Two separated samples were used to test the structural validity. An exploratory factor analysis (EFA) tested the factor structure of C–FISHP using the principal axis factoring. A confirmatory factor analysis (CFA) was further conducted to confirm the factor structure constructed in the prior EFA. Results The C–FIS–HP had a Spearman-Brown split-half coefficient, Cronbach’s alpha, and intraclass correlation coefficient of 0.96, 0.93, and 0.96, respectively. Convergent validity was satisfactory with significantly correlations between the C-FIS-HP and C-ESCAS. C–FIS–HP to differentiate the differences between high-, moderate-, and low- medication adherence groups. EFA demonstrated a two-factor structure among 297 older people. A first-order CFA was performed to confirm the construct dimensionality of C–FIS–HP with satisfactory fit indices (NFI = 0.92; IFI = 0.95; TLI = 0.94; CFI = 0.95 and RMSEA = 0.07) among 296 older people. Conclusions C–FIS–HP is a reliable and valid test for assessing helping relationships in older Chinese people. Health professionals can use C–FIS–HP as a clinical tool to assess the comfort level of patients in a helping relationship, and use this information to develop culturally sensitive therapeutic interventions and treatment plans. Further studies need to be conducted concerning the different psychometric properties, as well as the application of C–FIS–HP in various regions. PMID:29795563

Measuring health-related quality of life: psychometric evaluation of the Tunisian version of the SF-12 health survey.

PubMed

Younsi, Moheddine; Chakroun, Mohamed

2014-09-01

The 12-item short-form health survey (SF-12) was developed as a shorter alternative to the SF-36 for use in large-scale studies as an applicable instrument for measuring health-related quality of life. The main purpose of this study was to evaluate the psychometric properties of the Tunisian version of the SF-12. A stratified representative sample (N = 3,582) of the general Tunisian population aged 18 years and over was interviewed. SF-12 summary scores were derived using the standard US algorithm. Factor analysis was used to confirm the hypothesized component structure of the SF-12 items. Reliability was estimated using internal consistency, and construct validity was investigated with "known groups" validity testing and via convergent and divergent validity. SF-12 summary scores distinguished well, and in the expected manner, between groups of respondents on the basis of gender, age, education and socioeconomic status, thus providing evidence of construct validity. Mean scores in the total sample were 50.11 (SD 8.53) for the physical component summary (PCS) score and 47.96 (SD 9.82) for the mental component summary (MCS) score. The results showed satisfactory internal consistency and acceptable convergent validity for both summary scores. Cronbach's α coefficient for PCS-12 and MCS-12 was 0.73 and 0.72, respectively. Known groups comparison showed that the SF-12 discriminated well between groups of respondents on the basis of gender, age, education and socioeconomic status. In addition, no floor or ceiling effects at baseline were observed. The PCA confirmed the two-factor structure of the SF-12 items. Items belonging to the physical component correlated more strongly with the PCS-12 than those with the MCS-12. Similarly, items belonging to the mental component correlated more strongly with the MCS-12 than those with the PCS-12. The findings suggest that the SF-12 appears to be a valid and reliable measure that can be used for measuring of population health status. However, for optimal measurement, modifications to traditional scoring methods for the SF-12 should be considered.

Determination of alcohol and extract concentration in beer samples using a combined method of near-infrared (NIR) spectroscopy and refractometry.

PubMed

Castritius, Stefan; Kron, Alexander; Schäfer, Thomas; Rädle, Matthias; Harms, Diedrich

2010-12-22

A new approach of combination of near-infrared (NIR) spectroscopy and refractometry was developed in this work to determine the concentration of alcohol and real extract in various beer samples. A partial least-squares (PLS) regression, as multivariate calibration method, was used to evaluate the correlation between the data of spectroscopy/refractometry and alcohol/extract concentration. This multivariate combination of spectroscopy and refractometry enhanced the precision in the determination of alcohol, compared to single spectroscopy measurements, due to the effect of high extract concentration on the spectral data, especially of nonalcoholic beer samples. For NIR calibration, two mathematical pretreatments (first-order derivation and linear baseline correction) were applied to eliminate light scattering effects. A sample grouping of the refractometry data was also applied to increase the accuracy of the determined concentration. The root mean squared errors of validation (RMSEV) of the validation process concerning alcohol and extract concentration were 0.23 Mas% (method A), 0.12 Mas% (method B), and 0.19 Mas% (method C) and 0.11 Mas% (method A), 0.11 Mas% (method B), and 0.11 Mas% (method C), respectively.

Comparison of prediction methods for octanol-air partition coefficients of diverse organic compounds.

PubMed

Fu, Zhiqiang; Chen, Jingwen; Li, Xuehua; Wang, Ya'nan; Yu, Haiying

2016-04-01

The octanol-air partition coefficient (KOA) is needed for assessing multimedia transport and bioaccumulability of organic chemicals in the environment. As experimental determination of KOA for various chemicals is costly and laborious, development of KOA estimation methods is necessary. We investigated three methods for KOA prediction, conventional quantitative structure-activity relationship (QSAR) models based on molecular structural descriptors, group contribution models based on atom-centered fragments, and a novel model that predicts KOA via solvation free energy from air to octanol phase (ΔGO(0)), with a collection of 939 experimental KOA values for 379 compounds at different temperatures (263.15-323.15 K) as validation or training sets. The developed models were evaluated with the OECD guidelines on QSAR models validation and applicability domain (AD) description. Results showed that although the ΔGO(0) model is theoretically sound and has a broad AD, the prediction accuracy of the model is the poorest. The QSAR models perform better than the group contribution models, and have similar predictability and accuracy with the conventional method that estimates KOA from the octanol-water partition coefficient and Henry's law constant. One QSAR model, which can predict KOA at different temperatures, was recommended for application as to assess the long-range transport potential of chemicals. Copyright © 2016 Elsevier Ltd. All rights reserved.

Can jurors recognize missing control groups, confounds, and experimenter bias in psychological science?

PubMed

McAuliff, Bradley D; Kovera, Margaret Bull; Nunez, Gabriel

2009-06-01

This study examined the ability of jury-eligible community members (N = 248) to detect internal validity threats in psychological science presented during a trial. Participants read a case summary in which an expert testified about a study that varied in internal validity (valid, missing control group, confound, and experimenter bias) and ecological validity (high, low). Ratings of expert evidence quality and expert credibility were higher for the valid versus missing control group versions only. Internal validity did not influence verdict or ratings of plaintiff credibility and no differences emerged as a function of ecological validity. Expert evidence quality, expert credibility, and plaintiff credibility were positively correlated with verdict. Implications for the scientific reasoning literature and for trials containing psychological science are discussed.

How to test validity in orthodontic research: a mixed dentition analysis example.

PubMed

Donatelli, Richard E; Lee, Shin-Jae

2015-02-01

The data used to test the validity of a prediction method should be different from the data used to generate the prediction model. In this study, we explored whether an independent data set is mandatory for testing the validity of a new prediction method and how validity can be tested without independent new data. Several validation methods were compared in an example using the data from a mixed dentition analysis with a regression model. The validation errors of real mixed dentition analysis data and simulation data were analyzed for increasingly large data sets. The validation results of both the real and the simulation studies demonstrated that the leave-1-out cross-validation method had the smallest errors. The largest errors occurred in the traditional simple validation method. The differences between the validation methods diminished as the sample size increased. The leave-1-out cross-validation method seems to be an optimal validation method for improving the prediction accuracy in a data set with limited sample sizes. Copyright © 2015 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

Screening for Posttraumatic Stress Disorder among Somali ex-combatants: A validation study

PubMed Central

Odenwald, Michael; Lingenfelder, Birke; Schauer, Maggie; Neuner, Frank; Rockstroh, Brigitte; Hinkel, Harald; Elbert, Thomas

2007-01-01

Background In Somalia, a large number of active and former combatants are affected by psychological problems such as Posttraumatic Stress Disorder (PTSD). This disorder impairs their ability to re-integrate into civilian life. However, many screening instruments for Posttraumatic Stress Disorder used in post-conflict settings have limited validity. Here we report on development and validation of a screening tool for PTSD in Somali language with a sample of ex-combatants. Methods We adapted the Posttraumatic Diagnostic Scale (PDS) to reflect linguistic and cultural differences within the Somali community so that local interviewers could be trained to administer the scale. For validation purposes, a randomly selected group of 135 Somali ex-combatants was screened by trained local interviewers; 64 of them were then re-assessed by trained clinical psychologists using the Composite International Diagnostic Interview (CIDI) and the Self-Report Questionnaire (SRQ-20). Results The screening instrument showed good internal consistency (Cronbach's α = .86), convergent validity with the CIDI (sensitivity = .90; specificity = .90) as well as concurrent validity: positive cases showed higher SRQ-20 scores, higher prevalence of psychotic symptoms, and higher levels of intake of the local stimulant drug khat. Compared to a single cut-off score, the multi-criteria scoring, in keeping with the DSM-IV, produced more diagnostic specificity. Conclusion The results provide evidence that our screening instrument is a reliable and valid method to detect PTSD among Somali ex-combatants. A future Disarmament, Demobilization and Reintegration Program in Somalia is recommended to screen for PTSD in order to identify ex-combatants with special psycho-social needs. PMID:17822562

VALIDITY AND RELIABILITY OF THE SPIRITUAL COPING STRATEGIES SCALE ARABIC VERSION IN SAUDI PATIENTS UNDERGOING HAEMODIALYSIS.

PubMed

Cruz, Jonas P; Baldacchino, Donia R; Alquwez, Nahed

2016-06-01

Patients often resort to religious and spiritual activities to cope with physical and mental challenges. The effect of spiritual coping on overall health, adaptation and health-related quality of life among patients undergoing haemodialysis (HD) is well documented. Thus, it is essential to establish a valid and reliable instrument that can assess both the religious and non-religious coping methods in patients undergoing HD. This study aimed to assess the validity and reliability of the Spiritual Coping Strategies Scale Arabic version (SCS-A) in Saudi patients undergoing HD. A convenience sample of 60 Saudi patients undergoing HD was recruited for this descriptive, cross-sectional study. Data were collected between May and June 2015. Forward-backward translation was used to formulate the SCS-A. The SCS-A, Muslim Religiosity Scale and the Quality of Life Index Dialysis Version III were used to procure the data. Internal consistency reliability, stability reliability, factor analysis and construct validity tests were performed. Analyses were set at the 0.05 level of significance. The SCS-A showed an acceptable internal consistency and strong stability reliability over time. The EFA produced two factors (non-religious and religious coping). Satisfactory construct validity was established by the convergent and divergent validity and known-groups method. The SCS-A is a reliable and valid tool that can be used to measure the religious and non-religious coping strategies of patients undergoing HD in Saudi Arabia and other Muslim and Arabic-speaking countries. © 2016 European Dialysis and Transplant Nurses Association/European Renal Care Association.

Nomogram-based prediction of survival in patients with advanced oesophagogastric adenocarcinoma receiving first-line chemotherapy: a multicenter prospective study in the era of trastuzumab

PubMed Central

Custodio, A; Carmona-Bayonas, A; Jiménez-Fonseca, P; Sánchez, M L; Viudez, A; Hernández, R; Cano, J M; Echavarria, I; Pericay, C; Mangas, M; Visa, L; Buxo, E; García, T; Rodríguez Palomo, A; Álvarez Manceñido, F; Lacalle, A; Macias, I; Azkarate, A; Ramchandani, A; Fernández Montes, A; López, C; Longo, F; Sánchez Bayona, R; Limón, M L; Díaz-Serrano, A; Hurtado, A; Madero, R; Gómez, C; Gallego, J

2017-01-01

Background: To develop and validate a nomogram and web-based calculator to predict overall survival (OS) in Caucasian-advanced oesophagogastric adenocarcinoma (AOA) patients undergoing first-line combination chemotherapy. Methods: Nine hundred twenty-four AOA patients treated at 28 Spanish teaching hospitals from January 2008 to September 2014 were used as derivation cohort. The result of an adjusted-Cox proportional hazards regression was represented as a nomogram and web-based calculator. The model was validated in 502 prospectively recruited patients treated between October 2014 and December 2016. Harrell's c-index was used to evaluate discrimination. Results: The nomogram includes seven predictors associated with OS: HER2-positive tumours treated with trastuzumab, Eastern Cooperative Oncology Group performance status, number of metastatic sites, bone metastases, ascites, histological grade, and neutrophil-to-lymphocyte ratio. Median OS was 5.8 (95% confidence interval (CI), 4.5–6.6), 9.4 (95% CI, 8.5–10.6), and 14 months (95% CI, 11.8–16) for high-, intermediate-, and low-risk groups, respectively (P<0.001), in the derivation set and 4.6 (95% CI, 3.3–8.1), 12.7 (95% CI, 11.3–14.3), and 18.3 months (95% CI, 14.6–24.2) for high-, intermediate-, and low-risk groups, respectively (P<0.001), in the validation set. The nomogram is well-calibrated and reveals acceptable discriminatory capacity, with optimism-corrected c-indices of 0.618 (95% CI, 0.591–0.631) and 0.673 (95% CI, 0.636–0.709) in derivation and validation groups, respectively. The AGAMENON nomogram outperformed the Royal Marsden Hospital (c-index=0.583; P=0.00046) and Japan Clinical Oncology Group prognostic indices (c-index=0.611; P=0.03351). Conclusions: We developed and validated a straightforward model to predict survival in Caucasian AOA patients initiating first-line polychemotherapy. This model can contribute to inform clinical decision-making and optimise clinical trial design. PMID:28463962

A digital photographic measurement method for quantifying foot posture: validity, reliability, and descriptive data.

PubMed

Cobb, Stephen C; James, C Roger; Hjertstedt, Matthew; Kruk, James

2011-01-01

Although abnormal foot posture long has been associated with lower extremity injury risk, the evidence is equivocal. Poor intertester reliability of traditional foot measures might contribute to the inconsistency. To investigate the validity and reliability of a digital photographic measurement method (DPMM) technology, the reliability of DPMM-quantified foot measures, and the concurrent validity of the DPMM with clinical-measurement methods (CMMs) and to report descriptive data for DPMM measures with moderate to high intratester and intertester reliability. Descriptive laboratory study. Biomechanics research laboratory. A total of 159 people participated in 3 groups. Twenty-eight people (11 men, 17 women; age  =  25 ± 5 years, height  =  1.71 ± 0.10 m, mass  =  77.6 ± 17.3 kg) were recruited for investigation of intratester and intertester reliability of the DPMM technology; 20 (10 men, 10 women; age  =  24 ± 2 years, height  =  1.71 ± 0.09 m, mass  =  76 ± 16 kg) for investigation of DPMM and CMM reliability and concurrent validity; and 111 (42 men, 69 women; age  =  22.8 ± 4.7 years, height  =  168.5 ± 10.4 cm, mass  =  69.8 ± 13.3 kg) for development of a descriptive data set of the DPMM foot measurements with moderate to high intratester and intertester reliabilities. The dimensions of 10 model rectangles and the 28 participants' feet were measured, and DPMM foot posture was measured in the 111 participants. Two clinicians assessed the DPMM and CMM foot measures of the 20 participants. Validity and reliability were evaluated using mean absolute and percentage errors and intraclass correlation coefficients. Descriptive data were computed from the DPMM foot posture measures. The DPMM technology intratester and intertester reliability intraclass correlation coefficients were 1.0 for each tester and variable. Mean absolute errors were equal to or less than 0.2 mm for the bottom and right-side variables and 0.1° for the calculated angle variable. Mean percentage errors between the DPMM and criterion reference values were equal to or less than 0.4%. Intratester and intertester reliabilities of DPMM-computed structural measures of arch and navicular indices were moderate to high (>0.78), and concurrent validity was moderate to strong. The DPMM is a valid and reliable clinical and research tool for quantifying foot structure. The DPMM and the descriptive data might be used to define groups in future studies in which the relationship between foot posture and function or injury risk is investigated.

Interprofessional partnerships in chronic illness care: a conceptual model for measuring partnership effectiveness

PubMed Central

Butt, Gail; Markle-Reid, Maureen; Browne, Gina

2008-01-01

Introduction Interprofessional health and social service partnerships (IHSSP) are internationally acknowledged as integral for comprehensive chronic illness care. However, the evidence-base for partnership effectiveness is lacking. This paper aims to clarify partnership measurement issues, conceptualize IHSSP at the front-line staff level, and identify tools valid for group process measurement. Theory and methods A systematic literature review utilizing three interrelated searches was conducted. Thematic analysis techniques were supported by NVivo 7 software. Complexity theory was used to guide the analysis, ground the new conceptualization and validate the selected measures. Other properties of the measures were critiqued using established criteria. Results There is a need for a convergent view of what constitutes a partnership and its measurement. The salient attributes of IHSSP and their interorganizational context were described and grounded within complexity theory. Two measures were selected and validated for measurement of proximal group outcomes. Conclusion This paper depicts a novel complexity theory-based conceptual model for IHSSP of front-line staff who provide chronic illness care. The conceptualization provides the underpinnings for a comprehensive evaluative framework for partnerships. Two partnership process measurement tools, the PSAT and TCI are valid for IHSSP process measurement with consideration of their strengths and limitations. PMID:18493591

Revealing barriers and facilitators to use a new genetic test: comparison of three user involvement methods.

PubMed

Rhebergen, Martijn D F; Visser, Maaike J; Verberk, Maarten M; Lenderink, Annet F; van Dijk, Frank J H; Kezic, Sanja; Hulshof, Carel T J

2012-10-01

We compared three common user involvement methods in revealing barriers and facilitators from intended users that might influence their use of a new genetic test. The study was part of the development of a new genetic test on the susceptibility to hand eczema for nurses. Eighty student nurses participated in five focus groups (n = 33), 15 interviews (n = 15) or questionnaires (n = 32). For each method, data were collected until saturation. We compared the mean number of items and relevant remarks that could influence the use of the genetic test obtained per method, divided by the number of participants in that method. Thematic content analysis was performed using MAXQDA software. The focus groups revealed 30 unique items compared to 29 in the interviews and 21 in the questionnaires. The interviews produced more items and relevant remarks per participant (1.9 and 8.4 pp) than focus groups (0.9 and 4.8 pp) or questionnaires (0.7 and 2.3 pp). All three involvement methods revealed relevant barriers and facilitators to use a new genetic test. Focus groups and interviews revealed substantially more items than questionnaires. Furthermore, this study suggests a preference for the use of interviews because the number of items per participant was higher than for focus groups and questionnaires. This conclusion may be valid for other genetic tests as well.

The use of the FACT-H&N (v4) in clinical settings within a developing country: a mixed method study.

PubMed

Bilal, Sobia; Doss, Jennifer Geraldine; Rogers, Simon N

2014-12-01

In the last decade there has been an increasing awareness about 'quality of life' (QOL) of cancer survivors in developing countries. The study aimed to cross-culturally adapt and validate the FACT-H&N (v4) in Urdu language for Pakistani head and neck cancer patients. In this study the 'same language adaptation method' was used. Cognitive debriefing through in-depth interviews of 25 patients to assess semantic, operational and conceptual equivalence was done. The validation phase included 50 patients to evaluate the psychometric properties. The translated FACT-H&N was easily comprehended (100%). Cronbach's alpha for FACT-G subscales ranged from 0.726 - 0.969. The head and neck subscale and Pakistani questions subscale showed low internal consistency (0.426 and 0.541 respectively). Instrument demonstrated known-group validity in differentiating patients of different clinical stages, treatment status and tumor sites (p < 0.05). Most FACT summary scales correlated strongly with each other (r > 0.75) and showed convergent validity (r > 0.90), with little discriminant validity. Factor analysis revealed 6 factors explaining 85.1% of the total variance with very good (>0.8) Kaiser-Meyer-Olkin and highly significant Bartlett's Test of Sphericity (p < 0.001). The cross-culturally adapted FACT-H&N into Urdu language showed adequate reliability and validity to be incorporated in Pakistani clinical settings for head and neck cancer patients. Copyright © 2014 European Association for Cranio-Maxillo-Facial Surgery. Published by Elsevier Ltd. All rights reserved.

Validation and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women.

PubMed

Abay, Halime; Kaplan, Sena

2016-04-01

There are a limited number of menopause-specific quality-of-life scales for the Turkish population. This study was conducted to evaluate the validity and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women. The study group was comprised of 250 postmenopausal women who applied to a training and research hospital's menopause clinic in Turkey. A survey form and the Turkish Utian quality-of-Life Scale were used to collect data, and the Turkish version of Short Form-36 was used to evaluate reliability with an equivalent form. Language-validity, content-validity, and construct-validity methods were used to assess the validity of the scale, and Cronbach's α coefficient calculation and the equivalent-form reliability methods were used to assess the reliability of the scale. The Turkish Utian Quality-of-Life Scale was determined to be a valid and reliable instrument for measuring the quality of life of postmenopausal women. Confirmatory factor analysis demonstrates that the instrument fits well with 23 items and a four-factor model. The Cronbach's α coefficient for the quality-of-life domains were as follows: 0.88 overall, 0.79 health, 0.78 emotional, 0.76 sexual, and 0.75 occupational. Reliability of the instrument was confirmed through significant correlations between scores on the Turkish version of the Utian Quality-of-Life Scale and the Turkish version of the Short Form-36 (r = 0.745, P < 0.001). This research emphasizes that the Turkish Utian Quality-of-Life Scale is reliable and valid in postmenopausal women-it is a useful instrument for measuring quality of life during menopause.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gehin, Jess C; Godfrey, Andrew T; Evans, Thomas M

The Consortium for Advanced Simulation of Light Water Reactors (CASL) is developing a collection of methods and software products known as VERA, the Virtual Environment for Reactor Applications, including a core simulation capability called VERA-CS. A key milestone for this endeavor is to validate VERA against measurements from operating nuclear power reactors. The first step in validation against plant data is to determine the ability of VERA to accurately simulate the initial startup physics tests for Watts Bar Nuclear Power Station, Unit 1 (WBN1) cycle 1. VERA-CS calculations were performed with the Insilico code developed at ORNL using cross sectionmore » processing from the SCALE system and the transport capabilities within the Denovo transport code using the SPN method. The calculations were performed with ENDF/B-VII.0 cross sections in 252 groups (collapsed to 23 groups for the 3D transport solution). The key results of the comparison of calculations with measurements include initial criticality, control rod worth critical configurations, control rod worth, differential boron worth, and isothermal temperature reactivity coefficient (ITC). The VERA results for these parameters show good agreement with measurements, with the exception of the ITC, which requires additional investigation. Results are also compared to those obtained with Monte Carlo methods and a current industry core simulator.« less

[Evaluation of disease management programmes--assessing methods and initial outcomes from a health economic perspective].

PubMed

Birnbaum, Dana Sophie; Braun, Sebastian

2010-01-01

Evaluation represents a substantial component of the concept of Disease Management Programmes. This and the fact that the implementation of Disease Management Programmes constitutes a major change in the German healthcare system require that the criteria established by the German Federal Social Insurance Authority (Bundesversicherungsamt) be carefully reviewed. The present paper focuses on the evaluation method and the economic data. The pre-/-post study design used in the evaluation is known to be vulnerable to threats to internal validity. The objective of this paper is to analyze whether these threats to internal validity which have been known theoretically are confirmed by the results of the final reports. A review of the final reports of health insurance companies like the AOK, Barmer and a group of the BKK in Westfalen-Lippe shows that this question can be answered in the affirmative. The pre-/-post design without control groups is unable to recognize the failure or success of the Disease Management concept. The reasons include a high drop-out rate as well as the lack of consideration of the characteristics of chronic disease. Hence the evaluation method has failed to prove the quality of Disease Management Programmes in Germany. This is why consistent further development is needed.

Current status of validation for robotic surgery simulators - a systematic review.

PubMed

Abboudi, Hamid; Khan, Mohammed S; Aboumarzouk, Omar; Guru, Khurshid A; Challacombe, Ben; Dasgupta, Prokar; Ahmed, Kamran

2013-02-01

To analyse studies validating the effectiveness of robotic surgery simulators. The MEDLINE(®), EMBASE(®) and PsycINFO(®) databases were systematically searched until September 2011. References from retrieved articles were reviewed to broaden the search. The simulator name, training tasks, participant level, training duration and evaluation scoring were extracted from each study. We also extracted data on feasibility, validity, cost-effectiveness, reliability and educational impact. We identified 19 studies investigating simulation options in robotic surgery. There are five different robotic surgery simulation platforms available on the market. In all, 11 studies sought opinion and compared performance between two different groups; 'expert' and 'novice'. Experts ranged in experience from 21-2200 robotic cases. The novice groups consisted of participants with no prior experience on a robotic platform and were often medical students or junior doctors. The Mimic dV-Trainer(®), ProMIS(®), SimSurgery Educational Platform(®) (SEP) and Intuitive systems have shown face, content and construct validity. The Robotic Surgical SimulatorTM system has only been face and content validated. All of the simulators except SEP have shown educational impact. Feasibility and cost-effectiveness of simulation systems was not evaluated in any trial. Virtual reality simulators were shown to be effective training tools for junior trainees. Simulation training holds the greatest potential to be used as an adjunct to traditional training methods to equip the next generation of robotic surgeons with the skills required to operate safely. However, current simulation models have only been validated in small studies. There is no evidence to suggest one type of simulator provides more effective training than any other. More research is needed to validate simulated environments further and investigate the effectiveness of animal and cadaveric training in robotic surgery. © 2012 BJU International.

Validation and comparison of the psychometric properties of the EQ-5D-3L and EQ-5D-5L instruments in Greece.

PubMed

Yfantopoulos, John N; Chantzaras, Athanasios E

2017-05-01

To validate and compare the psychometric properties of the EQ-5D-3L with the EQ-5D-5L classification systems in Greece. Participants (n = 2279) over 40 years old, sampled from the greater area of Athens using a multistage stratified quota sampling method, completed both EQ-5D versions, while information was also collected on socio-demographics and health-related characteristics. The EQ-5D-5L and EQ-5D-3L were evaluated in terms of agreement, ceiling effects, redistribution and inconsistency, informativity, and convergent and known-groups validity. The agreement between the EQ-5D-3L and EQ-5D-5L was high (ICC = 0.85). Ceiling effects decreased significantly in the EQ-5D-5L in all domains (P < 0.001), with "usual activities" (-21.4 %) and "self-care" (-20.1 %) showing the highest absolute and "anxiety/depression" the highest relative reduction (-32.46 %). Inconsistency was low (5.7 %). The increase in prevalence of problems was larger than the decrease in their severity, resulting in a lower mean health utility for the EQ-5D-5L. Overall absolute and relative informativity improved by 70.5 % and 16.4 %, respectively, in the EQ-5D-5L. Both instruments exhibited good convergent and known-groups validity, with evidence of a considerably better convergent performance and discriminatory ability of the EQ-5D-5L. Both EQ-5D versions demonstrated good construct validity and had consistent redistribution. The EQ-5D-5L system may be preferable to the EQ-5D-3L, as it exhibited superior performance in terms of lower ceiling effects, higher absolute and relative informativity, and improved convergent and known-groups validity efficiency.

Optimized and Validated Spectrophotometric Methods for the Determination of Enalapril Maleate in Commercial Dosage Forms

PubMed Central

Rahman, Nafisur; Haque, Sk Manirul

2008-01-01

Four simple, rapid and sensitive spectrophotometric methods have been proposed for the determination of enalapril maleate in pharmaceutical formulations. The first method is based on the reaction of carboxylic acid group of enalapril maleate with a mixture of potassium iodate (KIO3) and iodide (KI) to form yellow colored product in aqueous medium at 25 ± 1°C. The reaction is followed spectrophotometrically by measuring the absorbance at 352 nm. The second, third and fourth methods are based on the charge transfer complexation reaction of the drug with p-chloranilic acid (pCA) in 1, 4-dioxan-methanol medium, 2, 3-dichloro 5, 6-dicyano 1, 4-benzoquinone (DDQ) in acetonitrile-1,4 dioxane medium and iodine in acetonitrile-dichloromethane medium. Under optimized experimental conditions, Beer’s law is obeyed in the concentration ranges of 2.5–50, 20–560, 5–75 and 10–200 μg mL−1, respectively. All the methods have been applied to the determination of enalapril maleate in pharmaceutical dosage forms. Results of analysis are validated statistically. PMID:19609388

The importance of the external potential on group electronegativity.

PubMed

Leyssens, Tom; Geerlings, Paul; Peeters, Daniel

2005-11-03

The electronegativity of groups placed in a molecular environment is obtained using CCSD calculations of the electron affinity and ionization energy. A point charge model is used as an approximation of the molecular environment. The electronegativity values obtained in the presence of a point charge model are compared to the isolated group property to estimate the importance of the external potential on the group's electronegativity. The validity of the "group in molecule" electronegativities is verified by comparing EEM (electronegativity equalization method) charge transfer values to the explicitly calculated natural population analysis (NPA) ones, as well as by comparing the variation in electronegativity between the isolated functional group and the functional group in the presence of a modeled environment with the variation based on a perturbation expansion of the chemical potential.

The validity of self-reported cancer screening history and the role of social disadvantage in Ontario, Canada.

PubMed

Lofters, Aisha; Vahabi, Mandana; Glazier, Richard H

2015-01-29

Self-report may not be an accurate method of determining cervical, breast and colorectal cancer screening rates due to recall, acquiescence and social desirability biases, particularly for certain sociodemographic groups. Therefore, the aims of this study were to determine the validity of self-report of cancer screening in Ontario, Canada, both for people in the general population and for socially disadvantaged groups based on immigrant status, ethnicity, education, income, language ability, self-rated health, employment status, age category (for cervical cancer screening), and gender (for fecal occult blood testing). We linked multiple data sources for this study, including the Canadian Community Health Survey and provincial-level health databases. Using administrative data as our gold standard, we calculated validity measures for self-report (i.e. sensitivity, specificity, positive and negative likelihood ratios, positive and negative predictive values), calculated report-to-record ratios, and conducted a multivariable regression analysis to determine which characteristics were independently associated with over-reporting of screening. Specificity was less than 70% overall and for all subgroups for cervical and breast cancer screening, and sensitivity was lower than 80% overall and for all subgroups for fecal occult blood testing FOBT. Report-to-record ratios were persistently significantly greater than 1 across all cancer screening types, highest for the FOBT group: 1.246 [1.189-1.306]. Regression analyses showed no consistent patterns, but sociodemographic characteristics were associated with over-reporting for each screening type. We have found that in Ontario, as in other jurisdictions, there is a pervasive tendency for people to over-report their cancer screening histories. Sociodemographic status also appears to influence over-reporting. Public health practitioners and policymakers need to be aware of the limitations of self-report and adjust their methods and interpretations accordingly.

Proposal of a Mediterranean Diet Serving Score

PubMed Central

Monteagudo, Celia; Mariscal-Arcas, Miguel; Rivas, Ana; Lorenzo-Tovar, María Luisa; Tur, Josep A.; Olea-Serrano, Fátima

2015-01-01

Background and Aims Numerous studies have demonstrated a relationship between Mediterranean Diet (MD) adherence and the prevention of cardiovascular diseases, cancer, and diabetes, etc. The study aim was to validate a novel instrument to measure MD adherence based on the consumption of food servings and food groups, and apply it in a female population from southern Spain and determining influential factors. Methods and Results The study included 1,155 women aged 12-83 yrs, classified as adolescents, adults, and over-60-yr-olds. All completed a validated semi-quantitative food frequency questionnaire (FFQ). The Mediterranean Dietary Serving Score (MDSS) is based on the latest update of the Mediterranean Diet Pyramid, using the recommended consumption frequency of foods and food groups; the MDSS ranges from 0 to 24. The discriminative power or correct subject classification capacity of the MDSS was analyzed with the Receiver Operating Characteristic (ROC) curve, using the MDS as reference method. Predictive factors for higher MDSS adherence were determined with a logistic regression model, adjusting for age. According to ROC curve analysis, MDSS evidenced a significant discriminative capacity between adherents and non-adherents to the MD pattern (optimal cutoff point=13.50; sensitivity=74%; specificity=48%). The mean MDSS was 12.45 (2.69) and was significantly higher with older age (p<0.001). Logistic regression analysis showed highest MD adherence by over 60-year-olds with low BMI and no habit of eating between meals. Conclusions The MDSS is an updated, easy, valid, and accurate instrument to assess MD adherence based on the consumption of foods and food groups per meal, day, and week. It may be useful in future nutritional education programs to prevent the early onset of chronic non-transmittable diseases in younger populations. PMID:26035442

The Psychometric Properties of English and Spanish Versions of the Life Orientation Test-Revised in Hispanic Americans.

PubMed

Pan, Tonya M; Mills, Sarah D; Fox, Rina S; Baik, Sharon H; Harry, Kadie M; Roesch, Scott C; Sadler, Georgia Robins; Malcarne, Vanessa L

2017-12-01

The Life Orientation Test-Revised (LOT-R) is a widely used measure of optimism and pessimism, with three positively worded and three negatively worded content items. This study examined the structural validity and invariance, internal consistency reliability, and convergent and divergent validity of the English and Spanish versions of the LOT-R among Hispanic Americans. A community sample of Hispanic Americans ( N = 422) completed self-report measures, including the LOT-R, Patient Health Questionnaire-9, and Generalized Anxiety Disorder-7, in their preferred language of English or Spanish. Based on the literature, four structural models were tested: one-factor , oblique two-factor , orthogonal two-factor method effects with positive specific factor , and orthogonal two-factor method effects with negative specific factor . Baseline support for both of the English and Spanish versions was not achieved for any model; in all models, the negatively worded items in Spanish had non-significant factor loadings. Therefore, the positively worded three-item optimism subscale of the LOT-R was examined separately and fit the data, with factor loadings equivalent across language-preference groups. Coefficient alphas for the optimism subscale were consistent across both language-preference groups (αs = .61 [English] and .66 [Spanish]). In contrast, the six-item total score and three-item pessimism subscale demonstrated extremely low or inconsistent alphas. Convergent and divergent validity were established for the optimism subscale in both languages. In sum, the optimism subscale of the LOT-R demonstrated minimally acceptable to good psychometric properties across English and Spanish language-preference groups. However, neither the total score nor the pessimism subscale showed adequate psychometric properties for Spanish-speaking Hispanic Americans, likely due to translation and cultural adaptation issues, and thus are not supported for use with this population.

Illegal performance enhancing drugs and doping in sport: a picture-based brief implicit association test for measuring athletes’ attitudes

PubMed Central

2014-01-01

Background Doping attitude is a key variable in predicting athletes’ intention to use forbidden performance enhancing drugs. Indirect reaction-time based attitude tests, such as the implicit association test, conceal the ultimate goal of measurement from the participant better than questionnaires. Indirect tests are especially useful when socially sensitive constructs such as attitudes towards doping need to be described. The present study serves the development and validation of a novel picture-based brief implicit association test (BIAT) for testing athletes’ attitudes towards doping in sport. It shall provide the basis for a transnationally compatible research instrument able to harmonize anti-doping research efforts. Method Following a known-group differences validation strategy, the doping attitudes of 43 athletes from bodybuilding (representative for a highly doping prone sport) and handball (as a contrast group) were compared using the picture-based doping-BIAT. The Performance Enhancement Attitude Scale (PEAS) was employed as a corresponding direct measure in order to additionally validate the results. Results As expected, in the group of bodybuilders, indirectly measured doping attitudes as tested with the picture-based doping-BIAT were significantly less negative (η2 = .11). The doping-BIAT and PEAS scores correlated significantly at r = .50 for bodybuilders, and not significantly at r = .36 for handball players. There was a low error rate (7%) and a satisfactory internal consistency (r tt  = .66) for the picture-based doping-BIAT. Conclusions The picture-based doping-BIAT constitutes a psychometrically tested method, ready to be adopted by the international research community. The test can be administered via the internet. All test material is available “open source”. The test might be implemented, for example, as a new effect-measure in the evaluation of prevention programs. PMID:24479865

Comparison of anthropometric-based equations for estimation of body fat percentage in a normal-weight and overweight female cohort: validation via air-displacement plethysmography.

PubMed

Temple, Derry; Denis, Romain; Walsh, Marianne C; Dicker, Patrick; Byrne, Annette T

2015-02-01

To evaluate the accuracy of the most commonly used anthropometric-based equations in the estimation of percentage body fat (%BF) in both normal-weight and overweight women using air-displacement plethysmography (ADP) as the criterion measure. A comparative study in which the equations of Durnin and Womersley (1974; DW) and Jackson, Pollock and Ward (1980) at three, four and seven sites (JPW₃, JPW₄ and JPW₇) were validated against ADP in three groups. Group 1 included all participants, group 2 included participants with a BMI <25·0 kg/m² and group 3 included participants with a BMI ≥25·0 kg/m². Human Performance Laboratory, Institute for Sport and Health, University College Dublin, Republic of Ireland. Forty-three female participants aged between 18 and 55 years. In all three groups, the %BF values estimated from the DW equation were closer to the criterion measure (i.e. ADP) than those estimated from the other equations. Of the three JPW equations, JPW₃ provided the most accurate estimation of %BF when compared with ADP in all three groups. In comparison to ADP, these findings suggest that the DW equation is the most accurate anthropometric method for the estimation of %BF in both normal-weight and overweight females.

Validation of a physical anthropology methodology using mandibles for gender estimation in a Brazilian population.

PubMed

Carvalho, Suzana Papile Maciel; Brito, Liz Magalhães; Paiva, Luiz Airton Saavedra de; Bicudo, Lucilene Arilho Ribeiro; Crosato, Edgard Michel; Oliveira, Rogério Nogueira de

2013-01-01

Validation studies of physical anthropology methods in the different population groups are extremely important, especially in cases in which the population variations may cause problems in the identification of a native individual by the application of norms developed for different communities. This study aimed to estimate the gender of skeletons by application of the method of Oliveira, et al. (1995), previously used in a population sample from Northeast Brazil. The accuracy of this method was assessed for a population from Southeast Brazil and validated by statistical tests. The method used two mandibular measurements, namely the bigonial distance and the mandibular ramus height. The sample was composed of 66 skulls and the method was applied by two examiners. The results were statistically analyzed by the paired t test, logistic discriminant analysis and logistic regression. The results demonstrated that the application of the method of Oliveira, et al. (1995) in this population achieved very different outcomes between genders, with 100% for females and only 11% for males, which may be explained by ethnic differences. However, statistical adjustment of measurement data for the population analyzed allowed accuracy of 76.47% for males and 78.13% for females, with the creation of a new discriminant formula. It was concluded that methods involving physical anthropology present high rate of accuracy for human identification, easy application, low cost and simplicity; however, the methodologies must be validated for the different populations due to differences in ethnic patterns, which are directly related to the phenotypic aspects. In this specific case, the method of Oliveira, et al. (1995) presented good accuracy and may be used for gender estimation in Brazil in two geographic regions, namely Northeast and Southeast; however, for other regions of the country (North, Central West and South), previous methodological adjustment is recommended as demonstrated in this study.

Validation of a continuous flow method for the determination of soluble iron in atmospheric dust and volcanic ash.

PubMed

Simonella, Lucio E; Gaiero, Diego M; Palomeque, Miriam E

2014-10-01

Iron is an essential micronutrient for phytoplankton growth and is supplied to the remote areas of the ocean mainly through atmospheric dust/ash. The amount of soluble Fe in dust/ash is a major source of uncertainty in modeling-Fe dissolution and deposition to the surface ocean. Currently in the literature, there exist almost as many different methods to estimate fractional solubility as researchers in the field, making it difficult to compare results between research groups. Also, an important constraint to evaluate Fe solubility in atmospheric dust is the limited mass of sample which is usually only available in micrograms to milligrams amounts. A continuous flow (CF) method that can be run with low mass of sediments (<10mg) was tested against a standard method which require about 1g of sediments (BCR of the European Union). For validation of the CF experiment, we run both methods using South American surface sediment and deposited volcanic ash. Both materials tested are easy eroded by wind and are representative of atmospheric dust/ash exported from this region. The uncertainty of the CF method was obtained from seven replicates of one surface sediment sample, and shows very good reproducibility. The replication was conducted on different days in a span of two years and ranged between 8 and 22% (i.e., the uncertainty for the standard method was 6-19%). Compared to other standardized methods, the CF method allows studies of dissolution kinetic of metals and consumes less reagents and time (<3h). The method validated here is suggested to be used as a standardized method for Fe solubility studies on dust/ash. Copyright © 2014 Elsevier B.V. All rights reserved.

Analytical method development and validation of spectrofluorimetric and spectrophotometric determination of some antimicrobial drugs in their pharmaceuticals.

PubMed

Ibrahim, F; Wahba, M E K; Magdy, G

2018-01-05

In this study, three novel, sensitive, simple and validated spectrophotometric and spectrofluorimetric methods have been proposed for estimation of some important antimicrobial drugs. The first two methods have been proposed for estimation of two important third-generation cephalosporin antibiotics namely, cefixime and cefdinir. Both methods were based on condensation of the primary amino group of the studied drugs with acetyl acetone and formaldehyde in acidic medium. The resulting products were measured by spectrophotometric (Method I) and spectrofluorimetric (Method II) tools. Regarding method I, the absorbance was measured at 315nm and 403nm with linearity ranges of 5.0-140.0 and 10.0-100.0μg/mL for cefixime and cefdinir, respectively. Meanwhile in method II, the produced fluorophore was measured at λ em 488nm or 491nm after excitation at λ ex 410nm with linearity ranges of 0.20-10.0 and 0.20-36.0μg/mL for cefixime and cefdinir, respectively. On the other hand, method III was devoted to estimate nifuroxazide spectrofluorimetrically depending on formation of highly fluorescent product upon reduction of the studied drug with Zinc powder in acidic medium. Measurement of the fluorescent product was carried out at λ em 335nm following excitation at λ ex 255nm with linearity range of 0.05 to 1.6μg/mL. The developed methods were subjected to detailed validation procedure, moreover they were used for the estimation of the concerned drugs in their pharmaceuticals. It was found that there is a good agreement between the obtained results and those obtained by the reported methods. Copyright © 2017 Elsevier B.V. All rights reserved.

Analytical method development and validation of spectrofluorimetric and spectrophotometric determination of some antimicrobial drugs in their pharmaceuticals

NASA Astrophysics Data System (ADS)

Ibrahim, F.; Wahba, M. E. K.; Magdy, G.

2018-01-01

In this study, three novel, sensitive, simple and validated spectrophotometric and spectrofluorimetric methods have been proposed for estimation of some important antimicrobial drugs. The first two methods have been proposed for estimation of two important third-generation cephalosporin antibiotics namely, cefixime and cefdinir. Both methods were based on condensation of the primary amino group of the studied drugs with acetyl acetone and formaldehyde in acidic medium. The resulting products were measured by spectrophotometric (Method I) and spectrofluorimetric (Method II) tools. Regarding method I, the absorbance was measured at 315 nm and 403 nm with linearity ranges of 5.0-140.0 and 10.0-100.0 μg/mL for cefixime and cefdinir, respectively. Meanwhile in method II, the produced fluorophore was measured at λem 488 nm or 491 nm after excitation at λex 410 nm with linearity ranges of 0.20-10.0 and 0.20-36.0 μg/mL for cefixime and cefdinir, respectively. On the other hand, method III was devoted to estimate nifuroxazide spectrofluorimetrically depending on formation of highly fluorescent product upon reduction of the studied drug with Zinc powder in acidic medium. Measurement of the fluorescent product was carried out at λem 335 nm following excitation at λex 255 nm with linearity range of 0.05 to 1.6 μg/mL. The developed methods were subjected to detailed validation procedure, moreover they were used for the estimation of the concerned drugs in their pharmaceuticals. It was found that there is a good agreement between the obtained results and those obtained by the reported methods.

Validated selective spectrophotometric methods for the kinetic determination of desloratidine in tablets and in the presence of its parent drug.

PubMed

Derayea, S M Sayed

2014-11-01

Two novel selective validated methods have been developed for analysis of desloratidine (DSL) in its tablets formulation. Both were kinetic spectrophotometric methods, depend on the interaction of the secondary amino group in DSL with acetaldehyde to give N-vinylpiperidyl product. The formed N-vinylpiperidyl compound was reacted with 2,3,5,6-tetrachloro-1,4-benzoquinone (chloranil) to form colored N-vinylpiperidyl-substituted benzoquinone derivatives. The formed blue-colored derivative was measured at 672 nm. The reaction conditions were carefully studied and all factors were optimized. The molar ratio between the reactants was estimated and a suggested reaction mechanism was presented. The analysis was carried out using initial rate and fixed time (at 6 min) methods. The linear concentration ranges were 3-50 and 10 - 60 μg mL-1 with limits of detection of 3.2 and 2.2 μg mL-1 for the initial rate and fixed time methods, respectively. ICH guidelines were applied for analytical performance validation of the proposed methods. The presence of common excipients in the pharmaceutical formulation did not produce any significant interference, as well as from loratadine, which is the parent compound of DSL. Different commercially available tablets formulations containing were successfully analyzed, with, the percentage recovery ranging from 97.28-100.90 ± 0.7 2-1.41%. The obtained results were compared statistically with the reported method results. The proposed methods have similar accuracy and precision as the reported as indicated from the F- and t-test data.

A Research-Inspired and Computer-Guided Clinical Interview for Mathematics Assessment: Introduction, Reliability and Validity

ERIC Educational Resources Information Center

Ginsburg, Herbert P.; Lee, Young-Sun; Pappas, Sandra

2016-01-01

Formative assessment involves the gathering of information that can guide the teaching of individual or groups of children. This approach requires a sound understanding of children's thinking and learning, as well as an effective method for gaining the information. We propose that formative assessment should employ a version of clinical…

An Overview of Addiction Research Center Inventory Scales (ARCI): An Appendix and Manual of Scales.

ERIC Educational Resources Information Center

Haertzen, C.A.

The Addiction Research Center Inventory is a 550 item multipurpose test measuring the broad range of physical, emotive, cognitive, and subjective effects of drugs. This manual provides technical information concerning 38 most valid scales, a quantitative method for characterizing the similarity of a profile of scores for the subject, group, or…

Assessing the Generalizability of Estimates of Causal Effects from Regression Discontinuity Designs

ERIC Educational Resources Information Center

Bloom, Howard S.; Porter, Kristin E.

2012-01-01

In recent years, the regression discontinuity design (RDD) has gained widespread recognition as a quasi-experimental method that when used correctly, can produce internally valid estimates of causal effects of a treatment, a program or an intervention (hereafter referred to as treatment effects). In an RDD study, subjects or groups of subjects…

A Profile Examination System for Physician Extenders and a Method for Curricular Prescription. Final Report.

ERIC Educational Resources Information Center

Smull, Ned W.; And Others

The basic purposes of the Profile Examination for Physician Extenders (PEPE) project included: (1) development of a computerized test item bank from which Profile Examinations could be generated, (2) review and analysis of curricula for the allied health groups, and (3) assessment of the reliability and validity of the Profile Examinations. The…

Using Self-Assessments to Detect Workshop Success: Do They Work?

ERIC Educational Resources Information Center

D'Eon, Marcel; Sadownik, Leslie; Harrison, Alexandra; Nation, Jill

2008-01-01

An accepted gold standard for measuring change in participant behavior is third-party observation. This method is highly resource intensive, and many small-scale evaluations may not be in a position to use this approach. This study was designed to assess the validity and reliably of aggregated group self-assessments as one way to measure workshop…

Validation of an asthma questionnaire for use in healthcare workers

PubMed Central

Delclos, G L; Arif, A A; Aday, L; Carson, A; Lai, D; Lusk, C; Stock, T; Symanski, E; Whitehead, L W; Benavides, F G; Antó, J M

2006-01-01

Background Previous studies have described increased occurrence of asthma among healthcare workers, but to our knowledge there are no validated survey questionnaires with which to study this occupational group. Aims To develop, validate, and refine a new survey instrument on asthma for use in epidemiological studies of healthcare workers. Methods An initial draft questionnaire, designed by a multidisciplinary team, used previously validated questions where possible; the occupational exposure section was developed by updating health services specific chemical lists through hospital walk‐through surveys and review of material safety data sheets. A cross‐sectional validation study was conducted in 118 non‐smoking subjects, who also underwent bronchial challenge testing, an interview with an industrial hygienist, and measurement of specific IgE antibodies to common aeroallergens. Results The final version consisted of 43 main questions in four sections. Time to completion of the questionnaire ranged from 13 to 25 minutes. Test–retest reliability of asthma and allergy items ranged from 75% to 94%, and internal consistency for these items was excellent (Cronbach's α ⩾ 0.86). Against methacholine challenge, an eight item combination of asthma related symptoms had a sensitivity of 71% and specificity of 70%; against a physician diagnosis of asthma, this same combination showed a sensitivity of 79% and specificity of 98%. Agreement between self‐reported exposures and industrial hygienist review was similar to previous studies and only moderate, indicating the need to incorporate more reliable methods of exposure assessment. Against the aerollergen panel, the best combinations of sensitivity and specificity were obtained for a history of allergies to dust, dust mite, and animals. Conclusions Initial evaluation of this new questionnaire indicates good validity and reliability, and further field testing and cross‐validation in a larger healthcare worker population is in progress. The need for development of more reliable occupational exposure assessment methods that go beyond self‐report is underscored. PMID:16497858

Derivation and Validation of the Surgical Site Infections Risk Model Using Health Administrative Data.

PubMed

van Walraven, Carl; Jackson, Timothy D; Daneman, Nick

2016-04-01

OBJECTIVE Surgical site infections (SSIs) are common hospital-acquired infections. Tracking SSIs is important to monitor their incidence, and this process requires primary data collection. In this study, we derived and validated a method using health administrative data to predict the probability that a person who had surgery would develop an SSI within 30 days. METHODS All patients enrolled in the National Surgical Quality Improvement Program (NSQIP) from 2 sites were linked to population-based administrative datasets in Ontario, Canada. We derived a multivariate model, stratified by surgical specialty, to determine the independent association of SSI status with patient and hospitalization covariates as well as physician claim codes. This SSI risk model was validated in 2 cohorts. RESULTS The derivation cohort included 5,359 patients with a 30-day SSI incidence of 6.0% (n=118). The SSI risk model predicted the probability that a person had an SSI based on 7 covariates: index hospitalization diagnostic score; physician claims score; emergency visit diagnostic score; operation duration; surgical service; and potential SSI codes. More than 90% of patients had predicted SSI risks lower than 10%. In the derivation group, model discrimination and calibration was excellent (C statistic, 0.912; Hosmer-Lemeshow [H-L] statistic, P=.47). In the 2 validation groups, performance decreased slightly (C statistics, 0.853 and 0.812; H-L statistics, 26.4 [P=.0009] and 8.0 [P=.42]), but low-risk patients were accurately identified. CONCLUSION Health administrative data can effectively identify postoperative patients with a very low risk of surgical site infection within 30 days of their procedure. Records of higher-risk patients can be reviewed to confirm SSI status.

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Development and pilot of an internationally standardized measure of cardiovascular risk management in European primary care

PubMed Central

2011-01-01

Background Primary care can play an important role in providing cardiovascular risk management in patients with established Cardiovascular Diseases (CVD), patients with a known high risk of developing CVD, and potentially for individuals with a low risk of developing CVD, but who have unhealthy lifestyles. To describe and compare cardiovascular risk management, internationally valid quality indicators and standardized measures are needed. As part of a large project in 9 European countries (EPA-Cardio), we have developed and tested a set of standardized measures, linked to previously developed quality indicators. Methods A structured stepwise procedure was followed to develop measures. First, the research team allocated 106 validated quality indicators to one of the three target populations (established CVD, at high risk, at low risk) and to different data-collection methods (data abstraction from the medical records, a patient survey, an interview with lead practice GP/a practice survey). Secondly, we selected a number of other validated measures to enrich the assessment. A pilot study was performed to test the feasibility. Finally, we revised the measures based on the findings. Results The EPA-Cardio measures consisted of abstraction forms from the medical-records data of established Coronary Heart Disease (CHD)-patients - and high-risk groups, a patient questionnaire for each of the 3 groups, an interview questionnaire for the lead GP and a questionnaire for practice teams. The measures were feasible and accepted by general practices from different countries. Conclusions An internationally standardized measure of cardiovascular risk management, linked to validated quality indicators and tested for feasibility in general practice, is now available. Careful development and pilot testing of the measures are crucial in international studies of quality of healthcare. PMID:21473758

Adaptation and cross-cultural validation of the United States Primary Care Assessment Tool (expanded version) for use in South Africa.

PubMed

Bresick, Graham; Sayed, Abdul-Rauf; le Grange, Cynthia; Bhagwan, Susheela; Manga, Nayna

2015-06-19

Measuring primary care is important for health sector reform. The Primary Care Assessment Tool (PCAT) measures performance of elements essential for cost-effective care. Following minor adaptations prior to use in Cape Town in 2011, a few findings indicated a need to improve the content and cross-cultural validity for wider use in South Africa (SA). This study aimed to validate the United States of America-developed PCAT before being used in a baseline measure of primary care performance prior to major reform. Public sector primary care clinics, users, practitioners and managers in urban and rural districts in the Western Cape Province. Face value evaluation of item phrasing and a combination of Delphi and Nominal Group Technique (NGT) methods with an expert panel and user focus group were used to obtain consensus on content relevant to SA. Original and new domains and items with > = 70% agreement were included in the South African version--ZA PCAT. All original PCAT domains achieved consensus on inclusion. One new domain, the primary healthcare (PHC) team, was added. Three of 95 original items achieved < 70% agreement, that is consensus to exclude as not relevant to SA; 19 new items were added. A few items needed minor rephrasing with local healthcare jargon. The demographic section was adapted to local socio-economic conditions. The adult PCAT was translated into isiXhosa and Afrikaans. The PCAT is a valid measure of primary care performance in SA. The PHC team domain is an important addition, given its emphasis in PHC re-engineering. A combination of Delphi and NGT methods succeeded in obtaining consensus on a multi-domain, multi-item instrument in a resource-constrained environment.

The validity of anthropometric leg muscle volume estimation across a wide spectrum: From able-bodied adults to individuals with a spinal cord injury

PubMed Central

Venturelli, Massimo; Jeong, Eun-Kee; Richardson, Russell S.

2014-01-01

The assessment of muscle volume, and changes over time, have significant clinical and research-related implications. Methods to assess muscle volume vary from simple and inexpensive to complex and expensive. Therefore this study sought to examine the validity of muscle volume estimated simply by anthropometry compared with the more complex proton magnetic resonance imaging (1H-MRI) across a wide spectrum of individuals including those with a spinal cord injury (SCI), a group recognized to exhibit significant muscle atrophy. Accordingly, muscle volume of the thigh and lower leg of eight subjects with a SCI and eight able-bodied subjects (controls) was determined by anthropometry and 1H-MRI. With either method, muscle volumes were significantly lower in the SCI compared with the controls (P < 0.05) and, using pooled data from both groups, anthropometric measurements of muscle volume were strongly correlated to the values assessed by 1H-MRI in both the thigh (r2 = 0.89; P < 0.05) and lower leg (r2 = 0.98; P < 0.05). However, the anthropometric approach systematically overestimated muscle volume compared with 1H-MRI in both the thigh (mean bias = 2407cm3) and the lower (mean bias = 170 cm3) leg. Thus with an appropriate correction for this systemic overestimation, muscle volume estimated from anthropometric measurements is a valid approach and provides acceptable accuracy across a spectrum of adults with normal muscle mass to a SCI and severe muscle atrophy. In practical terms this study provides the formulas that add validity to the already simple and inexpensive anthropometric approach to assess muscle volume in clinical and research settings. PMID:24458749