Field evaluation of roller integrated intelligent compaction monitoring : tech summary.

DOT National Transportation Integrated Search

2016-04-01

The objectives of the research were to: : 1. Demonstrate the value of RICM to accelerate construction, reduce re-work, and improve uniformity : of pavement layers. : 2. Evaluate the reliability and potential use of RICM data for acceptance and measur...

Test-retest reliability of jump execution variables using mechanography: a comparison of jump protocols.

PubMed

Fitzgerald, John S; Johnson, LuAnn; Tomkinson, Grant; Stein, Jesse; Roemmich, James N

2018-05-01

Mechanography during the vertical jump may enhance screening and determining mechanistic causes underlying physical performance changes. Utility of jump mechanography for evaluation is limited by scant test-retest reliability data on force-time variables. This study examined the test-retest reliability of eight jump execution variables assessed from mechanography. Thirty-two women (mean±SD: age 20.8 ± 1.3 yr) and 16 men (age 22.1 ± 1.9 yr) attended a familiarization session and two testing sessions, all one week apart. Participants performed two variations of the squat jump with squat depth self-selected and controlled using a goniometer to 80º knee flexion. Test-retest reliability was quantified as the systematic error (using effect size between jumps), random error (using coefficients of variation), and test-retest correlations (using intra-class correlation coefficients). Overall, jump execution variables demonstrated acceptable reliability, evidenced by small systematic errors (mean±95%CI: 0.2 ± 0.07), moderate random errors (mean±95%CI: 17.8 ± 3.7%), and very strong test-retest correlations (range: 0.73-0.97). Differences in random errors between controlled and self-selected protocols were negligible (mean±95%CI: 1.3 ± 2.3%). Jump execution variables demonstrated acceptable reliability, with no meaningful differences between the controlled and self-selected jump protocols. To simplify testing, a self-selected jump protocol can be used to assess force-time variables with negligible impact on measurement error.

Developing an Acceptability Assessment of Preventive Dental Treatments

PubMed Central

Hyde, Susan; Gansky, Stuart A.; Gonzalez-Vargas, Maria J.; Husting, Sheila R.; Cheng, Nancy F.; Millstein, Susan G.; Adams, Sally H.

2012-01-01

Objectives Early childhood caries (ECC) is very prevalent among young Hispanic children. ECC is amenable to a variety of preventive procedures, yet many Hispanic families underutilize dental services. Acceptability research may assist in health care planning and resource allocation by identifying patient preferences among efficacious treatments with the goal of improving their utilization. The purposes of this study were (a) to develop a culturally competent acceptability assessment instrument, directed toward the caregivers of young Hispanic children, for five preventive dental treatments for ECC and (b) to test the instrument's reliability and validity. Methods An instrument of five standard treatments known to prevent ECC was developed, translated, reviewed by focus groups, and pilot tested, then tested for reliability. The instrument included illustrated cards, brief video clips, and samples of the treatments and was culturally appropriate for low-income Hispanic caregivers. In addition to determining the acceptability of the five treatments individually, the treatments were also presented as paired comparisons. Results Focus groups and debriefing interviews following the pilot tests established that the instrument has good face validity. The illustrated cards, product samples, and video demonstrations of the five treatments resulted in an instrument possessing good content validity. The instrument has good to excellent test–retest reliability, with identical time 1–time 2 responses for each of the five treatments 92 percent of the time (range 87 to 97 percent), and the same treatment of the paired comparisons preferred 75 percent of the time (range 61 to 90 percent). Conclusions The acceptability instrument described is reliable and valid and may be useful in program planning efforts to identify and increase the utilization of preferred ECC preventive treatments for target populations. PMID:18662256

Developing an acceptability assessment of preventive dental treatments.

PubMed

Hyde, Susan; Gansky, Stuart A; Gonzalez-Vargas, Maria J; Husting, Sheila R; Cheng, Nancy F; Millstein, Susan G; Adams, Sally H

2009-01-01

Early childhood caries (ECC) is very prevalent among young Hispanic children. ECC is amenable to a variety of preventive procedures, yet many Hispanic families underutilize dental services. Acceptability research may assist in health care planning and resource allocation by identifying patient preferences among efficacious treatments with the goal of improving their utilization. The purposes of this study were (a) to develop a culturally competent acceptability assessment instrument, directed toward the caregivers of young Hispanic children, for five preventive dental treatments for ECC and (b) to test the instrument's reliability and validity. An instrument of five standard treatments known to prevent ECC was developed, translated, reviewed by focus groups, and pilot tested, then tested for reliability The instrument included illustrated cards, brief video clips, and samples of the treatments and was culturally appropriate for low-income Hispanic caregivers. In addition to determining the acceptability of the five treatments individually, the treatments were also presented as paired comparisons. Focus groups and debriefing interviews following the pilot tests established that the instrument has good face validity. The illustrated cards, product samples, and video demonstrations of the five treatments resulted in an instrument possessing good content validity. The instrument has good to excellent test-retest reliability, with identical time 1-time 2 responses for each of the five treatments 92 percent of the time (range 87 to 97 percent), and the same treatment of the paired comparisons preferred 75 percent of the time (range 61 to 90 percent). The acceptability instrument described is reliable and valid and may be useful in program planning efforts to identify and increase the utilization of preferred ECC preventive treatments for target populations.

Development and implementation of the Structured Training Trainer Assessment Report (STTAR) in the English National Training Programme for laparoscopic colorectal surgery.

PubMed

Wyles, Susannah M; Miskovic, Danilo; Ni, Zhifang; Darzi, Ara W; Valori, Roland M; Coleman, Mark G; Hanna, George B

2016-03-01

There is a lack of educational tools available for surgical teaching critique, particularly for advanced laparoscopic surgery. The aim was to develop and implement a tool that assesses training quality and structures feedback for trainers in the English National Training Programme for laparoscopic colorectal surgery. Semi-structured interviews were performed and analysed, and items were extracted. Through the Delphi process, essential items pertaining to desirable trainer characteristics, training structure and feedback were determined. An assessment tool (Structured Training Trainer Assessment Report-STTAR) was developed and tested for feasibility, acceptability and educational impact. Interview transcripts (29 surgical trainers, 10 trainees, four educationalists) were analysed, and item lists created and distributed for consensus opinion (11 trainers and seven trainees). The STTAR consisted of 64 factors, and its web-based version, the mini-STTAR, included 21 factors that were categorised into four groups (training structure, training behaviour, trainer attributes and role modelling) and structured around a training session timeline (beginning, middle and end). The STTAR (six trainers, 48 different assessments) demonstrated good internal consistency (α = 0.88) and inter-rater reliability (ICC = 0.75). The mini-STTAR demonstrated good inter-item reliability (α = 0.79) and intra-observer reliability on comparison of 85 different trainer/trainee combinations (r = 0.701, p = <0.001). Both were found to be feasible and acceptable. The educational report for trainers was found to be useful (4.4 out of 5). An assessment tool that evaluates training quality was developed and shown to be reliable, acceptable and of educational value. It has been successfully implemented into the English National Training Programme for laparoscopic colorectal surgery.

PEM-INST-001: Instructions for Plastic Encapsulated Microcircuit (PEM) Selection, Screening, and Qualification

NASA Technical Reports Server (NTRS)

Teverovsky, Alexander; Sahu, Kusum

2003-01-01

Potential users of plastic encapsulated microcircuits (PEMs) need to be reminded that unlike the military system of producing robust high-reliability microcircuits that are designed to perform acceptably in a variety of harsh environments, PEMs are primarily designed for use in benign environments where equipment is easily accessed for repair or replacement. The methods of analysis applied to military products to demonstrate high reliability cannot always be applied to PEMs. This makes it difficult for users to characterize PEMs for two reasons: 1. Due to the major differences in design and construction, the standard test practices used to ensure that military devices are robust and have high reliability often cannot be applied to PEMs that have a smaller operating temperature range and are typically more frail and susceptible to moisture absorption. In contrast, high-reliability military microcircuits usually utilize large, robust, high-temperature packages that are hermetically sealed. 2. Unlike the military high-reliability system, users of PEMs have little visibility into commercial manufacturers proprietary design, materials, die traceability, and production processes and procedures. There is no central authority that monitors PEM commercial product for quality, and there are no controls in place that can be imposed across all commercial manufacturers to provide confidence to high-reliability users that a common acceptable level of quality exists for all PEMs manufacturers. Consequently, there is no guaranteed control over the type of reliability that is built into commercial product, and there is no guarantee that different lots from the same manufacturer are equally acceptable. And regarding application, there is no guarantee that commercial products intended for use in benign environments will provide acceptable performance and reliability in harsh space environments. The qualification and screening processes contained in this document are intended to detect poor-quality lots and screen out early random failures from use in space flight hardware. However, since it cannot be guaranteed that quality was designed and built into PEMs that are appropriate for space applications, users cannot screen in quality that may not exist. It must be understood that due to the variety of materials, processes, and technologies used to design and produce PEMs, this test process may not accelerate and detect all failure mechanisms. While the tests herein will increase user confidence that PEMs with otherwise unknown reliability can be used in space environments, such testing may not guarantee the same level of reliability offered by military microcircuits. PEMs should only be used where due to performance needs there are no alternatives in the military high-reliability market, and projects are willing to accept higher risk.

77 FR 24556 - Waiver of Acceptable Risk Restriction for Launch and Reentry

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-24

... designed to stimulate efforts by the private sector to demonstrate safe, reliable, and cost-effective space... ensure safe approach and berthing with the International Space Station, utilizing considerable fuel. In... economic growth and entrepreneurial activity through use of the space environment; (2) to encourage the...

A Case Study for Probabilistic Methods Validation (MSFC Center Director's Discretionary Fund, Project No. 94-26)

NASA Technical Reports Server (NTRS)

Price J. M.; Ortega, R.

1998-01-01

Probabilistic method is not a universally accepted approach for the design and analysis of aerospace structures. The validity of this approach must be demonstrated to encourage its acceptance as it viable design and analysis tool to estimate structural reliability. The objective of this Study is to develop a well characterized finite population of similar aerospace structures that can be used to (1) validate probabilistic codes, (2) demonstrate the basic principles behind probabilistic methods, (3) formulate general guidelines for characterization of material drivers (such as elastic modulus) when limited data is available, and (4) investigate how the drivers affect the results of sensitivity analysis at the component/failure mode level.

Artificial pancreas (AP) clinical trial participants' acceptance of future AP technology.

PubMed

Bevier, Wendy C; Fuller, Serena M; Fuller, Ryan P; Rubin, Richard R; Dassau, Eyal; Doyle, Francis J; Jovanovič, Lois; Zisser, Howard C

2014-09-01

Artificial pancreas (AP) systems are currently an active field of diabetes research. This pilot study examined the attitudes of AP clinical trial participants toward future acceptance of the technology, having gained firsthand experience. After possible influencers of AP technology adoption were considered, a 34-question questionnaire was developed. The survey assessed current treatment satisfaction, dimensions of clinical trial participant motivation, and variables of the technology acceptance model (TAM). Forty-seven subjects were contacted to complete the survey. The reliability of the survey scales was tested using Cronbach's α. The relationship of the factors to the likelihood of AP technology adoption was explored using regression analysis. Thirty-six subjects (76.6%) completed the survey. Of the respondents, 86.1% were either highly likely or likely to adopt the technology once available. Reliability analysis of the survey dimensions revealed good internal consistency, with scores of >0.7 for current treatment satisfaction, convenience (motivation), personal health benefit (motivation), perceived ease of use (TAM), and perceived usefulness (TAM). Linear modeling showed that future acceptance of the AP was significantly associated with TAM and the motivation variables of convenience plus the individual item benefit to others (R(2)=0.26, P=0.05). When insulin pump and continuous glucose monitor use were added, the model significance improved (R(2)=0.37, P=0.02). This pilot study demonstrated that individuals with direct AP technology experience expressed high likelihood of future acceptance. Results support the factors of personal benefit, convenience, perceived usefulness, and perceived ease of use as reliable scales that suggest system adoption in this highly motivated patient population.

Non-Technical Skills for Surgeons (NOTSS): Critical appraisal of its measurement properties.

PubMed

Jung, James J; Borkhoff, Cornelia M; Jüni, Peter; Grantcharov, Teodor P

2018-02-17

To critically appraise the development and measurement properties, including sensibility, reliability, and validity of the Non-Technical Skills of Surgeons (NOTSS) system. Articles that described development process of the NOTSS system were identified. Relevant primary studies that presented evidence of reliability and validity were identified through a comprehensive literature review. NOTSS was developed through robust item generation and reduction strategies. It was shown to have good content validity, acceptability, and feasibility. Inter-rater reliability increased with greater expertise and number of assessors. Studies demonstrated evidence of cross-sectional construct validity, in that the tool was able to differentiate known groups of varied non-technical skill levels. Evidence of longitudinal construct validity also existed to demonstrate that NOTSS detected changes in non-technical skills before and after targeted training. In populations and settings presented in our critical appraisal, NOTSS provided reliable and valid measurements of intraoperative non-technical skills of surgeons. Copyright © 2018 Elsevier Inc. All rights reserved.

Reliability and criterion validity of an observation protocol for working technique assessments in cash register work.

PubMed

Palm, Peter; Josephson, Malin; Mathiassen, Svend Erik; Kjellberg, Katarina

2016-06-01

We evaluated the intra- and inter-observer reliability and criterion validity of an observation protocol, developed in an iterative process involving practicing ergonomists, for assessment of working technique during cash register work for the purpose of preventing upper extremity symptoms. Two ergonomists independently assessed 17 15-min videos of cash register work on two occasions each, as a basis for examining reliability. Criterion validity was assessed by comparing these assessments with meticulous video-based analyses by researchers. Intra-observer reliability was acceptable (i.e. proportional agreement >0.7 and kappa >0.4) for 10/10 questions. Inter-observer reliability was acceptable for only 3/10 questions. An acceptable inter-observer reliability combined with an acceptable criterion validity was obtained only for one working technique aspect, 'Quality of movements'. Thus, major elements of the cashiers' working technique could not be assessed with an acceptable accuracy from short periods of observations by one observer, such as often desired by practitioners. Practitioner Summary: We examined an observation protocol for assessing working technique in cash register work. It was feasible in use, but inter-observer reliability and criterion validity were generally not acceptable when working technique aspects were assessed from short periods of work. We recommend the protocol to be used for educational purposes only.

Connectedness among Taiwanese Middle School Students: A Validation Study of the Hemingway Measure of Adolescent Connectedness.

ERIC Educational Resources Information Center

Karcher, Michael J.; Lee, Yun

2002-01-01

Examines the psychometric properties of the Hemingway Measure of Adolescent Connectedness among 320 Taiwanese junior high school students. Finds that connectedness measure subscales and composite scales demonstrated acceptable reliability and concurrent validity. Also finds, among other things, that girls report more connectedness to school than…

The reliability of WorkWell Systems Functional Capacity Evaluation: a systematic review

PubMed Central

2014-01-01

Background Functional capacity evaluation (FCE) determines a person’s ability to perform work-related tasks and is a major component of the rehabilitation process. The WorkWell Systems (WWS) FCE (formerly known as Isernhagen Work Systems FCE) is currently the most commonly used FCE tool in German rehabilitation centres. Our systematic review investigated the inter-rater, intra-rater and test-retest reliability of the WWS FCE. Methods We performed a systematic literature search of studies on the reliability of the WWS FCE and extracted item-specific measures of inter-rater, intra-rater and test-retest reliability from the identified studies. Intraclass correlation coefficients ≥ 0.75, percentages of agreement ≥ 80%, and kappa coefficients ≥ 0.60 were categorised as acceptable, otherwise they were considered non-acceptable. The extracted values were summarised for the five performance categories of the WWS FCE, and the results were classified as either consistent or inconsistent. Results From 11 identified studies, 150 item-specific reliability measures were extracted. 89% of the extracted inter-rater reliability measures, all of the intra-rater reliability measures and 96% of the test-retest reliability measures of the weight handling and strength tests had an acceptable level of reliability, compared to only 67% of the test-retest reliability measures of the posture/mobility tests and 56% of the test-retest reliability measures of the locomotion tests. Both of the extracted test-retest reliability measures of the balance test were acceptable. Conclusions Weight handling and strength tests were found to have consistently acceptable reliability. Further research is needed to explore the reliability of the other tests as inconsistent findings or a lack of data prevented definitive conclusions. PMID:24674029

Development and validation of the Female Sexual Function Index adaptation for breast cancer patients (FSFI-BC).

PubMed

Bartula, Iris; Sherman, Kerry A

2015-08-01

Sexual dysfunction following breast cancer treatment is common and screening for this is recommended. This study determined the reliability, validity, and acceptability of a breast cancer-specific adaptation of the Female Sexual Function Index, the FSFI-BC. This new measure addresses limitations in the FSFI when assessing sexual dysfunction of women with breast cancer regarding applicability to non-sexually active women, measuring distress and changes after cancer. Female breast cancer survivors (n = 596; 429 sexually active, 166 non-sexually active) completed an online survey including demographic/medical information, the FSFI-BC, and scales measuring sexual functioning, fatigue, body image, physical and mental health, and relationship adjustment (Time 1). Three weeks later, 326 women (245 sexually active; 81 non-sexually active) completed the Time 2 survey including the FSFI-BC, and questions regarding its acceptability and perceived change in sexual functioning. Reliability, construct validity, and acceptability were examined using standard scale validation techniques. Exploratory factor analysis delineated seven factors: Changes after cancer, desire/arousal, lubrication, orgasm, pain, satisfaction, and distress, accounting for 79.98 % (sexually active) and 77.19 % (non-active) variance in responses. Acceptable internal consistencies (non-active: α = 0.71-0.96; sexually active: α = 0.89-0.96) and test-retest reliabilities (non-active: r = 0.63-0.86; sexually active: r = 0.71-0.88) were evident. Inter-scale correlations provided evidence for convergent and divergent validities of the FSFI-BC. Both sexually active and non-active women provided positive feedback about the FSFI-BC. The optional partner questions demonstrated clinical utility. With desirable psychometric properties and acceptability to participants, the FSFI-BC is suitable for screening for sexual dysfunction in women with breast cancer.

The interrater and intrarater reliability of the Philpott-Javer staging system based on level of training.

PubMed

Parhar, Harman S; Thamboo, Andrew; Habib, Al-Rahim; Chang, Brent; Gan, Eng Cern; Javer, Amin R

2014-04-01

The Philpott-Javer postoperative endoscopic mucosal staging system for allergic fungal rhinosinusitis has previously demonstrated acceptable interrater reliability among rhinologists. There are, however, numerous learners involved in patient care at tertiary centers. This study aims to analyze the interrater and intrarater reliability of this system among learners in otolaryngology at different stages in training. A prospective analysis of retrospectively collected endoscopic photographs. A tertiary care teaching hospital (January 2013). Fifty patients undergoing routine follow-up. Three photographs from each of 50 patients undergoing routine postsurgical nasoendoscopy were reviewed. Images were played twice, 1 week apart, in 2 differently randomized cycles and scored according to Philpott-Javer criteria by a rhinologist, a rhinology fellow, a senior otolaryngology resident, a junior otolaryngology resident, and a medical student. Interobserver reliability was assessed using the intraclass correlation coefficient, while intrarater reliability was assessed by Shrout-Fleiss κ values. Agreement between each learner and the rhinologist was also assessed using κ values. The interclass correlation among the 5 raters was 0.7600 (95% confidence interval, 0.6917-0.8161) for the Philpott-Javer scoring system, suggesting substantial reliability. Intrarater data showed substantial to almost-perfect reliability (κ values between 0.668 and 0.815) among all raters using this system. There was also moderate to substantial agreement between the learners and the rhinologist (κ values between 0.534 and 0.710). Results suggest that the Philpott-Javer staging system has acceptable intrarater and interrater reliability among learners of differing levels of clinical experience and is suitable for evaluating progress following surgery.

Reliability and acceptability of six station multiple mini-interviews: past-behavioural versus situational questions in postgraduate medical admission.

PubMed

Yamada, Toru; Sato, Juichi; Yoshimura, Hiroshi; Okubo, Tomoya; Hiraoka, Eiji; Shiga, Takashi; Kubota, Tadao; Fujitani, Shigeki; Machi, Junji; Ban, Nobutaro

2017-03-16

The multiple mini-interview (MMI) is increasingly used for postgraduate medical admissions and in undergraduate settings. MMIs use mostly Situational Questions (SQs) rather than Past-Behavioural Questions (PBQs). A previous study of MMIs in this setting, where PBQs and SQs were asked in the same order, reported that the reliability of PBQs was non-inferior to SQs and that SQs were more acceptable to candidates. The order in which the questions are asked may affect reliability and acceptability of an MMI. This study investigated the reliability of an MMI using both PBQs and SQs, minimising question order bias. Acceptability of PBQs and SQs was also assessed. Forty candidates applying for a postgraduate medical admission for 2016-2017 were included; 24 examiners were used. The MMI consisted of six stations with one examiner per station; a PBQ and a SQ were asked at every station, and the order of questions was alternated between stations. Reliability was analysed for scores obtained for PBQs or SQs separately, and for both questions. A post-MMI survey was used to assess the acceptability of PBQs and SQs. The generalisability (G) coefficients for PBQs only, SQs only, and both questions were 0.87, 0.96, and 0.80, respectively. Decision studies suggested that a four-station MMI would also be sufficiently reliable (G-coefficients 0.82 and 0.94 for PBQs and SQs, respectively). In total, 83% of participants were satisfied with the MMI. In terms of face validity, PBQs were more acceptable than SQs for candidates (p = 0.01), but equally acceptable for examiners (88% vs. 83% positive responses for PBQs vs. SQs; p = 0.377). Candidates preferred PBQs to SQs when asked to choose one, though this difference was not significant (p = 0.081); examiners showed a clear preference for PBQs (p = 0.007). Reliability and acceptability of six-station MMI were good among 40 postgraduate candidates; modelling suggested that four stations would also be reliable. SQs were more reliable than PBQs. Candidates found PBQs more acceptable than SQs and examiners preferred PBQs when they had to choose between the two. Our findings suggest that it is better to ask both PBQs and SQs during an MMI to maximise acceptability.

The Validation of the Interpersonal Reactivity Index for Chinese Teachers from Primary and Middle Schools

ERIC Educational Resources Information Center

Huang, Xiaozhong; Li, Weijian; Sun, Binghai; Chen, Haide; Davis, Mark H.

2012-01-01

Psychometric properties of the Chinese version of Interpersonal Reactivity Index (C-IRI) were examined in a sample of 930 teachers in China. The subscales of the C-IRI demonstrated acceptable to good internal consistency and test-retest reliability. Exploratory and confirmatory factor analyses revealed a stable four-factor structure across three…

[Acceptance of tinnitus: Validation of the ‛Akzeptanzfragebogen bei chronischem Tinnitus' (AFCT)].

PubMed

Riedl, D; Rumpold, G; Schmidt, A; Bliem, H R; Moschen, R

2014-12-01

Tinnitus is a widely spread symptom, which is perceived chronically by approximately 10% of the population. The vast majority of the tinnitus patients doesn´t feel impaired through the ear noise, but about 5-30% of the tinnitus patient are suffering in their everyday life. Whether severe distress is experienced cannot be explained by the quality of the ear noise itself (i. e. loudness or duration). Newer research tends to explain the difference in the experienced strain by the concept of acceptance. The aim of this study was to analyze the psychometric quality of a German Version of the "Chronic Pain Acceptance Ques-tionnaire" (CPAQ), namely the "Akzeptanzfragebogen bei chronischem Tinnitus" (AFCT) which has been adapted for tinnitus. 97 patients with chronic tinnitus have been tested at the start of an outpatient tinnitus group therapy. The following questionnaires were used: "Akzeptanzfragebogen bei chronischem Tinnitus" (AFCT) and "Tinnitusfragebogen" (TF). The structure of the AFCT was determined by a factor analysis. The reliability was evaluated by the estimation of the internal consistency (Cronbach Alpha). Due to psychometric weakness and unclear factorial loadings 8 items have been removed. Out of the remaining 12 items the AFCT-12 has been developed. The AFCT-12 consists of 2 factors, which explain a variance of 54.9%. Both AFCT-12 and AFCT have a satisfactory reliability and validity. The results demonstrate that the AFCT-12 is a reliable and valid instrument to measure the acceptance of patients suffering from chronic tinnitus. © Georg Thieme Verlag KG Stuttgart · New York.

Development and validation of the brief esophageal dysphagia questionnaire.

PubMed

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

Development and Validation of the Brief Esophageal Dysphagia Questionnaire

PubMed Central

Taft, Tiffany H.; Riehl, Megan; Sodikoff, Jamie B.; Kahrilas, Peter J.; Keefer, Laurie; Doerfler, Bethany; Pandolfino, John E.

2017-01-01

Background Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. Methods 1,638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. Key Results The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. Conclusions & Inferences The BEDQ represents a rapid, reliable and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. PMID:27380834

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

The Chinese-version of the CARE Measure reliably differentiates between doctors in primary care: a cross-sectional study in Hong Kong

PubMed Central

2011-01-01

Background The Consultation and Relational Empathy (CARE) Measure is a widely used patient-rated experience measure which has recently been translated into Chinese and has undergone preliminary qualitative and quantitative validation. The objective of this study was to determine the reliability of the Chinese-version of the CARE Measure in reliably differentiating between doctors in a primary care setting in Hong Kong Methods Data were collected from 984 primary care patients attending 20 doctors with differing levels of training in family medicine in 5 public clinics in Hong Kong. The acceptability of the Chinese-CARE measure to patients was assessed. The reliability of the measure in discriminating effectively between doctors was analysed by Generalisability-theory (G-Theory) Results The items in the Chinese-CARE measure were regarded as important by patients and there were few 'not applicable' responses. The measure showed high internal reliability (coefficient 0.95) and effectively differentiated between doctors with only 15-20 patient ratings per doctor (inter-rater reliability > 0.8). Doctors' mean CARE measure scores varied widely, ranging from 24.1 to 45.9 (maximum possible score 50) with a mean of 34.6. CARE Measure scores were positively correlated with level of training in family medicine (Spearman's rho 0.493, p < 0.05). Conclusion These data demonstrate the acceptability, feasibility and reliability of using the Chinese-CARE Measure in primary care in Hong Kong to differentiate between doctors interpersonal competencies. Training in family medicine appears to enhance these key interpersonal skills. PMID:21631927

Parent-reported social support for child's fruit and vegetable intake: validity of measures.

PubMed

Dave, Jayna M; Evans, Alexandra E; Condrasky, Marge D; Williams, Joel E

2012-01-01

To develop and validate measures of parental social support to increase their child's fruit and vegetable (FV) consumption. Cross-sectional study design. School and home. Two hundred three parents with at least 1 elementary school-aged child. Parents completed a questionnaire that included instrumental social support scale (ISSPS), emotional social support scale (ESSPS), household FV availability and accessibility index, and demographics. Exploratory factor analysis with promax rotation was conducted to obtain the psychometric properties of ISSPS and ESSPS. Internal consistency and test-retest reliabilities were also assessed. Factor analysis indicated a 4-factor model for ESSPS: positive encouragement, negative role modeling, discouragement, and an item cluster called reinforcement. Psychometric properties indicated that ISSPS performed best as independent single scales with α = .87. Internal consistency reliabilities were acceptable, and test-retest reliabilities ranged from low to acceptable. Correlations between scales, subscales, and item clusters were significant (P < .05). In addition, ISSPS and the positive encouragement subscale were significantly correlated with household FV availability. The ISSPS and ESSPS subscales demonstrated good internal consistency reliability and are suitable for impact assessment of an intervention designed to target parents to help their children eat more fruit and vegetables. Copyright © 2012 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Quantifying beliefs regarding telehealth: Development of the Whole Systems Demonstrator Service User Technology Acceptability Questionnaire.

PubMed

Hirani, Shashivadan P; Rixon, Lorna; Beynon, Michelle; Cartwright, Martin; Cleanthous, Sophie; Selva, Abi; Sanders, Caroline; Newman, Stanton P

2017-05-01

Introduction Telehealth (TH) is a potential solution to the increased incidence of chronic illness in an ageing population. The extent to which older people and users with chronic conditions accept and adhere to using assistive technologies is a potential barrier to mainstreaming the service. This study reports the development and validation of the Whole Systems Demonstrator (WSD) Service User Technology Acceptability Questionnaire (SUTAQ). Methods Questionnaires measuring the acceptability of TH, quality of life, well-being and psychological processes were completed by 478 users of TH. The 22 acceptability items were subject to principal components analysis (PCA) to determine sub-scales. Scale scores, relationships between scales and other patient-reported outcome measures (PROMs), and group differences on scales were utilised to check the reliability and validity of the measure. Results PCAs of SUTAQ items produced six TH acceptability scales: enhanced care, increased accessibility, privacy and discomfort, care personnel concerns, kit as substitution and satisfaction. Significant correlations within these beliefs and between these scales and additional PROMs were coherent, and the SUTAQ sub-scales were able to predict those more likely to refuse TH. Discussion The SUTAQ is an instrument that can be used to measure user beliefs about the acceptability of TH, and has the ability to discriminate between groups and predict individual differences in beliefs and behaviour. Measuring acceptability beliefs of TH users can provide valuable information to direct and target provision of services to increase uptake and maintain use of TH.

76 FR 38459 - Surety Companies Acceptable on Federal Bonds; Termination American Reliable Insurance Company

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-30

... DEPARTMENT OF THE TREASURY Fiscal Service Surety Companies Acceptable on Federal Bonds; Termination American Reliable Insurance Company AGENCY: Fiscal Service, Department of the Treasury, Financial... of Authority issued by the Treasury to American Reliable Insurance Company (NAIC 19615) under 31 U.S...

76 FR 45252 - Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-28

... DEPARTMENT OF ENERGY Federal Energy Regulatory Commission [Project No. 14125-000] Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and Soliciting Comments, Motions To Intervene, and Competing Applications On March 25, 2011, Reliable Storage 1 LLC, filed an...

76 FR 45251 - Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-28

... DEPARTMENT OF ENERGY Federal Energy Regulatory Commission [Project No. 14121-000] Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and Soliciting Comments, Motions To Intervene, and Competing Applications On March 25, 2011, Reliable Storage 1 LLC, filed an...

76 FR 45252 - Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-28

... DEPARTMENT OF ENERGY Federal Energy Regulatory Commission [Project No. 14122-000] Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and Soliciting Comments, Motions To Intervene, and Competing Applications On March 25, 2011, Reliable Storage 1 LLC, filed an...

76 FR 45251 - Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-28

... DEPARTMENT OF ENERGY Federal Energy Regulatory Commission [Project No. 14124-000] Reliable Storage 1 LLC; Notice of Preliminary Permit Application Accepted for Filing and Soliciting Comments, Motions To Intervene, and Competing Applications On March 25, 2011, Reliable Storage 1 LLC, filed an...

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

Validation of the German revised version of the program in palliative care education and practice questionnaire (PCEP-GR).

PubMed

Fetz, Katharina; Wenzel-Meyburg, Ursula; Schulz-Quach, Christian

2017-12-28

The evaluation of the effectiveness of undergraduate palliative care education (UPCE) programs is an essential foundation to providing high-quality UPCE programs. Therefore, the implementation of valid evaluation tools is indispensable. Until today, there has been no general consensus regarding concrete outcome parameters and their accurate measurement. The Program in Palliative Care Education and Practice Questionnaire (German Revised Version; PCEP-GR) is a promising assessment tool for UPCE. The aim of the current study was to evaluate the psychometric properties of PCEP-GR and to demonstrate its feasibility for the evaluation of UPCE programs. The practical feasibility of the PCEP-GR and its acceptance in medical students were investigated in a pilot study with 24 undergraduate medical students at Heinrich Heine University Dusseldorf, Germany. Subsequently, the PCEP-GR was surveyed in a representative sample (N = 680) of medical students in order to investigate its psychometric properties. Factorial validity was investigated by means of principal component analysis (PCA). Reliability was examined by means of split-half-reliability analysis and analysis of internal consistency. After taking into consideration the PCA and distribution analysis results, an evaluation instruction for the PCEP-GR was developed. The PCEP-GR proved to be feasible and well-accepted in medical students. PCA revealed a four-factorial solution indicating four PCEP-GR subscales: preparation to provide palliative care, attitudes towards palliative care, self-estimation of competence in communication with dying patients and their relatives and self-estimation of knowledge and skills in palliative care. The PCEP-GR showed good split-half-reliability and acceptable to good internal consistency of subscales. Attitudes towards palliative care slightly missed the criterion of acceptable internal consistency. The evaluation instruction suggests a global PCEP-GR index and four subscales. The PCEP-GR has proven to be a feasible, economic, valid and reliable tool for the assessment of UPCE that comprises self-efficacy expectation and relevant attitudes towards palliative care.

Validation of the cardiac health behavior scale for Korean adults with cardiovascular risks or diseases.

PubMed

Song, Rhayun; Oh, Hyunkyoung; Ahn, Sukhee; Moorhead, Sue

2018-02-01

The purpose of this study was to validate the Cardiac Health Behavior Scale for Korean adults (CHB-K) to determine its validity and reliability. Cardiovascular diseases (CVDs) are one of the most important chronic diseases due to their high prevalence and mortality rates. Patients with cardiovascular risks or diseases need to perform appropriate cardiac health behaviors that help to prevent the progression of the disease and improve their health status. This secondary analysis obtained data from two clinical trials of cardiac rehabilitation. Data from 298 patients with cardiovascular risks or diseases were analyzed for validation. Data analyses included correlation coefficients, t-tests, and exploratory and confirmatory factor analyses using SPSS (version WIN 22.0) and AMOS (version 20.0). The Self-Efficacy Scale was used to assess convergent validity, while reliability was assessed using Cronbach's alpha coefficients. Five main factors were verified: health responsibility, physical activity, diet habit (eating habit and food choice), stress management, and smoking cessation. A set of 21 items from the 25-item scale was verified after performing item analysis, factor analyses, and critical evaluation of the statistical results. The 21-item CHB-K (CHB-K21) exhibited acceptable validity, and the model of the CHB-K21 provided a good fit to the data. Most of the factors were found to be moderately correlated with SES scores (r=0.45-0.52, p<0.001). The CHB-K21 also demonstrated acceptable reliability (Cronbach's alpha=0.83). The CHB-K21 demonstrates strong validity and reliability. It can be used to assess cardiac health behaviors in Korean adults with cardiovascular risks or diseases. Copyright © 2017 Elsevier Inc. All rights reserved.

Japanese Adaptation of the Stroke and Aphasia Quality of Life Scale-39 (SAQOL-39): Comparative Study among Different Types of Aphasia.

PubMed

Kamiya, Akane; Kamiya, Kentaro; Tatsumi, Hiroshi; Suzuki, Makihiko; Horiguchi, Satoshi

2015-11-01

We have developed a Japanese version of the Stroke and Aphasia Quality of Life Scale-39 (SAQOL-39), designated as SAQOL-39-J, and used psychometric methods to examine its acceptability and reliability. The acceptability and reliability of SAQOL-39-J, which was developed from the English version using a standard translation and back-translation method, were examined in 54 aphasia patients using standard psychometric methods. The acceptability and reliability of SAQOL-39-J were then compared among patients with different types of aphasia. SAQOL-39-J showed good acceptability, internal consistency (Cronbach's α score = .90), and test-retest reliability (intraclass correlation coefficient = .97). Broca's aphasia patients showed the lowest total scores and communication scores on SAQOL-39-J. The Japanese version of SAQOL-39, SAQOL-39-J, provides acceptable and reliable data in Japanese stroke patients with aphasia. Among different types of aphasia, Broca's aphasia patients had the lowest total and communication SAQOL-39-J scores. Further studies are needed to assess the effectiveness of health care interventions on health-related quality of life in this population. Copyright © 2015 National Stroke Association. Published by Elsevier Inc. All rights reserved.

The Surgeons' Leadership Inventory (SLI): a taxonomy and rating system for surgeons' intraoperative leadership skills.

PubMed

Henrickson Parker, Sarah; Flin, Rhona; McKinley, Aileen; Yule, Steven

2013-06-01

Surgeons must demonstrate leadership to optimize performance and maximize patient safety in the operating room, but no behavior rating tool is available to measure leadership. Ten focus groups with members of the operating room team discussed surgeons' intraoperative leadership. Surgeons' leadership behaviors were extracted and used to finalize the Surgeons' Leadership Inventory (SLI), which was checked by surgeons (n = 6) for accuracy and face validity. The SLI was used to code video recordings (n = 5) of operations to test reliability. Eight elements of surgeons' leadership were included in the SLI: (1) maintaining standards, (2) managing resources, (3) making decisions, (4) directing, (5) training, (6) supporting others, (7) communicating, and (8) coping with pressure. Interrater reliability to code videos of surgeons' behaviors while operating using this tool was acceptable (κ = .70). The SLI is empirically grounded in focus group data and both the leadership and surgical literature. The interrater reliability of the system was acceptable. The inventory could be used for rating surgeons' leadership in the operating room for research or as a basis for postoperative feedback on performance. Copyright © 2013 Elsevier Inc. All rights reserved.

Validity and Reliability of the 8-Item Work Limitations Questionnaire.

PubMed

Walker, Timothy J; Tullar, Jessica M; Diamond, Pamela M; Kohl, Harold W; Amick, Benjamin C

2017-12-01

Purpose To evaluate factorial validity, scale reliability, test-retest reliability, convergent validity, and discriminant validity of the 8-item Work Limitations Questionnaire (WLQ) among employees from a public university system. Methods A secondary analysis using de-identified data from employees who completed an annual Health Assessment between the years 2009-2015 tested research aims. Confirmatory factor analysis (CFA) (n = 10,165) tested the latent structure of the 8-item WLQ. Scale reliability was determined using a CFA-based approach while test-retest reliability was determined using the intraclass correlation coefficient. Convergent/discriminant validity was tested by evaluating relations between the 8-item WLQ with health/performance variables for convergent validity (health-related work performance, number of chronic conditions, and general health) and demographic variables for discriminant validity (gender and institution type). Results A 1-factor model with three correlated residuals demonstrated excellent model fit (CFI = 0.99, TLI = 0.99, RMSEA = 0.03, and SRMR = 0.01). The scale reliability was acceptable (0.69, 95% CI 0.68-0.70) and the test-retest reliability was very good (ICC = 0.78). Low-to-moderate associations were observed between the 8-item WLQ and the health/performance variables while weak associations were observed between the demographic variables. Conclusions The 8-item WLQ demonstrated sufficient reliability and validity among employees from a public university system. Results suggest the 8-item WLQ is a usable alternative for studies when the more comprehensive 25-item WLQ is not available.

Reliability of pulse waveform separation analysis: effects of posture and fasting.

PubMed

Stoner, Lee; Credeur, Daniel; Fryer, Simon; Faulkner, James; Lambrick, Danielle; Gibbs, Bethany Barone

2017-03-01

Oscillometric pulse wave analysis devices enable, with relative simplicity and objectivity, the measurement of central hemodynamic parameters. The important parameters are central blood pressures and indices of arterial wave reflection, including wave separation analysis (backward pressure component Pb and reflection magnitude). This study sought to determine whether the measurement precision (between-day reliability) of Pb and reflection magnitude: exceeds the criterion for acceptable reliability; and is affected by posture (supine, seated) and fasting state. Twenty healthy adults (50% female, 27.9 years, 24.2 kg/m) were tested on six different mornings: 3 days fasted, 3 days nonfasted condition. On each occasion, participants were tested in supine and seated postures. Oscillometric pressure waveforms were recorded on the left upper arm. The criterion intra-class correlation coefficient value of 0.75 was exceeded for Pb (0.76) and reflection magnitude (0.77) when participants were assessed under the combined supine-fasted condition. The intra-class correlation coefficient was lowest for Pb in seated-nonfasted condition (0.57), and lowest for reflection magnitude in the seated-fasted condition (0.56). For Pb, the smallest detectible change that must be exceeded in order for a significant change to occur in an individual was 2.5 mmHg, and for reflection magnitude, the smallest detectable change was 8.5%. Assessments of Pb and reflection magnitude are as follows: exceed the criterion for acceptable reliability; and are most reliable when participants are fasted in a supine position. The demonstrated reliability suggests sufficient precision to detect clinically meaningful changes in reflection magnitude and Pb.

[Reliability and validity of depression scales of Chinese version: a systematic review].

PubMed

Sun, X Y; Li, Y X; Yu, C Q; Li, L M

2017-01-10

Objective: Through systematically reviewing the reliability and validity of depression scales of Chinese version in adults in China to evaluate the psychometric properties of depression scales for different groups. Methods: Eligible studies published before 6 May 2016 were retrieved from the following database: CNKI, Wanfang, PubMed and Embase. The HSROC model of the diagnostic test accuracy (DTA) for Meta-analysis was used to calculate the pooled sensitivity and specificity of the PHQ-9. Results: A total of 44 papers evaluating the performance of depression scales were included. Results showed that the reliability and validity of the common depression scales were eligible, including the Beck depression inventory (BDI), the Hamilton depression scale (HAMD), the center epidemiological studies depression scale (CES-D), the patient health questionnaire (PHQ) and the Geriatric depression scale (GDS). The Cronbach' s coefficient of most tools were larger than 0.8, while the test-retest reliability and split-half reliability were larger than 0.7, indicating good internal consistency and stability. The criterion validity, convergent validity, discrimination validity and screening validity were acceptable though different cut-off points were recommended by different studies. The pooled sensitivity of the 11 studies evaluating PHQ-9 was 0.88 (95 %CI : 0.85-0.91) while the pooled specificity was 0.89 (95 %CI : 0.82-0.94), which demonstrated the applicability of PHQ-9 in screening depression. Conclusion: The reliability and validity of different depression scales of Chinese version are acceptable. The characteristics of different tools and study population should be taken into consideration when choosing a specific scale.

Reliability and validity of Kano Test for Social Nicotine Dependence (KTSND), and development of its revised scale assessing the psychosocial acceptability of smoking among university students.

PubMed

Kitada, Masako; Musashi, Manabu; Kano, Masato

2011-08-01

To examine reliability and validity of Kano Test for Social Nicotine Dependence (KTSND), a scale assessing the psychosocial acceptability of smoking, and to develop a new version when validity or reliability of KTSND was not acceptable. We carried out a self-administered cross-sectional survey on undergraduate university students. The participants completed the KTSND, and supplemented three questions on the attitudes toward tobacco control policies and smoking states. Using daily smokers, we examined the relationship between the KTSND and Fagerström Test for Nicotine Dependence (FTND). In each study, we examined test-retest reliability and construct validity, discriminant and convergent validity, and factor validity. Although the KTSND had high internal consistency (Cronbach's a 0.82) and high test-retest reliability (r=0.72), the results of factor analysis were unacceptable; we expected three factors to be extracted, however, only two factors of "Overestimate of smoking usefulness" and "Allege smoking as a taste and/or culture" were extracted. Using the Kano's Test for Assessing Acceptability of Smoking (KTAAS), the new version of KTSND in which a question was replaced with another one, the third factor of "Neglect of harm of tobacco smoking" was extracted adding to the above-mentioned two. KTAAS had also both high internal consistency (Cronbach's alpha 0.82) and test-retest reliability (r=0.66). Overall, the KTSND and the KTAAS score differed according to smoking states, and the nonsmokers' scores were the lowest. The KTSND was a popular questionnaire in Japan, however, its validity assessed using factor analysis was not acceptable, while KTAAS had sufficient reliability and validity, and might assess the cognition and attitude affirming or accepting tobacco smoking among university students.

Measuring social alienation in adolescence: translation and validation of the Jessor and Jessor Social Alienation Scale.

PubMed

Safipour, Jalal; Tessma, Mesfin Kassaye; Higginbottom, Gina; Emami, Azita

2010-12-01

The objective of the study is to translate and examine the reliability and validity of the Jessor and Jessor Social Alienation Scale for use in a Swedish context. The study involved four phases of testing: (1) Translation and back-translation; (2) a pilot test to evaluate the translation; (3) reliability testing; and (4) a validity test. Main participants of this study were 446 students (Age = 15-19, SD = 1.01, Mean = 17). Results from the reliability test showed high internal consistency and stability. Face, content and construct validity were demonstrated using experts and confirmatory factor analysis. The results of testing the Swedish version of the alienation scale revealed an acceptable level of reliability and validity, and is appropriate for use in the Swedish context. © 2010 The Authors. Scandinavian Journal of Psychology © 2010 The Scandinavian Psychological Associations.

Psychometric evaluation of the Persian version of the Templer's Death Anxiety Scale in cancer patients.

PubMed

Soleimani, Mohammad Ali; Yaghoobzadeh, Ameneh; Bahrami, Nasim; Sharif, Saeed Pahlevan; Sharif Nia, Hamid

2016-10-01

In this study, 398 Iranian cancer patients completed the 15-item Templer's Death Anxiety Scale (TDAS). Tests of internal consistency, principal components analysis, and confirmatory factor analysis were conducted to assess the internal consistency and factorial validity of the Persian TDAS. The construct reliability statistic and average variance extracted were also calculated to measure construct reliability, convergent validity, and discriminant validity. Principal components analysis indicated a 3-component solution, which was generally supported in the confirmatory analysis. However, acceptable cutoffs for construct reliability, convergent validity, and discriminant validity were not fulfilled for the three subscales that were derived from the principal component analysis. This study demonstrated both the advantages and potential limitations of using the TDAS with Persian-speaking cancer patients.

Reliability of the Measure of Acceptance of the Theory of Evolution (MATE) Instrument with University Students

ERIC Educational Resources Information Center

Rutledge, Michael L.; Sadler, Kim C.

2007-01-01

The Measure of Acceptance of the Theory of Evolution (MATE) instrument was initially designed to assess high school biology teachers' acceptance of evolutionary theory. To determine if the MATE instrument is reliable with university students, it was administered to students in a non-majors biology course (n = 61) twice over a 3-week period.…

Use of the Family Interaction Macro-coding System with Families of Adolescents: Psychometric Properties Among Pediatric and Healthy Populations

PubMed Central

Zebracki, Kathy; Kichler, Jessica C.; Fitzgerald, Christopher J.; Neff Greenley, Rachel; Alemzadeh, Ramin; Holmbeck, Grayson N.

2011-01-01

Objective To examine reliability and validity data for the Family Interaction Macro-coding System (FIMS) with adolescents with spina bifida (SB), adolescents with type 1 diabetes mellitus (T1DM), and healthy adolescents and their families. Methods Sixty-eight families of children with SB, 58 families of adolescents with T1DM, and 68 families in a healthy comparison group completed family interaction tasks and self-report questionnaires. Trained coders rated family interactions using the FIMS. Results Acceptable interrater and scale reliabilities were obtained for FIMS items and subscales. Observed FIMS parental acceptance, parental behavioral control, parental psychological control, family cohesion, and family conflict scores demonstrated convergent validity with conceptually similar self-report measures. Conclusions Preliminary evidence supports the use of the FIMS with families of youths with SB and T1DM and healthy youths. Future research on overall family functioning may be enhanced by use of the FIMS. PMID:21097956

A comprehensive approach for diagnosing opportunities for improving the performance of a WWTP.

PubMed

Silva, C; Matos, J Saldanha; Rosa, M J

2016-12-01

High quality services of wastewater treatment require a continuous assessment and improvement of the technical, environmental and economic performance. This paper demonstrates a comprehensive approach for benchmarking wastewater treatment plants (WWTPs), using performance indicators (PIs) and indices (PXs), in a 'plan-do-check-act' cycle routine driven by objectives. The performance objectives herein illustrated were to diagnose the effectiveness and energy performance of an oxidation ditch WWTP. The PI and PX results demonstrated an effective and reliable oxidation ditch (good-excellent performance), and a non-reliable UV disinfection (unsatisfactory-excellent performance) related with influent transmittance and total suspended solids. The energy performance increased with the treated wastewater volume and was unsatisfactory below 50% of plant capacity utilization. The oxidation ditch aeration performed unsatisfactorily and represented 38% of the plant energy consumption. The results allowed diagnosing opportunities for improving the energy and economic performance considering the influent flows, temperature and concentrations, and for levering the WWTP performance to acceptable-good effectiveness, reliability and energy efficiency. Regarding the plant reliability for fecal coliforms, improvement of UV lamp maintenance and optimization of the UV dose applied and microscreen recommissioning were suggested.

[Risk perception of the building population].

PubMed

Pedron, F; Ferrante, D

2006-01-01

The development of a new measure to investigate risk perception in afield setting as building was the aim of this work. Workers' cognitive representation of risk and relation among ris perception, risk-acceptance and risk taking was the goals of the measure. The methodological approach for the measure development was the psychometric paradigm (Fischhoff, Slovic, Lichtenstein, Read e Combs, 1978). A first data collection in field context demonstrates measure's validity and reliability.

Cross-cultural adaptation into Punjabi of the English version of the Hospital Anxiety and Depression Scale.

PubMed

Lane, Deirdre A; Jajoo, Jagdish; Taylor, Rod S; Lip, Gregory Yh; Jolly, Kate

2007-01-26

We wanted to use a Punjabi version of the Hospital Anxiety and Depression Scale (HADS) to enable non-English speaking patients to participate in a clinical trial. The aim of the study was to translate and validate the Hospital Anxiety and Depression Scale into Punjabi. The HADS was translated into Punjabi by a multidisciplinary team, verified against the original version, and administered to 73 bilingual patients attending an outpatient clinic. One sample t-tests and the Bland-Altman plots demonstrated acceptable linguistic agreement between the two versions of the HADS. Spearman's rank-order correlation coefficients (p < 0.0001) demonstrate excellent conceptual agreement between each item and its corresponding subscale score, for both versions. Concordance rates revealed that the Punjabi HADS adequately identified borderline cases of anxiety (80.8%), definite cases of anxiety (91.8%) and depression (91.8%), but was less reliable in identifying borderline cases of depression (65.8%). Cronbach alpha coefficients revealed high levels of internal consistency for both the Punjabi and English versions (0.81 and 0.86 for anxiety and 0.71 and 0.85 for depression, respectively). The Punjabi HADS is an acceptable, reliable and valid measure of anxiety and depression among physically ill Punjabi speaking people in the United Kingdom.

Digit ratio (2D : 4D) moderates the impact of sexual cues on men's decisions in ultimatum games

PubMed Central

Van den Bergh, Bram; Dewitte, Siegfried

2006-01-01

Three experimental studies demonstrate that ‘sex-related cues’ impact human decision-making in ultimatum games. In the ultimatum game, two individuals divide a sum of money. The proposer offers a portion of the money to the other player, the responder. If the responder accepts the offer, the money is distributed in agreement with the proposer's offer. If the responder rejects the offer, neither player receives anything. Our studies show that exposure to pictures of sexy women or lingerie increases the likelihood of accepting unfair offers. Digit ratios of responders are reliably associated with their behaviour: males with lower digit ratios are more likely to reject an unfair split in neutral contexts, but more likely to accept unfair offers in sex-related contexts. PMID:16846918

Development of a Digital-Based Instrument to Assess Perceived Motor Competence in Children: Face Validity, Test-Retest Reliability, and Internal Consistency

PubMed Central

Palmer, Kara K.

2017-01-01

Assessing children’s perceptions of their movement abilities (i.e., perceived competence) is traditionally done using picture scales—Pictorial Scale of Perceived Competence and Acceptance for Young Children or Pictorial Scale of Perceived Movement Skill Competence. Pictures fail to capture the temporal components of movement. To address this limitation, we created a digital-based instrument to assess perceived motor competence: the Digital Scale of Perceived Motor Competence. The purpose of this study was to determine the validity, reliability, and internal consistency of the Digital-based Scale of Perceived Motor Skill Competence. The Digital-based Scale of Perceived Motor Skill Competence is based on the twelve fundamental motor skills from the Test of Gross Motor Development-2nd Edition with a similar layout and item structure as the Pictorial Scale of Perceived Movement Skill Competence. Face Validity of the instrument was examined in Phase I (n = 56; Mage = 8.6 ± 0.7 years, 26 girls). Test-retest reliability and internal consistency were assessed in Phase II (n = 54, Mage = 8.7 years ± 0.5 years, 26 girls). Intra-class correlations (ICC) and Cronbach’s alpha were conducted to determine test-retest reliability and internal consistency for all twelve skills along with locomotor and object control subscales. The Digital Scale of Perceived Motor Competence demonstrates excellent test-retest reliability (ICC = 0.83, total; ICC = 0.77, locomotor; ICC = 0.79, object control) and acceptable/good internal consistency (α = 0.62, total; α = 0.57, locomotor; α = 0.49, object control). Findings provide evidence of the reliability of the three level digital-based instrument of perceived motor competence for older children. PMID:29910408

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

Inter-examiner classification reliability of Mechanical Diagnosis and Therapy for extremity problems - Systematic review.

PubMed

Takasaki, Hiroshi; Okuyama, Kousuke; Rosedale, Richard

2017-02-01

Mechanical Diagnosis and Therapy (MDT) is used in the treatment of extremity problems. Classifying clinical problems is one method of providing effective treatment to a target population. Classification reliability is a key factor to determine the precise clinical problem and to direct an appropriate intervention. To explore inter-examiner reliability of the MDT classification for extremity problems in three reliability designs: 1) vignette reliability using surveys with patient vignettes, 2) concurrent reliability, where multiple assessors decide a classification by observing someone's assessment, 3) successive reliability, where multiple assessors independently assess the same patient at different times. Systematic review with data synthesis in a quantitative format. Agreement of MDT subgroups was examined using the Kappa value, with the operational definition of acceptable reliability set at ≥ 0.6. The level of evidence was determined considering the methodological quality of the studies. Six studies were included and all studies met the criteria for high quality. Kappa values for the vignette reliability design (five studies) were ≥ 0.7. There was data from two cohorts in one study for the concurrent reliability design and the Kappa values ranged from 0.45 to 1.0. Kappa values for the successive reliability design (data from three cohorts in one study) were < 0.6. The current review found strong evidence of acceptable inter-examiner reliability of MDT classification for extremity problems in the vignette reliability design, limited evidence of acceptable reliability in the concurrent reliability design and unacceptable reliability in the successive reliability design. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents

PubMed Central

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

Background The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. Method A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. Results The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. Conclusions In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years. PMID:26498182

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents.

PubMed

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years.

Evaluation of the CEAS model for barley yields in North Dakota and Minnesota

NASA Technical Reports Server (NTRS)

Barnett, T. L. (Principal Investigator)

1981-01-01

The CEAS yield model is based upon multiple regression analysis at the CRD and state levels. For the historical time series, yield is regressed on a set of variables derived from monthly mean temperature and monthly precipitation. Technological trend is represented by piecewise linear and/or quadriatic functions of year. Indicators of yield reliability obtained from a ten-year bootstrap test (1970-79) demonstrated that biases are small and performance as indicated by the root mean square errors are acceptable for intended application, however, model response for individual years particularly unusual years, is not very reliable and shows some large errors. The model is objective, adequate, timely, simple and not costly. It considers scientific knowledge on a broad scale but not in detail, and does not provide a good current measure of modeled yield reliability.

Forward Skirt Structural Testing on the Space Launch System (SLS) Program

NASA Technical Reports Server (NTRS)

Lohrer, J. D.; Wright, R. D.

2016-01-01

Structural testing was performed to evaluate heritage forward skirts from the Space Shuttle program for use on the NASA Space Launch System (SLS) program. Testing was needed because SLS ascent loads are 35% higher than Space Shuttle loads. Objectives of testing were to determine margins of safety, demonstrate reliability, and validate analytical models. Testing combined with analysis was able to show heritage forward skirts were acceptable to use on the SLS program.

Demonstration and evaluation of gas turbine transit buses

NASA Technical Reports Server (NTRS)

1983-01-01

The Gas Turbine Transit Bus Demonstration Program was designed to demonstrate and evaluate the operation of gas turbine engines in transit coaches in revenue service compared with diesel powered coaches. The main objective of the program was to accelerate development and commercialization of automotive gas turbines. The benefits from the installation of this engine in a transit coach were expected to be reduced weight, cleaner exhaust emissions, lower noise levels, reduced engine vibration and maintenance requirements, improved reliability and vehicle performance, greater engine braking capability, and superior cold weather starting. Four RTS-II advanced design transit coaches were converted to gas turbine power using engines and transmissions. Development, acceptance, performance and systems tests were performed on the coaches prior to the revenue service demonstration.

Methods Used to Streamline the CAHPS® Hospital Survey

PubMed Central

Keller, San; O'Malley, A James; Hays, Ron D; Matthew, Rebecca A; Zaslavsky, Alan M; Hepner, Kimberly A; Cleary, Paul D

2005-01-01

Objective To identify a parsimonious subset of reliable, valid, and consumer-salient items from 33 questions asking for patient reports about hospital care quality. Data Source CAHPS® Hospital Survey pilot data were collected during the summer of 2003 using mail and telephone from 19,720 patients who had been treated in 132 hospitals in three states and discharged from November 2002 to January 2003. Methods Standard psychometric methods were used to assess the reliability (internal consistency reliability and hospital-level reliability) and construct validity (exploratory and confirmatory factor analyses, strength of relationship to overall rating of hospital) of the 33 report items. The best subset of items from among the 33 was selected based on their statistical properties in conjunction with the importance assigned to each item by participants in 14 focus groups. Principal Findings Confirmatory factor analysis (CFA) indicated that a subset of 16 questions proposed to measure seven aspects of hospital care (communication with nurses, communication with doctors, responsiveness to patient needs, physical environment, pain control, communication about medication, and discharge information) demonstrated excellent fit to the data. Scales in each of these areas had acceptable levels of reliability to discriminate among hospitals and internal consistency reliability estimates comparable with previously developed CAHPS instruments. Conclusion Although half the length of the original, the shorter CAHPS hospital survey demonstrates promising measurement properties, identifies variations in care among hospitals, and deals with aspects of the hospital stay that are important to patients' evaluations of care quality. PMID:16316438

The Rothschild Scale for Antidepressant Tachyphylaxis: reliability and validity.

PubMed

Rothschild, Anthony J

2008-01-01

After successful treatment of an episode of major depression, many patients complain of symptoms of apathy or decreased motivation (described by patients as "the blahs"), fatigue, dullness in cognitive function, sleep disturbance, weight gain, and sexual dysfunction; however, the characterization of this phenomenon of antidepressant tachyphylaxis has been hampered by the lack of an accepted definition and a reliable and valid assessment tool. To address this problem, the development and assessment of the Rothschild Scale for Antidepressant Tachyphylaxis (RSAT) are described. The RSAT consists of 6 self-report items assessing energy level, motivation and interest, cognitive functioning, weight gain, sleep, and sexual functioning. A seventh item, affect, is assessed by the interviewer. Each item is measured within a 5-point ordinal scale with anchor points developed to illustrate each rating. This study assesses the internal consistency, test-retest reliability, convergent and discriminant validity, sensitivity, specificity, and positive and negative predictive values of the RSAT. The RSAT demonstrated excellent internal consistency and scale reliability (Cronbach alpha = .902). The RSAT also demonstrated strong test-retest reliability (for depressed patients: r = 0.822, P < .01; for control subjects: r = 0.887, P < .01). The total RSAT score did not correlate with severity of depression as measured by the total Hamilton Depression Rating Scale score or the Hamilton Depression Rating Scale item 1 (depressed mood), supporting the discriminant validity of the RSAT for use in antidepressant tachyphylaxis. The RSAT is a reliable measure of antidepressant tachyphylaxis.

Fatigue after stroke: the development and evaluation of a case definition.

PubMed

Lynch, Joanna; Mead, Gillian; Greig, Carolyn; Young, Archie; Lewis, Susan; Sharpe, Michael

2007-11-01

While fatigue after stroke is a common problem, it has no generally accepted definition. Our aim was to develop a case definition for post-stroke fatigue and to test its psychometric properties. A case definition with face validity and an associated structured interview was constructed. After initial piloting, the feasibility, reliability (test-retest and inter-rater) and concurrent validity (in relation to four fatigue severity scales) were determined in 55 patients with stroke. All participating patients provided satisfactory answers to all the case definition probe questions demonstrating its feasibility For test-retest reliability, kappa was 0.78 (95% CI, 0.57-0.94, P<.01) and for inter-rater reliability kappa was 0.80 (95% CI, 0.62-0.99, P<.01). Patients fulfilling the case definition also had substantially higher fatigue scores on four fatigue severity scales (P<.001) indicating concurrent validity. The proposed case definition is feasible to administer and reliable in practice, and there is evidence of concurrent validity. It requires further evaluation in different settings.

Development and validation of a fatigue assessment scale for U.S. construction workers.

PubMed

Zhang, Mingzong; Sparer, Emily H; Murphy, Lauren A; Dennerlein, Jack T; Fang, Dongping; Katz, Jeffrey N; Caban-Martinez, Alberto J

2015-02-01

To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Using a two-phased approach, we first identified items (first phase) for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n = 11) and focus groups (three groups with six workers each) with construction workers. The second phase included assessment for the reliability, validity, and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n = 144). Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales ("Lethargy" and "Bodily Ailment"). During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW [0.91], Lethargy [0.86] and Bodily Ailment [0.84]) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59-0.68; Intraclass Correlation Coefficients: 0.74-0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. © 2015 Wiley Periodicals, Inc.

Using personal qualities assessment to measure the moral orientation and personal qualities of medical students in a non-Western culture.

PubMed

Tsou, Kuo-Inn; Lin, Chaou-Shune; Cho, Shu-Ling; Powis, David; Bore, Miles; Munro, Don; Sze, Daniel Man-Yuen; Wu, Hsi-Chin; Hsieh, Ming-Shium; Lin, Chyi-Her

2013-06-01

How to select candidates with appropriate personal qualities for medical school is an important issue. This study examined the psychometric properties and group differences of the Personal Qualities Assessment (PQA) to test the feasibility of using it as a tool to assess the medical school applicants in a non-Western culture. Seven hundred forty-six medical students in Taiwan completed two psychometric measures: Mojac to assess moral orientation and NACE to assess four aspects of interpersonal relationships. Thirty-one students completed the tests twice to establish test-retest reliability. A subsample of 127 students also completed a measure of the "Big Five" personality traits to examine the construct validity of these scales. Both Mojac and NACE had acceptable internal consistency and test-retest reliability. Conceptually, coherent and significant relationships were observed between test components and between the NACE and Big Five. NACE but not Mojac varied significantly between different sociodemographic groups. Both tests demonstrated acceptable psychometric properties. However, the predictive validity of PQA requires future studies.

Psychometric properties including reliability, validity and responsiveness of the Majeed pelvic score in patients with chronic sacroiliac joint pain.

PubMed

Bajada, Stefan; Mohanty, Khitish

2016-06-01

The Majeed scoring system is a disease-specific outcome measure that was originally designed to assess pelvic injuries. The aim of this study was to determine the psychometric properties of the Majeed scoring system for chronic sacroiliac joint pain. Internal consistency, content validity, criterion validity, construct validity and responsiveness to change was assessed prospectively for the Majeed scoring system in a cohort of 60 patients diagnosed with sacroiliac joint pain. This diagnosis was confirmed with CT-guided sacroiliac joint anaesthetic block. The overall Majeed score showed acceptable internal consistency (Cronbach alpha = 0.63). Similarly, it showed acceptable floor (0 %) and ceiling (0 %) effects. On the other hand, the domains of pain, work, sitting and sexual intercourse had high (>30 %) floor effects. Significant correlation with the physical component of the Short Form-36 (p = 0.005) and Oswestry disability index (p ≤ 0.001) was found indicating acceptable criterion validity. The overall Majeed score showed acceptable construct validity with all five developed hypotheses showing significance (p ≤ 0.05). The overall Majeed score showed acceptable responsiveness to change with a large (≥0.80) effect size and standardized response mean. Overall the Majeed scoring system demonstrated acceptable psychometric properties for outcome assessment in chronic sacroiliac joint pain. Thus, its use in this condition is adequate. However, some domains demonstrated suboptimal performance indicating that improvement might be achieved with the development of an outcome measure specific for sacroiliac joint dysfunction and degeneration.

The Employment Precariousness Scale (EPRES): psychometric properties of a new tool for epidemiological studies among waged and salaried workers.

PubMed

Vives, Alejandra; Amable, Marcelo; Ferrer, Montserrat; Moncada, Salvador; Llorens, Clara; Muntaner, Carles; Benavides, Fernando G; Benach, Joan

2010-08-01

Despite the fact that labour market flexibility has resulted in an expansion of precarious employment in industrialised countries, to date there is limited empirical evidence concerning its health consequences. The Employment Precariousness Scale (EPRES) is a newly developed, theory-based, multidimensional questionnaire specifically devised for epidemiological studies among waged and salaried workers. To assess the acceptability, reliability and construct validity of EPRES in a sample of waged and salaried workers in Spain. A sample of 6968 temporary and permanent workers from a population-based survey carried out in 2004-2005 was analysed. The survey questionnaire was interviewer administered and included the six EPRES subscales, and measures of the psychosocial work environment (COPSOQ ISTAS21) and perceived general and mental health (SF-36). A high response rate to all EPRES items indicated good acceptability; Cronbach's alpha coefficients, over 0.70 for all subscales and the global score, demonstrated good internal consistency reliability; exploratory factor analysis using principal axis analysis and varimax rotation confirmed the six-subscale structure and the theoretical allocation of all items. Patterns across known groups and correlation coefficients with psychosocial work environment measures and perceived health demonstrated the expected relations, providing evidence of construct validity. Our results provide evidence in support of the psychometric properties of EPRES, which appears to be a promising tool for the measurement of employment precariousness in public health research.

The Use of Cronbach's Alpha When Developing and Reporting Research Instruments in Science Education

NASA Astrophysics Data System (ADS)

Taber, Keith S.

2017-06-01

Cronbach's alpha is a statistic commonly quoted by authors to demonstrate that tests and scales that have been constructed or adopted for research projects are fit for purpose. Cronbach's alpha is regularly adopted in studies in science education: it was referred to in 69 different papers published in 4 leading science education journals in a single year (2015)—usually as a measure of reliability. This article explores how this statistic is used in reporting science education research and what it represents. Authors often cite alpha values with little commentary to explain why they feel this statistic is relevant and seldom interpret the result for readers beyond citing an arbitrary threshold for an acceptable value. Those authors who do offer readers qualitative descriptors interpreting alpha values adopt a diverse and seemingly arbitrary terminology. More seriously, illustrative examples from the science education literature demonstrate that alpha may be acceptable even when there are recognised problems with the scales concerned. Alpha is also sometimes inappropriately used to claim an instrument is unidimensional. It is argued that a high value of alpha offers limited evidence of the reliability of a research instrument, and that indeed a very high value may actually be undesirable when developing a test of scientific knowledge or understanding. Guidance is offered to authors reporting, and readers evaluating, studies that present Cronbach's alpha statistic as evidence of instrument quality.

Study on the stability and reliability of Clinotron at Y-band

NASA Astrophysics Data System (ADS)

Li, Shuang; Wang, Jianguo; Chen, Zaigao; Wang, Guangqiang; Wang, Dongyang; Teng, Yan

2017-11-01

To improve the stability and reliability of Clinotron at the Y-band, some key issues are researched, such as the synchronous operating mode, the heat accumulation on the slow-wave structure, and the errors in micro-fabrication. By analyzing the dispersion relationship, the working mode is determined as the TM10 mode. The problem of heat dissipation on a comb is researched to make a trade-off on the choice of suitable working conditions, making sure that the safety and efficiency of the device are guaranteed simultaneously. The study on the effect of tolerance on device's performance is also conducted to determine the acceptable error during micro-fabrication. The validity of the device and the cost for fabrication are both taken into consideration. At last, the performance of Clinotron under the optimized conditions demonstrates that it can work steadily at 315.89 GHz and the output power is about 12 W, showing advanced stability and reliability.

Examining the Factor Structure and Reliability of the Safe Patient Handling Perception Scale: An Initial Validation Study.

PubMed

White-Heisel, Regina; Canfield, James P; Young-Hughes, Sadie

Perceiving imminent safe patient handling and movement (SPH&M) dangers may reduce musculoskeletal (MSK) injuries for nurses in the workplace. The purpose of this study is to develop and validate the 17-item Safe Patient Handling Perception Scale (SPHPS) as an evaluation instrument assessing perceptual risk of MSK injury based on SPH&M knowledge, practice, and resource accessibility in the workplace. Data were collected from a convenience sample (N = 117) of nursing employees at a Veteran Affairs Medical Center. Factor analysis identified three factors: knowledge, practice, and accessibility. The SPHPS demonstrated high levels of reliability, supported by acceptable alpha scores (SPHM knowledge [α = .866], SPHM practices [α = .901], and access to SPHM resources [α = .855]), in addition to the relatively low standard error of measurement scores (SEM). The study outcomes suggest that the SPHPS is a valid and reliable tool that can measure participants' perceived risk factors for MSK injuries.

Development and validation of a novel patient-reported treatment satisfaction measure for hyperfunctional facial lines: facial line satisfaction questionnaire.

PubMed

Pompilus, Farrah; Burgess, Somali; Hudgens, Stacie; Banderas, Benjamin; Daniels, Selena

2015-12-01

Facial lines or wrinkles are among the most visible signs of aging, and minimally invasive cosmetic procedures are becoming increasingly popular. The aim of this study was to develop and validate the Facial Line Satisfaction Questionnaire (FLSQ) for use in adults with upper facial lines (UFL). A literature review, concept elicitation interviews (n = 33), and cognitive debriefing interviews (n = 23) of adults with UFL were conducted to develop the FLSQ. The FLSQ comprises Baseline and Follow-up versions and was field-tested with 150 subjects in a US observational study designed to assess its psychometric performance. Analyses included acceptability (item and scale distribution [i.e. missingness, floor, and ceiling effects]), reliability, and validity (including concurrent validity). In total, 69 concepts were elicited during patient interviews. Following cognitive debriefing interviews, the FLSQ-Baseline version included 11 items and the Follow-up version included 13 items. Response rates for the FLSQ were 100% and 73% at baseline and follow-up, respectively; no items had excessive missing data. Questionnaire scale scores were normally distributed. Most domain scores demonstrated good internal consistency reliability (Cronbach's α ≥ 0.70). Most items within their respective domains exhibited good convergent (item-scale correlations > 0.40) and discriminant (items had higher correlation with their hypothesized scales than other scales) validity. Concurrent validity correlation coefficients of the FLSQ domain scores with the associated concurrent measures were acceptable (range: r = 0.40-0.70). Six FLSQ items demonstrated reliability and validity as stand-alone items outside their domains. The FLSQ is a valid questionnaire for assessing treatment expectations, satisfaction, impact, and preference in adults with UFL. © 2015 The Authors. Journal of Cosmetic Dermatology Published by Wiley Periodicals, Inc.

Are photographic records reliable for orthodontic screening?

PubMed

Mandall, N A

2002-06-01

The aim of the study was to evaluate the reliability of a panel of orthodontists for accepting new patient referrals based on clinical photographs. Eight orthodontists from Greater Manchester, Lancashire, Chester, and Derbyshire observed clinical photographs of 40 consecutive new patients attending the orthodontic department, Hope Hospital, Salford. They recorded whether or not they would accept the patient, as a new patient referral, in their department. Each consultant was asked to take into account factors, such as oral hygiene, dental development, and severity of the malocclusion. Kappa statistic for multiple-rater agreement and kappa statistic for intra-observer reliability were calculated. Inter-observer panel agreement for accepting new patient referrals based on photographic information was low (multiple rater kappa score 0.37). Intra-examiner agreement was better (kappa range 0.34-0.90). Clinician agreement for screening and accepting orthodontic referrals based on clinical photographs is comparable to that previously reported for other clinical decision making.

A reliability and mass perspective of SP-100 Stirling cycle lunar-base powerplant designs

NASA Technical Reports Server (NTRS)

Bloomfield, Harvey S.

1991-01-01

The purpose was to obtain reliability and mass perspectives on selection of space power system conceptual designs based on SP-100 reactor and Stirling cycle power-generation subsystems. The approach taken was to: (1) develop a criterion for an acceptable overall reliability risk as a function of the expected range of emerging technology subsystem unit reliabilities; (2) conduct reliability and mass analyses for a diverse matrix of 800-kWe lunar-base design configurations employing single and multiple powerplants with both full and partial subsystem redundancy combinations; and (3) derive reliability and mass perspectives on selection of conceptual design configurations that meet an acceptable reliability criterion with the minimum system mass increase relative to reference powerplant design. The developed perspectives provided valuable insight into the considerations required to identify and characterize high-reliability and low-mass lunar-base powerplant conceptual design.

Validation in Support of Internationally Harmonised OECD Test Guidelines for Assessing the Safety of Chemicals.

PubMed

Gourmelon, Anne; Delrue, Nathalie

Ten years elapsed since the OECD published the Guidance document on the validation and international regulatory acceptance of test methods for hazard assessment. Much experience has been gained since then in validation centres, in countries and at the OECD on a variety of test methods that were subjected to validation studies. This chapter reviews validation principles and highlights common features that appear to be important for further regulatory acceptance across studies. Existing OECD-agreed validation principles will most likely generally remain relevant and applicable to address challenges associated with the validation of future test methods. Some adaptations may be needed to take into account the level of technique introduced in test systems, but demonstration of relevance and reliability will continue to play a central role as pre-requisite for the regulatory acceptance. Demonstration of relevance will become more challenging for test methods that form part of a set of predictive tools and methods, and that do not stand alone. OECD is keen on ensuring that while these concepts evolve, countries can continue to rely on valid methods and harmonised approaches for an efficient testing and assessment of chemicals.

Validation of the Chronic Pain Acceptance Questionnaire (CPAQ) in Cantonese-speaking Chinese patients.

PubMed

Cheung, Michelle N; Ning, Michelle Cheung; Wong, Tony C M; Ming, Tony Wong Chi; Yap, Jacqueline C M; Mae, Jacqueline Yap Chooi; Chen, Phoon P; Ping, Chen Phoon

2008-09-01

Acceptance of chronic pain has become an important concept in understanding and predicting that chronic pain sufferers can remain engaged with meaningful aspects of life. Assessment of acceptance has been facilitated by the development of Chronic Pain Acceptance Questionnaire (CPAQ). In this study, we aimed to test the reliability and validity of translated Chinese version of CPAQ to use this important tool in the future management of Hong Kong Chinese patients with chronic nonmalignant pain. Content validity was established by consensus formed among a panel of 5 experts in clinical psychology and pain specialty during the process of forward and backward translations. Test-retest reliability was examined by completing the Chinese CPAQ twice, 2 weeks apart, by 54 patients. A total of 224 Chinese patients with chronic nonmalignant pain attending our cluster multidisciplinary pain clinic were asked to complete a battery of psychometric instruments in Chinese, including an intake form for demographic data, Hospital Anxiety and Depression Score (HADS), Medical Outcome Study Short Form 36 (SF-36), Pain Catastrophizing Scale (PCS), and Pain Self-Efficacy Questionnaire (PSEQ). Analysis results showed that Chinese CPAQ had good test-retest reliability (intraclass correlation coefficient, 0.79) and internal consistency reliability (Cronbach alpha = 0.79). The Chinese CPAQ score was significantly correlated to anxiety, depression, pain catastrophizing, pain self-efficacy, and physical and psychosocial disability. Scree plot and Principal Components Factor analysis confirmed the same 2-factor construct as the original English CPAQ. Construct validity of the Chinese CPAQ can therefore be supported. In conclusion, the Chinese CPAQ is a reliable clinical assessment tool with valid construct for acceptance measurement in our heterogeneous Chinese patients sample with chronic nonmalignant pain. This article confirms the reliability and validity of a Chinese version of the CPAQ. The Chinese CPAQ can then be used by pain clinicians caring for Chinese chronic pain patients worldwide for acceptance-based psychometric assessment as well as therapies.

Mixed methods evaluation of a quality improvement and audit tool for nurse-to-nurse bedside clinical handover in ward settings.

PubMed

Redley, Bernice; Waugh, Rachael

2018-04-01

Nurse bedside handover quality is influenced by complex interactions related to the content, processes used and the work environment. Audit tools are seldom tested in 'real' settings. Examine the reliability, validity and usability of a quality improvement tool for audit of nurse bedside handover. Naturalistic, descriptive, mixed-methods. Six inpatient wards at a single large not-for-profit private health service in Victoria, Australia. Five nurse experts and 104 nurses involved in 199 change-of-shift bedside handovers. A focus group with experts and pilot test were used to examine content and face validity, and usability of the handover audit tool. The tool was examined for inter-rater reliability and usability using observation audits of handovers across six wards. Data were collected in 2013-2014. Two independent observers for 72 audits demonstrated acceptable inter-observer agreement for 27 (77%) items. Reliability was weak for items examining the handover environment. Seventeen items were not observed reflecting gaps in practices. Across 199 observation audits, gaps in nurse bedside handover practice most often related to process and environment, rather than content items. Usability was impacted by high observer burden, familiarity and non-specific illustrative behaviours. The reliability and validity of most items to audit handover content was acceptable. Gaps in practices for process and environment items were identified. Context specific exemplars and reducing the items used at each handover audit can enhance usability. Further research is needed to develop context specific exemplars and undertake additional reliability testing using a wide range of handover settings. CONTRIBUTION OF THE PAPER. Copyright © 2017 Elsevier Inc. All rights reserved.

Willing and able: a closer look at pain Willingness and Activity Engagement on the Chronic Pain Acceptance Questionnaire (CPAQ-8).

PubMed

Fish, Rosemary A; Hogan, Michael J; Morrison, Todd G; Stewart, Ian; McGuire, Brian E

2013-03-01

An 8-item version of the Chronic Pain Acceptance Questionnaire (CPAQ-8) has recently been proposed and validated. The aims of this study were to further investigate the reliability and validity of the CPAQ-8 in a new sample. Questionnaires were completed by 550 people with chronic pain (478 online survey, 72 paper survey). A demographic and pain history questionnaire was administered along with the CPAQ-8 and measures of pain self-efficacy, pain catastrophizing, psychological flexibility in pain, anxiety, and mood. In addition, 105 respondents completed the CPAQ-8 within 6 weeks to provide test-retest reliability data. The 2-factor structure of the CPAQ-8 (Activity Engagement [AE] and Pain Willingness [PW]) was confirmed and had reasonable-to-good scale score reliability and test-retest reliability. Pain acceptance as measured by the CPAQ-8 was associated with less depression, anxiety, pain interference, fear of reinjury, pain catastrophizing, and psychological inflexibility in pain, and higher levels of satisfaction with life, pain self-efficacy, and general acceptance. Furthermore, pain acceptance fully mediated the relationship between reported pain severity and emotional distress (anxiety and depression) and partially mediated the relationship between pain severity and pain interference in a structural equation model. The test-retest reliability after 4 to 6 weeks ranged from .68 for PW to .86 for AE; the overall score correlation was .81. We conclude that the CPAQ-8 is a reliable and valid measure of pain acceptance and that the 2 subscales of the measure each make an individual contribution to the prediction of adjustment in people with chronic pain. The present study provides further evidence for the reliability and validity of the CPAQ-8. Support was found for the 2 related subscales, PW and AE, which appear to work in synergy to influence levels of pain interference and emotional distress in people living with chronic pain. Copyright © 2013 American Pain Society. Published by Elsevier Inc. All rights reserved.

[Development of an instrument to measure psychosocial determinants of physical activity behavior among coronary heart disease patients].

PubMed

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Cornélio, Marilia Estevam; Gallani, Maria Cecília Bueno Jayme; Godin, Gaston

2010-09-01

The aim of this study was to report the development and the analysis of content validity and reliability of the Psychosocial Determinants of Physical Activity among Coronary Heart Disease Patients Questionnaire, based on an extension of the Theory of Planned Behavior. In the content validity step, three experts evaluated the instrument which was, afterwards, pre-tested with five subjects in order to obtain a conceptually appropriate and easily understood instrument. Fifty-one patients participated in the evaluation of internal consistency of the reviewed instrument. Cronbach's alpha coefficients above 0.75 were observed for the constructs: Intention, Attitude, Subjective Norm, Self-efficacy and Habit. The new instrument demonstrated acceptable evidence of content validity and reliability.

Space Shuttle Propulsion System Reliability

NASA Technical Reports Server (NTRS)

Welzyn, Ken; VanHooser, Katherine; Moore, Dennis; Wood, David

2011-01-01

This session includes the following sessions: (1) External Tank (ET) System Reliability and Lessons, (2) Space Shuttle Main Engine (SSME), Reliability Validated by a Million Seconds of Testing, (3) Reusable Solid Rocket Motor (RSRM) Reliability via Process Control, and (4) Solid Rocket Booster (SRB) Reliability via Acceptance and Testing.

Quantitative measurement of hypertrophic scar: interrater reliability and concurrent validity.

PubMed

Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo

2008-01-01

Research into the pathophysiology and treatment of hypertrophic scar (HSc) remains limited by the heterogeneity of scar and the imprecision with which its severity is measured. The objective of this study was to test the interrater reliability and concurrent validity of the Cutometer measurement of elasticity, the Mexameter measurement of erythema and pigmentation, and total thickness measure of the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar, and HSc. Three independent investigators evaluated 128 sites (severe HSc, moderate or mild HSc, donor site, and normal skin) on 32 burn survivors using all of the above measurement tools. The intraclass correlation coefficient, which was used to measure interrater reliability, reflects the inherent amount of error in the measure and is considered acceptable when it is >0.75. Interrater reliability of the totals of the height, pliability, and vascularity subscales of the mVSS fell below the acceptable limit ( congruent with0.50). The individual subscales of the mVSS fell well below the acceptable level (< or =0.3). The Cutometer reading of elasticity provided acceptable reliability (>0.89) for each study site with the exception of severe scar. Mexameter and DermaScan C reliability measurements were acceptable for all sites (>0.82). Concurrent validity correlations with the mVSS were significant except for the comparison of the mVSS pliability subscale and the Cutometer maximum deformation measure comparison in severe scar. In conclusion, the Mexameter and DermaScan C measurements of scar color and thickness of all sites, as well as the Cutometer measurement of elasticity in all but the most severe scars shows high interrater reliability. Their significant concurrent validity with the mVSS confirms that these tools are measuring the same traits as the mVSS, and in a more objective way.

Development and validation of the sociocultural attitudes towards appearance questionnaire-4-revised (SATAQ-4R).

PubMed

Schaefer, Lauren M; Harriger, Jennifer A; Heinberg, Leslie J; Soderberg, Taylor; Kevin Thompson, J

2017-02-01

The Sociocultural Attitudes Toward Appearance Questionnaire-4 (SATAQ-4) is a measure of internalization of appearance ideals (i.e., personal acceptance of societal ideals) and appearance pressures (i.e., pressures to achieve the societal ideal). The current study sought to address limitations of the scale in order to increase precision in the measurement of muscular ideal internalization, include an assessment of one's desire for attractiveness, and broaden the measurement of appearance-related pressures. The factor structure, reliability and construct validity of the SATAQ-4-Revised were examined among college women (N = 1,114) in Study 1, adolescent girls (N = 275) in Study 2, and college men (N = 290) in Study 3. Factor analysis among college women indicated a 7-factor 31-item scale, labeled the SATAQ-4R-Female: (1) Internalization: Thin/Low Body Fat, (2) Internalization: Muscular, (3) Internalization: General Attractiveness, (4) Pressures: Family, (5) Pressures: Media, (6) Pressures: Peers, and (7) Pressures: Significant Others. SATAQ-4R-Female subscales demonstrated good reliability and construct validity among college women. Examination of the SATAQ-4R-Female among adolescent girls suggested a six-factor scale in which peer and significant others items comprised a single subscale. The scale demonstrated good reliability and construct validity in adolescent girls. Examination of the SATAQ-4R among men produced a 28-item scale with seven factors paralleling the factors identified among college women. This scale, labeled the SATAQ-4R-Male, demonstrated good reliability and construct validity. Results support the reliability and validity of SATAQ-4R-Female in college women and adolescent girls, and the SATAQ-4R-Male in college men. © 2016 Wiley Periodicals, Inc.(Int J Eat Disord 2017; 50:104-117). © 2016 Wiley Periodicals, Inc.

Testing the reliability of the Fall Risk Screening Tool in an elderly ambulatory population.

PubMed

Fielding, Susan J; McKay, Michael; Hyrkas, Kristiina

2013-11-01

To identify and test the reliability of a fall risk screening tool in an ambulatory outpatient clinic. The Fall Risk Screening Tool (Albert Lea Medical Center, MN, USA) was scripted for an interview format. Two interviewers separately screened a convenience sample of 111 patients (age ≥ 65 years) in an ambulatory outpatient clinic in a northeastern US city. The interviewers' scoring of fall risk categories was similar. There was good internal consistency (Cronbach's α = 0.834-0.889) and inter-rater reliability [intra-class correlation coefficients (ICC) = 0.824-0.881] for total, Risk Factor and Client's Health Status subscales. The Physical Environment scores indicated acceptable internal consistency (Cronbach's α = 0.742) and adequate reliability (ICC = 0.688). Two Physical Environment items (furniture and medical equipment condition) had low reliabilities [Kappa (K) = 0.323, P = 0.08; K = -0.078, P = 0.648), respectively. The scripted Fall Risk Screening Tool demonstrated good reliability in this sample. Rewording two Physical Environment items will be considered. A reliable instrument such as the scripted Fall Risk Screening Tool provides a standardised assessment for identifying high fall risk patients. This tool is especially useful because it assesses personal, behavioural and environmental factors specific to community-dwelling patients; the interview format also facilitates patient-provider interaction. © 2013 John Wiley & Sons Ltd.

Cultural adaptation and validation of the Health Literacy Questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model.

PubMed

Maindal, Helle Terkildsen; Kayser, Lars; Norgaard, Ole; Bo, Anne; Elsworth, Gerald R; Osborne, Richard H

2016-01-01

Health literacy is an important construct in population health and healthcare requiring rigorous measurement. The Health Literacy Questionnaire (HLQ), with nine scales, measures a broad perception of health literacy. This study aimed to adapt the HLQ to the Danish setting, and to examine the factor structure, homogeneity, reliability and discriminant validity. The HLQ was adapted using forward-backward translation, consensus conference and cognitive interviews (n = 15). Psychometric properties were examined based on data collected by face-to-face interview (n = 481). Tests included difficulty level, composite scale reliability and confirmatory factor analysis (CFA). Cognitive testing revealed that only minor re-wording was required. The easiest scale to respond to positively was 'Social support for health', and the hardest were 'Navigating the healthcare system' and 'Appraisal of health information'. CFA of the individual scales showed acceptably high loadings (range 0.49-0.93). CFA fit statistics after including correlated residuals were good for seven scales, acceptable for one. Composite reliability and Cronbach's α were >0.8 for all but one scale. A nine-factor CFA model was fitted to items with no cross-loadings or correlated residuals allowed. Given this restricted model, the fit was satisfactory. The HLQ appears robust for its intended application of assessing health literacy in a range of settings. Further work is required to demonstrate sensitivity to measure changes.

The PedsQL in pediatric cancer: reliability and validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module.

PubMed

Varni, James W; Burwinkle, Tasha M; Katz, Ernest R; Meeske, Kathy; Dickinson, Paige

2002-04-01

The Pediatric Quality of Life Inventory (PedsQL) is a modular instrument designed to measure health-related quality of life (HRQOL) in children and adolescents ages 2-18 years. The PedsQL 4.0 Generic Core Scales are multidimensional child self-report and parent proxy-report scales developed as the generic core measure to be integrated with the PedsQL disease specific modules. The PedsQL Multidimensional Fatigue Scale was designed to measure fatigue in pediatric patients. The PedsQL 3.0 Cancer Module was designed to measure pediatric cancer specific HRQOL. The PedsQL Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module were administered to 339 families (220 child self-reports; 337 parent proxy-reports). Internal consistency reliability for the PedsQL Generic Core Total Scale Score (alpha = 0.88 child, 0.93 parent report), Multidimensional Fatigue Total Scale Score (alpha = 0.89 child, 0.92 parent report) and most Cancer Module Scales (average alpha = 0.72 child, 0.87 parent report) demonstrated reliability acceptable for group comparisons. Validity was demonstrated using the known-groups method. The PedsQL distinguished between healthy children and children with cancer as a group, and among children on-treatment versus off-treatment. The validity of the PedsQL Multidimensional Fatigue Scale was further demonstrated through hypothesized intercorrelations with dimensions of generic and cancer specific HRQOL. The results demonstrate the reliability and validity of the PedsQL Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module in pediatric cancer. The PedsQL may be utilized as an outcome measure in clinical trials, research, and clinical practice. Copyright 2002 American Cancer Society.

Software reliability experiments data analysis and investigation

NASA Technical Reports Server (NTRS)

Walker, J. Leslie; Caglayan, Alper K.

1991-01-01

The objectives are to investigate the fundamental reasons which cause independently developed software programs to fail dependently, and to examine fault tolerant software structures which maximize reliability gain in the presence of such dependent failure behavior. The authors used 20 redundant programs from a software reliability experiment to analyze the software errors causing coincident failures, to compare the reliability of N-version and recovery block structures composed of these programs, and to examine the impact of diversity on software reliability using subpopulations of these programs. The results indicate that both conceptually related and unrelated errors can cause coincident failures and that recovery block structures offer more reliability gain than N-version structures if acceptance checks that fail independently from the software components are available. The authors present a theory of general program checkers that have potential application for acceptance tests.

A Framework to Expand and Advance Probabilistic Risk Assessment to Support Small Modular Reactors

DOE Office of Scientific and Technical Information (OSTI.GOV)

Curtis Smith; David Schwieder; Robert Nourgaliev

2012-09-01

During the early development of nuclear power plants, researchers and engineers focused on many aspects of plant operation, two of which were getting the newly-found technology to work and minimizing the likelihood of perceived accidents through redundancy and diversity. As time, and our experience, has progressed, the realization of plant operational risk/reliability has entered into the design, operation, and regulation of these plants. But, to date, we have only dabbled at the surface of risk and reliability technologies. For the next generation of small modular reactors (SMRs), it is imperative that these technologies evolve into an accepted, encompassing, validated, andmore » integral part of the plant in order to reduce costs and to demonstrate safe operation. Further, while it is presumed that safety margins are substantial for proposed SMR designs, the depiction and demonstration of these margins needs to be better understood in order to optimize the licensing process.« less

Diagnosing prosopagnosia in East Asian individuals: Norms for the Cambridge Face Memory Test-Chinese.

PubMed

McKone, Elinor; Wan, Lulu; Robbins, Rachel; Crookes, Kate; Liu, Jia

2017-07-01

The Cambridge Face Memory Test (CFMT) is widely accepted as providing a valid and reliable tool in diagnosing prosopagnosia (inability to recognize people's faces). Previously, large-sample norms have been available only for Caucasian-face versions, suitable for diagnosis in Caucasian observers. These are invalid for observers of different races due to potentially severe other-race effects. Here, we provide large-sample norms (N = 306) for East Asian observers on an Asian-face version (CFMT-Chinese). We also demonstrate methodological suitability of the CFMT-Chinese for prosopagnosia diagnosis (high internal reliability, approximately normal distribution, norm-score range sufficiently far above chance). Additional findings were a female advantage on mean performance, plus a difference between participants living in the East (China) or the West (international students, second-generation children of immigrants), which we suggest might reflect personality differences associated with willingness to emigrate. Finally, we demonstrate suitability of the CFMT-Chinese for individual differences studies that use correlations within the normal range.

Ultra Reliable Closed Loop Life Support for Long Space Missions

NASA Technical Reports Server (NTRS)

Jones, Harry W.; Ewert, Michael K.

2010-01-01

Spacecraft human life support systems can achieve ultra reliability by providing sufficient spares to replace all failed components. The additional mass of spares for ultra reliability is approximately equal to the original system mass, provided that the original system reliability is not too low. Acceptable reliability can be achieved for the Space Shuttle and Space Station by preventive maintenance and by replacing failed units. However, on-demand maintenance and repair requires a logistics supply chain in place to provide the needed spares. In contrast, a Mars or other long space mission must take along all the needed spares, since resupply is not possible. Long missions must achieve ultra reliability, a very low failure rate per hour, since they will take years rather than weeks and cannot be cut short if a failure occurs. Also, distant missions have a much higher mass launch cost per kilogram than near-Earth missions. Achieving ultra reliable spacecraft life support systems with acceptable mass will require a well-planned and extensive development effort. Analysis must determine the reliability requirement and allocate it to subsystems and components. Ultra reliability requires reducing the intrinsic failure causes, providing spares to replace failed components and having "graceful" failure modes. Technologies, components, and materials must be selected and designed for high reliability. Long duration testing is needed to confirm very low failure rates. Systems design should segregate the failure causes in the smallest, most easily replaceable parts. The system must be designed, developed, integrated, and tested with system reliability in mind. Maintenance and reparability of failed units must not add to the probability of failure. The overall system must be tested sufficiently to identify any design errors. A program to develop ultra reliable space life support systems with acceptable mass should start soon since it must be a long term effort.

The FACIT-Sp spiritual well-being scale: an investigation of the dimensionality, reliability and construct validity in a cognitively intact nursing home population.

PubMed

Haugan, Gørill

2015-03-01

Spiritual well-being has been found to be a strong individual predictor of overall nursing home satisfaction and a fundamental dimension of global as well as health-related quality-in-life among nursing home patients. Therefore, access to a valid and reliable measure of spiritual well-being among nursing home patients is highly warranted. The aim of this study was to investigate the dimensionality, reliability and construct validity of the Functional Assessment of Chronic Illness Therapy Spiritual Wellbeing scale in a cognitively intact nursing home population. A cross-sectional design was applied, selecting two counties in central Norway from which 20 municipalities representing 44 different nursing homes took part in this study. Long-term care was defined as 24-hour care with duration of 6 months or longer. Participants were 202 cognitively intact long-term nursing home patients fulfilling the inclusion criteria. Approval by all regulatory institutions dealing with research issues in Norway and the Management Unit at the 44 nursing homes was obtained. Explorative and confirmative factor analyses as well as correlation with selected construct were used. Though three items loaded very low (λ = 0.22, 0.26, 0.32) indicating low reliability, the three-factor model for the FACIT-Sp spiritual well-being scale provided an acceptable fit (χ(2) = 101.15 (df = 50), p-value <0.001, RMSEA = 0.075 p = 0.030, NFI = 0.90, GFI = 0.91, AGFI = 0.85) for older nursing home patients, demonstrating acceptable measurement reliability. Construct validity was supported by significant correlations in the hypothesised direction with the selected constructs. The three-factor model is an improvement over the original two-factor construct, based on these nursing home data. The measure yielded significantly factor loadings, good composite reliability and construct validity. © 2014 Nordic College of Caring Science.

Developing Ultra Reliable Life Support for the Moon and Mars

NASA Technical Reports Server (NTRS)

Jones, Harry W.

2009-01-01

Recycling life support systems can achieve ultra reliability by using spares to replace failed components. The added mass for spares is approximately equal to the original system mass, provided the original system reliability is not very low. Acceptable reliability can be achieved for the space shuttle and space station by preventive maintenance and by replacing failed units, However, this maintenance and repair depends on a logistics supply chain that provides the needed spares. The Mars mission must take all the needed spares at launch. The Mars mission also must achieve ultra reliability, a very low failure rate per hour, since it requires years rather than weeks and cannot be cut short if a failure occurs. Also, the Mars mission has a much higher mass launch cost per kilogram than shuttle or station. Achieving ultra reliable space life support with acceptable mass will require a well-planned and extensive development effort. Analysis must define the reliability requirement and allocate it to subsystems and components. Technologies, components, and materials must be designed and selected for high reliability. Extensive testing is needed to ascertain very low failure rates. Systems design should segregate the failure causes in the smallest, most easily replaceable parts. The systems must be designed, produced, integrated, and tested without impairing system reliability. Maintenance and failed unit replacement should not introduce any additional probability of failure. The overall system must be tested sufficiently to identify any design errors. A program to develop ultra reliable space life support systems with acceptable mass must start soon if it is to produce timely results for the moon and Mars.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stokes, David

This program seeks to demonstrate a solution to enhance existing biomass cookstove performance through the use of RTI’s Thermoelectric Enhanced Cookstove Add-on (TECA) device. The self-powered TECA device captures a portion of heat from the stove and converts it to electricity through a thermoelectric (TE) device to power a blower. Colorado State University and Envirofit International are partners to support the air injection design and commercialization to enhance combustion in the stove and reduce emissions. Relevance: By demonstrating a proof of concept of the approach with the Envirofit M-5000 stove and TECA device, we hope to apply this technology tomore » existing stoves that are already in use and reduce emissions for stoves that have already found user acceptance to provide a true health benefit. Challenges: The technical challenges include achieving Tier 4 emissions from a biomass stove and for such a stove to operate reliably in the harsh field environment. Additional challenges include the fact that it is difficult to develop a cost effective solution and insure adoption and proper use in the field. Outcomes: In this program we have demonstrated PM emissions at 82 mg/MJd, a 70% reduction as compared to baseline stove operation. We have also developed a stove optimization approach that reduces the number of costly experiments. We have evaluated component-level reliability and will be testing the stove prototype in the field for performance and reliability.« less

Development and Validation of a Fatigue Assessment Scale for U.S. Construction Workers

PubMed Central

Zhang, Mingzong; Sparer, Emily H.; Murphy, Lauren A.; Dennerlein, Jack T.; Fang, Dongping; Katz, Jeffrey N.; Caban-Martinez, Alberto J.

2015-01-01

Objective To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Methods Using a two-phased approach, we first identified items for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n=11) and focus groups (3 groups with 6 workers each) with construction workers. The second phase included assessment for the reliability, validity and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n=144). Results Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales (“Lethargy” and “Bodily Ailment”).. During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW (0.91), Lethargy (0.86) and Bodily Ailment (0.84)) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59–0.68; Intraclass Correlation Coefficients: 0.74–0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. Conclusions The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. PMID:25603944

Reliability and validity of a new HIV-specific questionnaire with adults living with HIV in Canada and Ireland: the HIV Disability Questionnaire (HDQ).

PubMed

O'Brien, Kelly K; Solomon, Patricia; Bergin, Colm; O'Dea, Siobhán; Stratford, Paul; Iku, Nkem; Bayoumi, Ahmed M

2015-08-12

Our aim was to assess internal consistency reliability, construct validity, and test-retest reliability of the HDQ with adults living with HIV in Canada and Ireland. We recruited adults 18 years of age or older living with HIV from hospital clinics and AIDS service organizations in Canada and Ireland. We administered the HDQ paired with reference measures (World Health Organization Disability Assessment Schedule, SF-36 Questionnaire, Medical Outcomes Study Social Support Survey), and a demographic questionnaire. We calculated HDQ disability presence, severity and episodic scores (scored from 0-100). We calculated Cronbach's alpha and Intraclass Correlation Coefficients (ICC) (Canada only) for the disability severity and episodic scores and considered coefficients >0.80 and >0.70 as acceptable, respectively. To assess construct validity, we tested 40 a priori hypotheses of correlations between scores on the HDQ and reference measures and two known group hypotheses comparing HDQ presence and severity scores based on age and comorbidity. We considered acceptance of at least 75% of hypotheses as demonstrating support for construct validity. Of the 235 participants (139 Canada; 96 Ireland), the majority were men (74% Ireland; 82% Canada) and were taking antiretroviral therapy (88% Ireland; 91% Canada). Compared with Irish participants, Canadian participants were older (median age: 48 versus 41 years) and reported living with a higher median number of comorbidities (4 versus 1). Cronbach's alpha for Irish and Canadian participants were 0.97 (95% confidence interval (CI): 0.97-0.98) and 0.96 (95 % CI: 0.95-0.98), respectively, for the severity scale and 0.98 (95 % CI: 0.97-0.98) and 0.96 (95 % CI: 0.95-0.98), respectively, for the episodic scale. Of the 40 construct validity correlation hypotheses, 32 (80%) and 22 (55%) were supported among the Canadian and Irish samples respectively; both (100%) known group hypotheses were also supported. ICC values for Canadian participants ranged from 0.80 (95 % CI: 0.71, 0.86) in the cognitive domain to 0.89 (95 % CI: 0.83, 0.92) in the social inclusion domain. The HDQ demonstrates internal consistency reliability and a variable degree of construct validity when administered to adults living with HIV in Canada and Ireland. The HDQ demonstrates test-retest reliability when administered to adults with HIV in Canada. Further validation of the HDQ outside of Canada is needed.

Screening for depression in clinical practice: reliability and validity of a five-item subset of the CES-Depression.

PubMed

Bohannon, Richard W; Maljanian, Rose; Goethe, John

2003-12-01

Individuals with chronic disease are not screened routinely for depression. Availability of an abbreviated test with demonstrated reliability and validity might encourage screening so we explored the reliability and validity of a 5-item subset of the 20-item Center for Epidemiological Studies Depression Scale among inner-city outpatients with chronic asthma or diabetes. Most patients were female (73.1%) and Hispanic (61.8%). Acceptable reliability was shown by Cronbach alpha (.76) for the subset of 5 items. Validity was supported by the high correlation of .91 between patients' scores on the 5-item subset and the full 20 items. The 5 items reflected a single factor (eigenvalue = 2.66). Receiver operating characteristic curve analysis identified cut-points for the 5 items that were sensitive (> .84) and specific (> or = .80) in identifying patients classified as depressed by full 20 items. The reduced patient and clinician burden of the subset of 5 items, as well as its desirable psychometric properties, support broader application of this subset as a screening tool for depression.

Tolerability, usability and acceptability of dissolving microneedle patch administration in human subjects

PubMed Central

Arya, Jaya; Henry, Sebastien; Kalluri, Haripriya; McAllister, Devin V.; Pewin, Winston P.; Prausnitz, Mark R.

2017-01-01

To support translation of microneedle patches from pre-clinical development into clinical trials, this study examined the effect of microneedle patch application on local skin reactions, reliability of use and acceptability to patients. Placebo patches containing dissolving microneedles were administered to fifteen human participants. Microneedle patches were well tolerated in the skin with no pain or swelling and only mild erythema localized to the site of patch administration that resolved fully within seven days. Microneedle patches could be administered by hand without the need of an applicator and delivery efficiencies were similar for investigator-administration and self-administration. Microneedle patch administration was not considered painful and the large majority of subjects were somewhat or fully confident that they self-administered patches correctly. Microneedle patches were overwhelmingly preferred over conventional needle and syringe injection. Altogether, these results demonstrate that dissolving microneedle patches were well tolerated, easily usable and strongly accepted by human subjects, which will facilitate further clinical translation of this technology. PMID:28285193

Several submaximal exercise tests are reliable, valid and acceptable in people with chronic pain, fibromyalgia or chronic fatigue: a systematic review.

PubMed

Ratter, Julia; Radlinger, Lorenz; Lucas, Cees

2014-09-01

Are submaximal and maximal exercise tests reliable, valid and acceptable in people with chronic pain, fibromyalgia and fatigue disorders? Systematic review of studies of the psychometric properties of exercise tests. People older than 18 years with chronic pain, fibromyalgia and chronic fatigue disorders. Studies of the measurement properties of tests of physical capacity in people with chronic pain, fibromyalgia or chronic fatigue disorders were included. Studies were required to report: reliability coefficients (intraclass correlation coefficient, alpha reliability coefficient, limits of agreements and Bland-Altman plots); validity coefficients (intraclass correlation coefficient, Spearman's correlation, Kendal T coefficient, Pearson's correlation); or dropout rates. Fourteen studies were eligible: none had low risk of bias, 10 had unclear risk of bias and four had high risk of bias. The included studies evaluated: Åstrand test; modified Åstrand test; Lean body mass-based Åstrand test; submaximal bicycle ergometer test following another protocol other than Åstrand test; 2-km walk test; 5-minute, 6-minute and 10-minute walk tests; shuttle walk test; and modified symptom-limited Bruce treadmill test. None of the studies assessed maximal exercise tests. Where they had been tested, reliability and validity were generally high. Dropout rates were generally acceptable. The 2-km walk test was not recommended in fibromyalgia. Moderate evidence was found for reliability, validity and acceptability of submaximal exercise tests in patients with chronic pain, fibromyalgia or chronic fatigue. There is no evidence about maximal exercise tests in patients with chronic pain, fibromyalgia and chronic fatigue. Copyright © 2014. Published by Elsevier B.V.

ARABIC TRANSLATION AND ADAPTATION OF THE HOSPITAL CONSUMER ASSESSMENT OF HEALTHCARE PROVIDERS AND SYSTEMS (HCAHPS) PATIENT SATISFACTION SURVEY INSTRUMENT.

PubMed

Dockins, James; Abuzahrieh, Ramzi; Stack, Martin

2015-01-01

To translate and adapt an effective, validated, benchmarked, and widely used patient satisfaction measurement tool for use with an Arabic-speaking population. Translation of survey's items, survey administration process development, evaluation of reliability, and international benchmarking Three hundred-bed tertiary care hospital in Jeddah, Saudi Arabia. 645 patients discharged during 2011 from the hospital's inpatient care units. INTERVENTIONS; The Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) instrument was translated into Arabic, a randomized weekly sample of patients was selected, and the survey was administered via telephone during 2011 to patients or their relatives. Scores were compiled for each of the HCAHPS questions and then for each of the six HCAHPS clinical composites, two non-clinical items, and two global items. Clinical composite scores, as well as the two non-clinical and two global items were analyzed for the 645 respondents. Clinical composites were analyzed using Spearman's correlation coefficient and Cronbach's alpha to demonstrate acceptable internal consistency for these items and scales demonstrated acceptable internal consistency for the clinical composites. (Spearman's correlation coefficient = 0.327 - 0.750, P < 0.01; Cronbach's alpha = 0.516 - 0.851) All ten HCAHPS measures were compared quarterly to US national averages with results that closely paralleled the US benchmarks. . The Arabic translation and adaptation of the HCAHPS is a valid, reliable, and feasible tool for evaluation and benchmarking of inpatient satisfaction in Arabic speaking populations.

A Theory-Grounded Measure of Adolescents’ Response to a Media Literacy Intervention

PubMed Central

Greene, Kathryn; Yanovitzky, Itzhak; Carpenter, Amanda; Banerjee, Smita C.; Magsamen-Conrad, Kate; Hecht, Michael L.; Elek, Elvira

2016-01-01

Media literacy interventions offer promising avenues for the prevention of risky health behaviors among children and adolescents, but current literature remains largely equivocal about their efficacy. The primary objective of this study was to develop and test theoretically-grounded measures of audiences’ degree of engagement with the content of media literacy programs based on the recognition that engagement (and not participation per se) can better explain and predict individual variations in the effects of these programs. We tested the validity and reliability of a measure of engagement with two different samples of 10th grade high school students who participated in a pilot and actual test of a brief media literacy curriculum. Four message evaluation factors (involvement, perceived novelty, critical thinking, personal reflection) emerged and demonstrate acceptable reliability. PMID:28042522

A conflict management scale for pharmacy.

PubMed

Austin, Zubin; Gregory, Paul A; Martin, Craig

2009-11-12

To develop and establish the validity and reliability of a conflict management scale specific to pharmacy practice and education. A multistage inventory-item development process was undertaken involving 93 pharmacists and using a previously described explanatory model for conflict in pharmacy practice. A 19-item inventory was developed, field tested, and validated. The conflict management scale (CMS) demonstrated an acceptable degree of reliability and validity for use in educational or practice settings to promote self-reflection and self-awareness regarding individuals' conflict management styles. The CMS provides a unique, pharmacy-specific method for individuals to determine and reflect upon their own conflict management styles. As part of an educational program to facilitate self-reflection and heighten self-awareness, the CMS may be a useful tool to promote discussions related to an important part of pharmacy practice.

Methodology Used to Assess Acceptability of Oral Pediatric Medicines: A Systematic Literature Search and Narrative Review.

PubMed

Mistry, Punam; Batchelor, Hannah

2017-06-01

Regulatory guidelines require that any new medicine designed for a pediatric population must be demonstrated as being acceptable to that population. There is currently no guidance on how to conduct or report on acceptability testing. Our objective was to undertake a review of the methods used to assess the acceptability of medicines within a pediatric population and use this review to propose the most appropriate methodology. We used a defined search strategy to identify literature reports of acceptability assessments of medicines conducted within pediatric populations and extracted information about the tools used in these studies for comparison across studies. In total, 61 articles were included in the analysis. Palatability was the most common (54/61) attribute measured when evaluating acceptability. Simple scale methods were most commonly used, with visual analog scales (VAS) and hedonic scales used both separately and in combination in 34 of the 61 studies. Hedonic scales alone were used in 14 studies and VAS alone in just five studies. Other tools included Likert scales; forced choice or preference; surveys or questionnaires; observations of facial expressions during administration, ease of swallowing, or ability to swallow the dosage; prevalence of complaints or refusal to take the medicine; and time taken for a nurse to administer the medicine. The best scale in terms of validity, reliability, feasibility, and preference to use when assessing acceptability remains unclear. Further work is required to select the most appropriate method to justify whether a medicine is acceptable to a pediatric population.

Validation of the Malay version of the Inventory of Functional Status after Childbirth questionnaire.

PubMed

Noor, Norhayati Mohd; Aziz, Aniza Abd; Mostapa, Mohd Rosmizaki; Awang, Zainudin

2015-01-01

This study was designed to examine the psychometric properties of Malay version of the Inventory of Functional Status after Childbirth (IFSAC). A cross-sectional study. A total of 108 postpartum mothers attending Obstetrics and Gynaecology Clinic, in a tertiary teaching hospital in Malaysia, were involved. Construct validity and internal consistency were performed after the translation, content validity, and face validity process. The data were analyzed using Analysis of Moment Structure version 18 and Statistical Packages for the Social Sciences version 20. The final model consists of four constructs, namely, infant care, personal care, household activities, and social and community activities, with 18 items demonstrating acceptable factor loadings, domain to domain correlation, and best fit (Chi-squared/degree of freedom = 1.678; Tucker-Lewis index = 0.923; comparative fit index = 0.936; and root mean square error of approximation = 0.080). Composite reliability and average variance extracted of the domains ranged from 0.659 to 0.921 and from 0.499 to 0.628, respectively. The study suggested that the four-factor model with 18 items of the Malay version of IFSAC was acceptable to be used to measure functional status after childbirth because it is valid, reliable, and simple.

The DASS-14: Improving the Construct Validity and Reliability of the Depression, Anxiety, and Stress Scale in a Cohort of Health Professionals.

PubMed

Wise, Frances M; Harris, Darren W; Olver, John H

2017-01-01

Considerable research has been undertaken in evaluating the DASS-21 in a variety of clinical populations, but studies of the instrument's psychometric adequacy in healthcare professionals is lacking. This study aimed to establish and improve the construct validity and reliability of the DASS-21 in a cohort of Australian health professionals. 343 rehabilitation health professionals completed the DASS-21, along with a demographic questionnaire. Principal components analysis was performed to identify potential factors in the DASS-21. Factors were interpreted against theoretical constructs underlying the instrument. Items loading on separate factors were then subjected to reliability analysis to determine internal consistency of subscales. Items that demonstrated poor fit, or loaded onto more than one factor, were deleted to maximise the reliability of each subscale. Principal components analysis identified three dimensions (depression, anxiety, stress) in a modified version of the DASS-21 (renamed DASS-14), with appropriate construct validity and good reliability (a=0.73 to 0.88). The three dimensions accounted for over 62% of variance between items. The modified DASS-14 scale is a more parsimonious measure of depression, anxiety, and stress, with acceptable reliability and construct validity, in rehabilitation health professionals and is appropriate for use in studies of similar populations.

Reliability Generalization of Scores on the Spielberger State-Trait Anxiety Inventory.

ERIC Educational Resources Information Center

Barnes, Laura L. B.; Harp, Diane; Jung, Woo Sik

2002-01-01

Conducted a reliability generalization study for the State-Trait Anxiety Inventory (C. Spielberger, 1983) by reviewing and classifying 816 research articles. Average reliability coefficients were acceptable for both internal consistency and test-retest reliability, but variation was present among the estimates. Other differences are discussed.…

Measuring and Promoting Acceptance of Young Children with Disabilities.

ERIC Educational Resources Information Center

Favazza, Paddy C.; Phillipsen, Leslie; Kumar, Poonam

2000-01-01

Results of two studies indicate the Acceptance Scale for Kindergartners was reliable with a sample of minority, low socioeconomic status children and that children exposed to all of the components of an intervention designed to promote acceptance of young children with disabilities had short-term and long-term gains in acceptance. (Contains…

Landfill gas to electricity demonstration project

NASA Astrophysics Data System (ADS)

Giuliani, A. J.; Cagliostro, L. A.

1982-03-01

Medium Btu methane gas is a naturally occurring by product of anaerobic digestion of landfilled municipal solid waste. The energy potential of landfill gas in New York State is estimated to be 61 trillion Btu's per year or the equivalent of 10 percent of the natural gas used annually in the State. The 18-month Landfill Gas to Electricity Demonstration Project conducted at the Fresh Kills Landfill in Staten Island, New York conclusively demonstrated that landfill gas is an acceptable fuel for producing electricity using an internal combustion engine/generator set. Landfill gas proved to be a reliable and consistent fuel source during a six-month field test program. Engine exhaust emissions were determined to be comparable to that of natural gas and no unusually high corrosion rates on standard pipeline material were found.

Validity and reliability of the Japanese version of the FIM + FAM in patients with cerebrovascular accident.

PubMed

Miki, Emi; Yamane, Shingo; Yamaoka, Mai; Fujii, Hiroe; Ueno, Hiroka; Kawahara, Toshie; Tanaka, Keiko; Tamashiro, Hiroaki; Inoue, Eiji; Okamoto, Takatsugu; Kuriyama, Masaru

2016-09-01

The study aim was to investigate the validity and reliability of the Functional Independence Measure and Functional Assessment Measure (FIM + FAM), which is unfamiliar in Japan, by using its Japanese version (FIM + FAM-j) in patients with cerebrovascular accident (CVA). Forty-two CVA patients participated. Criterion validity was examined by correlating the full scale and subscales of FIM + FAM-j with several well-established measurements using Spearman's correlation coefficient. Reliability was evaluated by internal consistency (tested by Cronbach's alpha coefficient) and intra-rater reliability (tested by Kendall's tau correlation coefficient). Good-to-excellent criterion validity was found between the full scale and motor subscales of the FIM + FAM-j and the Barthel Index, National Institutes of Health Stroke Scale, modified Rankin Scale, and lower extremity Brunnstrom Recovery Stage. High internal consistency was observed within the full-scale FIM + FAM-j and the motor and cognitive subscales (Cronbach's alphas were 0.968, 0.954, and 0.948, respectively). Additionally, good intra-rater reliability was observed within the full scale and motor subscales, and excellent reliability for the cognitive subscales (taus were 0.83, 0.80, and 0.98, respectively). This study showed that the FIM + FAM-j demonstrated acceptable levels of validity and reliability when used for CVA as a measure of disability.

Validation of an Arabic version of Fatigue Severity Scale

PubMed Central

Al-Sobayel, Hana I.; Al-Hugail, Hind A.; AlSaif, Ranyah M.; Albawardi, Nada M.; Alnahdi, Ali H.; Daif, Abdulkader M.; Al-Arfaj, Hussein F.

2016-01-01

Objectives: To develop and test the psychometric properties of an Arabic version of Fatigue Severity Scale (FSS-Ar) that can be used to measure fatigue in Arabic patients with disorders where fatigue is a major symptom. Methods: Forward and backward translations of FSS were undertaken to develop an Arabic version. The validity and reliability of the FSS-Ar was then tested on 28 patients with systemic lupus erythematosus (SLE), 24 patients with multiple sclerosis (MS), and 31 healthy subjects. Exploratory factor analysis and hypothesis testing methods were used to examine construct validity. The correlation between FSS-Ar and the vitality domain of the RAND 36-Item Health was examined to test construct validity. The study was conducted at the King Khalid University Hospital, Riyadh, Kingdom of Saudi Arabia between February and June 2012. Results: Using a score of ≥4.05 to define fatigue, 39 of 52 (75%) participants were fatigued compared with 10 out of 31 (32%) healthy participants. The correlation between the FSS-Ar and the vitality domain of the RAND-36 was acceptable (r = -0.46). Factor analysis showed that items of the FSS-Ar measured one underlying construct, namely, fatigue. Test-retest reliability and internal consistency of the FSS-Ar was acceptable (intraclass correlation coefficient model 2,1 = 0.80; Cronbach’s alpha = 0.84). Conclusion: The Arabic version of the FSS demonstrated acceptable psychometric properties and was able to differentiate between patients with SLE or MS, and healthy subjects. PMID:26739978

Methods for Calculating Frequency of Maintenance of Complex Information Security System Based on Dynamics of Its Reliability

NASA Astrophysics Data System (ADS)

Varlataya, S. K.; Evdokimov, V. E.; Urzov, A. Y.

2017-11-01

This article describes a process of calculating a certain complex information security system (CISS) reliability using the example of the technospheric security management model as well as ability to determine the frequency of its maintenance using the system reliability parameter which allows one to assess man-made risks and to forecast natural and man-made emergencies. The relevance of this article is explained by the fact the CISS reliability is closely related to information security (IS) risks. Since reliability (or resiliency) is a probabilistic characteristic of the system showing the possibility of its failure (and as a consequence - threats to the protected information assets emergence), it is seen as a component of the overall IS risk in the system. As it is known, there is a certain acceptable level of IS risk assigned by experts for a particular information system; in case of reliability being a risk-forming factor maintaining an acceptable risk level should be carried out by the routine analysis of the condition of CISS and its elements and their timely service. The article presents a reliability parameter calculation for the CISS with a mixed type of element connection, a formula of the dynamics of such system reliability is written. The chart of CISS reliability change is a S-shaped curve which can be divided into 3 periods: almost invariable high level of reliability, uniform reliability reduction, almost invariable low level of reliability. Setting the minimum acceptable level of reliability, the graph (or formula) can be used to determine the period of time during which the system would meet requirements. Ideally, this period should not be longer than the first period of the graph. Thus, the proposed method of calculating the CISS maintenance frequency helps to solve a voluminous and critical task of the information assets risk management.

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

Multidimensional daily diary of fatigue-fibromyalgia-17 items (MDF-fibro-17): part 2 psychometric evaluation in fibromyalgia patients.

PubMed

Li, Y; Morris, S; Cole, J; Dube', S; Smith, J A M; Burbridge, C; Symonds, T; Hudgens, S; Wang, W

2017-05-18

The Multidimensional Daily Diary of Fatigue-Fibromyalgia-17 instrument (MDF-Fibro-17) has been developed for use in fibromyalgia (FM) clinical studies and includes 5 domains: Global Fatigue Experience, Cognitive Fatigue, Physical Fatigue, Motivation, and Impact on Function. Psychometric properties of the MDF-Fibro-17 needed to demonstrate the appropriateness of using this instrument in clinical studies are presented. Psychometric analyses were conducted to evaluate the factor structure, reliability, validity, and responsiveness of the MDF-Fibro-17 using data from a Phase 2 clinical study of FM patients (N = 381). Confirmatory factor analyses (CFA) were performed to ensure understanding of the multidimensional domain structure, and a secondary factor analysis of the domains examined the appropriateness of calculating a total score in addition to domain scores. Longitudinal psychometric analyses (test-retest reliability and responder analysis) were also conducted on the data from Baseline to Week 6. The CFA supported the 17-item, 5 domain structure of this instrument as the best fit of the data: comparative fit index (CFI) and non-normed fit index (NNFI) were 0.997 and 0.992 respectively, standardized root mean square residual (SRMR) was 0.010 and the root mean square error of approximation (RMSEA) was 0.06. In addition, total score (CFI and NNFI both 0.95) met required standards. For the total and 5 domain scores, reliability and validity data were acceptable: test-retest and internal consistency were above 0.9; correlations were as expected with the Global Fatigue Index (GFI) (0.62-0.75), Fibromyalgia Impact Questionnaire (FIQ) Total (0.59-0.71), and 36-Item Short Form Health Survey (SF-36) vitality (VT) (0.43-0.53); and discrimination was shown using quintile scores for the GFI, FIQ Total, and Pain Numeric Rating Scale (NRS) quartiles. In addition, sensitivity to change was demonstrated with an overall mean responder score of -2.59 using anchor-based methods. The MDF-Fibro-17 reliably measures 5 domains of FM-related fatigue and psychometric evaluation confirms that this measure meets or exceeds each of the predefined acceptable thresholds for evidence of reliability, validity, and responsiveness to changes in clinical status. This suggests that the MDF-Fibro-17 is an appropriate and responsive measure of FM-related fatigue in clinical studies.

Psychometric properties of the SCOFF questionnaire (Chinese version) for screening eating disorders in Hong Kong secondary school students: a cross-sectional study.

PubMed

Leung, Sau Fong; Lee, Ka Li; Lee, Sze Man; Leung, Sik Chi; Hung, Wing Sze; Lee, Wai Leng; Leung, Yuen Yee; Li, Man Wai; Tse, Tak Kin; Wong, Hoi Kei; Wong, Yuen Ni

2009-02-01

Eating disorders are affecting an increasing number of high school students in Western and Asian countries. The availability of an effective screening tool is crucial for early detection and prompt intervention. The objective of this study was to examine the validity and reliability of the SCOFF questionnaire for screening eating disorders in Hong Kong high school students. This study adopted a cross-sectional design to examine the psychometric properties of the SCOFF questionnaire. A panel of 7 experts and 936 students of a high school participated in the study. The SCOFF questionnaire was translated into Chinese and back-translated into English to ensure the linguistic equivalence. A panel of 7 experts involved in the content validation of the SCOFF questionnaire. The Eating Disorder Examination-Questionnaire (EDE-Q) was used as the "reference standard" to assess its concurrent validity in 936 students of a high school. Its reliability was examined by internal consistency and the test-retest method at a 2-week interval and with 38 students. The SCOFF questionnaire achieved an agreement of 86-100% among the experts for the content relevance. Of 812 students (86.8%) who responded to this study, their SCOFF scores correlated significantly with their global scores on the EDE-Q (r=0.5, P<0.01). Students identified as potentially having eating disorders had significantly higher scores in the EDE-Q than those not identified as such by SCOFF. The SCOFF questionnaire demonstrated moderate test-retest reliability (ICC=0.66) and an acceptable internal consistency reliability (Cronbach's alpha=0.44-0.57) in comparing with previous studies. The SCOFF questionnaire has acceptable psychometric properties in the Chinese culture. It will be useful for detecting potential eating disorders and assisting health promotion activity.

Reliability of Untrained and Experienced Raters on FEES: Rating Overall Residue is a Simple Task.

PubMed

Pisegna, Jessica M; Borders, James C; Kaneoka, Asako; Coster, Wendy J; Leonard, Rebecca; Langmore, Susan E

2018-03-07

The purpose of this study was to investigate the reliability of residue ratings on Fiberoptic Endoscopic Evaluation of Swallowing (FEES). We also examined rating differences based on experience to determine if years of experience influenced residue ratings. A group of 44 raters watched 81 FEES videos representing a wide range of residue severities for thin liquid, applesauce, and cracker boluses. Raters were untrained on the rating scales and simply rated their overall impression of residue amount on a visual analog scale (VAS) and a five-point ordinal scale in a randomized fashion across two sessions. Intra-class correlation coefficients, kappa coefficients, and ANOVAs were used to analyze agreement and differences in ratings. Residue ratings on both the VAS and ordinal scales had acceptable inter- and intra-rater reliability. Inter-rater agreement was acceptable (ICC > 0.7) for all comparisons. Intra-rater agreement was excellent on the VAS scale (r c  = 0.9) and good on the ordinal scale (k = 0.78). There was no significant difference between expert ratings and other raters based on years of experience for cracker ratings (p = 0.2119) and applesauce ratings (p = 0.2899), but there was a significant difference between clinicians on thin liquid ratings (p = 0.0005). Without any specific training, raters demonstrated high reliability when rating the overall amount of residue on FEES. Years of experience with FEES did not influence residue ratings, suggesting that expert ratings of overall residue amount are not unique or specialized. Rating the overall amount of residue on FEES appears to be a simple visual-perceptual task for puree and cracker boluses.

Development and Validation of a Measure of Attitudes toward Fluffy Women

PubMed Central

Barned, C; Lipps, GE

2014-01-01

ABSTRACT Background: There is an absence of research on the newly evolved term “fluffy” which describes body image and personality features among women. Research on “fluffiness” among Caribbean peoples has been limited by the lack of valid and reliable measures of the concept. Objective: This project addresses this problem by exploring the internal consistency reliability and the concurrent and discriminant validity of the Attitudes toward Fluffy Women Scale (ATFW) using a mixture of past and present students from The University of the West Indies (UWI), Mona, and the University of Technology (UTech), Kingston. Method: Past or present students from The UWI, Mona, and UTech, Kingston, were recruited for the study through the use of convenience sampling. A total of 80 students (38 males, 47.5%; 42 females, 52.5%) participated in the study. Results: Overall, the ATFW was found to have an acceptable degree of internal consistency reliability (α = 0.90). The scale also had reasonably good concurrent validity as evidenced by moderate correlations with scores on the Attitudes Toward Obese Persons Scale (r = −0.42) and acceptable discriminant validity as demonstrated through low correlations with a Bogardus Social Distance Scale designed to assess prejudice toward people living with the human immunodeficiency virus [HIV] (r = 0.29). This pattern of scores suggests that the majority of the stable variance underlying the ATFW assesses the “fluffy” concept (17.6%) while a smaller degree of the variability (8%) measures a conceptually similar but distinct concept. Conclusion: The Attitudes toward Fluffy Women scale was found to be a reliable and valid scale for assessing the attitudes of young adults toward fluffy women. PMID:25803379

Validity and reliability of the Spanish version of the 10-item CD-RISC in patients with fibromyalgia

PubMed Central

2014-01-01

Background No resilience scale has been validated in Spanish patients with fibromyalgia. The aim of this study was to evaluate the validity and reliability of the 10-item CD-RISC in a sample of Spanish patients with fibromyalgia. Methods Design: Observational prospective multicenter study. Sample: Patients with diagnoses of fibromyalgia recruited from primary care settings (N = 208). Instruments: In addition to sociodemographic data, the following questionnaires were administered: Pain Visual Analogue Scale (PVAS), the 10-item Connor-Davidson Resilience scale (10-item CD-RISC), the Fibromyalgia Impact Questionnaire (FIQ), the Hospital Anxiety and Depression Scale (HADS), the Pain Catastrophizing Scale (PCS), the Chronic Pain Acceptance Questionnaire (CPAQ), and the Mindful Attention Awareness Scale (MAAS). Results Regarding construct validity, the factor solution in the Principal Component Analysis (PCA) was considered adequate, so the KMO test had a value of 0.91, and the Barlett’s test of sphericity was significant (χ2 = 852.8; gl = 45; p < 0.001). Only one factor showed an eigenvalue greater than 1, and it explained 50.4% of the variance. PCA and Confirmatory Factor Analysis (CFA) results did not show significant differences between groups. The 10-item CD-RISC scale demonstrated good internal consistency (Cronbach’s alpha = 0.88) and test-retest reliability (r = 0.89 for a six-week interval). The 10-item CD-RISC score was significantly correlated with all of the other psychometric instruments in the expected direction, except for the PVAS (−0.115; p = 0.113). Conclusions Our study confirms that the Spanish version of the 10-item CD-RISC shows, in patients with fibromyalgia, acceptable psychometric properties, with a high level of reliability and validity. PMID:24484847

[Validation of the Copenhagen Burnout Inventory to assess professional burnout in Spain].

PubMed

Molinero Ruiz, Emilia; Basart Gómez-Quintero, Helena; Moncada Lluis, Salvador

2013-01-01

The Copenhagen Burnout Inventory (CBI) is a public domain questionnaire measuring the degree of psychological fatigue experienced in three subdimensions of Burnout: personal (PB), work-related (WB), and client-related Burnout (CB). The study aimed to examine the acceptability, reliability and construct validity of the Spanish version of CBI. The study population consisted of 479 workers of educational centers, social work centres, healthcare centres and workers within the industry sector. Data was collected in 2009 through a self-administered questionnaire including the three CBI scales, sixteen scales of psychosocial work environment (COPSOQ ISTAS21) and perceived general and mental health and vitality (SF-36). Response rate was 78.7%. The three scales have an inter-item correlation average between 0.42 and 0.60 and a corrected item-total correlation between 0,49 and 0,83. The internal consistency of the three scales had Cronbach's α values of 0.90 for PB, 0.83 for WB and 0.82 for CB. Burnout was related to both psychosocial work environment and wellbeing measures in the expected direction and intensity. The items of the three scales show good discrimination capacity, good consistency and homogeneity. The three CBI scales have an acceptable internal consistency reliability index, slightly higher in PB. The discrimination capacity of the scales is verified through the discrimination index and the different levels between occupations and activities. These results demonstrate that the Spanish version of the CBI is a reliable and valid instrument for measuring Burnout.

Proof test methodology for composites

NASA Technical Reports Server (NTRS)

Wu, Edward M.; Bell, David K.

1992-01-01

The special requirements for proof test of composites are identified based on the underlying failure process of composites. Two proof test methods are developed to eliminate the inevitable weak fiber sites without also causing flaw clustering which weakens the post-proof-test composite. Significant reliability enhancement by these proof test methods has been experimentally demonstrated for composite strength and composite life in tension. This basic proof test methodology is relevant to the certification and acceptance of critical composite structures. It can also be applied to the manufacturing process development to achieve zero-reject for very large composite structures.

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project.

PubMed

Whitford, Heather M; Donnan, Peter T; Symon, Andrew G; Kellett, Gillian; Monteith-Hodge, Ewa; Rauchhaus, Petra; Wyatt, Jeremy C

2012-01-01

To test the reliability, validity, acceptability, and practicality of short message service (SMS) messaging for collection of research data. The studies were carried out in a cohort of recently delivered women in Tayside, Scotland, UK, who were asked about their current infant feeding method and future feeding plans. Reliability was assessed by comparison of their responses to two SMS messages sent 1 day apart. Validity was assessed by comparison of their responses to text questions and the same question administered by phone 1 day later, by comparison with the same data collected from other sources, and by correlation with other related measures. Acceptability was evaluated using quantitative and qualitative questions, and practicality by analysis of a researcher log. Reliability of the factual SMS message gave perfect agreement. Reliabilities for the numerical question were reasonable, with κ between 0.76 (95% CI 0.56 to 0.96) and 0.80 (95% CI 0.59 to 1.00). Validity for data compared with that collected by phone within 24 h (κ =0.92 (95% CI 0.84 to 1.00)) and with health visitor data (κ =0.85 (95% CI 0.73 to 0.97)) was excellent. Correlation validity between the text responses and other related demographic and clinical measures was as expected. Participants found the method a convenient and acceptable way of providing data. For researchers, SMS text messaging provided an easy and functional method of gathering a large volume of data. In this sample and for these questions, SMS was a reliable and valid method for capturing research data.

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project

PubMed Central

Donnan, Peter T; Symon, Andrew G; Kellett, Gillian; Monteith-Hodge, Ewa; Rauchhaus, Petra; Wyatt, Jeremy C

2012-01-01

Objective To test the reliability, validity, acceptability, and practicality of short message service (SMS) messaging for collection of research data. Materials and methods The studies were carried out in a cohort of recently delivered women in Tayside, Scotland, UK, who were asked about their current infant feeding method and future feeding plans. Reliability was assessed by comparison of their responses to two SMS messages sent 1 day apart. Validity was assessed by comparison of their responses to text questions and the same question administered by phone 1 day later, by comparison with the same data collected from other sources, and by correlation with other related measures. Acceptability was evaluated using quantitative and qualitative questions, and practicality by analysis of a researcher log. Results Reliability of the factual SMS message gave perfect agreement. Reliabilities for the numerical question were reasonable, with κ between 0.76 (95% CI 0.56 to 0.96) and 0.80 (95% CI 0.59 to 1.00). Validity for data compared with that collected by phone within 24 h (κ =0.92 (95% CI 0.84 to 1.00)) and with health visitor data (κ =0.85 (95% CI 0.73 to 0.97)) was excellent. Correlation validity between the text responses and other related demographic and clinical measures was as expected. Participants found the method a convenient and acceptable way of providing data. For researchers, SMS text messaging provided an easy and functional method of gathering a large volume of data. Conclusion In this sample and for these questions, SMS was a reliable and valid method for capturing research data. PMID:22539081

Development and validation of the Survey of Organizational Research Climate (SORC).

PubMed

Martinson, Brian C; Thrush, Carol R; Lauren Crain, A

2013-09-01

Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach's α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from 0.13 to 0.95) document both construct and discriminant validity of the instrument. The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity.

Development and evaluation of oral Cancer quality-of-life questionnaire (QOL-OC).

PubMed

Nie, Min; Liu, Chang; Pan, Yi-Chen; Jiang, Chen-Xi; Li, Bao-Ru; Yu, Xi-Jie; Wu, Xin-Yu; Zheng, Shu-Ning

2018-05-03

In this study scales and items for the Oral Cancer Quality-of-life Questionnaire (QOL-OC) were designed and the instrument was evaluated. The QOL-OC was developed and modified using the international definition of quality of life (QOL) promulgated by the European Organization for Research and Treatment of Cancer (EORTC) and analysis of the precedent measuring instruments. The contents of each item were determined in the context of the specific characteristics of oral cancer. Two hundred thirteen oral cancer patients were asked to complete both the EORTC core quality of life questionnaire (EORTC QLC-C30) and the QOL-OC. Data collected was used to conduct factor analysis, test-retest reliability, internal consistency, and construct validity. Questionnaire compliance was relatively high. Fourteen of the 213 subjects accepted the same tests after 24 to 48 h demonstrating a high test-retest reliability for all five scales. Overall internal consistency surpasses 0.8. The outcome of the factor analysis coincides substantially with our theoretical conception. Each item shows a higher correlation coefficient within its own scale than the others which indicates high construct validity. QOL-OC demonstrates fairly good statistical reliability, validity, and feasibility. However, further tests and modification are needed to ensure its applicability to the quality-of-life assessment of Chinese oral cancer patients.

Development and Validation of the Survey of Organizational Research Climate (SORC)

PubMed Central

Martinson, Brian C.; Thrush, Carol R.; Crain, A. Lauren

2012-01-01

Background Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. Methods A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Results Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach’s α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from .13 to .95) document both construct and discriminant validity of the instrument. Conclusions The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity. PMID:23096775

The impact of false warnings on partial and full lane departure warnings effectiveness and acceptance in car driving.

PubMed

Navarro, Jordan; Yousfi, Elsa; Deniel, Jonathan; Jallais, Christophe; Bueno, Mercedes; Fort, Alexandra

2016-12-01

In the past, lane departure warnings (LDWs) were demonstrated to improve driving behaviours during lane departures but little is known about the effects of unreliable warnings. This experiment focused on the influence of false warnings alone or in combination with missed warnings and warning onset on assistance effectiveness and acceptance. Two assistance unreliability levels (33 and 17%) and two warning onsets (partial and full lane departure) were manipulated in order to investigate interaction. Results showed that assistance, regardless unreliability levels and warning onsets, improved driving behaviours during lane departure episodes and outside of these episodes by favouring better lane-keeping performances. Full lane departure and highly unreliable warnings, however, reduced assistance efficiency. Drivers' assistance acceptance was better for the most reliable warnings and for the subsequent warnings. The data indicate that imperfect LDWs (false warnings or false and missed warnings) further improve driving behaviours compared to no assistance. Practitioner Summary: This study revealed that imperfect lane departure warnings are able to significantly improve driving performances and that warning onset is a key element for assistance effectiveness and acceptance. The conclusion may be of particular interest for lane departure warning designers.

What Adherence Measures Should Be Used in Trials of Home-Based Rehabilitation Interventions? A Systematic Review of the Validity, Reliability, and Acceptability of Measures.

PubMed

Frost, Rachael; Levati, Sara; McClurg, Doreen; Brady, Marian; Williams, Brian

2017-06-01

To systematically review methods for measuring adherence used in home-based rehabilitation trials and to evaluate their validity, reliability, and acceptability. In phase 1 we searched the CENTRAL database, NHS Economic Evaluation Database, and Health Technology Assessment Database (January 2000 to April 2013) to identify adherence measures used in randomized controlled trials of allied health professional home-based rehabilitation interventions. In phase 2 we searched the databases of MEDLINE, Embase, CINAHL, Allied and Complementary Medicine Database, PsycINFO, CENTRAL, ProQuest Nursing and Allied Health, and Web of Science (inception to April 2015) for measurement property assessments for each measure. Studies assessing the validity, reliability, or acceptability of adherence measures. Two reviewers independently extracted data on participant and measure characteristics, measurement properties evaluated, evaluation methods, and outcome statistics and assessed study quality using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. In phase 1 we included 8 adherence measures (56 trials). In phase 2, from the 222 measurement property assessments identified in 109 studies, 22 high-quality measurement property assessments were narratively synthesized. Low-quality studies were used as supporting data. StepWatch Activity Monitor validly and acceptably measured short-term step count adherence. The Problematic Experiences of Therapy Scale validly and reliably assessed adherence to vestibular rehabilitation exercises. Adherence diaries had moderately high validity and acceptability across limited populations. The Borg 6 to 20 scale, Bassett and Prapavessis scale, and Yamax CW series had insufficient validity. Low-quality evidence supported use of the Joint Protection Behaviour Assessment. Polar A1 series heart monitors were considered acceptable by 1 study. Current rehabilitation adherence measures are limited. Some possess promising validity and acceptability for certain parameters of adherence, situations, and populations and should be used in these situations. Rigorous evaluation of adherence measures in a broader range of populations is needed. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Identifying reliable independent components via split-half comparisons

PubMed Central

Groppe, David M.; Makeig, Scott; Kutas, Marta

2011-01-01

Independent component analysis (ICA) is a family of unsupervised learning algorithms that have proven useful for the analysis of the electroencephalogram (EEG) and magnetoencephalogram (MEG). ICA decomposes an EEG/MEG data set into a basis of maximally temporally independent components (ICs) that are learned from the data. As with any statistic, a concern with using ICA is the degree to which the estimated ICs are reliable. An IC may not be reliable if ICA was trained on insufficient data, if ICA training was stopped prematurely or at a local minimum (for some algorithms), or if multiple global minima were present. Consequently, evidence of ICA reliability is critical for the credibility of ICA results. In this paper, we present a new algorithm for assessing the reliability of ICs based on applying ICA separately to split-halves of a data set. This algorithm improves upon existing methods in that it considers both IC scalp topographies and activations, uses a probabilistically interpretable threshold for accepting ICs as reliable, and requires applying ICA only three times per data set. As evidence of the method’s validity, we show that the method can perform comparably to more time intensive bootstrap resampling and depends in a reasonable manner on the amount of training data. Finally, using the method we illustrate the importance of checking the reliability of ICs by demonstrating that IC reliability is dramatically increased by removing the mean EEG at each channel for each epoch of data rather than the mean EEG in a prestimulus baseline. PMID:19162199

The Counseling Center Assessment of Psychological Symptoms (CCAPS-62): Acceptance, feasibility, and initial psychometric properties in a UK student population.

PubMed

Broglia, Emma; Millings, Abigail; Barkham, Michael

2017-09-01

The burden and severity of student mental health continue to increase in parallel with increasing financial pressures on students and services alike. There is a need for a student-specific measure of distress that acknowledges their unique context. This study examined the feasibility, acceptance, and initial psychometric properties of a US measure, the Counseling Center Assessment of Psychological Symptoms (CCAPS), in a UK student sample. A sample of 294 UK help-seeking students from two universities completed the CCAPS-62 and Clinical Outcomes in Routine Evaluation (CORE-10) as a comparator. The factor solution and reliability of the CCAPS-62 were examined. Correlations and clinical boundaries were determined between the CCAPS-62 subscales and CORE-10, and comparisons were made with US published norms. The CCAPS-62 demonstrated a strong factor solution that matched the intended subscales. All subscales had good reliability and correlated significantly with the CORE-10. The agreement on caseness between the two measures was 92.8% with 86.3% reaching clinical threshold on both the CCAPS-62 and CORE-10. Severity was most noticeable for academic distress, depression, anxiety, and social anxiety. Compared to US data, UK students showed higher clinical severity for all psychological symptoms. The CCAPS-62 is a reliable and psychometrically valid assessment measure to use with UK students without revision. The overall distress indicated is similar to that of the CORE-10, but the individual subscales are more informative of specific student concerns including academic distress, social anxiety, and substance abuse. Potential benefits of administering a student-focused assessment measure in student counselling services are discussed. University students attending counselling in the UK demonstrate clinical severity for academic distress, depression, anxiety, and social anxiety. Compared to university students in the US, UK students present with higher clinical severity on all contextual measures of student psychological distress. It is advantageous for university counselling services to administer a student-specific clinical measure over measures intended for the general clinical population. CCAPS-62 is an acceptable, feasible, and psychometrically valid measure of student psychological distress that can be used in the UK without revision. It is important for university counselling services to continue to provide support from therapists that are trained and experienced in the university context over services intended for the general clinical population. Copyright © 2017 John Wiley & Sons, Ltd.

Measuring decisional certainty among women seeking abortion.

PubMed

Ralph, Lauren J; Foster, Diana Greene; Kimport, Katrina; Turok, David; Roberts, Sarah C M

2017-03-01

Evaluating decisional certainty is an important component of medical care, including preabortion care. However, minimal research has examined how to measure certainty with reliability and validity among women seeking abortion. We examine whether the Decisional Conflict Scale (DCS), a measure widely used in other health specialties and considered the gold standard for measuring this construct, and the Taft-Baker Scale (TBS), a measure developed by abortion counselors, are valid and reliable for use with women seeking abortion and predict the decision to continue the pregnancy. Eligible women at four family planning facilities in Utah completed baseline demographic surveys and scales before their abortion information visit and follow-up interviews 3 weeks later. For each scale, we calculated mean scores and explored factors associated with high uncertainty. We evaluated internal reliability using Cronbach's alpha and assessed predictive validity by examining whether higher scale scores, indicative of decisional uncertainty or conflict, were associated with still being pregnant at follow-up. Five hundred women completed baseline surveys; two-thirds (63%) completed follow-up, at which time 11% were still pregnant. Mean scores on the DCS (15.5/100) and TBS (12.4/100) indicated low uncertainty, with acceptable reliability (α=.93 and .72, respectively). Higher scores on each scale were significantly and positively associated with still being pregnant at follow-up in both unadjusted and adjusted analyses. The DCS and TBS demonstrate acceptable reliability and validity among women seeking abortion care. Comparing scores on the DCS in this population to other studies of decision making suggests that the level of uncertainty in abortion decision making is comparable to or lower than other health decisions. The high levels of decisional certainty found in this study challenge the narrative that abortion decision making is exceptional compared to other healthcare decisions and requires additional protection such as laws mandating waiting periods, counseling and ultrasound viewing. Copyright © 2016. Published by Elsevier Inc.

A Conflict Management Scale for Pharmacy

PubMed Central

Gregory, Paul A.; Martin, Craig

2009-01-01

Objectives To develop and establish the validity and reliability of a conflict management scale specific to pharmacy practice and education. Methods A multistage inventory-item development process was undertaken involving 93 pharmacists and using a previously described explanatory model for conflict in pharmacy practice. A 19-item inventory was developed, field tested, and validated. Results The conflict management scale (CMS) demonstrated an acceptable degree of reliability and validity for use in educational or practice settings to promote self-reflection and self-awareness regarding individuals' conflict management styles. Conclusions The CMS provides a unique, pharmacy-specific method for individuals to determine and reflect upon their own conflict management styles. As part of an educational program to facilitate self-reflection and heighten self-awareness, the CMS may be a useful tool to promote discussions related to an important part of pharmacy practice. PMID:19960081

Evaluation of the Williams-type model for barley yields in North Dakota and Minnesota

NASA Technical Reports Server (NTRS)

Barnett, T. L. (Principal Investigator)

1981-01-01

The Williams-type yield model is based on multiple regression analysis of historial time series data at CRD level pooled to regional level (groups of similar CRDs). Basic variables considered in the analysis include USDA yield, monthly mean temperature, monthly precipitation, soil texture and topographic information, and variables derived from these. Technologic trend is represented by piecewise linear and/or quadratic functions of year. Indicators of yield reliability obtained from a ten-year bootstrap test (1970-1979) demonstrate that biases are small and performance based on root mean square appears to be acceptable for the intended AgRISTARS large area applications. The model is objective, adequate, timely, simple, and not costly. It consideres scientific knowledge on a broad scale but not in detail, and does not provide a good current measure of modeled yield reliability.

75 FR 80391 - Electric Reliability Organization Interpretations of Interconnection Reliability Operations and...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-12-22

... configuration to maintain system stability, acceptable voltage or power flows.\\12\\ \\12\\ In the Western... prevent system instability or cascading outages, and protect other facilities in response to transmission... nature used to address system reliability vulnerabilities to prevent system instability, cascading...

Small Scale SOFC Demonstration Using Bio-Based and Fossil Fuels

DOE Office of Scientific and Technical Information (OSTI.GOV)

Petrik, Michael; Ruhl, Robert

2012-05-01

Technology Management, Inc. (TMI) of Cleveland, Ohio, has completed the project entitled Small Scale SOFC Demonstration using Bio-based and Fossil Fuels. Under this program, two 1-kW systems were engineered as technology demonstrators of an advanced technology that can operate on either traditional hydrocarbon fuels or renewable biofuels. The systems were demonstrated at Patterson's Fruit Farm of Chesterland, OH and were open to the public during the first quarter of 2012. As a result of the demonstration, TMI received quantitative feedback on operation of the systems as well as qualitative assessments from customers. Based on the test results, TMI believes thatmore » > 30% net electrical efficiency at 1 kW on both traditional and renewable fuels with a reasonable entry price is obtainable. The demonstration and analysis provide the confidence that a 1 kW entry-level system offers a viable value proposition, but additional modifications are warranted to reduce sound and increase reliability before full commercial acceptance.« less

Reliability and Validity of a New Method for Isometric Back Extensor Strength Evaluation Using A Hand-Held Dynamometer.

PubMed

Park, Hee-Won; Baek, Sora; Kim, Hong Young; Park, Jung-Gyoo; Kang, Eun Kyoung

2017-10-01

To investigate the reliability and validity of a new method for isometric back extensor strength measurement using a portable dynamometer. A chair equipped with a small portable dynamometer was designed (Power Track II Commander Muscle Tester). A total of 15 men (mean age, 34.8±7.5 years) and 15 women (mean age, 33.1±5.5 years) with no current back problems or previous history of back surgery were recruited. Subjects were asked to push the back of the chair while seated, and their isometric back extensor strength was measured by the portable dynamometer. Test-retest reliability was assessed with intraclass correlation coefficient (ICC). For the validity assessment, isometric back extensor strength of all subjects was measured by a widely used physical performance evaluation instrument, BTE PrimusRS system. The limit of agreement (LoA) from the Bland-Altman plot was evaluated between two methods. The test-retest reliability was excellent (ICC=0.82; 95% confidence interval, 0.65-0.91). The Bland-Altman plots demonstrated acceptable agreement between the two methods: the lower 95% LoA was -63.1 N and the upper 95% LoA was 61.1 N. This study shows that isometric back extensor strength measurement using a portable dynamometer has good reliability and validity.

The London field trial for hoarding disorder.

PubMed

Mataix-Cols, D; Billotti, D; Fernández de la Cruz, L; Nordsletten, A E

2013-04-01

A new diagnostic category, hoarding disorder (HD), has been proposed for inclusion in DSM-5. This study field-tested the validity, reliability and perceived acceptability of the proposed diagnostic criteria for HD. Method Fifty unselected individuals with prominent hoarding behavior and 20 unselected, self-defined 'collectors' participated in thorough psychiatric assessments, involving home visits whenever possible. A semi-structured interview based on the proposed diagnostic criteria for HD was administered and scored by two independent raters. 'True' diagnoses were made by consensus according to the best-estimate diagnosis procedure. The percentage of true positive HD cases (sensitivity) and true negative HD cases (specificity) was calculated, along with inter-rater reliability for the diagnosis and each criterion. Participants were asked about their perceptions of the acceptability, utility and stigma associated with the new diagnosis. Twenty-nine (58%) of the hoarding individuals and none of the collectors fulfilled diagnostic criteria for HD. The sensitivity, specificity and inter-rater reliability of the diagnosis, and of each individual criterion and the specifiers, were excellent. Most participants with HD (96%) felt that creating a new disorder would be very or somewhat acceptable, useful (96%) and not too stigmatizing (59%). The proposed HD criteria are valid, reliable and perceived as acceptable and useful by the sufferers. Crucially, they seem to be sufficiently conservative and unlikely to overpathologize normative behavior. Minor changes in the wording of the criteria are suggested.

Evaluation of the Early Childhood Oral Health Impact Scale in an Australian preschool child population.

PubMed

Arrow, P; Klobas, E

2015-09-01

Early childhood caries has significant impacts on children and their families. The Early Childhood Oral Health Impact Scale (ECOHIS) is an instrument for capturing the complex dimensions of preschool children's oral health. This study aimed to evaluate the reliability and validity of the instrument among Australian preschool children. Parents/children dyads (n = 286) participating in a treatment trial on early childhood caries completed the scale at baseline, and 33 parents repeated the questionnaire 2-3 weeks later. The validity and reliability of the ECOHIS was determined using tests for convergent and discriminant validity, internal reliability of the instrument and test-retest reliability. Scale impacts were strongly correlated with global oral health ratings (Spearman's correlations; r = 0.51, total score; r = 0.43, child impact; and r = 0.49, family impact; p < 0.001). The scale was significantly associated with children's caries experience, p < 0.001. Cronbach's alpha values were 0.87, 0.89 and 0.74 for the total, the child and the family domains, respectively. Test-retest reliability was 0.92, 0.89 and 0.78 for the total, child and family domains, respectively. The scale demonstrated acceptable validity and reliability for assessing the impact of early childhood caries among Australian preschool children. © 2015 Australian Dental Association.

Sensor-triggered sampling to determine instantaneous airborne vapor exposure concentrations.

PubMed

Smith, Philip A; Simmons, Michael K; Toone, Phillip

2018-06-01

It is difficult to measure transient airborne exposure peaks by means of integrated sampling for organic chemical vapors, even with very short-duration sampling. Selection of an appropriate time to measure an exposure peak through integrated sampling is problematic, and short-duration time-weighted average (TWA) values obtained with integrated sampling are not likely to accurately determine actual peak concentrations attained when concentrations fluctuate rapidly. Laboratory analysis for integrated exposure samples is preferred from a certainty standpoint over results derived in the field from a sensor, as a sensor user typically must overcome specificity issues and a number of potential interfering factors to obtain similarly reliable data. However, sensors are currently needed to measure intra-exposure period concentration variations (i.e., exposure peaks). In this article, the digitized signal from a photoionization detector (PID) sensor triggered collection of whole-air samples when toluene or trichloroethylene vapors attained pre-determined levels in a laboratory atmosphere generation system. Analysis by gas chromatography-mass spectrometry of whole-air samples (with both 37 and 80% relative humidity) collected using the triggering mechanism with rapidly increasing vapor concentrations showed good agreement with the triggering set point values. Whole-air samples (80% relative humidity) in canisters demonstrated acceptable 17-day storage recoveries, and acceptable precision and bias were obtained. The ability to determine exceedance of a ceiling or peak exposure standard by laboratory analysis of an instantaneously collected sample, and to simultaneously provide a calibration point to verify the correct operation of a sensor was demonstrated. This latter detail may increase the confidence in reliability of sensor data obtained across an entire exposure period.

Intertester reliability of the acceptable noise level.

PubMed

Gordon-Hickey, Susan; Adams, Elizabeth; Moore, Robert; Gaal, Ashley; Berry, Katie; Brock, Sommer

2012-01-01

The acceptable noise level (ANL) serves to accurately predict the listener's likelihood of success with amplification. It has been proposed as a pre-hearing aid fitting protocol for hearing aid selection and counseling purposes. The ANL is a subjective measure of the listener's ability to accept background noise. Measurement of ANL relies on the tester and listener to follow the instructions set forth. To date, no research has explored the reliability of ANL as measured across clinicians or testers. To examine the intertester reliability of ANL. A descriptive quasi-experimental reliability study was completed. ANL was measured for one group of listeners by three testers. Three participants served as testers. Each tester was familiar with basic audiometry. Twenty-five young adults with normal hearing served as listeners. Each tester was stationed in a laboratory with the needed equipment. Listeners were instructed to report to these laboratories in a random order provided by the experimenters. The testers assessed most comfortable listening level (MCL) and background noise level (BNL) for all 25 listeners. Intraclass correlation coefficients were significant and revealed that MCL, BNL, and ANLs are reliable across testers. Additionally, one-way ANOVAs for MCL, BNL, and ANL were not significant. These findings indicate that MCL, BNL, and ANL do not differ significantly when measured by different testers. If the ANL instruction set is accurately followed, ANL can be reliably measured across testers, laboratories, and clinics. Intertester reliability of ANL allows for comparison across ANLs measured by different individuals. Findings of the present study indicate that tester reliability can be ruled out as a factor contributing to the disparity of mean ANLs reported in the literature. American Academy of Audiology.

Software reliability through fault-avoidance and fault-tolerance

NASA Technical Reports Server (NTRS)

Vouk, Mladen A.; Mcallister, David F.

1992-01-01

Accomplishments in the following research areas are summarized: structure based testing, reliability growth, and design testability with risk evaluation; reliability growth models and software risk management; and evaluation of consensus voting, consensus recovery block, and acceptance voting. Four papers generated during the reporting period are included as appendices.

A Meta-Analysis of Reliability Coefficients in Second Language Research

ERIC Educational Resources Information Center

Plonsky, Luke; Derrick, Deirdre J.

2016-01-01

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

16 CFR 260.5 - Interpretation and substantiation of environmental marketing claims.

Code of Federal Regulations, 2011 CFR

2011-01-01

... reasonable basis substantiating the claim. A reasonable basis consists of competent and reliable evidence. In... reliable scientific evidence, defined as tests, analyses, research, studies or other evidence based on the... qualified to do so, using procedures generally accepted in the profession to yield accurate and reliable...

75 FR 4375 - Transmission Loading Relief Reliability Standard and Curtailment Priorities

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-27

... Site: http://www.ferc.gov . Documents created electronically using word processing software should be... ensure operation within acceptable reliability criteria. NERC Glossary of Terms Used in Reliability Standards at 19, available at http://www.nerc.com/files/Glossary_12Feb08.pdf (NERC Glossary). An...

Irradiated ready-to-eat spinach leaves: How information influences awareness towards irradiation treatment and consumer's purchase intention

NASA Astrophysics Data System (ADS)

Finten, G.; Garrido, J. I.; Agüero, M. V.; Jagus, R. J.

2017-01-01

This article aims to clarify and supply further information on food irradiation acceptance, with particular focus on Argentina and irradiated ready-to-eat (RTE) spinach leaves through an open web-online survey. Results showed that half of respondents did not know food irradiation, but the other half demonstrated uncertainty despite they declared they had knowledge about it; thus, confirming little awareness towards this technology. Respondents who believed in the misleading myth about food irradiation represented 39%, while roughly the same number was doubtful. On the other hand, after supplying informative material, respondents were positively influenced and an increase in acceptance by 90% was found. Finally, 42% of respondents were willing to consume/purchase irradiated RTE spinach leaves, and 35% remained doubtful. Respondents who did not exclude to accept irradiated spinach could be considered potential consumers if intensive campaigns about the benefits of food irradiation were carried out by reliable actors. If the Argentinean RTE market grew, following the world consumption trend towards these products, irradiated spinach leaves could be successfully introduced by making better efforts to inform consumers about food irradiation.

Validation of the Malay Version of the Inventory of Functional Status after Childbirth Questionnaire

PubMed Central

Noor, Norhayati Mohd; Aziz, Aniza Abd.; Mostapa, Mohd Rosmizaki; Awang, Zainudin

2015-01-01

Objective. This study was designed to examine the psychometric properties of Malay version of the Inventory of Functional Status after Childbirth (IFSAC). Design. A cross-sectional study. Materials and Methods. A total of 108 postpartum mothers attending Obstetrics and Gynaecology Clinic, in a tertiary teaching hospital in Malaysia, were involved. Construct validity and internal consistency were performed after the translation, content validity, and face validity process. The data were analyzed using Analysis of Moment Structure version 18 and Statistical Packages for the Social Sciences version 20. Results. The final model consists of four constructs, namely, infant care, personal care, household activities, and social and community activities, with 18 items demonstrating acceptable factor loadings, domain to domain correlation, and best fit (Chi-squared/degree of freedom = 1.678; Tucker-Lewis index = 0.923; comparative fit index = 0.936; and root mean square error of approximation = 0.080). Composite reliability and average variance extracted of the domains ranged from 0.659 to 0.921 and from 0.499 to 0.628, respectively. Conclusion. The study suggested that the four-factor model with 18 items of the Malay version of IFSAC was acceptable to be used to measure functional status after childbirth because it is valid, reliable, and simple. PMID:25667932

Measuring trust in nurses - Psychometric properties of the Trust in Nurses Scale in four countries.

PubMed

Stolt, Minna; Charalambous, Andreas; Radwin, Laurel; Adam, Christina; Katajisto, Jouko; Lemonidou, Chryssoula; Patiraki, Elisabeth; Sjövall, Katarina; Suhonen, Riitta

2016-12-01

The purpose of this study was to examine psychometric properties of three translated versions of the Trust in Nurses Scale (TNS) and cancer patients' perceptions of trust in nurses in a sample of cancer patients from four European countries. A cross-sectional, cross-cultural, multi-site survey design was used. The data were collected with the Trust in Nurses Scale from patients with different types of malignancies in 17 units within five clinical sites (n = 599) between 09/2012 and 06/2014. Data were analyzed using descriptive and inferential statistics, multivariate methods and psychometrics using exploratory factor analysis, Cronbach's alpha coefficients, item analysis and Rasch analysis. The psychometric properties of the data were consistent in all countries. Within the exploratory factor analysis the principal component analysis supported the one component structure (unidimensionality) of the TNS. The internal consistency reliability was acceptable. The Rasch analysis supported the unidimensionality of the TNS cross-culturally. All items of the TNS demonstrated acceptable goodness-of-fit to the Rasch model. Cancer patients trusted nurses to a great extent although between-country differences were found. The Trust in Nurses Scale proved to be a valid and reliable tool for measuring patients' trust in nurses in oncological settings in international contexts. Copyright © 2016 Elsevier Ltd. All rights reserved.

Developing Reliable Life Support for Mars

NASA Technical Reports Server (NTRS)

Jones, Harry W.

2017-01-01

A human mission to Mars will require highly reliable life support systems. Mars life support systems may recycle water and oxygen using systems similar to those on the International Space Station (ISS). However, achieving sufficient reliability is less difficult for ISS than it will be for Mars. If an ISS system has a serious failure, it is possible to provide spare parts, or directly supply water or oxygen, or if necessary bring the crew back to Earth. Life support for Mars must be designed, tested, and improved as needed to achieve high demonstrated reliability. A quantitative reliability goal should be established and used to guide development t. The designers should select reliable components and minimize interface and integration problems. In theory a system can achieve the component-limited reliability, but testing often reveal unexpected failures due to design mistakes or flawed components. Testing should extend long enough to detect any unexpected failure modes and to verify the expected reliability. Iterated redesign and retest may be required to achieve the reliability goal. If the reliability is less than required, it may be improved by providing spare components or redundant systems. The number of spares required to achieve a given reliability goal depends on the component failure rate. If the failure rate is under estimated, the number of spares will be insufficient and the system may fail. If the design is likely to have undiscovered design or component problems, it is advisable to use dissimilar redundancy, even though this multiplies the design and development cost. In the ideal case, a human tended closed system operational test should be conducted to gain confidence in operations, maintenance, and repair. The difficulty in achieving high reliability in unproven complex systems may require the use of simpler, more mature, intrinsically higher reliability systems. The limitations of budget, schedule, and technology may suggest accepting lower and less certain expected reliability. A plan to develop reliable life support is needed to achieve the best possible reliability.

How reliable are Functional Movement Screening scores? A systematic review of rater reliability.

PubMed

Moran, Robert W; Schneiders, Anthony G; Major, Katherine M; Sullivan, S John

2016-05-01

Several physical assessment protocols to identify intrinsic risk factors for injury aetiology related to movement quality have been described. The Functional Movement Screen (FMS) is a standardised, field-expedient test battery intended to assess movement quality and has been used clinically in preparticipation screening and in sports injury research. To critically appraise and summarise research investigating the reliability of scores obtained using the FMS battery. Systematic literature review. Systematic search of Google Scholar, Scopus (including ScienceDirect and PubMed), EBSCO (including Academic Search Complete, AMED, CINAHL, Health Source: Nursing/Academic Edition), MEDLINE and SPORTDiscus. Studies meeting eligibility criteria were assessed by 2 reviewers for risk of bias using the Quality Appraisal of Reliability Studies checklist. Overall quality of evidence was determined using van Tulder's levels of evidence approach. 12 studies were appraised. Overall, there was a 'moderate' level of evidence in favour of 'acceptable' (intraclass correlation coefficient ≥0.6) inter-rater and intra-rater reliability for composite scores derived from live scoring. For inter-rater reliability of composite scores derived from video recordings there was 'conflicting' evidence, and 'limited' evidence for intra-rater reliability. For inter-rater reliability based on live scoring of individual subtests there was 'moderate' evidence of 'acceptable' reliability (κ≥0.4) for 4 subtests (Deep Squat, Shoulder Mobility, Active Straight-leg Raise, Trunk Stability Push-up) and 'conflicting' evidence for the remaining 3 (Hurdle Step, In-line Lunge, Rotary Stability). This review found 'moderate' evidence that raters can achieve acceptable levels of inter-rater and intra-rater reliability of composite FMS scores when using live ratings. Overall, there were few high-quality studies, and the quality of several studies was impacted by poor study reporting particularly in relation to rater blinding. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

E-Book Acceptance among Undergraduate Students: A Look at the Moderating Role of Technology Innovativeness

ERIC Educational Resources Information Center

Ngafeeson, Madison N.; Sun, Jun

2015-01-01

This paper utilizes the technology acceptance model (TAM) to uncover the moderating roles of technology innovativeness. A study of 158 undergraduate students revealed that the original TAM constructs and relationships were reliable, supported, and applicable in the measurement of e-book acceptance. Interestingly, personal technology innovativeness…

Development and Validation of Mobile Learning Acceptance Measure

ERIC Educational Resources Information Center

Sharma, Sujeet Kumar; Sarrab, Mohamed; Al-Shihi, Hafedh

2017-01-01

The growth of Smartphone usage, increased acceptance of electronic learning (E-learning), the availability of high reliability mobile networks and need for flexibility in learning have resulted in the growth of mobile learning (M-learning). This has led to a tremendous interest in the acceptance behaviors related to M-learning users among the…

Psychometric properties of the Polish version of the Multidimensional Fatigue Inventory-20 in cancer patients.

PubMed

Buss, Tomasz; Kruk, Agnieszka; Wiśniewski, Piotr; Modlinska, Aleksandra; Janiszewska, Justyna; Lichodziejewska-Niemierko, Monika

2014-10-01

Multidimensional questionnaires estimating cancer-related fatigue (CRF) as a symptom cluster or a clinical syndrome primarily have been used and validated in English-speaking populations. However, cultural issues and language peculiarities can affect CRF assessment The main aims of this study were to evaluate the psychometric properties of the Polish version of the Multidimensional Fatigue Inventory-20 (MFI-20) and to deliver to clinicians a multidimensional tool for CRF assessment in Polish-speaking patients with cancer. After forward-backward translation procedures, the Polish version of MFI-20 was administered to 340 cancer patients. The Polish MFI-20 was appraised in terms of acceptability, reliability, and validity. Internal consistency was assessed by calculating Cronbach's alpha coefficients. Structural validity was evaluated with confirmatory factor analysis. The translated MFI-20 was well accepted; 90% of subjects fully completed the questionnaire. The overall Cronbach's alpha coefficient was 0.9, ranging from 0.57 to 0.81. All correlation coefficients among Numeric Rating Scale-fatigue, fatigue-related items from the European Organization for Research and Treatment of Cancer Quality of Life Core-30 questionnaire, and the MFI--20 were statistically significant (P < 0.001). Confirmatory factor analysis demonstrated good structural validity and revealed only three dimensions in the Polish version of the MFI-20-physical and mental fatigue as well as reduced motivation. The Polish version of the MFI-20 is well accepted by patients, reliable, and a valid instrument to assess CRF in Polish cancer patients. Copyright © 2014 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Perceived Parental Attitudes of Gender Expansiveness: Development and Preliminary Factor Structure of a Self-Report Youth Questionnaire

PubMed Central

Hidalgo, Marco A.; Chen, Diane; Garofalo, Robert; Forbes, Catherine

2017-01-01

Abstract Purpose: Parental acceptance of gender identity/expression in lesbian, gay, bisexual, transgender, and queer/questioning (LGBTQ+) youth moderates the effects of minority stress on mental health outcomes. Given this association, mental health clinicians of gender-expansive adolescents often assess the degree to which these youth perceive their parents/primary caregivers as accepting or nonaffirming of their gender identity and expression. While existing measures may reliably assess youth's perceptions of general family support, no known tool aids in the assessment an adolescent's perceived parental support related to adolescent gender-expansive experiences. Methods: To provide both clinicians and researchers with an empirically derived tool, the current study used factor analysis to explore an underlying factor structure of a brief questionnaire developed by subject-matter experts and pertaining to multiple aspects of perceived parental support in gender-expansive adolescents and young adults. Respondents were gender-expansive adolescents and young adults seeking care in an interdisciplinary gender-health clinic within a pediatric academic medical center in the Midwestern United States. Results: Exploratory factor analysis resulted in a 14-item questionnaire comprised of two subscales assessing perceived parental nonaffirmation and perceived parental acceptance. Internal consistency and construct validity results provided support for this new questionnaire. Conclusion: This study provides preliminary evidence of the factor structure, reliability and validity of the Parental Attitudes of Gender Expansiveness Scale for Youth (PAGES-Y). These findings demonstrate both the clinical and research utility of the PAGES-Y, a tool that can yield a more nuanced understanding of family-related risk and protective factors in gender-expansive adolescents. PMID:29159312

Perceived Parental Attitudes of Gender Expansiveness: Development and Preliminary Factor Structure of a Self-Report Youth Questionnaire.

PubMed

Hidalgo, Marco A; Chen, Diane; Garofalo, Robert; Forbes, Catherine

2017-01-01

Purpose: Parental acceptance of gender identity/expression in lesbian, gay, bisexual, transgender, and queer/questioning (LGBTQ+) youth moderates the effects of minority stress on mental health outcomes. Given this association, mental health clinicians of gender-expansive adolescents often assess the degree to which these youth perceive their parents/primary caregivers as accepting or nonaffirming of their gender identity and expression. While existing measures may reliably assess youth's perceptions of general family support, no known tool aids in the assessment an adolescent's perceived parental support related to adolescent gender-expansive experiences. Methods: To provide both clinicians and researchers with an empirically derived tool, the current study used factor analysis to explore an underlying factor structure of a brief questionnaire developed by subject-matter experts and pertaining to multiple aspects of perceived parental support in gender-expansive adolescents and young adults. Respondents were gender-expansive adolescents and young adults seeking care in an interdisciplinary gender-health clinic within a pediatric academic medical center in the Midwestern United States. Results: Exploratory factor analysis resulted in a 14-item questionnaire comprised of two subscales assessing perceived parental nonaffirmation and perceived parental acceptance. Internal consistency and construct validity results provided support for this new questionnaire. Conclusion: This study provides preliminary evidence of the factor structure, reliability and validity of the Parental Attitudes of Gender Expansiveness Scale for Youth (PAGES-Y). These findings demonstrate both the clinical and research utility of the PAGES-Y, a tool that can yield a more nuanced understanding of family-related risk and protective factors in gender-expansive adolescents.

Pitfalls and Precautions When Using Predicted Failure Data for Quantitative Analysis of Safety Risk for Human Rated Launch Vehicles

NASA Technical Reports Server (NTRS)

Hatfield, Glen S.; Hark, Frank; Stott, James

2016-01-01

Launch vehicle reliability analysis is largely dependent upon using predicted failure rates from data sources such as MIL-HDBK-217F. Reliability prediction methodologies based on component data do not take into account risks attributable to manufacturing, assembly, and process controls. These sources often dominate component level reliability or risk of failure probability. While consequences of failure is often understood in assessing risk, using predicted values in a risk model to estimate the probability of occurrence will likely underestimate the risk. Managers and decision makers often use the probability of occurrence in determining whether to accept the risk or require a design modification. Due to the absence of system level test and operational data inherent in aerospace applications, the actual risk threshold for acceptance may not be appropriately characterized for decision making purposes. This paper will establish a method and approach to identify the pitfalls and precautions of accepting risk based solely upon predicted failure data. This approach will provide a set of guidelines that may be useful to arrive at a more realistic quantification of risk prior to acceptance by a program.

Developmental monitoring using caregiver reports in a resource-limited setting: the case of Kilifi, Kenya

PubMed Central

Abubakar, A; Holding, P; Van de Vijver, F; Bomu, G; Van Baar, A

2010-01-01

Aim: The main aim of the current study was to evaluate the reliability, validity and acceptability of developmental monitoring using caregiver reports among mothers in a rural African setting. Methods: A structured interview for parents of children aged 24 months and less was developed through both participant consultation and a review of literature. The reliability and validity of the schedule was evaluated through a 10-month monitoring programme of 95 children, aged 2–10 months. The acceptability of the process was evaluated by studying retention rates and by organizing focus group discussions with participating mothers. Results: The structured interview ‘Developmental Milestones Checklist’ consisted of 66 items covering three broad domains of child functioning: motor, language and personal–social development. The interview yielded scores of developmental achievements that showed high internal consistency and excellent test–retest reliability. The results were sensitive to maturational changes and nutritional deficiencies. In addition, acceptable retention rates of approximately 80% were found. Participating mothers reported that they found the procedures both acceptable and beneficial. Conclusion: Developmental monitoring using caregiver report is a viable method to identify and monitor at-risk children in Sub-Saharan Africa. PMID:20353499

The reliability and utility of spirometry performed on people with asthma in community pharmacies.

PubMed

Lei Burton, Deborah; LeMay, Kate S; Saini, Bandana; Smith, Lorraine; Bosnic-Anticevich, Sinthia; Southwell, Phillipa; Cooke, Julie; Emmerton, Lynne; Stewart, Kay; Krass, Ines; Reddel, Helen; Armour, Carol

2015-01-01

To investigate the reliability and the utility of spirometry generated by community pharmacists participating in two large asthma intervention trials of 892 people. The Pharmacy Asthma Care Program (PACP) and the Pharmacy Asthma Management Service (PAMS) involved up to four visits to the pharmacy over 6 months for counseling and goal setting. Pharmacists performed spirometry according to ATS/ERS guidelines to inform management. The proportion of A-E, F quality tests, as per EasyOne QC grades, were recorded. Lung function results between visits and for participants referred/not referred to their general practitioner on the basis of spirometry were compared. Complete data from 2593 spirometry sessions were recorded, 68.5% of spirometry sessions achieved three acceptable tests with between-test repeatability of 150 ml or less (A or B quality), 96% of spirometry sessions included at least one test that met ATS/ERS acceptability criteria. About 39.1% of participants had FEV1/FVC values below the lower limit of normal (LNN), indicating a respiratory obstruction. As a result of the service, there was a significant increase in FEV1 and FEV1/FVC and asthma control. Lung function values were significantly poorer for participants referred to their general practitioner, compared with those not referred, on the basis of spirometry. Community pharmacists are able to reliably achieve spirometry results meeting ATS/ERS guidelines in people with asthma. Significant improvements in airway obstruction were demonstrated with the pharmacy services. Pharmacists interpreted lung function results to identify airway obstruction for referral, making this a useful technique for review of people with asthma in the community.

Spanish translation and adaptation of Victoria Champion's Health Belief Model Scales for breast cancer screening--mammography.

PubMed

Medina-Shepherd, Rosario; Kleier, Jo Ann

2010-01-01

Victoria Champion used the constructs of the Health Belief Model as the foundation for developing Champion's Health Belief Scales for Mammography Screening (CHBMS). The instrument has been used to collect health beliefs about breast screening behaviors among various ethnic populations but has not been translated, adapted, or psychometrically evaluated in the Hispanic population. The purpose of this article was to report the translation and adaptation process from English to Spanish and the psychometric estimates of the validity and reliability of CHBMS-Spanish. The original instrument was translated from English to Spanish by a professional translator and back-translated into English by a focus group of healthcare professionals. The tool was given to 5 monolingual women to evaluate for content validity, translation validity, and cultural appropriateness. A total of 200 self-identified Hispanic women, literate in speaking and reading Spanish, aged 45 to 75 years, and without history of breast cancer were included in the analyses. The items of the scale formed coherent subsets that were relatively independent of each other and aligned to the 3 factors prescribed by the Health Belief Model constructs. Internal consistency values presented acceptable Cronbach alpha levels ranging from .69 to .83. Test-retest reliability correlations were .57 for susceptibility, .63 for benefits, and .83 for barriers. Overall, the Spanish version of CHBMS demonstrated acceptable preliminary values of reliability and validity. Further psychometric testing is recommended. The Spanish version of the CHBMS can be used by practicing nurses as an instrument to assess health beliefs concerning mammography screening among Spanish-speaking Hispanic women.

Development of a Computer-Based Format for the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) With University Students.

PubMed

Christoff, Adriana Oliveira; Barreto, Heloisa Gomm Arruda; Boerngen-Lacerda, Roseli

2016-07-28

The Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) is a reliable and valid tool for the early detection of harmful and hazardous drug use in primary care settings when administered by interview in the general population. In university students, substance use is high, so a reliable and feasible screening instrument is needed. To compare the computer-based ASSIST (ASSISTc) with the interview format (ASSISTi). A convenience sample with counterbalanced design was used alternating between the ASSISTi and ASSISTc with 15-day interval. Although this is not a traditional test-retest reliability study, the same statistical analysis was used: intraclass correlations (ICC), kappa (κ), and Cronbach's alpha (α) to compare the two formats. A satisfaction questionnaire was applied immediately after the second session. Both formats were completed by the students (n = 809) over 15 days. The scores of involvement with all substances and with tobacco, alcohol, cannabis, and cocaine obtained with the two formats demonstrated excellent ICC (> .77). The level of agreement was considered substantial for tobacco (κ = .69) and cannabis (κ = .70) and moderate for alcohol (κ = .58). The consistency of the ASSISTc was considered satisfactory (α: .85 for tobacco, .73 for alcohol, and .87 for cannabis). The analysis of satisfaction and feasibility showed that the ASSISTi was easier to understand, but the two formats were considered similar when considering acceptability, ease of responding, and degree of intimidation. The two formats are acceptable, the scores are comparable, and they can be used interchangeably.

Psychometric Properties of the Persian Version of the Social Anxiety - Acceptance and Action Questionnaire.

PubMed

Soltani, Esmail; Bahrainian, Seyed Abdolmajid; Masjedi Arani, Abbas; Farhoudian, Ali; Gachkar, Latif

2016-06-01

Social anxiety disorder is often related to specific impairment or distress in different areas of life, including occupational, social and family settings. The purpose of the present study was to examine the psychometric properties of the persian version of the social anxiety-acceptance and action questionnaire (SA-AAQ) in university students. In this descriptive cross-sectional study, 324 students from Shahid Beheshti University of Medical Sciences participated via the cluster sampling method during year 2015. Factor analysis by the principle component analysis method, internal consistency analysis, and convergent and divergent validity were conducted to examine the validity of the SA-AAQ. To calculate the reliability of the SA-AAQ, Cronbach's alpha and test-retest reliability were used. The results from factor analysis by principle component analysis method yielded three factors that were named acceptance, action and non-judging of experience. The three-factor solution explained 51.82% of the variance. Evidence for the internal consistency of SA-AAQ was obtained via calculating correlations between SA-AAQ and its subscales. Support for convergent and discriminant validity of the SA-AAQ via its correlations with the acceptance and action questionnaire - II, social interaction anxiety scale, cognitive fusion questionnaire, believability of anxious feelings and thoughts questionnaire, valued living questionnaire and WHOQOL- BREF was obtained. The reliability of the SA-AAQ via calculating Cronbach's alpha and test-retest coefficients yielded values of 0.84 and 0.84, respectively. The Iranian version of the SA-AAQ has acceptable levels of psychometric properties in university students. The SA-AAQ is a valid and reliable measure to be utilized in research investigations and therapeutic interventions.

Psychometric Properties of the Persian Version of the Social Anxiety - Acceptance and Action Questionnaire

PubMed Central

Soltani, Esmail; Bahrainian, Seyed Abdolmajid; Masjedi Arani, Abbas; Farhoudian, Ali; Gachkar, Latif

2016-01-01

Background Social anxiety disorder is often related to specific impairment or distress in different areas of life, including occupational, social and family settings. Objective The purpose of the present study was to examine the psychometric properties of the persian version of the social anxiety-acceptance and action questionnaire (SA-AAQ) in university students. Materials and Methods In this descriptive cross-sectional study, 324 students from Shahid Beheshti University of Medical Sciences participated via the cluster sampling method during year 2015. Factor analysis by the principle component analysis method, internal consistency analysis, and convergent and divergent validity were conducted to examine the validity of the SA-AAQ. To calculate the reliability of the SA-AAQ, Cronbach’s alpha and test-retest reliability were used. Results The results from factor analysis by principle component analysis method yielded three factors that were named acceptance, action and non-judging of experience. The three-factor solution explained 51.82% of the variance. Evidence for the internal consistency of SA-AAQ was obtained via calculating correlations between SA-AAQ and its subscales. Support for convergent and discriminant validity of the SA-AAQ via its correlations with the acceptance and action questionnaire - II, social interaction anxiety scale, cognitive fusion questionnaire, believability of anxious feelings and thoughts questionnaire, valued living questionnaire and WHOQOL- BREF was obtained. The reliability of the SA-AAQ via calculating Cronbach’s alpha and test-retest coefficients yielded values of 0.84 and 0.84, respectively. Conclusions The Iranian version of the SA-AAQ has acceptable levels of psychometric properties in university students. The SA-AAQ is a valid and reliable measure to be utilized in research investigations and therapeutic interventions. PMID:27803719

Capturing the vital vascular fingerprint with optical coherence tomography

PubMed Central

Liu, Gangjun; Chen, Zhongping

2014-01-01

Using fingerprints as a method to identify an individual has been accepted in forensics since the nineteenth century, and the fingerprint has become one of the most widely used biometric characteristics. Most of the modern fingerprint recognition systems are based on the print pattern of the finger surface and are not robust against spoof attaching. We demonstrate a novel vital vascular fingerprint system using Doppler optical coherence tomography that provides highly sensitive and reliable personal identification. Because the system is based on blood flow, which only exists in a livng person, the technique is robust against spoof attaching. PMID:23913068

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

The "RAPID" cognitive-behavioral therapy program for inattentive children: preliminary findings.

PubMed

Young, Susan

2013-08-01

The objectives of the current study were to ascertain feasibility and acceptability of directly delivering a cognitive-behavioral therapy (CBT) group intervention for inattentive children in a school setting, to examine the reliability of the RATE-CQuestionnaires that accompany the program, and to determine whether they can be used to measure outcome. Eighty-eight parents/carers, their children (age 8-11), and teachers at mainstream primary schools in London participated by completing the RATE-C Questionnaires; 48 participated in the group treatment following which the Questionnaires were readministered together with a semistructured interview. The intervention had a completion rate of 92%. Postgroup interviews supported the acceptability of a direct intervention with young children. Reliability of the RATE-C Total scores was excellent for parent/carer, child, and teacher ratings; postintervention parent/carer ratings indicated significant improvement on scales of attention, emotion, and conduct with medium to large effect. The results support the reliability of the RATE-C Scales, and feasibility and acceptability of the RAPID intervention.

Assessment of technical and nontechnical skills in surgical residents.

PubMed

Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

2016-11-01

Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P < .001 to .86, P < .001. The associations between nontechnical and technical skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P < .001). Multiple samplings of integrated technical and nontechnical skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

A Real-World Setting Study: Which Glucose Meter Could Be the Best for POCT Use? An Easy and Applicable Protocol During the Hospital Routine.

PubMed

Mancini, Alessio; Esposto, Giampaolo; Manfrini, Silvana; Rilli, Silvia; Tinti, Gessica; Carta, Giuseppe; Petrolati, Laura; Vidali, Matteo; Barocci, Simone

2018-05-01

The aim of this retrospective study is to evaluate the reliability and robustness of six glucose meters for point-of-care testing in our wards using a brand-new protocol. During a 30-days study period a total of 50 diabetes patients were subjected to venous blood sampling and glucose meter blood analysis. The results of six glucose meters were compared with our laboratory reference assay. GlucoMen Plus (Menarini) with the 82% of acceptable results was the most robust glucose meter. Even if the Passing-Bablok analysis demonstrates the presence of constant systematic errors and the Bland-Altman test highlighted a possible overestimation, the surveillance error grid analysis showed that this glucose meter can be used safely. We proved that portable glucose meters are not always reliable in routinely clinical settings.

Test-retest reliability of subliminal facial affective priming.

PubMed

Dannlowski, Udo; Suslow, Thomas

2006-02-01

Since the seminal 1993 demonstrations o f Murphy an d Zajonc, researchers have replicated and extended findings concerning subliminal affective priming. So far, however, no data on test-retest reliability of affective priming effects are available. A subliminal facial affective priming task was administered to 22 healthy individuals (15 women and 7 men) twice about 7 wk. apart. Happy and sad facial expressions were used as affective primes and neutral Chinese ideographs served as target masks, which had to be evaluated. Neutral facial primes and a no-face condition served as baselines. All participants reported not having seen any of the prime faces at either testing session. Priming scores for affective faces compared to the baselines were computed. Acceptable test-retest correlations (rs) of up to .74 were found for the affective priming scores. Although measured almost 2 mo. apart, subliminal affective priming seems to be a temporally stable effect.

Measuring homework completion in behavioral activation.

PubMed

Busch, Andrew M; Uebelacker, Lisa A; Kalibatseva, Zornitsa; Miller, Ivan W

2010-07-01

The aim of this study was to develop and validate an observer-based coding system for the characterization and completion of homework assignments during Behavioral Activation (BA). Existing measures of homework completion are generally unsophisticated, and there is no current measure of homework completion designed to capture the particularities of BA. The tested scale sought to capture the type of assignment, realm of functioning targeted, extent of completion, and assignment difficulty. Homework assignments were drawn from 12 (mean age = 48, 83% female) clients in two trials of a 10-session BA manual targeting treatment-resistant depression in primary care. The two coders demonstrated acceptable or better reliability on most codes, and unreliable codes were dropped from the proposed scale. In addition, correlations between homework completion and outcome were strong, providing some support for construct validity. Ultimately, this line of research aims to develop a user-friendly, reliable measure of BA homework completion that can be completed by a therapist during session.

The Authoritative Parenting Index: predicting health risk behaviors among children and adolescents.

PubMed

Jackson, C; Henriksen, L; Foshee, V A

1998-06-01

Public health research demonstrates increasing interest in mobilizing parental influence to prevent health risk behaviors among children and adolescents. This research focuses on authoritative parenting, which previous studies suggest can prevent health risk behaviors among youth. To evaluate the reliability and validity of a new survey measure of authoritative parenting, data from studies of (1) substance use in a sample of 1,236 fourth- and sixth-grade students; (2) weapon carrying and interpersonal violence in a sample of 1,490 ninth- and tenth-grade students, and (3) anger, alienation, and conflict resolution in a sample of 224 seventh- and eighth-grade students were analyzed. The Authoritative Parenting Index had a factor structure consistent with a theoretical model of the construct; had acceptable reliability; showed grade, sex, and ethnic differences consistent with other studies; and identified parenting types that varied as hypothesized with multiple indicators of social competence and health risk behaviors among children and adolescents.

Standards for Environmental Measurement Using GIS: Toward a Protocol for Protocols.

PubMed

Forsyth, Ann; Schmitz, Kathryn H; Oakes, Michael; Zimmerman, Jason; Koepp, Joel

2006-02-01

Interdisciplinary research regarding how the built environment influences physical activity has recently increased. Many research projects conducted jointly by public health and environmental design professionals are using geographic information systems (GIS) to objectively measure the built environment. Numerous methodological issues remain, however, and environmental measurements have not been well documented with accepted, common definitions of valid, reliable variables. This paper proposes how to create and document standardized definitions for measures of environmental variables using GIS with the ultimate goal of developing reliable, valid measures. Inherent problems with software and data that hamper environmental measurement can be offset by protocols combining clear conceptual bases with detailed measurement instructions. Examples demonstrate how protocols can more clearly translate concepts into specific measurement. This paper provides a model for developing protocols to allow high quality comparative research on relationships between the environment and physical activity and other outcomes of public health interest.

A psychometric study of the Test of Everyday Attention for Children in the Chinese setting.

PubMed

Chan, Raymond C K; Wang, Li; Ye, Jiawen; Leung, Winnie W Y; Mok, Monica Y K

2008-07-01

To explore the psychometric properties of the Test of Everyday Attention for Children (TEA-Ch) in the context of a Chinese setting. Confirmatory factor analysis was conducted to examine the construct validity of the Chinese version of the TEA-Ch among a group of 232 children without attention deficit hyperactivity disorder (ADHD). Test-retest reliability was tested on a random sub-sample of 20 children at a 4-week interval. Clinical discrimination was also examined by comparing children with and without ADHD (22 in each group) on the performances of the TEA-Ch. The current Chinese sample demonstrated a three-factor solution for attentional performance among children without ADHD, namely selective attention, executive control/switch, and sustained attention (chi(2)(24)=34.56; RMSEA=.044; p=.075). Moreover, the whole test demonstrated acceptable test-retest reliability at a 4-week interval among a small sub-sample. Children with ADHD performed significantly more poorly than healthy controls in most of the subtests of the TEA-Ch. The results of the present study demonstrate that the test items remain useful in China, a culture very different from that in which the test originated. Finally, the TEA-Ch also presents several advantages when compared to other conventional objective measures of attention.

[A new method for evaluating psychomotor development based on information from parents. The Spanish version of the Kent Infant Development Scale].

PubMed

García-Tornel Florensa, S; García García, J J; Reuter, J; Clow, C; Reuter, L

1996-05-01

The purpose of this dissertation research was to design, standardize and validate the Spanish version of the Kent Infant Development Scale (KIDS). This questionnaire is based on information obtained from the parents. It was translated into Spanish and named "Escala de Desarrollo Infantil de Kent" (EDIK). The EDIK normative data were collected from the parents of 662 healthy infants (ages 1 to 15 months) in pediatric clinics in Catalonia (Spain). Test-retest reliability (r = 0.99; p < 0.001), interjudge reliability (r = 0.98; p < 0.001) and internal consistency (Cronbach alpha = 0.9947) were determined. An "r' of 0.96 was obtained when EDIK scores were compared to their estimated developmental ages obtained from the Denver Developmental Scale. The correlation of the infants' chronological age and their EDIK was 0.96 (p < 0.001). The high reliability and validity correlation coefficients demonstrate the sound psychometric properties of the EDIK. It appears to be a useful and acceptable instrument in measuring the developmental status of infants by using the reports of their parents.

Rethinking the superficial inferior epigastric artery flap in breast reconstruction: Video demonstration of a rapid, reliable harvest technique.

PubMed

Buchel, Edward W; Dalke, Kimberly R; Hayakawa, Thomas Ej

2013-01-01

Abdominal-based autologous free tissue breast reconstruction has undergone significant changes over the past decade. The evolution has focused on limiting morbidity of the donor site. The transition from the transverse rectus abdominus muscle free flap to the muscle-sparing transverse rectus abdominus muscle free flap to the deep inferior epigastric artery perforator free flap has markedly improved abdominal-based autologous breast reconstruction. However, all of these flaps involve an incision through the anterior rectus fascia and potential damage of intercostal motor and sensory nerves. The superficial inferior epigastric artery flap (SIEA) reliably perfuses the ipsilateral hemiabdomen, yet does not violate the fascia or any motor nerves. As a result, the incidence of hernia, abdominal wall weakness and bulging is essentially eliminated. Nevertheless, use of the SIEA flap remains marginal. Vessel size, dissection difficulties and lack of understanding of the relevant anatomy have limited its acceptance. The present article describes a rapid, reliable and safe dissection technique with an algorithm for harvesting the SIEA flap in autologous breast reconstruction.

40 CFR 227.27 - Limiting permissible con-cen-tra-tion (LPC).

Code of Federal Regulations, 2014 CFR

2014-07-01

... scientific literature or accepted by EPA as being reliable test organisms to determine the anticipated impact... for each type they represent, and that are documented in the scientific literature and accepted by EPA...

40 CFR 227.27 - Limiting permissible con-cen-tra-tion (LPC).

Code of Federal Regulations, 2013 CFR

2013-07-01

... scientific literature or accepted by EPA as being reliable test organisms to determine the anticipated impact... for each type they represent, and that are documented in the scientific literature and accepted by EPA...

Development of a scale to measure individuals’ ratings of peace

PubMed Central

2014-01-01

Background The evolving concept of peace-building and the interplay between peace and health is examined in many venues, including at the World Health Assembly. However, without a metric to determine effectiveness of intervention programs all efforts are prone to subjective assessment. This paper develops a psychometric index that lays the foundation for measuring community peace stemming from intervention programs. Methods After developing a working definition of ‘peace’ and delineating a Peace Evaluation Across Cultures and Environments (PEACE) scale with seven constructs comprised of 71 items, a beta version of the index was pilot-tested. Two hundred and fifty subjects in three sites in the U.S. were studied using a five-point Likert scale to evaluate the psychometric functioning of the PEACE scale. Known groups validation was performed using the SOS-10. In addition, test-retest reliability was performed on 20 subjects. Results The preliminary data demonstrated that the scale has acceptable psychometric properties for measuring an individual’s level of peacefulness. The study also provides reliability and validity data for the scale. The data demonstrated internal consistency, correlation between data and psychological well-being, and test-retest reliability. Conclusions The PEACE scale may serve as a novel assessment tool in the health sector and be valuable in monitoring and evaluating the peace-building impact of health initiatives in conflict-affected regions. PMID:25298781

The Interrelationships between Ratings of Speech and Facial Acceptability in Persons with Cleft Palate.

ERIC Educational Resources Information Center

Sinko, Garnet R.; Hedrick, Dona L.

1982-01-01

Thirty untrained young adult observers rated the speech and facial acceptablity of 20 speakers with cleft palate. The observers were reliable in rating both speech and facial acceptability. Judgments of facial acceptability were generally more positive, suggesting that speech is generally judged more negatively in speakers with cleft palate.…

Reliability Based Design for a Raked Wing Tip of an Airframe

NASA Technical Reports Server (NTRS)

Patnaik, Surya N.; Pai, Shantaram S.; Coroneos, Rula M.

2011-01-01

A reliability-based optimization methodology has been developed to design the raked wing tip of the Boeing 767-400 extended range airliner made of composite and metallic materials. Design is formulated for an accepted level of risk or reliability. The design variables, weight and the constraints became functions of reliability. Uncertainties in the load, strength and the material properties, as well as the design variables, were modeled as random parameters with specified distributions, like normal, Weibull or Gumbel functions. The objective function and constraint, or a failure mode, became derived functions of the risk-level. Solution to the problem produced the optimum design with weight, variables and constraints as a function of the risk-level. Optimum weight versus reliability traced out an inverted-S shaped graph. The center of the graph corresponded to a 50 percent probability of success, or one failure in two samples. Under some assumptions, this design would be quite close to the deterministic optimum solution. The weight increased when reliability exceeded 50 percent, and decreased when the reliability was compromised. A design could be selected depending on the level of risk acceptable to a situation. The optimization process achieved up to a 20-percent reduction in weight over traditional design.

Reliabilities of mental rotation tasks: limits to the assessment of individual differences.

PubMed

Hirschfeld, Gerrit; Thielsch, Meinald T; Zernikow, Boris

2013-01-01

Mental rotation tasks with objects and body parts as targets are widely used in cognitive neuropsychology. Even though these tasks are well established to study between-groups differences, the reliability on an individual level is largely unknown. We present a systematic study on the internal consistency and test-retest reliability of individual differences in mental rotation tasks comparing different target types and orders of presentations. In total n = 99 participants (n = 63 for the retest) completed the mental rotation tasks with hands, feet, faces, and cars as targets. Different target types were presented in either randomly mixed blocks or blocks of homogeneous targets. Across all target types, the consistency (split-half reliability) and stability (test-retest reliabilities) were good or acceptable both for intercepts and slopes. At the level of individual targets, only intercepts showed acceptable reliabilities. Blocked presentations resulted in significantly faster and numerically more consistent and stable responses. Mental rotation tasks-especially in blocked variants-can be used to reliably assess individual differences in global processing speed. However, the assessment of the theoretically important slope parameter for individual targets requires further adaptations to mental rotation tests.

50 CFR 600.1004 - Accepting a request for, and determinations about initiating, a financed program.

Code of Federal Regulations, 2011 CFR

2011-10-01

... design, propose, and adopt a timely and reliable implementation plan as well as propose and issue timely and reliable implementation regulations and otherwise complete the program in accordance with this...

Test-retest reliability of cardinal plane isokinetic hip torque and EMG.

PubMed

Claiborne, Tina L; Timmons, Mark K; Pincivero, Danny M

2009-10-01

The objective of the present study was to establish test-retest reliability of isokinetic hip torque and prime mover electromyogram (EMG) through the three cardinal planes of motion. Thirteen healthy young adults participated in two experimental sessions, separated by approximately one week. During each session, isokinetic hip torque was evaluated on the Biodex Isokinetic Dynamometer at a velocity of 60 deg/s. Subjects performed three maximal-effort concentric and eccentric contractions, separately, for right and left hip abduction/adduction, flexion/extension, and internal/external rotation. Surface EMGs were sampled from the gluteus maximus, gluteus medius, adductor, medial and lateral hamstring, and rectus femoris muscles during all contractions. Intraclass correlation coefficients (ICC - 2,1) and standard errors of measurement (SEM) were calculated for peak torque for each movement direction and contraction mode, while ICCs were only computed for the EMG data. Motions that demonstrated high torque reliability included concentric hip abduction (right and left), flexion (right and left), extension (right) and internal rotation (right and left), and eccentric hip abduction (left), adduction (left), flexion (right), and extension (right and left) (ICC range=0.81-0.91). Motions with moderate torque reliability included concentric hip adduction (right), extension (left), internal rotation (left), and external rotation (right), and eccentric hip abduction and adduction (right), flexion (left), internal rotation (right and left), and external rotation (right and left) (ICC range=0.49-0.79). The majority of the EMG sampled muscles (n=12 and n=11 for concentric and eccentric contractions, respectively) demonstrated high reliability (ICC=0.81-0.95). Instances of low, or unacceptable, EMG reliability values occurred for the medial hamstring muscle of the left leg (both contraction modes) and the adductor muscle of the right leg during eccentric internal rotation. The major finding revealed high and moderate levels of between-day reliability of isokinetic hip peak torque and prime mover EMG. It is recommended that the day-to-day variability estimates concomitant with acceptable levels of reliability be considered when attempting to objectify intervention effects on hip muscle performance.

Reliability and Validity of a New Method for Isometric Back Extensor Strength Evaluation Using A Hand-Held Dynamometer

PubMed Central

2017-01-01

Objective To investigate the reliability and validity of a new method for isometric back extensor strength measurement using a portable dynamometer. Methods A chair equipped with a small portable dynamometer was designed (Power Track II Commander Muscle Tester). A total of 15 men (mean age, 34.8±7.5 years) and 15 women (mean age, 33.1±5.5 years) with no current back problems or previous history of back surgery were recruited. Subjects were asked to push the back of the chair while seated, and their isometric back extensor strength was measured by the portable dynamometer. Test-retest reliability was assessed with intraclass correlation coefficient (ICC). For the validity assessment, isometric back extensor strength of all subjects was measured by a widely used physical performance evaluation instrument, BTE PrimusRS system. The limit of agreement (LoA) from the Bland-Altman plot was evaluated between two methods. Results The test-retest reliability was excellent (ICC=0.82; 95% confidence interval, 0.65–0.91). The Bland-Altman plots demonstrated acceptable agreement between the two methods: the lower 95% LoA was −63.1 N and the upper 95% LoA was 61.1 N. Conclusion This study shows that isometric back extensor strength measurement using a portable dynamometer has good reliability and validity. PMID:29201818

The hospital anxiety and depression scale--dimensionality, reliability and construct validity among cognitively intact nursing home patients.

PubMed

Haugan, Gørill; Drageset, Jorunn

2014-08-01

Depression and anxiety are particularly common among individuals living in long-term care facilities. Therefore, access to a valid and reliable measure of anxiety and depression among nursing home patients is highly warranted. To investigate the dimensionality, reliability and construct validity of the Hospital Anxiety and Depression scale (HADS) in a cognitively intact nursing home population. Cross-sectional data were collected from two samples; 429 cognitively intact nursing home patients participated, representing 74 different Norwegian nursing homes. Confirmative factor analyses and correlations with selected constructs were used. The two-factor model provided a good fit in Sample1, revealing a poorer fit in Sample2. Good-acceptable measurement reliability was demonstrated, and construct validity was supported. Using listwise deletion the sample sizes were 227 and 187, for Sample1 and Sample2, respectively. Greater sample sizes would have strengthen the statistical power in the tests. The researchers visited the participants to help fill in the questionnaires; this might have introduced some bias into the respondents׳ reporting. The 14 HADS items were part of greater questionnaires. Thus, frail, older NH patients might have tired during the interview causing a possible bias. Low reliability for depression was disclosed, mainly resulting from three items appearing to be inappropriate indicators for depression in this population. Further research is needed exploring which items might perform as more reliably indicators for depression among nursing home patients. Copyright © 2014 Elsevier B.V. All rights reserved.

Stability of person ability measures in people with acquired brain injury in the use of everyday technology: the test-retest reliability of the Management of Everyday Technology Assessment (META).

PubMed

Malinowsky, Camilla; Kassberg, Ann-Charlotte; Larsson-Lund, Maria; Kottorp, Anders

2016-01-01

To evaluate the test-retest reliability of the Management of Everyday Technology Assessment (META) in a sample of people with acquired brain injury (ABI). The META was administered twice within a two-week period to 25 people with ABI. A Rasch measurement model was used to convert the META ordinal raw scores into equal-interval linear measures of each participant's ability to manage everyday technology (ET). Test-retest reliability of the stability of the person ability measures in the META was examined by a standardized difference Z-test and an intra-class correlations analysis (ICC 1). The results showed that the paired person ability measures generated from the META were stable over the test-retest period for 22 of the 25 subjects. The ICC 1 correlation was 0.63, which indicates good overall reliability. The META demonstrated acceptable test-retest reliability in a sample of people with ABI. The results illustrate the importance of using sufficiently challenging ETs (relative to a person's abilities) to generate stable META measurements over time. Implications for Rehabilitation The findings add evidence regarding the test-retest reliability of the person ability measures generated from the observation assessment META in a sample of people with ABI. The META might support professionals in the evaluation of interventions that are designed to improve clients' performance of activities including the ability to manage ET.

Relative and Absolute Interrater Reliabilities of a Hand-Held Myotonometer to Quantify Mechanical Muscle Properties in Patients with Acute Stroke in an Inpatient Ward

PubMed Central

2017-01-01

Introduction The reliability of using MyotonPRO to quantify muscles mechanical properties in a ward setting for the acute stroke population remains unknown. Aims To investigate the within-session relative and absolute interrater reliability of MyotonPRO. Methods Mechanical properties of biceps brachii, brachioradialis, rectus femoris, and tibialis anterior were recorded at bedside. Participants were within 1 month of the first occurrence of stroke. Relative reliability was assessed by intraclass correlation coefficient (ICC). Absolute reliability was assessed by standard error of measurement (SEM), SEM%, smallest real difference (SRD), SRD%, and the Bland-Altman 95% limits of agreement. Results ICCs of all studied muscles ranged between 0.63 and 0.97. The SEM of all muscles ranged within 0.30–0.88 Hz for tone, 0.07–0.19 for decrement, 6.42–20.20 N/m for stiffness, and 0.04–0.07 for creep. The SRD of all muscles ranged within 0.70–2.05 Hz for tone, 0.16–0.45 for decrement, 14.98–47.15 N/m for stiffness, and 0.09–0.17 for creep. Conclusions MyotonPRO demonstrated acceptable relative and absolute reliability in a ward setting for patients with acute stroke. However, results must be interpreted with caution, due to the varying level of consistency between different muscles, as well as between different parameters within a muscle. PMID:29164148

Inventory of Determinants of Obesity-Related Behaviors in Adolescents: Development and Psychometric Characteristics.

PubMed

Amiri, Parisa; Ghofranipour, Fazlollah; Jalali-Farahani, Sara; Ahmadi, Fazlollah; Hosseinpanah, Farhad; Hooman, Haidar Ali; Parvin, Parnian; Ghasemi, Mohammadreza

2015-07-01

The rising prevalence of childhood obesity is a major health problem worldwide. Hence, there is a growing need for health professionals to become capable of assessing the factors that determine lifestyle in a culturally relevant manner. This study aimed to develop and assess a questionnaire for measuring determinants of obesity-related behaviors in Tehranian adolescents. Based on the results of a qualitative study and an extensive literature review, the 44-item "Inventory of determinants of obesity-related behaviors in adolescents (IDOBA)" with eight subscales was developed: 1) unhealthy nutrition and physical inactivity; 2) stress-related eating; 3) perceived inability; 4) perceived lack of threat; 5) perceived priority of educational achievement; 6) perceived acceptability; 7) motivation loss; and 8) lack of support. Validity of IDOBA was assessed, utilizing face, content, and construct validity methods. To confirm face validity, ten overweight/obese adolescents completed the questionnaire. To calculate content validity ratio (CVR) and content validity index (CVI), a different panel of ten experts commented independently on the necessity, relevance, clarity, and simplicity of each item. To assess construct validity using exploratory factor analysis (EFA), a total of 478 adolescents (57.7% male) aged 13 to 18 years, who were recruited from schools, participated in the study. Confirmatory factor analysis (CFA) was used to test whether the data fit the hypothesized measurement model that was derived from EFA. Test-retest and internal consistency methods were used to assess reliability of the IDOBA scale. All items were perceived as relevant and comprehendible by adolescents. Content validity was confirmed by the panel of experts. The internal consistency, as measured by Cronbach's alpha coefficients, exceeded the minimum reliability standard of 0.60 for eight subscales. No ceiling effects were observed. Detected floor effects ranged from 0.2% for perceived acceptability subscale score to 18.8% for lack of threat subscale score. The EFA suggested an eight-factor construct and the results of the CFA indicated acceptable fit indices for the proposed model. All subscales demonstrated satisfactory test-retest reliability (intra-class correlation coefficient, 0.42 - 0.91) over one month. Results provided initial evidence that the IDOBA is a valid and reliable instrument for measuring determinants of obesity-related behaviors in Iranian adolescents, indicating that the questionnaire can be used in future weight management programs for Tehranian adolescents.

Reliability of the Raven Coloured Progressive Matrices for Anglo and for Mexican-American Children.

ERIC Educational Resources Information Center

Valencia, Richard R.

1984-01-01

Investigated the internal consistency reliability estimates of the Raven Coloured Progressive Matrices (CPM) for 96 Anglo and Mexican American third-grade boys from low socioeconomic status background. The results showed that the reliability estimates of the CPM for the two ethnic groups were acceptably high and extremely similar in magnitude.…

The Reliability and Validity of the Instructional Climate Inventory-Student Form.

ERIC Educational Resources Information Center

Worrell, Frank C.

2000-01-01

Study examines the reliability and validity of the Instructional Climate Survey-Form S (ICI-S), a 20-item instrument that measures school climate, administered to students (N=328) in three programs. Analysis indicates that ICI-S was best explained by one factor. Reliability coeffecients of the total score were within the acceptable range for all…

Effect of Clinically Discriminating, Evidence-Based Checklist Items on the Reliability of Scores from an Internal Medicine Residency OSCE

ERIC Educational Resources Information Center

Daniels, Vijay J.; Bordage, Georges; Gierl, Mark J.; Yudkowsky, Rachel

2014-01-01

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving…

Fine-resolution imaging of solar features using Phase-Diverse Speckle

NASA Technical Reports Server (NTRS)

Paxman, Richard G.

1995-01-01

Phase-diverse speckle (PDS) is a novel imaging technique intended to overcome the degrading effects of atmospheric turbulence on fine-resolution imaging. As its name suggests, PDS is a blend of phase-diversity and speckle-imaging concepts. PDS reconstructions on solar data were validated by simulation, by demonstrating internal consistency of PDS estimates, and by comparing PDS reconstructions with those produced from well accepted speckle-imaging processing. Several sources of error in data collected with the Swedish Vacuum Solar Telescope (SVST) were simulated: CCD noise, quantization error, image misalignment, and defocus error, as well as atmospheric turbulence model error. The simulations demonstrate that fine-resolution information can be reliably recovered out to at least 70% of the diffraction limit without significant introduction of image artifacts. Additional confidence in the SVST restoration is obtained by comparing its spatial power spectrum with previously-published power spectra derived from both space-based images and earth-based images corrected with traditional speckle-imaging techniques; the shape of the spectrum is found to match well the previous measurements. In addition, the imagery is found to be consistent with, but slightly sharper than, imagery reconstructed with accepted speckle-imaging techniques.

Psychometric properties of the Spanish version of the Resilience Scale.

PubMed

Heilemann, MarySue V; Lee, Kathryn; Kury, Felix Salvador

2003-01-01

The purpose of this study is to test the reliability and validity of a Spanish translation of the Resilience Scale (RS), which was originally created in English by Wagnild and Young (1993). A team of bilingual, bicultural translators participated in the translation process to enhance the linguistic accuracy and cultural appropriateness of the Spanish translation. As part of the convenience sample of 315 women of Mexican descent who participated in the larger study, data from 147 women who preferred to read and write in Spanish were used in this analysis. The English version of the RS consists of a 17-item "Personal Competence" subscale and an 8-item "Acceptance of Self and Life" subscale for a total of 25 items. However, two items had low item-total loadings and were removed to form a modified 23-item RS. The exploratory principal components factor analysis, varimax rotation, and subsequent goodness of fit indices were ambivalent on whether a one or two-factor solution was appropriate, but the chi-square difference test clearly demonstrated that the two-factor solution of the Spanish version was more useful in explaining variance than a one-factor solution. Internal consistency reliability was estimated with Cronbach's alpha (alpha = 0.93) which was acceptable for the 23-item RS as well as its subscales. Construct validity was demonstrated by a significant positive correlation between resilience and life satisfaction (r = 0.36; p < 0.001), and a significant negative correlation between resilience and depressive symptoms (r = -0.29; p < 0.01). This analysis ultimately supports the appropriateness of the modified 23-item Spanish translation of the RS and its subscales in a sample of urban, low-income women of Mexican descent in the U.S.

Addressing the Lack of Measurement Invariance for the Measure of Acceptance of the Theory of Evolution

ERIC Educational Resources Information Center

Wagler, Amy; Wagler, Ron

2013-01-01

The Measure of Acceptance of the Theory of Evolution (MATE) was constructed to be a single-factor instrument that assesses an individual's overall acceptance of evolutionary theory. The MATE was validated and the scores resulting from the MATE were found to be reliable for the population of inservice high school biology teachers. However, many…

Cross-Cultural Adaptation, Reliability and Validity Study of the Persian Version of the Clinical COPD Questionnaire.

PubMed

Hasanpour, Neda; Attarbashi Moghadam, Behrouz; Sami, Ramin; Tavakol, Kamran

2016-08-01

The clinical COPD questionnaire (CCQ) has been developed to measure the health status of COPD patients. The aim of this study was to translate CCQ into the Persian language and assess the validity and reliability of the translated version. We used a forward-backward procedure to translate the questionnaire. In a cross-sectional study 100 COPD patients and 50 healthy subjects over 40 years old were selected to assess the reliability and construct validity of the instrument. The face and content validity were used for the questionnaire validity. Validity was examined in a population of patients with COPD, using the Persian validated version of the St George's Respiratory Questionnaire (PSGRQ). In order to assess the questionnaire's reliability, the Intraclass correlation coefficient (ICC) and Cronbach's alpha were calculated. Test-retest reliability was tested by re-administering the Persian version of the CCQ (PCCQ) after 1 week. Test-retest carry out of data demonstrates that the PCCQ has excellent reliability (ICC for all 3 domains were higher than 0.9). Internal consistency was found by Cronbach's alpha to be 0.96, 0.94, 0.97, and 0.98 for the symptom, mental state, functional state and total scores respectively. In addition, the correlation between the components of PCCQ and PSGRQ showed satisfactory construct validity. Analyzing the data from healthy subjects and patients divulged that the PCCQ has acceptable discriminant validity. In general, the PCCQ had satisfactory reliability and validity for assessing health-related quality of life status of Iranian COPD patients.

Electronic device for endosurgical skills training (EDEST): study of reliability.

PubMed

Pagador, J B; Uson, J; Sánchez, M A; Moyano, J L; Moreno, J; Bustos, P; Mateos, J; Sánchez-Margallo, F M

2011-05-01

Minimally Invasive Surgery procedures are commonly used in many surgical practices, but surgeons need specific training models and devices due to its difficulty and complexity. In this paper, an innovative electronic device for endosurgical skills training (EDEST) is presented. A study on reliability for this device was performed. Different electronic components were used to compose this new training device. The EDEST was focused on two basic laparoscopic tasks: triangulation and coordination manoeuvres. A configuration and statistical software was developed to complement the functionality of the device. A calibration method was used to assure the proper work of the device. A total of 35 subjects (8 experts and 27 novices) were used to check the reliability of the system using the MTBF analysis. Configuration values for triangulation and coordination exercises were calculated as 0.5 s limit threshold and 800-11,000 lux range of light intensity, respectively. Zero errors in 1,050 executions (0%) for triangulation and 21 errors in 5,670 executions (0.37%) for coordination were obtained. A MTBF of 2.97 h was obtained. The results show that the reliability of the EDEST device is acceptable when used under previously defined light conditions. These results along with previous work could demonstrate that the EDEST device can help surgeons during first training stages.

Validating Neuro-QoL short forms and targeted scales with people who have multiple sclerosis.

PubMed

Miller, Deborah M; Bethoux, Francois; Victorson, David; Nowinski, Cindy J; Buono, Sarah; Lai, Jin-Shei; Wortman, Katy; Burns, James L; Moy, Claudia; Cella, David

2016-05-01

Multiple sclerosis (MS) is a chronic, progressive, and disabling disease of the central nervous system with dramatic variations in the combination and severity of symptoms it can produce. The lack of reliable disease-specific health-related quality of life (HRQL) measures for use in clinical trials prompted the development of the Neurology Quality of Life (Neuro-QOL) instrument, which includes 13 scales that assess physical, emotional, cognitive, and social domains, for use in a variety of neurological illnesses. The objective of this research paper is to conduct an initial assessment of the reliability and validation of the Neuro-QOL short forms (SFs) in MS. We assessed reliability, concurrent validity, known groups validity, and responsiveness between cross-sectional and longitudinal data in 161 recruited MS patients. Internal consistency was high for all measures (α = 0.81-0.95) and ICCs were within the acceptable range (0.76-0.91); concurrent and known groups validity were highest with the Global HRQL question. Longitudinal assessment was limited by the lack of disease progression in the group. The Neuro-QOL SFs demonstrate good internal consistency, test-re-test reliability, and concurrent and known groups validity in this MS population, supporting the validity of Neuro-QOL in adults with MS. © The Author(s), 2015.

Developing and testing the patient-centred innovation questionnaire for hospital nurses.

PubMed

Huang, Ching-Yuan; Weng, Rhay-Hung; Wu, Tsung-Chin; Lin, Tzu-En; Hsu, Ching-Tai; Hung, Chiu-Hsia; Tsai, Yu-Chen

2018-03-01

Develop the patient-centred innovation questionnaire for hospital nurses and establish its validity and reliability. Patient-centred care has been adopted by health care managers in their efforts to improve health care quality. It is regarded as a core concept for developing innovation. A cross-sectional study was employed to collect data from hospital nurses in Taiwan. This study was divided into two stages: pilot study and main study. In the main study, 596 valid responses were collected. This study adopted reliability analysis, exploratory factor analysis, confirmatory factor analysis and selected nurse innovation scale as a criterion to test criterion-related validity. Five-dimension patient-centred innovation questionnaire was proposed: access and practicability, co-ordination and communication, sharing power and responsibility, care continuity, family and person focus. Each dimension demonstrated a reliability of 0.89-0.98. All dimensions had acceptable convergent and discriminate validity. The patient-centred innovation questionnaire and nurse innovation scale exhibited a significantly positive correlation. Patient-centred innovation questionnaire not only had a good theoretical basis but also had sufficient reliability and construct validity, and criterion-related validity. Patient-centred innovation questionnaire could give a measure for evaluating the implementation of patient-centred care and could be used as a management tool during the process of nurse innovation. © 2017 John Wiley & Sons Ltd.

Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management.

PubMed

Paddock, L E; Veloski, J; Chatterton, M L; Gevirtz, F O; Nash, D B

2000-07-01

To develop a reliable and valid questionnaire to measure patient satisfaction with diabetes disease management programs. Questions related to structure, process, and outcomes were categorized into 14 domains defining the essential elements of diabetes disease management. Health professionals confirmed the content validity. Face validity was established by a patient focus group. The questionnaire was mailed to 711 patients with diabetes who participated in a disease management program. To reduce the number of questionnaire items, a principal components analysis was performed using a varimax rotation. The Scree test was used to select significant components. To further assess reliability and validity; Cronbach's alpha and product-moment correlations were calculated for components having > or =3 items with loadings >0.50. The validated 73-item mailed satisfaction survey had a 34.1% response rate. Principal components analysis yielded 13 components with eigenvalues > 1.0. The Scree test proposed a 6-component solution (39 items), which explained 59% of the total variation. Internal consistency reliabilities computed for the first 6 components (alpha = 0.79-0.95) were acceptable. The final questionnaire, the Diabetes Management Evaluation Tool (DMET), was designed to assess patient satisfaction with diabetes disease management programs. Although more extensive testing of the questionnaire is appropriate, preliminary reliability and validity of the DMET has been demonstrated.

The development of an instrument to measure teachers' use of fear appeals in the GCSE classroom.

PubMed

Putwain, David W; Roberts, Christine M

2009-12-01

Previous work has suggested that teachers of General Certificate of Secondary Education classes may use fear appeals as a motivational device but these may have unwanted consequences by increasing examination-related anxiety in students. To facilitate future work in this area, an instrument was developed to measure teachers' use of fear appeals in the course of normal classroom instruction. Students in their final 2 years of compulsory schooling in England: 192 in Study 1 and 133 in Study 2. A construct validity approach was used in the development of this instrument. Study 1 reports the development and piloting of this measure. Study 2 reports refinement of this measure and relations with other constructs. A three-factor structure provided a reasonable model fit and all factors demonstrated acceptable reliability. Factors 1 and 2 described the perceived frequency of fear appeals made in relation to educational/occupational consequences and the third factor described the perceived threat of fear appeals. This instrument has demonstrated sufficient convergent and discriminant validity and reliability to be used in subsequent research, although the validation process should continue and it is hoped that the instrument will be adapted for use in other contexts.

Unavoidable Pressure Ulcers: Development and Testing of the Indiana University Health Pressure Ulcer Prevention Inventory.

PubMed

Pittman, Joyce; Beeson, Terrie; Terry, Colin; Dillon, Jill; Hampton, Charity; Kerley, Denise; Mosier, Judith; Gumiela, Ellen; Tucker, Jessica

2016-01-01

Despite prevention strategies, hospital-acquired pressure ulcers (HAPUs) continue to occur in the acute care setting. The purpose of this study was to develop an operational definition of and an instrument for identifying avoidable/unavoidable HAPUs in the acute care setting. The Indiana University Health Pressure Ulcer Prevention Inventory (PUPI) was developed and psychometric testing was performed. A retrospective pilot study of 31 adult hospitalized patients with an HAPU was conducted using the PUPI. Overall content validity index of 0.99 and individual item content validity index scores (0.9-1.0) demonstrated excellent content validity. Acceptable PUPI criterion validity was demonstrated with no statistically significant differences between wound specialists' and other panel experts' scoring. Construct validity findings were acceptable with no statistically significant differences among avoidable or unavoidable HAPU patients and their Braden Scale total scores. Interrater reliability was acceptable with perfect agreement on the total PUPI score between raters (κ = 1.0; P = .025). Raters were in total agreement 93% (242/260) of the time on all 12 individual PUPI items. No risk factors were found to be significantly associated with unavoidable HAPUs. An operational definition of and an instrument for identifying avoidable/unavoidable HAPUs in the acute care setting were developed and tested. The instrument provides an objective and structured method for identifying avoidable/unavoidable HAPUs. The PUPI provides an additional method that could be used in root-cause analyses and when reporting adverse pressure ulcer events.

Mass extraction container closure integrity physical testing method development for parenteral container closure systems.

PubMed

Yoon, Seung-Yil; Sagi, Hemi; Goldhammer, Craig; Li, Lei

2012-01-01

Container closure integrity (CCI) is a critical factor to ensure that product sterility is maintained over its entire shelf life. Assuring the CCI during container closure (C/C) system qualification, routine manufacturing and stability is important. FDA guidance also encourages industry to develop a CCI physical testing method in lieu of sterility testing in a stability program. A mass extraction system has been developed to check CCI for a variety of container closure systems such as vials, syringes, and cartridges. Various types of defects (e.g., glass micropipette, laser drill, wire) were created and used to demonstrate a detection limit. Leakage, detected as mass flow in this study, changes as a function of defect length and diameter. Therefore, the morphology of defects has been examined in detail with fluid theories. This study demonstrated that a mass extraction system was able to distinguish between intact samples and samples with 2 μm defects reliably when the defect was exposed to air, water, placebo, or drug product (3 mg/mL concentration) solution. Also, it has been verified that the method was robust, and capable of determining the acceptance limit using 3σ for syringes and 6σ for vials. Sterile products must maintain their sterility over their entire shelf life. Container closure systems such as those found in syringes and vials provide a seal between rubber and glass containers. This seal must be ensured to maintain product sterility. A mass extraction system has been developed to check container closure integrity for a variety of container closure systems such as vials, syringes, and cartridges. In order to demonstrate the method's capability, various types of defects (e.g., glass micropipette, laser drill, wire) were created in syringes and vials and were tested. This study demonstrated that a mass extraction system was able to distinguish between intact samples and samples with 2 μm defects reliably when the defect was exposed to air, water, placebo, or drug product (3 mg/mL concentration) solution. Also, it was verified that the method showed consistent results, and was able to determine the acceptance limit using 3σ for syringes and 6σ for vials.

The Chinese version of the Outcome Expectations for Exercise scale: validation study.

PubMed

Lee, Ling-Ling; Chiu, Yu-Yun; Ho, Chin-Chih; Wu, Shu-Chen; Watson, Roger

2011-06-01

Estimates of the reliability and validity of the English nine-item Outcome Expectations for Exercise (OEE) scale have been tested and found to be valid for use in various settings, particularly among older people, with good internal consistency and validity. Data on the use of the OEE scale among older Chinese people living in the community and how cultural differences might affect the administration of the OEE scale are limited. To test the validity and reliability of the Chinese version of the Outcome Expectations for Exercise scale among older people. A cross-sectional validation study was designed to test the Chinese version of the OEE scale (OEE-C). Reliability was examined by testing both the internal consistency for the overall scale and the squared multiple correlation coefficient for the single item measure. The validity of the scale was tested on the basis of both a traditional psychometric test and a confirmatory factor analysis using structural equation modelling. The Mokken Scaling Procedure (MSP) was used to investigate if there were any hierarchical, cumulative sets of items in the measure. The OEE-C scale was tested in a group of older people in Taiwan (n=108, mean age=77.1). There was acceptable internal consistency (alpha=.85) and model fit in the scale. Evidence of the validity of the measure was demonstrated by the tests for criterion-related validity and construct validity. There was a statistically significant correlation between exercise outcome expectations and exercise self-efficacy (r=.34, p<.01). An analysis of the Mokken Scaling Procedure found that nine items of the scale were all retained in the analysis and the resulting scale was reliable and statistically significant (p=.0008). The results obtained in the present study provided acceptable levels of reliability and validity evidence for the Chinese Outcome Expectations for Exercise scale when used with older people in Taiwan. Future testing of the OEE-C scale needs to be carried out to see whether these results are generalisable to older Chinese people living in urban areas. Copyright © 2010 Elsevier Ltd. All rights reserved.

Test-retest reliability of 3D ultrasound measurements of the thoracic spine.

PubMed

Fölsch, Christian; Schlögel, Stefanie; Lakemeier, Stefan; Wolf, Udo; Timmesfeld, Nina; Skwara, Adrian

2012-05-01

To explore the reliability of the Zebris CMS 20 ultrasound analysis system with pointer application for measuring end-range flexion, end-range extension, and neutral kyphosis angle of the thoracic spine. The study was performed within the School of Physiotherapy in cooperation with the Orthopedic Department at a University Hospital. The thoracic spines of 28 healthy subjects were measured. Measurements for neutral kyphosis angle, end-range flexion, and end-range extension were taken once at each time point. The bone landmarks were palpated by one examiner and marked with a pointer containing 2 transmitters using a frequency of 40 kHz. A third transmitter was fixed to the pelvis, and 3 microphones were used as receiver. The real angle was calculated by the software. Bland-Altman plots with 95% limits of agreement, intraclass correlations (ICC), standard deviations of mean measurements, and standard error of measurements were used for statistical analyses. The test-retest reliability in this study was measured within a 24-hour interval. Statistical parameters were used to judge reliability. The mean kyphosis angle was 44.8° with a standard deviation of 17.3° at the first measurement and a mean of 45.8° with a standard deviation of 16.2° the following day. The ICC was high at 0.95 for the neutral kyphosis angle, and the Bland-Altman 95% limits of agreement were within clinical acceptable margins. The ICC was 0.71 for end-range flexion and 0.34 for end-range extension, whereas the Bland-Altman 95% limits of agreement were wider than with the static measurement of kyphosis. Compared with static measurements, the analysis of motion with 3-dimensional ultrasound showed an increased standard deviation for test-retest measurements. The test-retest reliability of ultrasound measuring of the neutral kyphosis angle of the thoracic spine was demonstrated within 24 hours. Bland-Altman 95% limits of agreement and the standard deviation of differences did not appear to be clinically acceptable for measuring flexion and extension. Copyright © 2012 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

A Quantitative Socio-hydrological Characterization of Water Security in Large-Scale Irrigation Systems

NASA Astrophysics Data System (ADS)

Siddiqi, A.; Muhammad, A.; Wescoat, J. L., Jr.

2017-12-01

Large-scale, legacy canal systems, such as the irrigation infrastructure in the Indus Basin in Punjab, Pakistan, have been primarily conceived, constructed, and operated with a techno-centric approach. The emerging socio-hydrological approaches provide a new lens for studying such systems to potentially identify fresh insights for addressing contemporary challenges of water security. In this work, using the partial definition of water security as "the reliable availability of an acceptable quantity and quality of water", supply reliability is construed as a partial measure of water security in irrigation systems. A set of metrics are used to quantitatively study reliability of surface supply in the canal systems of Punjab, Pakistan using an extensive dataset of 10-daily surface water deliveries over a decade (2007-2016) and of high frequency (10-minute) flow measurements over one year. The reliability quantification is based on comparison of actual deliveries and entitlements, which are a combination of hydrological and social constructs. The socio-hydrological lens highlights critical issues of how flows are measured, monitored, perceived, and experienced from the perspective of operators (government officials) and users (famers). The analysis reveals varying levels of reliability (and by extension security) of supply when data is examined across multiple temporal and spatial scales. The results shed new light on evolution of water security (as partially measured by supply reliability) for surface irrigation in the Punjab province of Pakistan and demonstrate that "information security" (defined as reliable availability of sufficiently detailed data) is vital for enabling water security. It is found that forecasting and management (that are social processes) lead to differences between entitlements and actual deliveries, and there is significant potential to positively affect supply reliability through interventions in the social realm.

Reliability and validity of two multidimensional self-reported physical activity questionnaires in people with chronic low back pain.

PubMed

Carvalho, Flávia A; Morelhão, Priscila K; Franco, Marcia R; Maher, Chris G; Smeets, Rob J E M; Oliveira, Crystian B; Freitas Júnior, Ismael F; Pinto, Rafael Z

2017-02-01

Although there is some evidence for reliability and validity of self-report physical activity (PA) questionnaires in the general adult population, it is unclear whether we can assume similar measurement properties in people with chronic low back pain (LBP). To determine the test-retest reliability of the International Physical Activity Questionnaire (IPAQ) long-version and the Baecke Physical Activity Questionnaire (BPAQ) and their criterion-related validity against data derived from accelerometers in patients with chronic LBP. Cross-sectional study. Patients with non-specific chronic LBP were recruited. Each participant attended the clinic twice (one week interval) and completed self-report PA. Accelerometer measures >7 days included time spent in moderate-and-vigorous physical activity, steps/day, counts/minute, and vector magnitude counts/minute. Intraclass Correlation Coefficients (ICC) and Bland and Altman method were used to determine reliability and spearman rho correlation were used for criterion-related validity. A total of 73 patients were included in our analyses. The reliability analyses revealed that the BPAQ and its subscales have moderate to excellent reliability (ICC 2,1 : 0.61 to 0.81), whereas IPAQ and most IPAQ domains (except walking) showed poor reliability (ICC 2,1 : 0.20 to 0.40). The Bland and Altman method revealed larger discrepancies for the IPAQ. For the validity analysis, questionnaire and accelerometer measures showed at best fair correlation (rho < 0.37). Although the BPAQ showed better reliability than the IPAQ long-version, both questionnaires did not demonstrate acceptable validity against accelerometer data. These findings suggest that questionnaire and accelerometer PA measures should not be used interchangeably in this population. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reliability and validity of an audio signal modified shuttle walk test.

PubMed

Singla, Rupak; Rai, Richa; Faye, Abhishek Anil; Jain, Anil Kumar; Chowdhury, Ranadip; Bandyopadhyay, Debdutta

2017-01-01

The audio signal in the conventionally accepted protocol of shuttle walk test (SWT) is not well-understood by the patients and modification of the audio signal may improve the performance of the test. The aim of this study is to study the validity and reliability of an audio signal modified SWT, called the Singla-Richa modified SWT (SWTSR), in healthy normal adults. In SWTSR, the audio signal was modified with the addition of reverse counting to it. A total of 54 healthy normal adults underwent conventional SWT (CSWT) at one instance and two times SWTSRon the same day. The validity was assessed by comparing outcomes of the SWTSRto outcomes of CSWT using the Pearson correlation coefficient and Bland-Altman plot. Test-retest reliability of SWTSRwas assessed using the intraclass correlation coefficient (ICC). The acceptability of the modified test in comparison to the conventional test was assessed using Likert scale. The distance walked (mean ± standard deviation) in the CSWT and SWTSRtest was 853.33 ± 217.33 m and 857.22 ± 219.56 m, respectively (Pearson correlation coefficient - 0.98; P < 0.001) indicating SWTSRto be a valid test. The SWTSRwas found to be a reliable test with ICC of 0.98 (95% confidence interval: 0.97-0.99). The acceptability of SWTSRwas significantly higher than CSWT. The SWTSRwith modified audio signal with reverse counting is a reliable as well as a valid test when compared with CSWT in healthy normal adults. It better understood by subjects compared to CSWT.

Cross-cultural translation, validity, and reliability of the French version of the Neurophysiology of Pain Questionnaire.

PubMed

Demoulin, Christophe; Brasseur, Pauline; Roussel, Nathalie; Brereton, Clara; Humblet, Fabienne; Flynn, Daniel; Van Beveren, Julien; Osinsky, Thomas; Donneau, Anne-Françoise; Crielaard, Jean-Michel; Vanderthommen, Marc; Bruyère, Olivier

2017-11-01

Pain physiology education is an important component in the management of patients with chronic musculoskeletal pain. The Neurophysiology of Pain Questionnaire (NPQ) was developed in English to assess pain physiology knowledge in patients. This study aimed to translate the NPQ into French (NPQ-Fr) and to investigate the main psychometric properties of the NPQ-Fr. The translation was performed using the best practice translation guidelines. One hundred and one French-speaking patients with chronic non-specific spinal pain completed the NPQ-Fr to assess its acceptability and presence of floor/ceiling effects and test its dimensionality. The construct validity was tested by comparing the patients' NPQ-Fr scores to those of 17 physiotherapists and investigating its correlation with subscales of the Short Form-36 questionnaire. The reliability (i.e., internal consistency and test-retest reliability) was also investigated. To test the test-retest reliability, 70 patients were asked to complete the NPQ-Fr twice with one week in between. Regarding the NPQ-Fr psychometric properties: 1) acceptability was good; 2) internal consistency reached a Cronbach α-coefficient of 0.44; 3) no floor and ceiling effects were observed in patients; 4) a principal factor analysis generated three major factors; 5) construct validity was good; and 6) reliability was acceptable (intraclass correlation coefficient = 0.644; standard error of measurement = 1.5). The NPQ-Fr has satisfactory basic psychometric properties in patients with chronic spinal pain.

A "TNM" classification system for cancer pain: the Edmonton Classification System for Cancer Pain (ECS-CP).

PubMed

Fainsinger, Robin L; Nekolaichuk, Cheryl L

2008-06-01

The purpose of this paper is to provide an overview of the development of a "TNM" cancer pain classification system for advanced cancer patients, the Edmonton Classification System for Cancer Pain (ECS-CP). Until we have a common international language to discuss cancer pain, understanding differences in clinical and research experience in opioid rotation and use remains problematic. The complexity of the cancer pain experience presents unique challenges for the classification of pain. To date, no universally accepted pain classification measure can accurately predict the complexity of pain management, particularly for patients with cancer pain that is difficult to treat. In response to this gap in clinical assessment, the Edmonton Staging System (ESS), a classification system for cancer pain, was developed. Difficulties in definitions and interpretation of some aspects of the ESS restricted acceptance and widespread use. Construct, inter-rater reliability, and predictive validity evidence have contributed to the development of the ECS-CP. The five features of the ECS-CP--Pain Mechanism, Incident Pain, Psychological Distress, Addictive Behavior and Cognitive Function--have demonstrated value in predicting pain management complexity. The development of a standardized classification system that is comprehensive, prognostic and simple to use could provide a common language for clinical management and research of cancer pain. An international study to assess the inter-rater reliability and predictive value of the ECS-CP is currently in progress.

Validating a Chinese version of the Weight Self-stigma Questionnaire for use with obese adults.

PubMed

Lin, Kuan Pin; Lee, Mei Li

2017-08-01

Although weight-based stigmatization is pervasive in everyday life, a suitable measure of weight self-stigma is currently unavailable for the obese Chinese population. The purpose of this study was to translate and test the psychometric properties of the Weight Self-stigma Questionnaire into Chinese (C-WSSQ) for use with obese Chinese people. A cross-sectional study was conducted on 156 overweight or obese adults. The data were collected from September to December 2015. Data on the body mass index, C-WSSQ, and Multidimensional Body Self-relation Questionnaire were used. The reproducibility and Cronbach a of the C-WSSQ were .892 and .880, respectively, indicating acceptable reliability. The exploratory factor analysis revealed that 2 extracted factors identified to the domain structures of the C-WSSQ, as explained by the 67.05% total variance. The C-WSSQ also demonstrated that the 2-factor model, self-devaluation, and fear of enacted stigma fit the data on the basis of confirmatory factor analysis. Meanwhile, the C-WSSQ was correlated with body mass index and Multidimensional Body Self-relation Questionnaire, indicating an acceptable criterion-related validity. The C-WSSQ shows adequate reliability and validity. The health professionals can use the C-WSSQ to assess weight self-stigma of obese Chinese adults before and after intervention of a weight-loss program. © 2017 John Wiley & Sons Australia, Ltd.

Improved reliability of pH measurements.

PubMed

Spitzer, Petra; Werner, Barbara

2002-11-01

Measurements of pH are performed on a large scale at laboratory level, and in industry. To meet the quality-control requirements and other technical specifications there is a need for traceability in measurement results. The prerequisite for the international acceptance of analytical data is reliability. To measure means to compare. Comparability entails use of recognised references to which the standard buffer solutions used for calibration of pH meter-electrode assemblies can be traced. The new recommendation on the measurement of pH recently published as a provisional document by the International Union on Pure and Applied Chemistry (IUPAC) enables traceability for measured pH values to a conventional reference frame which is recognised world-wide. The primary method for pH will be described. If analytical data are to be accepted internationally it is necessary to demonstrate the equivalence of the national traceability structures, including national measurement standards. For the first time key comparisons for pH have been performed by the Consultative Committee for Amount of Substance (CCQM, set up by the International Bureau of Weights and Measures, BIPM) to assess the equivalence of the national measurement procedures used to determine the pH of primary standard buffer solutions. The results of the first key comparison on pH CCQM-K9, and other international initiatives to improve the consistency of the results of measurement for pH, are reported.

Development and validation of brief scales to measure emotional and behavioural problems among Chinese adolescents

PubMed Central

Shen, Minxue; Hu, Ming; Sun, Zhenqiu

2017-01-01

Objectives To develop and validate brief scales to measure common emotional and behavioural problems among adolescents in the examination-oriented education system and collectivistic culture of China. Setting Middle schools in Hunan province. Participants 5442 middle school students aged 11–19 years were sampled. 4727 valid questionnaires were collected and used for validation of the scales. The final sample included 2408 boys and 2319 girls. Primary and secondary outcome measures The tools were assessed by the item response theory, classical test theory (reliability and construct validity) and differential item functioning. Results Four scales to measure anxiety, depression, study problem and sociality problem were established. Exploratory factor analysis showed that each scale had two solutions. Confirmatory factor analysis showed acceptable to good model fit for each scale. Internal consistency and test–retest reliability of all scales were above 0.7. Item response theory showed that all items had acceptable discrimination parameters and most items had appropriate difficulty parameters. 10 items demonstrated differential item functioning with respect to gender. Conclusions Four brief scales were developed and validated among adolescents in middle schools of China. The scales have good psychometric properties with minor differential item functioning. They can be used in middle school settings, and will help school officials to assess the students’ emotional/behavioural problems. PMID:28062469

Body postures and patterns as amplifiers of physical condition.

PubMed Central

Taylor, P W; Hasson, O; Clark, D L

2000-01-01

The question of why receivers accept a selfish signaller's message as reliable or 'honest' has fuelled ample controversy in discussions of communication. The handicap mechanism is now widely accepted as a potent constraint on cheating. Handicap signals are deemed reliable by their costs: signallers must choose between investing in the signal or in other aspects of fitness. Accordingly, resources allocated to the signal come to reflect the signaller's fitness budget and, on average, cheating is uneconomic. However, that signals may also be deemed reliable by their design, regardless of costs, is not widely appreciated. Here we briefly describe indices and amplifiers, reliable signals that may be essentially cost free. Indices are reliable because they bear a direct association with the signalled quality rather than costs. Amplifiers do not directly provide information about signaller quality, but they facilitate assessment by increasing the apparency of pre-existing cues and signals that are associated with quality. We present results of experiments involving a jumping spider (Plexippus paykulli) to illustrate how amplifiers can facilitate assessment of cues associated with physical condition without invoking the costs required for handicap signalling. PMID:10853735

Psychometric properties of the communication skills attitude scale (CSAS) measure in a sample of Iranian medical students

PubMed Central

YAKHFOROSHHA, AFSANEH; SHIRAZI, MANDANA; YOUSEFZADEH, NASER; GHANBARNEJAD, AMIN; CHERAGHI, MOHAMMADALI; MOJTAHEDZADEH, RITA; MAHMOODI-BAKHTIARI, BEHROOZ; EMAMI, SEYED AMIR HOSSEIN

2018-01-01

Introduction: Communication skill (CS) has been regarded as one of the fundamental competencies for medical and other health care professionals. Student's attitude toward learning CS is a key factor in designing educational interventions. The original CSAS, as positive and negative subscales, was developed in the UK; however, there is no scale to measure these attitudes in Iran. The aim of this study was to assess the psychometric characteristic of the Communication Skills Attitude Scale (CSAS), in an Iranian context and to understand if it is a valid tool to assess attitude toward learning communication skills among health care professionals. Methods: Psychometric characteristics of the CSAS were assessed by using a cross-sectional design. In the current study, 410 medical students were selected using stratified sampling framework. The face validity of the scale was estimated through students and experts’ opinion. Content validity of CSAS was assessed qualitatively and quantitatively. Reliability was examined through two methods including Chronbach’s alpha coefficient and Intraclass Correlation of Coefficient (ICC). Construct validity of CSAS was assessed using confirmatory factor analysis (CFA) and explanatory factor analysis (PCA) followed by varimax rotation. Convergent and discriminant validity of the scale was measured through Spearman correlation. Statistical analysis was performed using SPSS 19 and EQS, 6.1. Results: The internal consistency and reproducibility of the total CSAS score were 0.84 (Cronbach’s alpha) and 0.81, which demonstrates an acceptable reliability of the questionnaire. The item-level content validity index (I-CVI) and the scale-level content validity index (S-CVI/Ave) demonstrated appropriate results: 0.97 and 0.94, respectively. An exploratory factor analysis (EFA) on the 25 items of the CSAS revealed 4-factor structure that all together explained %55 of the variance. Results of the confirmatory factor analysis indicated an acceptable goodness-of-fit between the model and the observed data. [χ2/df = 2.36, Comparative Fit Index (CFI) = 0.95, the GFI=0.96, Root Mean Square Error of Approximation (RMSEA) = 0.05]. Conclusion: The Persian version of CSAS is a multidimensional, valid and reliable tool for assessing attitudes towards communication skill among medical students. PMID:29344525

The Item-Specific Deficit Approach to evaluating verbal memory dysfunction: rationale, psychometrics, and application.

PubMed

Wright, Matthew J; Woo, Ellen; Schmitter-Edgecombe, Maureen; Hinkin, Charles H; Miller, Eric N; Gooding, Amanda L

2009-10-01

In the current study, we introduce the Item-Specific Deficit Approach (ISDA), a novel method for characterizing memory process deficits in list-learning data. To meet this objective, we applied the ISDA to California Verbal Learning Test (CVLT) data collected from a sample of 132 participants (53 healthy participants and 79 neurologically compromised participants). Overall, the ISDA indices measuring encoding, consolidation, and retrieval deficits demonstrated advantages over some traditional indices and indicated acceptable reliability and validity. Currently, the ISDA is intended for experimental use, although further research may support its utility for characterizing memory impairments in clinical assessments.

Factor Structure and Psychometric Properties of the Brief Illness Perception Questionnaire in Turkish Cancer Patients

PubMed Central

Karataş, Tuğba; Özen, Şükrü; Kutlutürkan, Sevinç

2017-01-01

Objective: The main aim of this study was to investigate the factor structure and psychometric properties of the Brief Illness Perception Questionnaire (BIPQ) in Turkish cancer patients. Methods: This methodological study involved 135 cancer patients. Statistical methods included confirmatory or exploratory factor analysis and Cronbach alpha coefficients for internal consistency. Results: The values of fit indices are within the acceptable range. The alpha coefficients for emotional illness representations, cognitive illness representations, and total scale are 0.83, 0.80, and 0.85, respectively. Conclusions: The results confirm the two-factor structure of the Turkish BIPQ and demonstrate its reliability and validity. PMID:28217734

Validation of a Spanish version of the psychological inflexibility in pain scale (PIPS) and an evaluation of its relation with acceptance of pain and mindfulness in sample of persons with fibromyalgia

PubMed Central

2013-01-01

Background Psychological flexibility has been suggested as a fundamental process in health. The Psychological Inflexibility in Pain Scale (PIPS) is one of the scales employed for assessing psychological inflexibility in pain patients. The aim of this study was to validate the Spanish version of the PIPS and secondly, to compare it to two other psychological constructs, the acceptance of pain and mindfulness scales. Methods The PIPS was translated into Spanish by two bilingual linguistic experts, and then, back-translated into English to assess for equivalence. The final Spanish version was administered along with the Pain Visual Analogue Scale, Fibromyalgia Impact Questionnaire, Hospital Anxiety Depression Scale, Pain Catastrophizing Scale, Chronic Pain Acceptance Questionnaire and the Mindful Attention Awareness Scale, to 250 Spanish patients with fibromyalgia. Face validity, construct validity, reliability (internal consistency and test-retest) and convergent validity were tested. Also a multiple regression analysis was carried out.The usual guidelines have been followed for cross-cultural adaptations. Results Data were very similar to the ones obtained in the original PIPS version. The construct validity confirmed the original two-components solution which explained 61.6% of the variance. The Spanish PIPS had good test-retest reliability (intraclass correlation coefficient 0.97) and internal consistency reliability (Cronbach’s alpha: 0.90). The Spanish PIPS’ score correlated significantly with worse global functioning (r = 0.55), anxiety (r = 0.54), depression (r = 0.66), pain catastrophizing (r = 0.62), pain acceptance (r = −0.72) and mindfulness (r = −0.47), as well as correlating modestly with pain intensity (r = 0.12). The multiple regression analyses showed that psychological inflexibility, acceptance and mindfulness are not overlapped. Conclusions The Spanish PIPS scale appears to be a valid and reliable instrument for the evaluation of psychological inflexibility among a sample of fibromyalgia patients. These results ensure the use of this scale in research as well as in clinical practice. Psychological inflexibility measures processes different from other related components such as acceptance and mindfulness. PMID:23594367

Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire.

PubMed

Ballangrud, Randi; Husebø, Sissel Eikeland; Hall-Lord, Marie Louise

2017-12-02

Teamwork is an integrated part of today's specialized and complex healthcare and essential to patient safety, and is considered as a core competency to improve twenty-first century healthcare. Teamwork measurements and evaluations show promising results to promote good team performance, and are recommended for identifying areas for improvement. The validated TeamSTEPPS® Teamwork Perception Questionnaire (T-TPQ) was found suitable for cross-cultural validation and testing in a Norwegian context. T-TPQ is a self-report survey that examines five dimensions of perception of teamwork within healthcare settings. The aim of the study was to translate and cross-validate the T-TPQ into Norwegian, and test the questionnaire for psychometric properties among healthcare personnel. The T-TPQ was translated and adapted to a Norwegian context according to a model of a back-translation process. A total of 247 healthcare personnel representing different professionals and hospital settings responded to the questionnaire. A confirmatory factor analysis was carried out to test the factor structure. Cronbach's alpha was used to establish internal consistency, and an Intraclass Correlation Coefficient was used to assess the test - retest reliability. A confirmatory factor analysis showed an acceptable fitting model (χ 2 (df) 969.46 (546), p < 0.001, Root Mean Square Error of Approximation (RMSEA) = 0.056, Tucker-Lewis Index (TLI) = 0.88, Comparative fit index (CFI) = 0.89, which indicates that each set of the items that was supposed to accompany each teamwork dimension clearly represents that specific construct. The Cronbach's alpha demonstrated acceptable values on the five subscales (0.786-0.844), and test-retest showed a reliability parameter, with Intraclass Correlation Coefficient scores from 0.672 to 0.852. The Norwegian version of T-TPQ was considered to be acceptable regarding the validity and reliability for measuring Norwegian individual healthcare personnel's perception of group level teamwork within their unit. However, it needs to be further tested, preferably in a larger sample and in different clinical settings.

A particle swarm model for estimating reliability and scheduling system maintenance

NASA Astrophysics Data System (ADS)

Puzis, Rami; Shirtz, Dov; Elovici, Yuval

2016-05-01

Modifying data and information system components may introduce new errors and deteriorate the reliability of the system. Reliability can be efficiently regained with reliability centred maintenance, which requires reliability estimation for maintenance scheduling. A variant of the particle swarm model is used to estimate reliability of systems implemented according to the model view controller paradigm. Simulations based on data collected from an online system of a large financial institute are used to compare three component-level maintenance policies. Results show that appropriately scheduled component-level maintenance greatly reduces the cost of upholding an acceptable level of reliability by reducing the need in system-wide maintenance.

Construct Validity of the Societal Outreach Scale (SOS).

PubMed

Fike, David S; Denton, Jason; Walk, Matt; Kish, Jennifer; Gorman, Ira

2018-04-01

The American Physical Therapy Association (APTA) has been working toward a vision of increasing professional focus on societal-level health. However, performance of social responsibility and related behaviors by physical therapists remain relatively poorly integrated into practice. Promoting a focus on societal outreach is necessary for all health care professionals to impact the health of their communities. The objective was to document the validity of the 14-item Societal Outreach Scale (SOS) for use with practicing physical therapists. This study used a cross-sectional survey. The SOS was transmitted via email to all therapists who were licensed and practicing in 10 states in the United States that were purposefully selected to assure a broad representation. A sample of 2612 usable responses was received. Factor analysis was applied to assess construct validity of the instrument. Of alternate models, a 3-factor model best demonstrated goodness of fit with the sample data according to conventional indices (standardized root mean squared residual = .03, comparative fit index .96, root mean square error of approximation = .06). The 3 factors measured by the SOS were labeled Societal-Level Health Advocacy, Community Engagement/Social Integration, and Political Engagement. Internal consistency reliability was 0.7 for all factors. The 3-factor SOS demonstrated acceptable validity and reliability. Though the sample included a broad representation of physical therapists, this was a single cross-sectional study. Additional confirmatory factor analysis, reliability testing, and word refinement of the tool are warranted. Given the construct validity and reliability of the 3-factor SOS, it is recommended for use as a validated instrument to measure physical therapists' performance of social responsibility and related behaviors.

Past-behavioural versus situational questions in a postgraduate admissions multiple mini-interview: a reliability and acceptability comparison.

PubMed

Yoshimura, Hiroshi; Kitazono, Hidetaka; Fujitani, Shigeki; Machi, Junji; Saiki, Takuya; Suzuki, Yasuyuki; Ponnamperuma, Gominda

2015-04-14

The Multiple Mini-Interview (MMI) mostly uses 'Situational' Questions (SQs) as an interview format within a station, rather than 'Past-Behavioural' Questions (PBQs), which are most frequently adopted in traditional single-station personal interviews (SSPIs) for non-medical and medical selection. This study investigated reliability and acceptability of the postgraduate admissions MMI with PBQ and SQ interview formats within MMI stations. Twenty-six Japanese medical graduates, first completed the two-year national obligatory initial postgraduate clinical training programme and then applied to three specialty training programmes - internal medicine, general surgery, and emergency medicine - in a Japanese teaching hospital, where they underwent the Accreditation Council for Graduate Medical Education (ACGME)-competency-based MMI. This MMI contained five stations, with two examiners per station. In each station, a PBQ, and then an SQ were asked consecutively. PBQ and SQ interview formats were not separated into two different stations, or the order of questioning of PBQs and SQs in individual stations was not changed due to lack of space and experienced examiners. Reliability was analysed for the scores of these two MMI question types. Candidates and examiners were surveyed on this experience. The PBQ and SQ formats had generalisability coefficients of 0.822 and 0.821, respectively. With one examiner per station, seven stations could produce a reliability of more than 0.80 in both PBQ and SQ formats. More than 60% of both candidates and examiners felt positive about the overall candidates' ability. All participants liked the fairness of this MMI when compared with the previously experienced SSPI. SQs were perceived more favourable by candidates; in contrast, PBQs were perceived more relevant by examiners. Both PBQs and SQs are equally reliable and acceptable as station interview formats in the postgraduate admissions MMI. However, the use of the two formats within the same station, and with a fixed order, is not the best to maximise its utility as an admission test. Future studies are required to evaluate how best the SQs and PBQs should be combined as station interview formats to enhance reliability, feasibility, acceptability and predictive validity of the MMI.

Adaptation and Evaluation of the Neighborhood Environment Walkability Scale in India (NEWS-India).

PubMed

Adlakha, Deepti; Hipp, J Aaron; Brownson, Ross C

2016-04-02

Physical inactivity is the fourth leading risk factor for global mortality, with most of these deaths occurring in low and middle-income countries (LMICs) like India. Research from developed countries has consistently demonstrated associations between built environment features and physical activity levels of populations. The development of culturally sensitive and reliable measures of the built environment is a necessary first step for accurate analysis of environmental correlates of physical activity in LMICs. This study systematically adapted the Neighborhood Environment Walkability Scale (NEWS) for India and evaluated aspects of test-retest reliability of the adapted version among Indian adults. Cultural adaptation of the NEWS was conducted by Indian and international experts. Semi-structured interviews were conducted with local residents and key informants in the city of Chennai, India. At baseline, participants (N = 370; female = 47.2%) from Chennai completed the adapted NEWS-India surveys on perceived residential density, land use mix-diversity, land use mix-access, street connectivity, infrastructure and safety for walking and cycling, aesthetics, traffic safety, and safety from crime. NEWS-India was administered for a second time to consenting participants (N = 62; female = 53.2%) with a gap of 2-3 weeks between successive administrations. Qualitative findings demonstrated that built environment barriers and constraints to active commuting and physical activity behaviors intersected with social ecological systems. The adapted NEWS subscales had moderate to high test-retest reliability (ICC range 0.48-0.99). The NEWS-India demonstrated acceptable measurement properties among Indian adults and may be a useful tool for evaluation of built environment attributes in India. Further adaptation and evaluation in rural and suburban settings in India is essential to create a version that could be used throughout India.

Adaptation and Evaluation of the Neighborhood Environment Walkability Scale in India (NEWS-India)

PubMed Central

Adlakha, Deepti; Hipp, J. Aaron; Brownson, Ross C.

2016-01-01

Physical inactivity is the fourth leading risk factor for global mortality, with most of these deaths occurring in low and middle-income countries (LMICs) like India. Research from developed countries has consistently demonstrated associations between built environment features and physical activity levels of populations. The development of culturally sensitive and reliable measures of the built environment is a necessary first step for accurate analysis of environmental correlates of physical activity in LMICs. This study systematically adapted the Neighborhood Environment Walkability Scale (NEWS) for India and evaluated aspects of test-retest reliability of the adapted version among Indian adults. Cultural adaptation of the NEWS was conducted by Indian and international experts. Semi-structured interviews were conducted with local residents and key informants in the city of Chennai, India. At baseline, participants (N = 370; female = 47.2%) from Chennai completed the adapted NEWS-India surveys on perceived residential density, land use mix-diversity, land use mix-access, street connectivity, infrastructure and safety for walking and cycling, aesthetics, traffic safety, and safety from crime. NEWS-India was administered for a second time to consenting participants (N = 62; female = 53.2%) with a gap of 2–3 weeks between successive administrations. Qualitative findings demonstrated that built environment barriers and constraints to active commuting and physical activity behaviors intersected with social ecological systems. The adapted NEWS subscales had moderate to high test-retest reliability (ICC range 0.48–0.99). The NEWS-India demonstrated acceptable measurement properties among Indian adults and may be a useful tool for evaluation of built environment attributes in India. Further adaptation and evaluation in rural and suburban settings in India is essential to create a version that could be used throughout India. PMID:27049394

The Overt Behaviour Scale-Self-Report (OBS-SR) for acquired brain injury: exploratory analysis of reliability and validity.

PubMed

Kelly, Glenn; Simpson, Grahame K; Brown, Suzanne; Kremer, Peter; Gillett, Lauren

2017-05-23

The objectives were to test the properties, via a psychometric study, of the Overt Behaviour Scale-Self-Report (OBS-SR), a version of the OBS-Adult Scale developed to provide a client perspective on challenging behaviours after acquired brain injury. Study sample 1 consisted of 37 patients with primary brain tumour (PBT) and a family-member informant. Sample 2 consisted of 34 clients with other acquired brain injury (mixed brain injury, MBI) and a service-provider informant. Participants completed the OBS-SR (at two time points), and the Awareness Questionnaire (AQ) and Mayo Portland Adaptability Inventory-III (MPAI-III) once; informants completed the OBS-Adult and AQ once only. PBT-informant dyads displayed "good" levels of agreement (ICC 2,k  = .74; OBS-SR global index). Although MBI-informant dyads displayed no agreement (ICC 2,k  = .22; OBS-SR global index), the sub-group (17/29) rated by clinicians as having moderate to good levels of awareness displayed "fair" agreement (ICC 2,k  = .58; OBS-SR global index). Convergent/divergent validity was demonstrated by significant correlations between OBS-SR subscales and MPAI-III subscales with behavioural content (coefficients in the range .36 -.61). Scores had good reliability across one week (ICC 2,k  = .69). The OBS-SR took approximately 15 minutes to complete. It was concluded that the OBS-SR demonstrated acceptable reliability and validity, providing a useful resource in understanding clients' perspectives about their behaviour.

Developing a contributing factor classification scheme for Rasmussen's AcciMap: Reliability and validity evaluation.

PubMed

Goode, N; Salmon, P M; Taylor, N Z; Lenné, M G; Finch, C F

2017-10-01

One factor potentially limiting the uptake of Rasmussen's (1997) Accimap method by practitioners is the lack of a contributing factor classification scheme to guide accident analyses. This article evaluates the intra- and inter-rater reliability and criterion-referenced validity of a classification scheme developed to support the use of Accimap by led outdoor activity (LOA) practitioners. The classification scheme has two levels: the system level describes the actors, artefacts and activity context in terms of 14 codes; the descriptor level breaks the system level codes down into 107 specific contributing factors. The study involved 11 LOA practitioners using the scheme on two separate occasions to code a pre-determined list of contributing factors identified from four incident reports. Criterion-referenced validity was assessed by comparing the codes selected by LOA practitioners to those selected by the method creators. Mean intra-rater reliability scores at the system (M = 83.6%) and descriptor (M = 74%) levels were acceptable. Mean inter-rater reliability scores were not consistently acceptable for both coding attempts at the system level (M T1  = 68.8%; M T2  = 73.9%), and were poor at the descriptor level (M T1  = 58.5%; M T2  = 64.1%). Mean criterion referenced validity scores at the system level were acceptable (M T1  = 73.9%; M T2  = 75.3%). However, they were not consistently acceptable at the descriptor level (M T1  = 67.6%; M T2  = 70.8%). Overall, the results indicate that the classification scheme does not currently satisfy reliability and validity requirements, and that further work is required. The implications for the design and development of contributing factors classification schemes are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of alternative methods for toxicity testing.

PubMed Central

Bruner, L H; Carr, G J; Curren, R D; Chamberlain, M

1998-01-01

Before nonanimal toxicity tests may be officially accepted by regulatory agencies, it is generally agreed that the validity of the new methods must be demonstrated in an independent, scientifically sound validation program. Validation has been defined as the demonstration of the reliability and relevance of a test method for a particular purpose. This paper provides a brief review of the development of the theoretical aspects of the validation process and updates current thinking about objectively testing the performance of an alternative method in a validation study. Validation of alternative methods for eye irritation testing is a specific example illustrating important concepts. Although discussion focuses on the validation of alternative methods intended to replace current in vivo toxicity tests, the procedures can be used to assess the performance of alternative methods intended for other uses. Images Figure 1 PMID:9599695

Methodology for Physics and Engineering of Reliable Products

NASA Technical Reports Server (NTRS)

Cornford, Steven L.; Gibbel, Mark

1996-01-01

Physics of failure approaches have gained wide spread acceptance within the electronic reliability community. These methodologies involve identifying root cause failure mechanisms, developing associated models, and utilizing these models to inprove time to market, lower development and build costs and higher reliability. The methodology outlined herein sets forth a process, based on integration of both physics and engineering principles, for achieving the same goals.

High validity and reliability of the PedsQL™ Multidimensional Fatigue Scale for Brazilian children with cancer.

PubMed

Nascimento, Lucila Castanheira; Nunes, Michelle Darezzo Rodrigues; Rocha, Ester Leonardo; Bomfim, Emiliana Omena; Floria-Santos, Milena; Dos Santos, Claudia Benedita; Dos Santos, Danielle Maria de Souza Serio; de Lima, Regina Aparecida Garcia

2015-01-01

Among the main factors that affect patients' quality of life, fatigue is a significant symptom experienced by children during treatment. Despite the high incidence, there has been no validated scale to evaluate fatigue in children with cancer in Brazil. The purpose of this study was to examine the psychometric properties of the PedsQL™ Multidimensional Fatigue Scale, using self-reports of Brazilian children, 8 to 18 years of age, and proxy reports. A cross-sectional method was used to collect data from 216 subjects over an 18-month period. Reliability ranged from .70 to .90 except for sleep/rest fatigue, self-report (α = .55). No floor or ceiling effects were found in any dimension. Convergent validity was higher than .40 and divergent validity had 100% adjustment. The root mean square error of approximation was acceptable. The comparative fit index was lower than expected. The agreement between self and proxy responses was weak and moderate. The results demonstrate the reliability and validity of the Brazilian version in children with cancer. This is the first validated scale that assesses fatigue in Brazilian children and adolescents with cancer. © 2014 by Association of Pediatric Hematology/Oncology Nurses.

Reliability of the hospital nutrition environment scan for cafeterias, vending machines, and gift shops.

PubMed

Winston, Courtney P; Sallis, James F; Swartz, Michael D; Hoelscher, Deanna M; Peskin, Melissa F

2013-08-01

According to ecological models, the physical environment plays a major role in determining individual health behaviors. As such, researchers have started targeting the consumer nutrition environment of large-scale foodservice operations when implementing obesity-prevention programs. In 2010, the American Hospital Association released a call-to-action encouraging health care facilities to join in this movement and improve their facilities' consumer nutrition environments. The Hospital Nutrition Environment Scan (HNES) for Cafeterias, Vending Machines, and Gift Shops was developed in 2011, and the present study evaluated the inter-rater reliability of this instrument. Two trained raters visited 39 hospitals in southern California and completed the HNES. Percent agreement, kappa statistics, and intraclass correlation coefficients were calculated. Percent agreement between raters ranged from 74.4% to 100% and kappa statistics ranged from 0.458 to 1.0. The intraclass correlation coefficient for the overall nutrition composite scores was 0.961. Given these results, the HNES demonstrated acceptable reliability metrics and can now be disseminated to assess the current state of hospital consumer nutrition environments. Copyright © 2013 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

National audit of continence care: laying the foundation.

PubMed

Mian, Sarah; Wagg, Adrian; Irwin, Penny; Lowe, Derek; Potter, Jonathan; Pearson, Michael

2005-12-01

National audit provides a basis for establishing performance against national standards, benchmarking against other service providers and improving standards of care. For effective audit, clinical indicators are required that are valid, feasible to apply and reliable. This study describes the methods used to develop clinical indicators of continence care in preparation for a national audit. To describe the methods used to develop and test clinical indicators of continence care with regard to validity, feasibility and reliability. A multidisciplinary working group developed clinical indicators that measured the structure, process and outcome of care as well as case-mix variables. Literature searching, consensus workshops and a Delphi process were used to develop the indicators. The indicators were tested in 15 secondary care sites, 15 primary care sites and 15 long-term care settings. The process of development produced indicators that received a high degree of consensus within the Delphi process. Testing of the indicators demonstrated an internal reliability of 0.7 and an external reliability of 0.6. Data collection required significant investment in terms of staff time and training. The method used produced indicators that achieved a high degree of acceptance from health care professionals. The reliability of data collection was high for this audit and was similar to the level seen in other successful national audits. Data collection for the indicators was feasible to collect, however, issues of time and staffing were identified as limitations to such data collection. The study has described a systematic method for developing clinical indicators for national audit. The indicators proved robust and reliable in primary and secondary care as well as long-term care settings.

Using Rasch Analysis to Evaluate the Reliability and Validity of the Swallowing Quality of Life Questionnaire: An Item Response Theory Approach.

PubMed

Cordier, Reinie; Speyer, Renée; Schindler, Antonio; Michou, Emilia; Heijnen, Bas Joris; Baijens, Laura; Karaduman, Ayşe; Swan, Katina; Clavé, Pere; Joosten, Annette Veronica

2018-02-01

The Swallowing Quality of Life questionnaire (SWAL-QOL) is widely used clinically and in research to evaluate quality of life related to swallowing difficulties. It has been described as a valid and reliable tool, but was developed and tested using classic test theory. This study describes the reliability and validity of the SWAL-QOL using item response theory (IRT; Rasch analysis). SWAL-QOL data were gathered from 507 participants at risk of oropharyngeal dysphagia (OD) across four European countries. OD was confirmed in 75.7% of participants via videofluoroscopy and/or fiberoptic endoscopic evaluation, or a clinical diagnosis based on meeting selected criteria. Patients with esophageal dysphagia were excluded. Data were analysed using Rasch analysis. Item and person reliability was good for all the items combined. However, person reliability was poor for 8 subscales and item reliability was poor for one subscale. Eight subscales exhibited poor person separation and two exhibited poor item separation. Overall item and person fit statistics were acceptable. However, at an individual item fit level results indicated unpredictable item responses for 28 items, and item redundancy for 10 items. The item-person dimensionality map confirmed these findings. Results from the overall Rasch model fit and Principal Component Analysis were suggestive of a second dimension. For all the items combined, none of the item categories were 'category', 'threshold' or 'step' disordered; however, all subscales demonstrated category disordered functioning. Findings suggest an urgent need to further investigate the underlying structure of the SWAL-QOL and its psychometric characteristics using IRT.

Cross-cultural adaptation and validation of Persian Achilles tendon Total Rupture Score.

PubMed

Ansari, Noureddin Nakhostin; Naghdi, Soofia; Hasanvand, Sahar; Fakhari, Zahra; Kordi, Ramin; Nilsson-Helander, Katarina

2016-04-01

To cross-culturally adapt the Achilles tendon Total Rupture Score (ATRS) to Persian language and to preliminary evaluate the reliability and validity of a Persian ATRS. A cross-sectional and prospective cohort study was conducted to translate and cross-culturally adapt the ATRS to Persian language (ATRS-Persian) following steps described in guidelines. Thirty patients with total Achilles tendon rupture and 30 healthy subjects participated in this study. Psychometric properties of floor/ceiling effects (responsiveness), internal consistency reliability, test-retest reliability, standard error of measurement (SEM), smallest detectable change (SDC), construct validity, and discriminant validity were tested. Factor analysis was performed to determine the ATRS-Persian structure. There were no floor or ceiling effects that indicate the content and responsiveness of ATRS-Persian. Internal consistency was high (Cronbach's α 0.95). Item-total correlations exceeded acceptable standard of 0.3 for the all items (0.58-0.95). The test-retest reliability was excellent [(ICC)agreement 0.98]. SEM and SDC were 3.57 and 9.9, respectively. Construct validity was supported by a significant correlation between the ATRS-Persian total score and the Persian Foot and Ankle Outcome Score (PFAOS) total score and PFAOS subscales (r = 0.55-0.83). The ATRS-Persian significantly discriminated between patients and healthy subjects. Explanatory factor analysis revealed 1 component. The ATRS was cross-culturally adapted to Persian and demonstrated to be a reliable and valid instrument to measure functional outcomes in Persian patients with Achilles tendon rupture. II.

Gait Deviation Index, Gait Profile Score and Gait Variable Score in children with spastic cerebral palsy: Intra-rater reliability and agreement across two repeated sessions.

PubMed

Rasmussen, Helle Mätzke; Nielsen, Dennis Brandborg; Pedersen, Niels Wisbech; Overgaard, Søren; Holsgaard-Larsen, Anders

2015-07-01

The Gait Deviation Index (GDI) and Gait Profile Score (GPS) are the most used summary measures of gait in children with cerebral palsy (CP). However, the reliability and agreement of these indices have not been investigated, limiting their clinimetric quality for research and clinical practice. The aim of this study was to investigate the intra-rater reliability and agreement of summary measures of gait (GDI; GPS; and the Gait Variable Score (GVS) derived from the GPS). The intra-rater reliability and agreement were investigated across two repeated sessions in 18 children aged 5-12 years diagnosed with spastic CP. No systematic bias was observed between the sessions and no heteroscedasticity was observed in Bland-Altman plots. For the GDI and GPS, excellent reliability with intraclass correlation coefficient (ICC) values of 0.8-0.9 was found, while the GVS was found to have fair to good reliability with ICCs of 0.4-0.7. The agreement for the GDI and the logarithmically transformed GPS, in terms of the standard error of measurement as a percentage of the grand mean (SEM%) varied from 4.1 to 6.7%, whilst the smallest detectable change in percent (SDC%) ranged from 11.3 to 18.5%. For the logarithmically transformed GVS, we found a fair to large variation in SEM% from 7 to 29% and in SDC% from 18 to 81%. The GDI and GPS demonstrated excellent reliability and acceptable agreement proving that they can both be used in research and clinical practice. However, the observed large variability for some of the GVS requires cautious consideration when selecting outcome measures. Copyright © 2015 Elsevier B.V. All rights reserved.

Translation, cross-cultural adaptation and psychometric properties of the Back Beliefs Questionnaire in Modern Standard Arabic.

PubMed

Maki, Dana; Rajab, Ebrahim; Watson, Paul J; Critchley, Duncan J

2017-02-01

Purpose To translate and cross-culturally adapt the Back Beliefs Questionnaire (BBQ) into modern standard Arabic and examine its validity, acceptability and reliability in Arabic-speaking patients with low back pain (LBP). Method The BBQ was forward, back-translated and reviewed by an expert committee. Seventeen bilingual patients completed Arabic and English BBQs. LBP patients (n = 199) completed the Arabic BBQ. Sixty-four repeated it a week later, and 151 completed the Arabic Fear-avoidance Beliefs Questionnaire (FABQ). Results The expert committee followed advice from the developers to maintain Arabic equivalence of "back trouble(s)". Patients found the questionnaire comprehensible and acceptable. Agreement between the English and Arabic versions of the BBQ was acceptable, ICC =  0.65 (0.25-0.86). Most item-by-item agreement ranged from fair to moderate (K = 0.12-0.54). Mean (SD) of BBQ, FABQ total, work and physical activity subscales were 25.31(6.13), 44.76(19.49), 21.17(10.10) and 13.95(6.65). The BBQ correlated with the FABQ at r = -0.33, work subscale r = -0.29 and physical activity r = -0.30 (all p < 0.01). Cronbach's α = 0.73 indicated high internal consistency. Test-retest reliability was high, ICC = 0.80 (0.68-0.87). Item-by-item agreement ranged from fair to acceptable (K = 0.31-0.66). Conclusions The Arabic BBQ has good comprehensibility and acceptability, acceptable agreement with the English BBQ, high internal consistency and test-retest reliability. We recommend its use with Arabic-speaking LBP patient to determine their beliefs and attitudes about their back pain, as they have been shown to be important predictors of persistent LBP disability. Implications for Rehabilitation There are limited valid and reliable outcome measures for back pain in Arabic. The Back Beliefs Questionnaire (BBQ) is a tool that measures attitudes and beliefs about back pain. We recommend the use of our valid and reliable, translated and cross-culturally adapted tool with Arabic-speaking patients. The tool can measure attitudes and beliefs concerning the future consequences of LBP, with regards to recovery and return to work in this sample. Findings will improve back pain management options aimed at reducing back pain disability though challenging and modifying beliefs in the Middle East or with migrant populations in the West.

76 FR 23171 - Electric Reliability Organization Interpretations of Interconnection Reliability Operations and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-04-26

... (MW and MVAR), or system configuration to maintain system stability, acceptable voltage or power flows... identified system conditions to prevent system instability or cascading outages, and protect other facilities... instability, cascading outages, and protect other facilities in response to contingencies. Therefore, a...

[Validity, reliability, and acceptability of the scale of knowledge, attitude, and behavior of lifestyle intervention in a diabetes high-risk population].

PubMed

Wang, W J; Dong, J; Ren, Z P; Chen, B; He, W; Li, W D; Hao, Z W

2016-07-06

To evaluate the validity, reliability, and acceptability of the scale of knowledge, attitude, and behavior of lifestyle intervention in a diabetes high-risk population (HILKAB), and provide scientific evidence for its usage. By convenient sampling, we selected 406 individuals at high risk for diabetes for survey using the HILKAB. Pearson correlation coefficient, factor analysis, independent sampling, and t-test for high- and low-score groups were used to evaluate the content validity, construct validity, and discriminant validity of the scale. Reliability of the scale was evaluated by internal consistency, which included Cronbach's α coefficient, θ coefficient, Ω coefficient, and split-half reliability. Scale acceptability was evaluated by acceptance rate and completion time of the survey. In this study, 366 questionnaires (90.1%) was qnalified and the completion time was (8.62±2.79) minutes. Scores for knowledge, attitude, and behavior were 10.60±3.73, 26.56±3.58, 17.09±9.74, respectively. The scale had good face validity and content validity. The correlation coefficient of items and the dimension to which they belong was between 0.25 and 0.97, and the correlation coefficient of three dimensions and the entire scale was between 0.64 and 0.91, all with P<0.001. Factor analysis of the scale extracted eight common factors. The cumulative variance contribution rate was 65.23%, thereby reaching the 50% approved standard. Of 30 items there were 29 items with factor loadings ≥0.40, indicating the scale had good construct validity. For the high-score group, scores for knowledge, attitude, and behavior dimensions were 13.89±2.55, 29.56± 2.46, 28.05 ± 2.93, respectively, which were higher than those for the low-score group (7.67 ± 2.78, 23.89 ± 3.35, 6.25 ± 3.13); t-values were 55.14, 119.40, 95.29, respectively, with P<0.001. The scale consisted of three dimensions: knowledge, attitude, and behavior. The Cronbach's α coefficient was between 0.84 and 0.92, the θ coefficient was between 0.85 and 0.96, the Ω coefficient was between 0.90 and 0.94, and the split-half reliability was between 0.77 and 0.95, reaching the 0.70 standard letter. The validity, reliability, and acceptability of the HILKAB scale were satisfactory for use in a population at high risk of diabetes.

Development and psychometric testing of the Dogs and WalkinG Survey (DAWGS).

PubMed

Richards, Elizabeth A; McDonough, Meghan H; Edwards, Nancy E; Lyle, Roseann M; Troped, Philip J

2013-12-01

Dog owners represent 40% of the population, a promising audience to increase population levels of physical activity. The purpose of this study was to develop and test the psychometric properties of a new instrument to assess social-cognitive theory constructs related to dog walking. Dog owners (N = 431) completed the Dogs and WalkinG Survey (DAWGS). Survey items assessed dog-walking behaviors and self-efficacy, social support, outcome expectations, and outcome expectancies for dog walking. Test-retest reliability was assessed among 252 (58%) survey respondents who completed the survey twice. Factorial validity and factorial invariance by age and walking level were tested using confirmatory factor analysis. DAWGS items demonstrated moderate test-retest reliability (p = .39-.79; k = .41-.89). Acceptable model fit was found for all subscales. All subscales were invariant by age and walking level, except self-efficacy, which showed mixed evidence of invariance. The DAWGS is a psychometrically sound instrument for examining individual and interpersonal correlates of dog walking.

Fiber Bragg grating sensors in harsh environments: considerations and industrial monitoring applications

NASA Astrophysics Data System (ADS)

Méndez, Alexis

2017-06-01

Over the last few years, fiber optic sensors (FOS) have seen an increased acceptance and widespread use in industrial sensing and in structural monitoring in civil, aerospace, marine, oil & gas, composites and other applications. One of the most prevalent types in use today are fiber Bragg grating (FBG) sensors. Historically, FOS have been an attractive solution because of their EM immunity and suitability for use in harsh environments and rugged applications with extreme temperatures, radiation exposure, EM fields, high voltages, water contact, flammable atmospheres, or other hazards. FBG sensors have demonstrated that can operate reliably in many different harsh environment applications but proper type and fabrication process are needed, along with suitable packaging and installation procedure. In this paper, we review the impact that external factors and environmental conditions play on FBG's performance and reliability, and describe the appropriate sensor types and protection requirements suitable for a variety of harsh environment applications in industrial furnaces, cryogenic coolers, nuclear plants, maritime vessels, oil & gas wells, aerospace crafts, automobiles, and others.

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka.

PubMed

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach's α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. © 2015 APJPH.

The Reliability and Validity of the Power-Load-Margin Inventory: A Rasch Analysis.

PubMed

Hardigan, Patrick C; Cohen, Stanley R; Hagen, Kathleen P

2015-01-01

Margin is a function of the relationship of stress to strength. The greater the margin, the more likely students are able to successfully navigate academic structures. This study examined the psychometric properties of a newly created instrument designed to measure margin - the Power-Load-Margin Inventory (PLMI). The PLMI was created using eight domains: (A) Student's aptitude and ability, (B) Course structure, (C) External motivation, (D) Student health, (E) Instructor style, (F) Internal motivation, (G) Life opportunities, and (H) University support structure. A three-point response scale was used to measure the domains: (1) stress, (2) neither stress nor strength, and (3) strength. The PLMI was administered to 586 medical, dental, and pharmacy students. A Rasch rating scale model was used to examine the psychometric properties of the PLMI. The PLMI demonstrated acceptable psychometric properties for use with pharmacy, dental, and medical students. The PLMI's primary weakness was with the subscales' reliability. We attribute this to the small number of items per subscale.

Assessing audiological, pathophysiological, and psychological variables in chronic tinnitus: a study of reliability and search for prognostic factors.

PubMed

Hiller, W; Goebel, G

1999-01-01

The development and course of chronic tinnitus are determined by both biological and psychological factors. To combine these different sources of data, we developed a standardized interview to assess tinnitus history, summarize audiological findings, screen for etiological conditions, and explore tinnitus-related psychological complaints (Structured Tinnitus Interview). The results of a test-retest study with 65 tinnitus inpatients show that most of these components can be assessed with acceptable or high reliability. Further data based on 166 patients demonstrate that tinnitus annoyance was to some extent different from patterns of general psychological complaints, although there were medium intercorrelations with depression. Significant predictors of tinnitus annoyance were (a) continuous tinnitus without intervals, (b) hearing loss, (c) increasing tinnitus loudness over time, (d) poor maskability, (e) history of sudden hearing loss, and (f) associated craniomandibular disorder. Psychological distress was not significantly increased in patients whose tinnitus was associated to vascular disorder, cervical spine dysfunction, acoustic trauma, Menihre's disease, or neurological disorder.

Validation of a short measure of effort-reward imbalance in the workplace: evidence from China.

PubMed

Li, Jian; Loerbroks, Adrian; Shang, Li; Wege, Natalia; Wahrendorf, Morten; Siegrist, Johannes

2012-01-01

Work stress is an emergent risk in occupational health in China, and its measurement is still a critical issue. The aim of this study was to examine the reliability and validity of a short version of the effort-reward imbalance (ERI) questionnaire in a sample of Chinese workers. A community-based survey was conducted in 1,916 subjects aged 30-65 years with paid employment (971 men and 945 women). Acceptable internal consistencies of the three scales, effort, reward and overcommitment, were obtained. Confirmatory factor analysis showed a good model fit of the data with the theoretical structure (goodness-of-fit index = 0.95). Evidence of criterion validity was demonstrated, as all three scales were independently associated with elevated odds ratios of both poor physical and mental health. Based on the findings of our study, this short version of the ERI questionnaire is considered to be a reliable and valid tool for measuring psychosocial work environment in Chinese working populations.

Validation of Bengali perceived stress scale among LGBT population.

PubMed

Mozumder, Muhammad Kamruzzaman

2017-08-29

Lesbian, gay, bisexual and transgender (LGBT) population encounter more stressful life circumstances compared to general population. Perceived Stress Scale (PSS) can be a useful tool for measuring their stress. However, psychometric properties of PSS have never been tested on LGBT population. This cross sectional study employed a two-stage sampling strategy to collect data from 296 LGBT participants from six divisional districts of Bangladesh. Exploratory (EFA) and confirmatory factor analysis (CFA) were carried out on PSS 10 along with analysis of reliability and validity. EFA revealed a two-factor structure of PSS for LGBT population explaining 43.55% - 51.45% of total variance. This measurement model was supported by multiple fit indices during CFA. Acceptable Cronbach's alpha indicated internal consistency reliability and high correlations with Self Reporting Questionnaire 20 demonstrated construct validity of PSS 10 for LGBT population. This study provided evidence of satisfactory psychometric properties of Bengali PSS 10 in terms of factor structure, internal consistency and validity among LGBT population.

Chinese version of the Perceived Stress Scale-10: A psychometric study in Chinese university students.

PubMed

Lu, Wei; Bian, Qian; Wang, Wenzheng; Wu, Xiaoling; Wang, Zhen; Zhao, Min

2017-01-01

Chinese university students often suffer from acute stress, which can affect their mental health. We measured and evaluated perceived stress in this population using the Simplified Chinese version of the 10-item Perceived Stress Scale (SCPSS-10). The SCPSS-10, Patient Health Questionnaire (PHQ), and Generalized Anxiety Disorder 7-item scale (GAD-7) were conducted in 1096 university students. Two weeks later, 129 participants were re-tested using the SCPSS-10. Exploratory factor analysis yielded two factors with Eigen values of 4.76 and 1.48, accounting for 62.41% of the variance. Confirmatory factor analysis demonstrated good fit of this two-factor model. The internal consistency reliability, as measured by Cronbach's α, was 0.85. The test-retest reliability coefficient was 0.7. The SCPSS-10 exhibited high correlation with the PHQ-9 and GAD-7, indicating an acceptable concurrent validity. The SCPSS-10 exhibited satisfactory psychometric properties in Chinese university students.

The 3600 hp split-torque helicopter transmission

NASA Technical Reports Server (NTRS)

White, G.

1985-01-01

Final design details of a helicopter transmission that is powered by GE twin T 700 engines each rated at 1800 hp are presented. It is demonstrated that in comparison with conventional helicopter transmission arrangements the split torque design offers: weight reduction of 15%; reduction in drive train losses of 9%; and improved reliability resulting from redundant drive paths between the two engines and the main shaft. The transmission fits within the NASA LeRC 3000 hp Test Stand and accepts the existing positions for engine inputs, main shaft, connecting drive shafts, and the cradle attachment points. One necessary change to the test stand involved gear trains of different ratio in the tail drive gearbox. Progressive uprating of engine input power from 3600 to 4500 hp twin engine rating is allowed for in the design. In this way the test transmission will provide a base for several years of analytical, research, and component development effort targeted at improving the performance and reliability of helicopter transmission.

The Parent-Version of the Spence Children's Anxiety Scale (SCAS-P) in Chinese and Italian Community Samples: Validation and Cross-Cultural Comparison.

PubMed

Li, Jian-Bin; Delvecchio, Elisa; Di Riso, Daniela; Nie, Yan-Gang; Lis, Adriana

2016-06-01

The current study aimed to validate the parent-version of the Spence Children's Anxiety Scale (SCAS-P) among Chinese and Italian community adolescents and to compare adolescents' anxiety symptoms in these two countries. Chinese (N = 456) and Italian (N = 452) adolescents and their parents participated in the study. Results showed that: (1) the six correlated-factor structure was demonstrated and invariant across countries. (2) The reliability of the total scale was good in both samples, whereas reliabilities of subscales were acceptable and moderate in Chinese and Italian samples, respectively. (3) The SCAS-P showed good convergent and divergent validity. (4) Adolescent-parent agreement was from low to medium while mother-father agreement ranged from medium to high. (5) There were cultural and gender differences in levels of parent-report anxiety symptoms. In conclusion, SCAS-P seems to be a promising parent-report instrument to assess Chinese and Italian adolescents' anxiety symptoms.

Development and Validation of a Measure of Quality of Life for the Young Elderly in Sri Lanka

PubMed Central

de Silva, Sudirikku Hennadige Padmal; Jayasuriya, Anura Rohan; Rajapaksa, Lalini Chandika; de Silva, Ambepitiyawaduge Pubudu; Barraclough, Simon

2016-01-01

Sri Lanka has one of the fastest aging populations in the world. Measurement of quality of life (QoL) in the elderly needs instruments developed that encompass the sociocultural settings. An instrument was developed to measure QoL in the young elderly in Sri Lanka (QLI-YES), using accepted methods to generate and reduce items. The measure was validated using a community sample. Construct, criterion and predictive validity and reliability were tested. A first-order model of 24 items with 6 domains was found to have good fit indices (CMIN/df = 1.567, RMR = 0.05, CFI = 0.95, and RMSEA = 0.053). Both criterion and predictive validity were demonstrated. Good internal consistency reliability (Cronbach’s α = 0.93) was shown. The development of the QLI-YES using a societal perspective relevant to the social and cultural beliefs has resulted in a robust and valid instrument to measure QoL for the young elderly in Sri Lanka. PMID:26712893

Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology.

PubMed

Beard, J D; Marriott, J; Purdie, H; Crossley, J

2011-01-01

To compare user satisfaction and acceptability, reliability and validity of three different methods of assessing the surgical skills of trainees by direct observation in the operating theatre across a range of different surgical specialties and index procedures. A 2-year prospective, observational study in the operating theatres of three teaching hospitals in Sheffield. The assessment methods were procedure-based assessment (PBA), Objective Structured Assessment of Technical Skills (OSATS) and Non-technical Skills for Surgeons (NOTSS). The specialties were obstetrics and gynaecology (O&G) and upper gastrointestinal, colorectal, cardiac, vascular and orthopaedic surgery. Two to four typical index procedures were selected from each specialty. Surgical trainees were directly observed performing typical index procedures and assessed using a combination of two of the three methods (OSATS or PBA and NOTSS for O&G, PBA and NOTSS for the other specialties) by the consultant clinical supervisor for the case and the anaesthetist and/or scrub nurse, as well as one or more independent assessors from the research team. Information on user satisfaction and acceptability of each assessment method from both assessor and trainee perspectives was obtained from structured questionnaires. The reliability of each method was measured using generalisability theory. Aspects of validity included the internal structure of each tool and correlation between tools, construct validity, predictive validity, interprocedural differences, the effect of assessor designation and the effect of assessment on performance. Of the 558 patients who were consented, a total of 437 (78%) cases were included in the study: 51 consultant clinical supervisors, 56 anaesthetists, 39 nurses, 2 surgical care practitioners and 4 independent assessors provided 1635 assessments on 85 trainees undertaking the 437 cases. A total of 749 PBAs, 695 NOTSS and 191 OSATSs were performed. Non-O&G clinical supervisors and trainees provided mixed, but predominantly positive, responses about a range of applications of PBA. Most felt that PBA was important in surgical education, and would use it again in the future and did not feel that it added time to the operating list. The overall satisfaction of O&G clinical supervisors and trainees with OSATS was not as high, and a majority of those who used both preferred PBA. A majority of anaesthetists and nurses felt that NOTSS allowed them to rate interpersonal skills (communication, teamwork and leadership) more easily than cognitive skills (situation awareness and decision-making), that it had formative value and that it was a valuable adjunct to the assessment of technical skills. PBA demonstrated high reliability (G > 0.8 for only three assessor judgements on the same index procedure). OSATS had lower reliability (G > 0.8 for five assessor judgements on the same index procedure). Both were less reliable on a mix of procedures because of strong procedure-specific factors. A direct comparison of PBA between O&G and non-O&G cases showed a striking difference in reliability. Within O&G, a good level of reliability (G > 0.8) could not be obtained using a feasible number of assessments. Conversely, the reliability within non-O&G cases was exceptionally high, with only two assessor judgements being required. The reasons for this difference probably include the more summative purpose of assessment in O&G and the much higher proportion of O&G trainees in this study with training concerns (42% vs 4%). The reliability of NOTSS was lower than that for PBA. Reliability for the same procedure (G > 0.8) required six assessor judgements. However, as procedure-specific factors exerted a lesser influence on NOTSS, reliability on a mix of procedures could be achieved using only eight assessor judgements. NOTSS also demonstrated a valid internal structure. The strongest correlations between NOTSS and PBA or OSATS were in the 'decision-making' domain. PBA and NOTSS showed better construct validity than OSATS, the year of training and the number of recent index procedures performed being significant independent predictors of performance. There was little variation in scoring between different procedures or different designations of assessor. The results suggest that PBA is a reliable and acceptable method of assessing surgical skills, with good construct validity. Specialties that use OSATS may wish to consider changing the design or switching to PBA. Whatever workplace-based assessment method is used, the purpose, timing and frequency of assessment require detailed guidance. NOTSS is a promising tool for the assessment of non-technical skills, and surgical specialties may wish to consider its inclusion in their assessment framework. Further research is required into the use of health-care professionals other than consultant surgeons to assess trainees, the relationship between performance and experience, the educational impact of assessment and the additional value of video recording.

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Simulation-Based Acceptance Testing for Unmanned Ground Vehicles

DTIC Science & Technology

2011-05-12

Ground Robotic Reliability Center (GRRC) at the University of Michigan in 2010, the focus of his research has been on unmanned ground vehicles...Jong Lee is a former student of the University of Michigan’s Ground Robotics Reliability Center (GRRC). He received his Bachelor’s and Master’s degree...methods to improve reliability of Unmanned Ground Vehicle (UGV) systems. His primary research interests include robotic systems and control

Ambiguities and conflicting results: the limitations of the kappa statistic in establishing the interrater reliability of the Irish nursing minimum data set for mental health: a discussion paper.

PubMed

Morris, Roisin; MacNeela, Padraig; Scott, Anne; Treacy, Pearl; Hyde, Abbey; O'Brien, Julian; Lehwaldt, Daniella; Byrne, Anne; Drennan, Jonathan

2008-04-01

In a study to establish the interrater reliability of the Irish Nursing Minimum Data Set (I-NMDS) for mental health difficulties relating to the choice of reliability test statistic were encountered. The objective of this paper is to highlight the difficulties associated with testing interrater reliability for an ordinal scale using a relatively homogenous sample and the recommended kw statistic. One pair of mental health nurses completed the I-NMDS for mental health for a total of 30 clients attending a mental health day centre over a two-week period. Data was analysed using the kw and percentage agreement statistics. A total of 34 of the 38 I-NMDS for mental health variables with lower than acceptable levels of kw reliability scores achieved acceptable levels of reliability according to their percentage agreement scores. The study findings implied that, due to the homogeneity of the sample, low variability within the data resulted in the 'base rate problem' associated with the use of kw statistic. Conclusions point to the interpretation of kw in tandem with percentage agreement scores. Suggestions that kw scores were low due to chance agreement and that one should strive to use a study sample with known variability are queried.

Interrater reliability: the kappa statistic.

PubMed

McHugh, Mary L

2012-01-01

The kappa statistic is frequently used to test interrater reliability. The importance of rater reliability lies in the fact that it represents the extent to which the data collected in the study are correct representations of the variables measured. Measurement of the extent to which data collectors (raters) assign the same score to the same variable is called interrater reliability. While there have been a variety of methods to measure interrater reliability, traditionally it was measured as percent agreement, calculated as the number of agreement scores divided by the total number of scores. In 1960, Jacob Cohen critiqued use of percent agreement due to its inability to account for chance agreement. He introduced the Cohen's kappa, developed to account for the possibility that raters actually guess on at least some variables due to uncertainty. Like most correlation statistics, the kappa can range from -1 to +1. While the kappa is one of the most commonly used statistics to test interrater reliability, it has limitations. Judgments about what level of kappa should be acceptable for health research are questioned. Cohen's suggested interpretation may be too lenient for health related studies because it implies that a score as low as 0.41 might be acceptable. Kappa and percent agreement are compared, and levels for both kappa and percent agreement that should be demanded in healthcare studies are suggested.

Motivation to Change as a Predictor of Treatment Outcome for Adolescent Substance Abusers.

ERIC Educational Resources Information Center

Cady, Mary E.; And Others

1996-01-01

The Problem Recognition Questionnaire (PRQ), administered to 234 adolescents undergoing chemical dependency treatment, was examined with respect to its reliability, factor structure, and predictive validity. Results indicate that the PRQ (a measure of adolescent motivation to change substance-use behaviors) has acceptable reliability and potential…

Validity and Reliability of a Scale Assessing Attitudes toward Mainstreaming.

ERIC Educational Resources Information Center

Green, Kathy; And Others

1983-01-01

In a study involving 50 undergraduate and graduate education students the Attitudes Toward Mainstreaming Scale was found to have a large first factor with adequate reliability. There was a low correlation between knowledge and ATMS scores, although knowledge was more strongly related to classroom acceptance of exceptional students. (CL)

A feasibility study of a new computerised cognitive remediation for young adults with schizophrenia

PubMed Central

Cellard, Caroline; Reeder, Clare; Paradis-Giroux, Andrée-Anne; Roy, Marc-André; Gilbert, Elsa; Ivers, Hans; Bouchard, Roch-Hugo; Maziade, Michel; Wykes, Til

2016-01-01

Cognitive remediation therapy is effective for improving cognition, symptoms and social functioning in individuals with schizophrenia; however, the impact on visual episodic memory remains unclear. The objectives of this feasibility study were: (1) to explore whether or not CIRCuiTS—a new computerised cognitive remediation therapy programme developed in England—improves visual episodic memory and other cognitive domains in young adults with early course schizophrenia; and (2) to evaluate acceptability of the CIRCuiTS programme in French-Canadians. Three participants with visual episodic memory impairments at baseline were recruited from clinical settings in Canada, and consented to participate. Neuropsychological, clinical and social functioning was evaluated at baseline and post-treatment. Intervention involved 40 sessions of cognitive remediation. First, the reliable change index (RCI) revealed that each participant demonstrated significant post-therapy change in episodic memory and in other cognitive domains. The response profile was characterised by the use of organisational strategies. Second, the treatment was considered acceptable to participants in terms of session frequency (number of sessions per week), intensity (hours per week; total hours), and number of missed sessions and total completed sessions. This preliminary study yielded encouraging data demonstrating the feasibility of the CIRCuiTS programme in French-Canadian young adults with schizophrenia. PMID:25753694

Investigation of risk factors of psychological acceptance and burnout syndrome among nurses in China.

PubMed

Yao, Yongcheng; Yao, Wu; Wang, Wei; Li, Hong; Lan, Yajia

2013-10-01

The objectives of this study were to determine reliability of Chinese version of Acceptance and Action Questionnaire-II (AAQ-II), the relationship between psychological acceptance (PA), and burnout syndrome and their risk factors among nurses in China. The reliability of AAQ-II in Chinese was evaluated first by testing on 111 doctors and 108 nurses in China. On the number of 845 nurses selected from nine city hospitals by using stratified cluster sampling method, the Maslach Burnout Inventory-General Survey was administered to establish the presence of burnout, and the AAQ-II was used to measure their PA. Results showed that the AAQ-II in Chinese had a good test-retest reliability. PA was statistically significantly negatively correlated to the three dimensionalities of burnout among nurses in China. Male and female nurses had a significant difference in PA. Risk factors for burnout were age (25-44 years), marital status (married), gender (male), hospital department (emergency) and position (primary title) as well as PA. The findings provide insights into the risk factors of burnout in Chinese nurses and may have clinical implications in preventing burnout in Chinese nurses. © 2013 Wiley Publishing Asia Pty Ltd.

Cross-cultural adaption and validation of the Persian version of the SWAL-QOL.

PubMed

Tarameshlu, Maryam; Azimi, Amir Reza; Jalaie, Shohreh; Ghelichi, Leila; Ansari, Noureddin Nakhostin

2017-06-01

The aim of this study was to translate and cross-culturally adapt the swallowing quality-of-life questionnaire (SWAL-QOL) to Persian language and to determine validity and reliability of the Persian version of the swallow quality-of-life questionnaire (PSWAL-QOL) in the patients with oropharyngeal dysphagia.The cross-sectional survey was designed to translate and cross-culturally adapt SWAL-QOL to Persian language following steps recommended in guideline. A total of 142 patients with dysphagia (mean age = 56.7 ± 12.22 years) were selected by non-probability consecutive sampling method to evaluate construct validity and internal consistency. Thirty patients with dysphagia were completed the PSWAL-QOL 2 weeks later for test-retest reliability.The PSWAL-QOL was favorably accepted with no missing items. The floor effect was ranged 0% to 21% and ceiling effect was ranged 0% to 16%. The construct validity was established via exploratory factor analysis. Internal consistency was confirmed with Cronbach α >0.7 for all scales except eating duration (α = 0.68). The test-retest reliability was excellent with intraclass correlation coefficient (ICC) ≥0.75 for all scales.The SWAL-QOL was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-report questionnaire to measure the impact of dysphagia on the quality-of-life in the Persian patients with oropharyngeal dysphagia.

Evaluation of the Swedish version of the Child Drawing: Hospital Manual.

PubMed

Wennström, Berith; Nasic, Salmir; Hedelin, Hans; Bergh, Ingrid

2011-05-01

This paper is a report of psychometric testing of the Swedish version of the Child Drawing: Hospital Manual. Drawings have shown to be useful in assessing emotional status and anxiety in children because they generally speak to us more clearly and openly through their drawings than they are willing or able to verbally. The Child Drawing: Hospital Manual was translated into Swedish according to World Health Organization guidelines (a routine procedure for translation of English instruments) in order to assess anxiety by analysing the drawings of 59 children (5-11 years), of whom nine were girls and 50 boys undergoing day surgery during 2007-2009. Inter-rater reliability (five independent scorers) was high and internal consistency reliability was good (coefficient alpha =0·77). Parts A and C, as well as the total scale score of the Child Drawing: Hospital Manual, discriminated anxiety significantly between the group of children undergoing day surgery and a comparison group of school children, indicating adequate construct validity. For the Swedish version of the Child Drawing: Hospital Manual, our study demonstrates evidence for adequate construct validity in Parts A and C (and total scale score), high inter-rater reliability and acceptable internal consistency reliability. However, some improvements are needed before the instrument will be a clinically useful assessment of anxiety in children undergoing day surgery. © 2011 Blackwell Publishing Ltd.

Cross-cultural adaption and validation of the Persian version of the SWAL-QOL

PubMed Central

Tarameshlu, Maryam; Azimi, Amir Reza; Jalaie, Shohreh; Ghelichi, Leila; Ansari, Noureddin Nakhostin

2017-01-01

Abstract The aim of this study was to translate and cross-culturally adapt the swallowing quality-of-life questionnaire (SWAL-QOL) to Persian language and to determine validity and reliability of the Persian version of the swallow quality-of-life questionnaire (PSWAL-QOL) in the patients with oropharyngeal dysphagia. The cross-sectional survey was designed to translate and cross-culturally adapt SWAL-QOL to Persian language following steps recommended in guideline. A total of 142 patients with dysphagia (mean age = 56.7 ± 12.22 years) were selected by non-probability consecutive sampling method to evaluate construct validity and internal consistency. Thirty patients with dysphagia were completed the PSWAL-QOL 2 weeks later for test–retest reliability. The PSWAL-QOL was favorably accepted with no missing items. The floor effect was ranged 0% to 21% and ceiling effect was ranged 0% to 16%. The construct validity was established via exploratory factor analysis. Internal consistency was confirmed with Cronbach α >0.7 for all scales except eating duration (α = 0.68). The test–retest reliability was excellent with intraclass correlation coefficient (ICC) ≥0.75 for all scales. The SWAL-QOL was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-report questionnaire to measure the impact of dysphagia on the quality-of-life in the Persian patients with oropharyngeal dysphagia. PMID:28658118

Intrarater and interrater reliability and validity in the assessment of the mechanism of injury and integrity of the posterior ligamentous complex: a novel injury severity scoring system for thoracolumbar injuries. Invited submission from the Joint Section Meeting On Disorders of the Spine and Peripheral Nerves, March 2005.

PubMed

Harrop, James S; Vaccaro, Alexander R; Hurlbert, R John; Wilsey, Jared T; Baron, Eli M; Shaffrey, Christopher I; Fisher, Charles G; Dvorak, Marcel F; Oner, F C; Wood, Kirkham B; Anand, Neel; Anderson, D Greg; Lim, Moe R; Lee, Joon Y; Bono, Christopher M; Arnold, Paul M; Rampersaud, Y Raja; Fehlings, Michael G

2006-02-01

A new classification and treatment algorithm for thoracolumbar injuries was recently introduced by Vaccaro and colleagues in 2005. A thoracolumbar injury severity scale (TLISS) was proposed for grading and guiding treatment for these injuries. The scale is based on the following: 1) the mechanism of injury; 2) the integrity of the posterior ligamentous complex (PLC); and 3) the patient's neurological status. The reliability and validity of assessing injury mechanism and the integrity of the PLC was assessed. Forty-eight spine surgeons, consisting of neurosurgeons and orthopedic surgeons, reviewed 56 clinical thoracolumbar injury case histories. Each was classified and scored to determine treatment recommendations according to a novel classification system. After 3 months the case histories were reordered and the physicians repeated the exercise. Validity of this classification was good among reviewers; the vast majority (> 90%) agreed with the system's treatment recommendations. Surgeons were unclear as to a cogent description of PLC disruption and fracture mechanism. The TLISS demonstrated acceptable reliability in terms of intra- and interobserver agreement on the algorithm's treatment recommendations. Replacing injury mechanism with a description of injury morphology and better definition of PLC injury will improve inter- and intraobserver reliability of this injury classification system.

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

PubMed

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

[Desing and validation of a scale to measure caregiving dedication in caregivers of dependent older people].

PubMed

Serrano-Ortega, Natalia; Frías-Osuna, Antonio; Recio-Gómez, Juan M; Del-Pino-Casado, Rafael

2015-11-01

To develop and validate a scale to measure caregiving dedication regarding activities of daily living in caregivers of dependent older people. Cross-sectional study. Primary Health Care (Andalusia, Spain). a probabilistic sample of 200 caregivers of older relatives from Córdoba, Spain. Content validation by experts, construct validity (by exploratory factor analysis), divergent validity and reliability (internal consistency, test-retest reliability and inter-observers reliability). Cronbach's alpha was 0.86. Intraclass Correlation Coefficient was 0.96 for test-retest reliability and 0.88 for inter-observers reliability. When the sample was divided in two groups according to perceived burden level (presence and absence), the perceived burden was significantly different in each group (P=.001). The factor analysis revealed one only factor that explained 64% of the variance. The scale allows a suitable measure of caregiving dedication regarding activities of daily living in caregivers of older people, because this scale allows a quickly, easy administration, is well accepted by caregivers, has acceptable psychometric results and includes the frequency of caregiving, the kind of attended need and the dependence level in each need. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Validity and reliability of the Turkish Migraine Disability Assessment (MIDAS) questionnaire.

PubMed

Ertaş, Mustafa; Siva, Aksel; Dalkara, Turgay; Uzuner, Nevzat; Dora, Babür; Inan, Levent; Idiman, Fethi; Sarica, Yakup; Selçuki, Deniz; Sirin, Hadiye; Oğuzhanoğlu, Atilla; Irkeç, Ceyla; Ozmenoğlu, Mehmet; Ozbenli, Taner; Oztürk, Musa; Saip, Sabahattin; Neyal, Münife; Zarifoğlu, Mehmet

2004-09-01

The aim of this study is to assess the comprehensibility, internal consistency, patient-physician reliability, test-retest reliability, and validity of Turkish version of Migraine Disability Assessment (MIDAS) questionnaire in patients with headache. MIDAS questionnaire has been developed by Stewart et al and shown to be reliable and valid to determine the degree of disability caused by migraine. This study was designed as a national multicenter study to demonstrate the reliability and validity of Turkish version of MIDAS questionnaire. Patients applying to 17 Neurology Clinics in Turkey were evaluated at the baseline (visit 1), week 4 (visit 2), and week 12 (visit 3) visits in terms of disease severity and comprehensibility, internal consistency, test-retest reliability, and validity of MIDAS. Since the severity of the disease has been found to change significantly at visit 2 compared to visit 1, test-retest reliability was assessed using the MIDAS scores of a subgroup of patients whose disease severity remained unchanged (up to +/-3 days difference in the number of days with headache between visits 1 and 2). A total of 306 patients (86.2% female, mean age: 35.0 +/- 9.8 years) were enrolled into the study. A total of 65.7%, 77.5%, 82.0% of patients reported that "they had fully understood the MIDAS questionnaire" in visits 1, 2, and 3, respectively. A highly positive correlation was found between physician and patient and the applied total MIDAS scores in all three visits (Spearman correlation coefficients were R= 0.87, 0.83, and 0.90, respectively, P <.001). Internal consistency of MIDAS was assessed using Cronbach's alpha and was found at acceptable (>0.7) or excellent (>0.8) levels in both patient and physician applied MIDAS scores, respectively. Total MIDAS score showed good test-retest reliability (R= 0.68). Both the number of days with headache and the total MIDAS scores were positively correlated at all visits with correlation coefficients between 0.47 and 0.63. There was also a moderate degree of correlation (R= 0.54) between the total MIDAS score at week 12 and the number of days with headache at visit 2 + visit 3, which quantify headache-related disability over a 3-month period similar to MIDAS questionnaire. These findings demonstrated that the Turkish translation is equivalent to the English version of MIDAS in terms of internal consistency, test-retest reliability, and validity. Physicians can reliably use the Turkish translation of the MIDAS questionnaire in defining the severity of illness and its treatment strategy when applied as a self-administered report by migraine patients themselves.

Advances in Sprint Acceleration Profiling for Field-Based Team-Sport Athletes: Utility, Reliability, Validity and Limitations.

PubMed

Simperingham, Kim D; Cronin, John B; Ross, Angus

2016-11-01

Advanced testing technologies enable insight into the kinematic and kinetic determinants of sprint acceleration performance, which is particularly important for field-based team-sport athletes. Establishing the reliability and validity of the data, particularly from the acceleration phase, is important for determining the utility of the respective technologies. The aim of this systematic review was to explain the utility, reliability, validity and limitations of (1) radar and laser technology, and (2) non-motorised treadmill (NMT) and torque treadmill (TT) technology for providing kinematic and kinetic measures of sprint acceleration performance. A comprehensive search of the CINAHL Plus, MEDLINE (EBSCO), PubMed, SPORTDiscus, and Web of Science databases was conducted using search terms that included radar, laser, non-motorised treadmill, torque treadmill, sprint, acceleration, kinetic, kinematic, force, and power. Studies examining the kinematics or kinetics of short (≤10 s), maximal-effort sprint acceleration in adults or children, which included an assessment of reliability or validity of the advanced technologies of interest, were included in this systematic review. Absolute reliability, relative reliability and validity data were extracted from the selected articles and tabulated. The level of acceptance of reliability was a coefficient of variation (CV) ≤10 % and an intraclass correlation coefficient (ICC) or correlation coefficient (r) ≥0.70. A total of 34 studies met the inclusion criteria and were included in the qualitative analysis. Generally acceptable validity (r = 0.87-0.99; absolute bias 3-7 %), intraday reliability (CV ≤9.5 %; ICC/r ≥0.84) and interday reliability (ICC ≥0.72) were reported for data from radar and laser. However, low intraday reliability was reported for the theoretical maximum horizontal force (ICC 0.64) within adolescent athletes, and low validity was reported for velocity during the initial 5 m of a sprint acceleration (bias up to 0.41 m/s) measured with a laser device. Acceptable reliability of results from NMT and TT was only ensured when testing protocols involved sufficient familiarisation, a high sampling rate (≥200 Hz), a 'blocked' start position, and the analysis of discrete steps rather than arbitrary time periods. Sprinting times and speeds were 20-28 % slower on a TT, 28-67 % slower on an NMT, and only 9-64 % of the variance in overground measurements of speed and time (≤30 m) was explained by results from an NMT. There have been no reports to date of criterion validity of kinetic measures of sprint acceleration performance on NMT andTT, and only limited results regarding acceptable concurrent validity of radar-derived kinetic data. Radar, laser, NMT and TT technologies can be used to reliably measure sprint acceleration performance and to provide insight into the determinants of sprinting speed. However, further research is required to establish the validity of the kinetic measurements made with NMT and TT. Radar and laser technology may not be suitable for measuring the first few steps of a sprint acceleration.

Automatically generated acceptance test: A software reliability experiment

NASA Technical Reports Server (NTRS)

Protzel, Peter W.

1988-01-01

This study presents results of a software reliability experiment investigating the feasibility of a new error detection method. The method can be used as an acceptance test and is solely based on empirical data about the behavior of internal states of a program. The experimental design uses the existing environment of a multi-version experiment previously conducted at the NASA Langley Research Center, in which the launch interceptor problem is used as a model. This allows the controlled experimental investigation of versions with well-known single and multiple faults, and the availability of an oracle permits the determination of the error detection performance of the test. Fault interaction phenomena are observed that have an amplifying effect on the number of error occurrences. Preliminary results indicate that all faults examined so far are detected by the acceptance test. This shows promise for further investigations, and for the employment of this test method on other applications.

Validation of Acceptance of Coercive Sexual Behavior (ACSB). A Multimedia Measure of Adolescent Dating Attitudes

ERIC Educational Resources Information Center

Teten, Andra L.; Hall, Gordon C. Nagayama; Pacifici, Caesar

2005-01-01

The psychometric properties of the Acceptance of Coercive Sexual Behavior (ACSB), a multimedia measure of adolescent dating attitudes, were examined. The ACSB is an interactive instrument that uses video vignettes to depict adolescent dating situations. Analyses of the measure's factor structure, internal consistency, test-retest reliability, and…

Popular or Unpopular? Therapists' Use of Structured Interviews and Their Estimation of Patient Acceptance

ERIC Educational Resources Information Center

Bruchmuller, Katrin; Margraf, Jurgen; Suppiger, Andrea; Schneider, Silvia

2011-01-01

An accurate diagnosis is an important precondition for effective psychotherapeutic treatment. The use of structured interviews provides the gold standard for reliable diagnosis. Suppiger et al. (2009) showed that structured interviews have a high acceptance among patients. On a scale from 0 ("not at all satisfied") to 100 ("totally…

40 CFR 227.27 - Limiting permissible con-cen-tra-tion (LPC).

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 26 2012-07-01 2011-07-01 true Limiting permissible con-cen-tra-tion... scientific literature or accepted by EPA as being reliable test organisms to determine the anticipated impact... for each type they represent, and that are documented in the scientific literature and accepted by EPA...

Pitfalls and Precautions When Using Predicted Failure Data for Quantitative Analysis of Safety Risk for Human Rated Launch Vehicles

NASA Technical Reports Server (NTRS)

Hatfield, Glen S.; Hark, Frank; Stott, James

2016-01-01

Launch vehicle reliability analysis is largely dependent upon using predicted failure rates from data sources such as MIL-HDBK-217F. Reliability prediction methodologies based on component data do not take into account system integration risks such as those attributable to manufacturing and assembly. These sources often dominate component level risk. While consequence of failure is often understood, using predicted values in a risk model to estimate the probability of occurrence may underestimate the actual risk. Managers and decision makers use the probability of occurrence to influence the determination whether to accept the risk or require a design modification. The actual risk threshold for acceptance may not be fully understood due to the absence of system level test data or operational data. This paper will establish a method and approach to identify the pitfalls and precautions of accepting risk based solely upon predicted failure data. This approach will provide a set of guidelines that may be useful to arrive at a more realistic quantification of risk prior to acceptance by a program.

Premonitory urges for tics in adult patients with Tourette syndrome.

PubMed

Crossley, Eleanor; Seri, Stefano; Stern, Jeremy S; Robertson, Mary M; Cavanna, Andrea E

2014-01-01

Patients with Tourette syndrome (TS) often report characteristic sensory experiences, also called premonitory urges (PUs), which precede tic expression and have high diagnostic relevance. This study investigated the usefulness of a scale developed and validated in children and adolescents-the Premonitory Urge for Tics Scale (PUTS, Woods et al., 2005 [13])-for the assessment of PUs in adult patients with TS. Standard statistical methods were applied to test the psychometric properties of the PUTS in 102 adult TS outpatients recruited from two specialist clinics in the United Kingdom. The PUTS showed good acceptability and endorsement rates, with evenly distributed scores and low floor and ceiling effects. Item-total correlations were moderate to strong; PUTS total scores were significantly correlated with quantitative measures of TS severity. The PUTS showed excellent internal consistency reliability (Cronbach's alpha=0.85) and Spearman's correlations demonstrated satisfactory convergent and discriminant validity. Although originally devised to assess urges to tic in young patients with TS, the PUTS demonstrated good psychometric properties in a large sample of adults recruited at specialist TS clinics. This instrument is therefore recommended for use across the life span as a valid and reliable self-report measure of sensory experiences accompanying tic expression. Copyright © 2013 The Japanese Society of Child Neurology. Published by Elsevier B.V. All rights reserved.

MEMS for pico- to micro-satellites

NASA Astrophysics Data System (ADS)

Shea, H. R.

2009-02-01

MEMS sensors, actuators, and sub-systems can enable an important reduction in the size and mass of spacecrafts, first by replacing larger and heavier components, then by replacing entire subsystems, and finally by enabling the microfabrication of highly integrated picosats. Very small satellites (1 to 100 kg) stand to benefit the most from MEMS technologies. These small satellites are typically used for science or technology demonstration missions, with higher risk tolerance than multi-ton telecommunication satellites. While MEMS are playing a growing role on Earth in safety-critical applications, in the harsh and remote environment of space, reliability is still the crucial issue, and the absence of an accepted qualification methodology is holding back MEMS from wider use. An overview is given of the range of MEMS applications in space. An effective way to prove that MEMS can operate reliably in space is to use them in space: we illustrate how Cubesats (1 kg, 1 liter, cubic satellites in a standardized format to reduce launch costs) can serve as low-cost vectors for MEMS technology demonstration in space. The Cubesat SwissCube developed in Switzerland is used as one example of a rapid way to fly new microtechnologies, and also as an example of a spacecraft whose performance is only possible thanks to MEMS.

Nickel hydrogen low Earth orbit life testing

NASA Technical Reports Server (NTRS)

Badcock, C. C.; Haag, R. L.

1986-01-01

A program to demonstrate the long term reliability of NiH2 cells in low Earth orbits (LEO) and support use in mid-altitude orbits (MAO) was initiated. Both 3.5 and 4.5 inch diameter nickel hydrogen cells are included in the test plan. Cells from all U.S. vendors are to be tested. The tests will be performed at -5 and 10 C at 40 and 60% DOD for LEO orbit and 10 C and 80% DOD for MAO orbit simulations. The goals of the testing are 20,000 cycles at 60% DOD and 30,000 cycles at 40% DOD. Cells are presently undergoing acceptance and characterization testing at Naval Weapons Systems Center, Crane.

A view from the AIAA: Introduction of new energy storage technology into orbital programs

NASA Technical Reports Server (NTRS)

Badcock, Charles

1987-01-01

The development of new energy storage technology must be heavily weighted toward the application. The requirements for transitioning low risk technology into operational space vehicles must remain the central theme even at the preliminary development stages by the development of efforts to define operational issues and verify the reliability of the system. Failure to follow a complete plan that results in a flight qualified unit may lead to an orphan technology. Development efforts must be directed toward a stable development where changes in design are evolutionary and end items are equivalent to flight units so that life and qualification testing can be used as a vehicle to demonstrate the acceptability of the technology.

Child safety driver assistant system and its acceptance.

PubMed

Quendler, Elisabeth; Diskus, Christian; Pohl, Alfred; Buchegger, Thomas; Beranek, Ernst; Boxberger, Josef

2009-01-01

Farming machinery incidents frequently cause the injury and death of children on farms worldwide. The two main causes of this problem are the driver's view being restricted by construction and/or environmental factors and insufficient risk awareness by children and parents. It is difficult to separate working and living areas on family farms, and the adult supervision necessary to avoid work accidents is often lacking. For this reason, additional preventive measures are required to reduce the number of crushings. Electronic tools that deliver information about the presence of children in the blind spots surrounding vehicles and their attached machines can be very effective. Such an electronic device must cover all security gaps around operating agricultural vehicles and their attached machines, ensure collision-free stopping in risk situations, and be inexpensive. Wireless sensor network and electrical near-field electronic components are suited to the development of low-cost wireless detection devices. For reliable detection in a versatile environment, it is necessary for children to continuously wear a slumbering transponder. This means that children and adults must have a high acceptance of the device, which can be improved by easy usability, design, and service quality. The developed demonstrator achieved detection distances of up to 40 m in the far field and 2.5 m in the near field. Recognized far-field sensor detection weaknesses, determined by user-friendliness tests, are false alarms in farmyards and around buildings. The detection distance and reliability of the near-field sensor varied with the design of the attached machines' metallic components.

Regional South Australia Health (RESONATE) survey: study protocol

PubMed Central

Jones, Martin; Gillam, Marianne; May, Esther

2018-01-01

Introduction Access to quality healthcare services is considered a moral right. However, for people living in regional locations, timely access to the services that they need may not always be possible because of structural and attitudinal barriers. This suggests that people living in regional areas may have unmet healthcare needs. The aim of this research will be to examine the healthcare needs, expectations and experiences of regional South Australians. Methods and analysis The Regional South Australia Health (RESONATE) survey is a cross-sectional study of adult health consumers living in any private or non-private dwelling, in any regional, rural, remote or very remote area of South Australia and with an understanding of written English. Data will be collected using a 45-item, multidimensional, self-administered instrument, designed to measure healthcare need, barriers to healthcare access and health service utilisation, attitudes, experiences and satisfaction. The instrument has demonstrated acceptable psychometric properties, including good content validity and internal reliability, good test–retest reliability and a high level of acceptability. The survey will be administered online and in hard-copy, with at least 1832 survey participants to be recruited over a 12-month period, using a comprehensive, multimodal recruitment campaign. Ethics and dissemination The study has been reviewed and approved by the Human Research Ethics Committee of the University of South Australia. The results will be actively disseminated through peer-reviewed journals, conference presentations, social media, broadcast media, print media, the internet and various community/stakeholder engagement activities. PMID:29654014

Design and test of the 172K fluidic rudder

NASA Technical Reports Server (NTRS)

Belsterling, C. A.

1978-01-01

Progress in the development of concepts for control of aircraft without moving parts or a separate source of power is described. The design and wind tunnel tests of a full scale fluidic rudder for a Cessna 172K aircraft, intended for subsequent flight tests were documented. The 172K fluidic rudder was designed to provide a control force equivalent to 3.3 degrees of deflection of the conventional rudder. In spite of an extremely thin airfoil, cascaded fluidic amplifiers were built to fit, with the capacity for generating the required level of control force. Wind tunnel tests demonstrated that the principles of lift control using ram air power are sound and reliable under all flight conditions. The tests also demonstrated that the performance of the 172K fluidic rudder is not acceptable for flight tests until the design of the scoop is modified to prevent interference with the lift control phenomenon.

Laser restorative dentistry in children and adolescents.

PubMed

Olivi, G; Genovese, M D

2011-04-01

The idea of substituting a drill with a laser light, has led to its introduction in dentistry. Besides being more accepted to patients, in paediatric dentistry the laser has demonstrated safety compared with rotating instruments. A review of the past 20 years of the dental literature concerning laser use in dentistry, including paediatric dentistry was completed. The findings of that review are presented. The various types of lasers and their uses for caries detection, tooth sealing and caries removal are described. Laser caries detection demonstrated a good reproducibility, reliability and predictability to monitor the caries process over time. Erbium lasers have been found to be efficient for caries removal, tooth cleaning and decontamination. The laser erbium technology represents a safe device to effectively and selectively remove carious tissues from decayed teeth. For children, all the recognized advantages of this technique play a decisive role in the successful day-to-day treatment of dental caries.

Standardized mappings--a framework to combine different semantic mappers into a standardized web-API.

PubMed

Neuhaus, Philipp; Doods, Justin; Dugas, Martin

2015-01-01

Automatic coding of medical terms is an important, but highly complicated and laborious task. To compare and evaluate different strategies a framework with a standardized web-interface was created. Two UMLS mapping strategies are compared to demonstrate the interface. The framework is a Java Spring application running on a Tomcat application server. It accepts different parameters and returns results in JSON format. To demonstrate the framework, a list of medical data items was mapped by two different methods: similarity search in a large table of terminology codes versus search in a manually curated repository. These mappings were reviewed by a specialist. The evaluation shows that the framework is flexible (due to standardized interfaces like HTTP and JSON), performant and reliable. Accuracy of automatically assigned codes is limited (up to 40%). Combining different semantic mappers into a standardized Web-API is feasible. This framework can be easily enhanced due to its modular design.

Inter-Observer, Intra-Observer and Intra-Individual Reliability of Uroflowmetry Tests in Aged Men: A Generalizability Theory Approach.

PubMed

Liu, Ying-Buh; Yang, Stephen S; Hsieh, Cheng-Hsing; Lin, Chia-Da; Chang, Shang-Jen

2014-05-01

To evaluate the inter-observer, intra-observer and intra-individual reliability of uroflowmetry and post-void residual urine (PVR) tests in adult men. Healthy volunteers aged over 40 years were enrolled. Every participant underwent two sets of uroflowmetry and PVR tests with a 2-week interval between the tests. The uroflowmetry tests were interpreted by four urologists independently. Uroflowmetry curves were classified as bell-shaped, bell-shaped with tail, obstructive, restrictive, staccato, interrupted and tower-shaped and scored from 1 (highly abnormal) to 5 (absolutely normal). The agreements between the observers, interpretations and tests within individuals were analyzed using kappa statistics and intraclass correlation coefficients. Generalizability theory with decision analysis was used to determine how many observers, tests, and interpretations were needed to obtain an acceptable reliability (> 0.80). Of 108 volunteers, we randomly selected the uroflowmetry results from 25 participants for the evaluation of reliability. The mean age of the studied adults was 55.3 years. The intra-individual and intra-observer reliability on uroflowmetry tests ranged from good to very good. However, the inter-observer reliability on normalcy and specific type of flow pattern were relatively lower. In generalizability theory, three observers were needed to obtain an acceptable reliability on normalcy of uroflow pattern if the patient underwent uroflowmetry tests twice with one observation. The intra-individual and intra-observer reliability on uroflowmetry tests were good while the inter-observer reliability was relatively lower. To improve inter-observer reliability, the definition of uroflowmetry should be clarified by the International Continence Society. © 2013 Wiley Publishing Asia Pty Ltd.

Prospective patients rate practice factors: development of a questionnaire.

PubMed

St Louis, Brian Lingg; Firestone, Allen R; Johnston, William; Shanker, Shiva; Vig, Katherine W L

2011-02-01

The importance that prospective patients place on practice characteristics when choosing an orthodontic practice has not been extensively reported. The objective of this research was to develop a valid and reliable questionnaire to address the relative importance of orthodontic office and doctor characteristics for prospective patients or parents of child patients during the initial orthodontic office consultation. An initial questionnaire, based on published literature, was field-tested on 16 subjects to assess its validity. Based on the field test, the questionnaire was modified and tested for reliability by using a test-retest method. The questionnaire covered the following areas: doctor, office, staff, and finances. The reliability study included 2 groups of subjects: 12 consecutive prospective adult patients and 41 consecutive parents of prospective child patients. The questionnaires consisted of 43 and 50 questions for the adult patients and the parents of patients, respectively. The subjects rated the importance of practice characteristics in their selection of an orthodontic practice using a 100-mm visual analog scale anchored at "not important at all" and "most important." Reliability was analyzed by using the intraclass correlation coefficient (ICC). Summary scores of all 53 subjects showed excellent reliability (ICC, 0.88; range, 0.61-1.0). Summary scores of all 50 questions showed acceptable reliability (ICC, 0.70; range, 0.45-0.88). Twenty-one questions had excellent reliability (ICC, >.75), and 29 questions had fair-to-good reliability (ICC, 0.41-0.75). No questions showed poor reliability (ICC, <0.4). The pilot study data indicated that the overall reliability of the questionnaire is acceptable. Copyright © 2011 American Association of Orthodontists. Published by Mosby, Inc. All rights reserved.

Reliability and construct validity of the College Student Stress Scale.

PubMed

Feldt, Ronald C; Koch, Chris

2011-04-01

Reliability and construct validity of the 11-item College Student Stress Scale were investigated with exploratory (N = 273) and confirmatory factor analyses (N = 185) in undergraduate college students. Two factors were observed; however, reliability of the 3-item factor was too low and one item failed to load on either factor. A 7-item measure (Factor 1) had acceptable reliability (.81) and good convergence with the Perceived Stress Scale. This measure was significantly correlated with Neuroticism, Test Anxiety, and Self-efficacy for Learning, but not Social Desirability or age.

[Assessing food acceptance in scholar children; qualitative visual record versus food waste analysis].

PubMed

Rodriguez Tadeo, Alejandra; Patiño Villena, Begoña; Periago Castón, María Jesús; Ros Berruezo, Gaspar; González Martínez-Lacuesta, Eduardo

2014-05-01

School canteens have rules of management and supervision of menus, however has not been assessed if they are totally consumed. To assess the acceptance of food by weigh food leftovers and validation of a methodology for visual estimation in school canteens of Murcia. Participated pupils in the second and third cycle of primary education, between 8 and 12 years. The estimate of leftovers was performed by 765 food trays. Visual estimation of 300 trays was based on a categorical scale as follow: 1 (0-25%), 2 (26-50%), 3 (51- 75%), 4 (76-100%) by two dietitians and reliability was assessed with respect to the weighed food. The reliability between both methods was assessed in two samples stratified by presence or absence of school kitchen. The first dishes with leftovers were pasta, rice and vegetable purees and was higher in those schools without kitchen (p < 0.05). Also, the second dishes poultry and fish salads and vegetables garnish. Fruit and the total sum of leftovers was higher in schools without dining menus (p < 0.05). The agreement between evaluators was high in meat dishes and salads, and substantial in vegetables, pre-cooked, omelet, pasta, fish and rice. The leftlovers are high and there are differences in the acceptance of certain foods according to the type of menu offered. The visual scale is a reliable to measure acceptance indirectly, but training to catering staff is needed. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Factor Analytic Validation of the Ford, Wolvin, and Chung Listening Competence Scale

ERIC Educational Resources Information Center

Mickelson, William T.; Welch, S. A.

2012-01-01

This research begins to independently and quantitatively validate the Ford, Wolvin, and Chung (2000) Listening Competency Scale. Reliability and Confirmatory Factor analyses were conducted on two independent samples. The reliability estimates were found to be below those reported by Ford, Wolvin, and Chung (2000) and below acceptable levels for…

Speaker Reliability Guides Children's Inductive Inferences about Novel Properties

ERIC Educational Resources Information Center

Kim, Sunae; Kalish, Charles W.; Harris, Paul L.

2012-01-01

Prior work shows that children can make inductive inferences about objects based on their labels rather than their appearance (Gelman, 2003). A separate line of research shows that children's trust in a speaker's label is selective. Children accept labels from a reliable speaker over an unreliable speaker (e.g., Koenig & Harris, 2005). In the…

Increasing Small Satellite Reliability- A Public-Private Initiative

NASA Technical Reports Server (NTRS)

Johnson, Michael A.; Beauchamp, Patricia; Schone, Harald; Sheldon, Doug; Fuhrman, Linda; Sullivan, Erica; Fairbanks, Tom; Moe, Miquel; Leitner, Jesse

2017-01-01

At present, CubeSat components and buses are generally not appropriate for missions where significant risk of failure, or the inability to quantify risk or confidence, is acceptable. However, in the future we anticipate that CubeSats will be used for missions requiring reliability of 1-3 years for Earth-observing missions and even longer for Planetary, Heliophysics, and Astrophysics missions. Their growing potential utility is driving an interagency effort to improve and quantify CubeSat reliability, and more generally, small satellite mission risk. The Small Satellite Reliability Initiative (SSRI)—an ongoing activity with broad collaborative participation from civil, DoD, and commercial space systems providers and stakeholders—targets this challenge. The Initiative seeks to define implementable and broadly-accepted approaches to achieve reliability and acceptable risk postures associated with several SmallSat mission risk classes—from “do no harm” missions, to those associated with missions whose failure would result in loss or delay of key national objectives. These approaches will maintain, to the extent practical, cost efficiencies associated with small satellite missions and consider constraints associated with supply chain elements, as appropriate. The SSRI addresses this challenge from two architectural levels—the mission- or system-level, and the component- or subsystem-level. The mission- or system-level scope targets assessment approaches that are efficient and effective, with mitigation strategies that facilitate resiliency to mission or system anomalies while the component- or subsystem-level scope addresses the challenge at lower architectural levels. The initiative does not limit strategies and approaches to proven and traditional methodologies, but is focused on fomenting thought on novel and innovative solutions. This paper discusses the genesis of and drivers for this initiative, how the public-private collaboration is being executed, findings and recommendations derived to date, and next steps towards broadening small satellite mission potential.

Measuring human remains in the field: Grid technique, total station, or MicroScribe?

PubMed

Sládek, Vladimír; Galeta, Patrik; Sosna, Daniel

2012-09-10

Although three-dimensional (3D) coordinates for human intra-skeletal landmarks are among the most important data that anthropologists have to record in the field, little is known about the reliability of various measuring techniques. We compared the reliability of three techniques used for 3D measurement of human remain in the field: grid technique (GT), total station (TS), and MicroScribe (MS). We measured 365 field osteometric points on 12 skeletal sequences excavated at the Late Medieval/Early Modern churchyard in Všeruby, Czech Republic. We compared intra-observer, inter-observer, and inter-technique variation using mean difference (MD), mean absolute difference (MAD), standard deviation of difference (SDD), and limits of agreement (LA). All three measuring techniques can be used when accepted error ranges can be measured in centimeters. When a range of accepted error measurable in millimeters is needed, MS offers the best solution. TS can achieve the same reliability as does MS, but only when the laser beam is accurately pointed into the center of the prism. When the prism is not accurately oriented, TS produces unreliable data. TS is more sensitive to initialization than is MS. GT measures human skeleton with acceptable reliability for general purposes but insufficiently when highly accurate skeletal data are needed. We observed high inter-technique variation, indicating that just one technique should be used when spatial data from one individual are recorded. Subadults are measured with slightly lower error than are adults. The effect of maximum excavated skeletal length has little practical significance in field recording. When MS is not available, we offer practical suggestions that can help to increase reliability when measuring human skeleton in the field. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Validation of the comprehensive feeding practices questionnaire in parents of preschool children in Brazil.

PubMed

Warkentin, Sarah; Mais, Laís Amaral; Latorre, Maria do Rosário Dias de Oliveira; Carnell, Susan; Taddei, José Augusto de Aguiar Carrazedo

2016-07-19

Recent national surveys in Brazil have demonstrated a decrease in the consumption of traditional food and a parallel increase in the consumption of ultra-processed food, which has contributed to a rise in obesity prevalence in all age groups. Environmental factors, especially familial factors, have a strong influence on the food intake of preschool children, and this has led to the development of psychometric scales to measure parents' feeding practices. The aim of this study was to test the validity of a translated and adapted Comprehensive Feeding Practices Questionnaire in a sample of Brazilian preschool-aged children enrolled in private schools. A transcultural adaptation process was performed in order to develop a modified questionnaire (43 items). After piloting, the questionnaire was sent to parents, along with additional questions about family characteristics. Test-retest reliability was assessed in one of the schools. Factor analysis with oblique rotation was performed. Internal reliability was tested using Cronbach's alpha and correlations between factors, discriminant validity using marker variables of child's food intake, and convergent validity via correlations with parental perceptions of perceived responsibility for feeding and concern about the child's weight were also performed. The final sample consisted of 402 preschool children. Factor analysis resulted in a final questionnaire of 43 items distributed over 6 factors. Cronbach alpha values were adequate (0.74 to 0.88), between-factor correlations were low, and discriminant validity and convergent validity were acceptable. The modified CFPQ demonstrated significant internal reliability in this urban Brazilian sample. Scale validation within different cultures is essential for a more comprehensive understanding of parental feeding practices for preschoolers.

Post-manufacturing, 17-times acceptable raw bit error rate enhancement, dynamic codeword transition ECC scheme for highly reliable solid-state drives, SSDs

NASA Astrophysics Data System (ADS)

Tanakamaru, Shuhei; Fukuda, Mayumi; Higuchi, Kazuhide; Esumi, Atsushi; Ito, Mitsuyoshi; Li, Kai; Takeuchi, Ken

2011-04-01

A dynamic codeword transition ECC scheme is proposed for highly reliable solid-state drives, SSDs. By monitoring the error number or the write/erase cycles, the ECC codeword dynamically increases from 512 Byte (+parity) to 1 KByte, 2 KByte, 4 KByte…32 KByte. The proposed ECC with a larger codeword decreases the failure rate after ECC. As a result, the acceptable raw bit error rate, BER, before ECC is enhanced. Assuming a NAND Flash memory which requires 8-bit correction in 512 Byte codeword ECC, a 17-times higher acceptable raw BER than the conventional fixed 512 Byte codeword ECC is realized for the mobile phone application without an interleaving. For the MP3 player, digital-still camera and high-speed memory card applications with a dual channel interleaving, 15-times higher acceptable raw BER is achieved. Finally, for the SSD application with 8 channel interleaving, 13-times higher acceptable raw BER is realized. Because the ratio of the user data to the parity bits is the same in each ECC codeword, no additional memory area is required. Note that the reliability of SSD is improved after the manufacturing without cost penalty. Compared with the conventional ECC with the fixed large 32 KByte codeword, the proposed scheme achieves a lower power consumption by introducing the "best-effort" type operation. In the proposed scheme, during the most of the lifetime of SSD, a weak ECC with a shorter codeword such as 512 Byte (+parity), 1 KByte and 2 KByte is used and 98% lower power consumption is realized. At the life-end of SSD, a strong ECC with a 32 KByte codeword is used and the highly reliable operation is achieved. The random read performance is also discussed. The random read performance is estimated by the latency. The latency is below 1.5 ms for ECC codeword up to 32 KByte. This latency is below the average latency of 15,000 rpm HDD, 2 ms.

Validation of an iPad activity to measure preschool children's food and physical activity knowledge and preferences.

PubMed

Wiseman, Nicola; Harris, Neil; Downes, Martin

2017-02-01

Preschool children's knowledge of, and preference for food and physical activity play an important role in the development of lifestyle behaviors throughout childhood. Valid and reliable instruments that are interactive and appealing to preschool children are needed, to obtain quality information in a way that actively engages children and encourages willing participation. The purpose of the current research is to assess the reliability and validity of an adapted computerized (iPad) version of the photo-pair food and exercise questionnaire (PPFEQ). The adaptation of the PPFEQ involved generating the questionnaire as an iPad-based tool, updating the photo-pairs within the questionnaire and testing for validity and reliability. This involved four phases of investigation to assess test-retest reliability, internal consistency, sensitivity to change and percent agreement of the questionnaire. The adaption of the PPFEQ resulted in an 18-item questionnaire, titled the preschool food and play questionnaire (Pre-FPQ). The Pre-FPQ demonstrated acceptable reliability and sensitivity to change. Test-retest reliability and internal consistency improved with age, however, it was evident that the tool was not suitable for children younger than 4 years of age. Children encounter a dynamic world that shapes their knowledge, preferences, choices and behaviors. The Pre-FPQ is an innovative tool to measure preschool children's knowledge of and preference for food and physical activity. The questionnaire offers the advantage of being presented in a well-received modality for preschool children as well as being easy and inexpensive to administer. This new tool is likely to be useful for the assessment of the effectiveness of healthy lifestyle programs implemented in the childcare setting. Future work is needed to refine and improve measures of physical activity preference in preschool children.

Test-retest reliability of sudden ankle inversion measurements in subjects with healthy ankle joints.

PubMed

Eechaute, Christophe; Vaes, Peter; Duquet, William; Van Gheluwe, Bart

2007-01-01

Sudden ankle inversion tests have been used to investigate whether the onset of peroneal muscle activity is delayed in patients with chronically unstable ankle joints. Before interpreting test results of latency times in patients with chronic ankle instability and healthy subjects, the reliability of these measures must be first demonstrated. To investigate the test-retest reliability of variables measured during a sudden ankle inversion movement in standing subjects with healthy ankle joints. Validation study. Research laboratory. 15 subjects with healthy ankle joints (30 ankles). Subjects stood on an ankle inversion platform with both feet tightly fixed to independently moveable trapdoors. An unexpected sudden ankle inversion of 50 degrees was imposed. We measured latency and motor response times and electromechanical delay of the peroneus longus muscle, along with the time and angular position of the first and second decelerating moments, the mean and maximum inversion speed, and the total inversion time. Correlation coefficients and standard error of measurements were calculated. Intraclass correlation coefficients ranged from 0.17 for the electromechanical delay of the peroneus longus muscle (standard error of measurement = 2.7 milliseconds) to 0.89 for the maximum inversion speed (standard error of measurement = 34.8 milliseconds). The reliability of the latency and motor response times of the peroneus longus muscle, the time of the first and second decelerating moments, and the mean and maximum inversion speed was acceptable in subjects with healthy ankle joints and supports the investigation of the reliability of these measures in subjects with chronic ankle instability. The lower reliability of the electromechanical delay of the peroneus longus muscle and the angular positions of both decelerating moments calls the use of these variables into question.

Development of the adult PedsQL™ neurofibromatosis type 1 module: initial feasibility, reliability and validity.

PubMed

Nutakki, Kavitha; Hingtgen, Cynthia M; Monahan, Patrick; Varni, James W; Swigonski, Nancy L

2013-02-21

Neurofibromatosis type 1 (NF1) is a common autosomal dominant genetic disorder with significant impact on health-related quality of life (HRQOL). Research in understanding the pathogenetic mechanisms of neurofibroma development has led to the use of new clinical trials for the treatment of NF1. One of the most important outcomes of a trial is improvement in quality of life, however, no condition specific HRQOL instrument for NF1 exists. The objective of this study was to develop an NF1 HRQOL instrument as a module of PedsQL™ and to test for its initial feasibility, internal consistency reliability and validity in adults with NF1. The NF1 specific HRQOL instrument was developed using a standard method of PedsQL™ module development - literature review, focus group/semi-structured interviews, cognitive interviews and experts' review of initial draft, pilot testing and field testing. Field testing involved 134 adults with NF1. Feasibility was measured by the percentage of missing responses, internal consistency reliability was measured with Cronbach's alpha and validity was measured by the known-groups method. Feasibility, measured by the percentage of missing responses was 4.8% for all subscales on the adult version of the NF1-specific instrument. Internal consistency reliability for the Total Score (alpha =0.97) and subscale reliabilities ranging from 0.72 to 0.96 were acceptable for group comparisons. The PedsQL™ NF1 module distinguished between NF1 adults with excellent to very good, good, and fair to poor health status. The results demonstrate the initial feasibility, reliability and validity of the PedsQL™ NF1 module in adult patients. The PedsQL™ NF1 Module can be used to understand the multidimensional nature of NF1 on the HRQOL patients with this disorder.

The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.

PubMed

Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan

2017-12-25

The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P < 0.05). Discriminative validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P < 0.001). The VCDQ was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Validation of a 4-item Negative Symptom Assessment (NSA-4): a short, practical clinical tool for the assessment of negative symptoms in schizophrenia.

PubMed

Alphs, Larry; Morlock, Robert; Coon, Cheryl; Cazorla, Pilar; Szegedi, Armin; Panagides, John

2011-06-01

The 16-item Negative Symptom Assessment (NSA-16) scale is a validated tool for evaluating negative symptoms of schizophrenia. The psychometric properties and predictive power of a four-item version (NSA-4) were compared with the NSA-16. Baseline data from 561 patients with predominant negative symptoms of schizophrenia who participated in two identically designed clinical trials were evaluated. Ordered logistic regression analysis of ratings using NSA-4 and NSA-16 were compared with ratings using several other standard tools to determine predictive validity and construct validity. Internal consistency and test--retest reliability were also analyzed. NSA-16 and NSA-4 scores were both predictive of scores on the NSA global rating (odds ratio = 0.83-0.86) and the Clinical Global Impressions--Severity scale (odds ratio = 0.91-0.93). NSA-16 and NSA-4 showed high correlation with each other (Pearson r = 0.85), similar high correlation with other measures of negative symptoms (demonstrating convergent validity), and lesser correlations with measures of other forms of psychopathology (demonstrating divergent validity). NSA-16 and NSA-4 both showed acceptable internal consistency (Cronbach α, 0.85 and 0.64, respectively) and test--retest reliability (intraclass correlation coefficient, 0.87 and 0.82). This study demonstrates that NSA-4 offers accuracy comparable to the NSA-16 in rating negative symptoms in patients with schizophrenia. Copyright © 2011 John Wiley & Sons, Ltd.

[Validity, reliability, and acceptability of the brief version of the self-management knowledge, attitude, and behavior assessment scale for diabetes patients].

PubMed

Wu, Y Z; Wang, W J; Feng, N P; Chen, B; Li, G C; Liu, J W; Liu, H L; Yang, Y Y

2016-07-06

To evaluate the validity, reliability, and acceptability of the brief version of the self-management knowledge, attitude, and behavior (KAB) assessment scale for diabetes patients. Diabetes patients who were managed at the Xinkaipu Community Health Service Center of Tianxin in Changsha, Hunan Province were selected for survey by cluster sampling. A total of 350 diabetes patients were surveyed using the brief scale to collect data on knowledge, attitudes, and behaviors of self-management. Content validity was evaluated by Pearson correlation coefficient between the brief scale and subscales of knowledge, attitude, and behavior. Structure validity was evaluated by factor analysis, and discrimination validity was evaluated by an independent sample t-test between the high-score and low-score groups. Reliability was tested by internal consistency reliability and split-half reliability. The evaluation indexes of internal consistency reliability were Cronbach's α coefficients, θ coefficient, and Ω coefficient. Acceptability was evaluated by valid response rate and completion time of the brief scale. A total of 346(98.9%) valid questionnaires were returned, with average survey time of (11.43±3.4) minutes. Average score of the brief scale was 78.85 ± 11.22; scores of the knowledge, attitude, and behavior subscales were 16.45 ± 4.42, 21.33 ± 2.03, and 41.07 ± 8.34, respectively. Pearson correlation coefficients between the brief scale and the knowledge, attitude, and behavior subscales were 0.92, 0.42, and 0.60, respectively; P-values were all less than 0.01, indicating that the face validity and content validity of the brief scale were achieved to a good level. The common factor cumulative variance contribution rate of the brief scale and three subscales was from 53.66% to 61.75%, which achieved more than 50% of the approved standard. There were 11 common factors; 41 of the total 42 items had factor loadings above 0.40 in their relevant common factor, indicating that the brief scale and three subscales had good construct validity. Patients were divided into a high-score group and a low-score group, then scores of the brief scale and three subscales were compared between the groups using a t-test. The results were all significant, indicating that the brief scale and three subscales had good discriminate validity. Mean scores of the brief scale and three subscales of the high-score group were 91.55±6.81, 19.51±2.17, 22.74±1.88, and 49.30±6.20, respectively; these were higher than the low-score group (65.89±5.79, 12.29±4.76, 20.22±1.88, and 33.39±6.17, respectively) with t-values 27.76, 13.31, 9.20, and 17.56 (P-values were less than 0.001). The Cronbach's α coefficient, θ coefficient, Ω coefficient, and split-half reliability of the brief scale were 0.83, 0.87, 0.96, and 0.84, respectively. These values for the three subscales were all above 0.70, except for the θ coefficient of the attitude subscale with 0.64, indicating that the brief scale and three subscales had acceptable internal consistency reliability. The brief version of the diabetes self-management knowledge, attitude, and behavior assessment scale showed good acceptability, validity, and reliability, to responsibly evaluate self-management KAB among patients with diabetes.

Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS)

PubMed Central

2013-01-01

Background Streetscape (microscale) features of the built environment can influence people’s perceptions of their neighborhoods’ suitability for physical activity. Many microscale audit tools have been developed, but few have published systematic scoring methods. We present the development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS) tool and its theoretically-based subscales. Methods MAPS was based on prior instruments and was developed to assess details of streetscapes considered relevant for physical activity. MAPS sections (route, segments, crossings, and cul-de-sacs) were scored by two independent raters for reliability analyses. There were 290 route pairs, 516 segment pairs, 319 crossing pairs, and 53 cul-de-sac pairs in the reliability sample. Individual inter-rater item reliability analyses were computed using Kappa, intra-class correlation coefficient (ICC), and percent agreement. A conceptual framework for subscale creation was developed using theory, expert consensus, and policy relevance. Items were grouped into subscales, and subscales were analyzed for inter-rater reliability at tiered levels of aggregation. Results There were 160 items included in the subscales (out of 201 items total). Of those included in the subscales, 80 items (50.0%) had good/excellent reliability, 41 items (25.6%) had moderate reliability, and 18 items (11.3%) had low reliability, with limited variability in the remaining 21 items (13.1%). Seventeen of the 20 route section subscales, valence (positive/negative) scores, and overall scores (85.0%) demonstrated good/excellent reliability and 3 demonstrated moderate reliability. Of the 16 segment subscales, valence scores, and overall scores, 12 (75.0%) demonstrated good/excellent reliability, three demonstrated moderate reliability, and one demonstrated poor reliability. Of the 8 crossing subscales, valence scores, and overall scores, 6 (75.0%) demonstrated good/excellent reliability, and 2 demonstrated moderate reliability. The cul-de-sac subscale demonstrated good/excellent reliability. Conclusions MAPS items and subscales predominantly demonstrated moderate to excellent reliability. The subscales and scoring system represent a theoretically based framework for using these complex microscale data and may be applicable to other similar instruments. PMID:23621947

The Parenting to Reduce Adolescent Depression and Anxiety Scale: Assessing parental concordance with parenting guidelines for the prevention of adolescent depression and anxiety disorders

PubMed Central

Cardamone-Breen, Mairead C.; Jorm, Anthony F.; Lawrence, Katherine A.; Mackinnon, Andrew J.

2017-01-01

Background Despite substantial evidence demonstrating numerous parental risk and protective factors for the development of adolescent depression and anxiety disorders, there is currently no single measure that assesses these parenting factors. To address this gap, we developed the Parenting to Reduce Adolescent Depression and Anxiety Scale (PRADAS) as a criterion-referenced measure of parental concordance with a set of evidence-based parenting guidelines for the prevention of adolescent depression and anxiety disorders. In this paper, we used a sample of Australian parents of adolescents to: (1) validate the PRADAS as a criterion-referenced measure; (2) examine parental concordance with the guidelines in the sample; and (3) examine correlates of parental concordance with the guidelines. Methods Seven hundred eleven parents completed the PRADAS, as well as two established parenting measures, and parent-report measures of adolescent depression and anxiety symptoms. Six hundred sixty adolescent participants (aged 12–15) also completed the symptom measures. Concordance with the guidelines was assessed via nine subscale scores and a total score. Reliability of the scores was assessed with an estimate of the agreement coefficient, as well as 1-month test-retest reliability. Convergent validity was examined via correlations between the scale and two established parenting measures. Results One proposed subscale was removed from the final version of the scale, resulting in a total of eight subscales. Reliability was high for the total score, and acceptable to high for seven of the eight subscales. One-month test-retest reliability was acceptable to high for the total score. Convergent validity was supported by moderate to high correlations with two established measures of parenting. Overall, rates of parental concordance with the guidelines were low in our sample. Higher scores were associated with being female and higher levels of parental education. Greater parental concordance with the guidelines was associated with fewer symptoms of depression and anxiety in adolescent participants. Discussion This initial validation study provides preliminary support for the reliability and validity of the PRADAS. The scale has potential for use in both clinical and research settings. It may be used to identify parents’ strengths and potential targets for intervention, and as an outcome measure in studies of preventive parenting interventions. PMID:28951815

Factor Structure, Reliability and Measurement Invariance of the Alberta Context Tool and the Conceptual Research Utilization Scale, for German Residential Long Term Care

PubMed Central

Hoben, Matthias; Estabrooks, Carole A.; Squires, Janet E.; Behrens, Johann

2016-01-01

We translated the Canadian residential long term care versions of the Alberta Context Tool (ACT) and the Conceptual Research Utilization (CRU) Scale into German, to study the association between organizational context factors and research utilization in German nursing homes. The rigorous translation process was based on best practice guidelines for tool translation, and we previously published methods and results of this process in two papers. Both instruments are self-report questionnaires used with care providers working in nursing homes. The aim of this study was to assess the factor structure, reliability, and measurement invariance (MI) between care provider groups responding to these instruments. In a stratified random sample of 38 nursing homes in one German region (Metropolregion Rhein-Neckar), we collected questionnaires from 273 care aides, 196 regulated nurses, 152 allied health providers, 6 quality improvement specialists, 129 clinical leaders, and 65 nursing students. The factor structure was assessed using confirmatory factor models. The first model included all 10 ACT concepts. We also decided a priori to run two separate models for the scale-based and the count-based ACT concepts as suggested by the instrument developers. The fourth model included the five CRU Scale items. Reliability scores were calculated based on the parameters of the best-fitting factor models. Multiple-group confirmatory factor models were used to assess MI between provider groups. Rather than the hypothesized ten-factor structure of the ACT, confirmatory factor models suggested 13 factors. The one-factor solution of the CRU Scale was confirmed. The reliability was acceptable (>0.7 in the entire sample and in all provider groups) for 10 of 13 ACT concepts, and high (0.90–0.96) for the CRU Scale. We could demonstrate partial strong MI for both ACT models and partial strict MI for the CRU Scale. Our results suggest that the scores of the German ACT and the CRU Scale for nursing homes are acceptably reliable and valid. However, as the ACT lacked strict MI, observed variables (or scale scores based on them) cannot be compared between provider groups. Rather, group comparisons should be based on latent variable models, which consider the different residual variances of each group. PMID:27656156

Using software metrics and software reliability models to attain acceptable quality software for flight and ground support software for avionic systems

NASA Technical Reports Server (NTRS)

Lawrence, Stella

1992-01-01

This paper is concerned with methods of measuring and developing quality software. Reliable flight and ground support software is a highly important factor in the successful operation of the space shuttle program. Reliability is probably the most important of the characteristics inherent in the concept of 'software quality'. It is the probability of failure free operation of a computer program for a specified time and environment.

Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients’ Motivation to Adhere to Insulin Therapy

PubMed Central

Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

2018-01-01

Introduction: Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient’s adherence to therapy. Aim: Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. Material and Methods: We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results: Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Conclusion: Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy. PMID:29670478

Relevance and reliability of experimental data in human health risk assessment of pesticides.

PubMed

Kaltenhäuser, Johanna; Kneuer, Carsten; Marx-Stoelting, Philip; Niemann, Lars; Schubert, Jens; Stein, Bernd; Solecki, Roland

2017-08-01

Evaluation of data relevance, reliability and contribution to uncertainty is crucial in regulatory health risk assessment if robust conclusions are to be drawn. Whether a specific study is used as key study, as additional information or not accepted depends in part on the criteria according to which its relevance and reliability are judged. In addition to GLP-compliant regulatory studies following OECD Test Guidelines, data from peer-reviewed scientific literature have to be evaluated in regulatory risk assessment of pesticide active substances. Publications should be taken into account if they are of acceptable relevance and reliability. Their contribution to the overall weight of evidence is influenced by factors including test organism, study design and statistical methods, as well as test item identification, documentation and reporting of results. Various reports make recommendations for improving the quality of risk assessments and different criteria catalogues have been published to support evaluation of data relevance and reliability. Their intention was to guide transparent decision making on the integration of the respective information into the regulatory process. This article describes an approach to assess the relevance and reliability of experimental data from guideline-compliant studies as well as from non-guideline studies published in the scientific literature in the specific context of uncertainty and risk assessment of pesticides. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Stroke and aphasia quality-of-life scale-39: Reliability and validity of the Turkish version.

PubMed

Noyan-ErbaŞ, AyŞin; Toğram, Bülent

2016-10-01

The aim of this study was to adapt the stroke and aphasia quality-of-life scale-39 (SAQoL-39) to the Turkish language and carry out a reliability and validity study of the instrument in a group of patients with aphasia. The study was a descriptive study and contained three phases: adaptation of the SAQoL-39 to the Turkish language, administration of the scale to 30 aphasia patients and reliability and validity studies of the scale. Internal consistency was assessed with Cronbach's alpha and test-re-test reliability was explored (n = 14). The adaptation process was completed based on inter-rater agreement on the translated items and within the scope of final editing by the authors of the study. The SAQoL-39 in Turkish exhibited high test-re-test reliability (ICC =0.97) as well as acceptability with minimal missing data (0-1.4). This instrument exhibited high internal consistency (Cronbach's α = 0.70-0.97), domain-total correlations (r = 0.76-0.85) and inter-domain correlations (r = 0.40-0.68). The analysis shows that the Turkish version of SAQoL-39 is a scale that is highly acceptable, valid and reliable and can be easily used in evaluating the quality-of-life of Turkish people with aphasia.

Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients' Motivation to Adhere to Insulin Therapy.

PubMed

Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

2018-03-01

Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient's adherence to therapy. Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy.

Parental Acceptance and Rejection: Theory, Measures, and Research in the Arab World

ERIC Educational Resources Information Center

Ahmed, Ramadan A.; Rohner, Ronald P.; Khaleque, Abdul; Gielen, Uwe P.

2010-01-01

Purpose. The purpose of this article is to summarize the rich and growing body of research that draws from parental acceptance-rejection theory (PARTheory) and associated measures as used throughout the Arab world. Methodology. This body of work includes more than 100 studies that explore the reliability and validity of Arabic adaptations of…

An Investigation of the Factors That Influence Faculty and Student Acceptance of Mobile Learning in Online Higher Education

ERIC Educational Resources Information Center

Marrs, Kathleen

2013-01-01

Technology acceptance in education has been and continues to be a central concern for researchers, application and platform developers, and educators. Rapid advancements in miniaturization along with the availability of fast, reliable, and affordable networks have sparked an increasing demand by students for better ways to complement their mobile…

Six of one, half a dozen of the other: A measure of multidisciplinary inter/intra-rater reliability of the society for fetal urology and urinary tract dilation grading systems for hydronephrosis.

PubMed

Rickard, Mandy; Easterbrook, Bethany; Kim, Soojin; Farrokhyar, Forough; Stein, Nina; Arora, Steven; Belostotsky, Vladamir; DeMaria, Jorge; Lorenzo, Armando J; Braga, Luis H

2017-02-01

The urinary tract dilation (UTD) classification system was introduced to standardize terminology in the reporting of hydronephrosis (HN), and bridge a gap between pre- and postnatal classification such as the Society for Fetal Urology (SFU) grading system. Herein we compare the intra/inter-rater reliability of both grading systems. SFU (I-IV) and UTD (I-III) grades were independently assigned by 13 raters (9 pediatric urology staff, 2 nephrologists, 2 radiologists), twice, 3 weeks apart, to 50 sagittal postnatal ultrasonographic views of hydronephrotic kidneys. Data regarding ureteral measurements and bladder abnormalities were included to allow proper UTD categorization. Ten images were repeated to assess intra-rater reliability. Krippendorff's alpha coefficient was used to measure overall and by grade intra/inter-rater reliability. Reliability between specialties and training levels were also analyzed. Overall inter-rater reliability was slightly higher for SFU (α = 0.842, 95% CI 0.812-0.879, in session 1; and α = 0.808, 95% CI 0.775-0.839, in session 2) than for UTD (α = 0.774, 95% CI 0.715-0.827, in session 1; and α = 0.679, 95% CI 0.605-0.750, in session 2). Reliability for intermediate grades (SFU II/III and UTD 2) of HN was poor regardless of the system. Reliabilities for SFU and UTD classifications among Urology, Nephrology, and Radiology, as well as between training levels were not significantly different. Despite the introduction of HN grading systems to standardize the interpretation and reporting of renal ultrasound in infants with HN, none have been proven superior in allowing clinicians to distinguish between "moderate" grades. While this study demonstrated high reliability in distinguishing between "mild" (SFU I/II and UTD 1) and "severe" (SFU IV and UTD 3) grades of HN, the overall reliability between specialties was poor. This is in keeping with a previous report of modest inter-rater reliability of the SFU system. This drawback is likely explained by the subjective interpretation required to assign grades, which can be impacted by experience, image quality, and scanning technique. As shown in the figure, which demonstrates SFU II (a) and SFU III (b), as assigned by a radiologist, it is possible to make an argument that either of these images can be classified into both categories that were observed during the grading sessions of this study. Although both systems have acceptable reliability, the SFU grading system showed higher overall intra/inter-rater reliability regardless of rater specialty than the UTD classification. Inter-rater reliability for SFU grades II/III and UTD 2 was low, highlighting the limitations of both classifications in regards to properly segregating moderate HN grades. Copyright © 2016 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

Reliability and Maintainability Engineering - A Major Driver for Safety and Affordability

NASA Technical Reports Server (NTRS)

Safie, Fayssal M.

2011-01-01

The United States National Aeronautics and Space Administration (NASA) is in the midst of an effort to design and build a safe and affordable heavy lift vehicle to go to the moon and beyond. To achieve that, NASA is seeking more innovative and efficient approaches to reduce cost while maintaining an acceptable level of safety and mission success. One area that has the potential to contribute significantly to achieving NASA safety and affordability goals is Reliability and Maintainability (R&M) engineering. Inadequate reliability or failure of critical safety items may directly jeopardize the safety of the user(s) and result in a loss of life. Inadequate reliability of equipment may directly jeopardize mission success. Systems designed to be more reliable (fewer failures) and maintainable (fewer resources needed) can lower the total life cycle cost. The Department of Defense (DOD) and industry experience has shown that optimized and adequate levels of R&M are critical for achieving a high level of safety and mission success, and low sustainment cost. Also, lessons learned from the Space Shuttle program clearly demonstrated the importance of R&M engineering in designing and operating safe and affordable launch systems. The Challenger and Columbia accidents are examples of the severe impact of design unreliability and process induced failures on system safety and mission success. These accidents demonstrated the criticality of reliability engineering in understanding component failure mechanisms and integrated system failures across the system elements interfaces. Experience from the shuttle program also shows that insufficient Reliability, Maintainability, and Supportability (RMS) engineering analyses upfront in the design phase can significantly increase the sustainment cost and, thereby, the total life cycle cost. Emphasis on RMS during the design phase is critical for identifying the design features and characteristics needed for time efficient processing, improved operational availability, and optimized maintenance and logistic support infrastructure. This paper discusses the role of R&M in a program acquisition phase and the potential impact of R&M on safety, mission success, operational availability, and affordability. This includes discussion of the R&M elements that need to be addressed and the R&M analyses that need to be performed in order to support a safe and affordable system design. The paper also provides some lessons learned from the Space Shuttle program on the impact of R&M on safety and affordability.

Effect of clinically discriminating, evidence-based checklist items on the reliability of scores from an Internal Medicine residency OSCE.

PubMed

Daniels, Vijay J; Bordage, Georges; Gierl, Mark J; Yudkowsky, Rachel

2014-10-01

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving learners are more likely to use. The purpose of this study was to determine if limiting checklist items to clinically discriminating items and/or adding missing evidence-based items improved score reliability in an Internal Medicine residency OSCE. Six internists reviewed the traditional checklists of four OSCE stations classifying items as clinically discriminating or non-discriminating. Two independent reviewers augmented checklists with missing evidence-based items. We used generalizability theory to calculate overall reliability of faculty observer checklist scores from 45 first and second-year residents and predict how many 10-item stations would be required to reach a Phi coefficient of 0.8. Removing clinically non-discriminating items from the traditional checklist did not affect the number of stations (15) required to reach a Phi of 0.8 with 10 items. Focusing the checklist on only evidence-based clinically discriminating items increased test score reliability, needing 11 stations instead of 15 to reach 0.8; adding missing evidence-based clinically discriminating items to the traditional checklist modestly improved reliability (needing 14 instead of 15 stations). Checklists composed of evidence-based clinically discriminating items improved the reliability of checklist scores and reduced the number of stations needed for acceptable reliability. Educators should give preference to evidence-based items over non-evidence-based items when developing OSCE checklists.

A Probabilistic Approach to Predict Thermal Fatigue Life for Ball Grid Array Solder Joints

NASA Astrophysics Data System (ADS)

Wei, Helin; Wang, Kuisheng

2011-11-01

Numerous studies of the reliability of solder joints have been performed. Most life prediction models are limited to a deterministic approach. However, manufacturing induces uncertainty in the geometry parameters of solder joints, and the environmental temperature varies widely due to end-user diversity, creating uncertainties in the reliability of solder joints. In this study, a methodology for accounting for variation in the lifetime prediction for lead-free solder joints of ball grid array packages (PBGA) is demonstrated. The key aspects of the solder joint parameters and the cyclic temperature range related to reliability are involved. Probabilistic solutions of the inelastic strain range and thermal fatigue life based on the Engelmaier model are developed to determine the probability of solder joint failure. The results indicate that the standard deviation increases significantly when more random variations are involved. Using the probabilistic method, the influence of each variable on the thermal fatigue life is quantified. This information can be used to optimize product design and process validation acceptance criteria. The probabilistic approach creates the opportunity to identify the root causes of failed samples from product fatigue tests and field returns. The method can be applied to better understand how variation affects parameters of interest in an electronic package design with area array interconnections.

Development and Validation of a Personality Assessment Instrument for Traditional Korean Medicine: Sasang Personality Questionnaire

PubMed Central

Chae, Han; Lee, Siwoo; Park, Soo Hyun; Jang, Eunsu; Lee, Soo Jin

2012-01-01

Objective. Sasang typology is a traditional Korean medicine based on the biopsychosocial perspectives of Neo-Confucianism and utilizes medical herbs and acupuncture for type-specific treatment. This study was designed to develop and validate the Sasang Personality Questionnaire (SPQ) for future use in the assessment of personality based on Sasang typology. Design and Methods. We selected questionnaire items using internal consistency analysis and examined construct validity with explorative factor analysis using 245 healthy participants. Test-retest reliability as well as convergent validity were examined. Results. The 14-item SPQ showed acceptable internal consistency (Cronbach's alpha = .817) and test-retest reliability (r = .837). Three extracted subscales, SPQ-behavior, SPQ-emotionality, and SPQ-cognition, were found, explaining 55.77% of the total variance. The SPQ significantly correlated with Temperament and Character Inventory novelty seeking (r = .462), harm avoidance (r = −.390), and NEO Personality Inventory extraversion (r = .629). The SPQ score of the So-Eum (24.43 ± 4.93), Tae-Eum (27.33 ± 5.88), and So-Yang (30.90 ± 5.23) types were significantly different from each other (P < .01). Conclusion. Current results demonstrated the reliability and validity of the SPQ and its subscales that can be utilized as an objective instrument for conducting personalized medicine research incorporating the biopsychosocial perspective. PMID:22567034

Reliability of the Pictorial Scale of Perceived Movement Skill Competence in 2 Diverse Samples of Young Children.

PubMed

Barnett, Lisa M; Robinson, Leah E; Webster, E Kipling; Ridgers, Nicola D

2015-08-01

The purpose was to determine the reliability of an instrument designed to assess young children's perceived movement skill competence in 2 diverse samples. A pictorial instrument assessed 12 perceived Fundamental Movement Skills (FMS) based on the Test of Gross Motor Development 2nd edition. Intra-Class Correlations (ICC) and internal consistency analyses were conducted. Paired sample t tests assessed change in mean perceived skill scores. Bivariate correlations between the intertrial difference and the mean of the trials explored proportional bias. Sample 1 (S1) were culturally diverse Australian children (n = 111; 52% boys) aged 5 to 8 years (mean = 6.4, SD = 1.0) with educated parents. Sample 2 (S2) were racially diverse and socioeconomically disadvantaged American children (n = 110; 57% boys) aged 5 to 10 years (mean = 6.8, SD = 1.1). For all children, the internal consistency for 12 FMS was acceptable (S1 = 0.72, 0.75, S2 = 0.66, 0.67). ICCs were higher in S1 (0.73) than S2 (0.50). Mean changes between trials were small. There was little evidence of proportional bias. Lower values in S2 may be due to differences in study demographic and execution. While the instrument demonstrated reliability/internal consistency, further work is recommended in diverse samples.

Validation of an instrument to assess toddler feeding practices of Latino mothers.

PubMed

Chaidez, Virginia; Kaiser, Lucia L

2011-08-01

This paper describes qualitative and quantitative aspects of testing a 34-item Toddler-Feeding Questionnaire (TFQ), designed for use in Latino families, and the associations between feeding practices and toddler dietary outcomes. Qualitative methods included review by an expert panel for content validity and cognitive testing of the tool to assess face validity. Quantitative analyses included use of exploratory factor analysis for construct validity; Pearson's correlations for test-retest reliability; Cronbach's alpha (α) for internal reliability; and multivariate regression for investigating relationships between feeding practices and toddler diet and anthropometry. Interviews were conducted using a convenience sample of 94 Latino mother and toddler dyads obtained largely through the Supplemental Nutrition Program for Women, Infants and Children (WIC). Data collection included household characteristics, self-reported early-infant feeding practices, the toddler's dietary intake, and anthropometric measurements. Factor analysis suggests the TFQ contains three subscales: indulgent; authoritative; and environmental influences. The TFQ demonstrated acceptable reliability for most measures. As hypothesized, indulgent practices in Latino toddlers were associated with increased energy consumption and higher intakes of total fat, saturated fat, and sweetened beverages. This tool may be useful in future research exploring the relationship of toddler feeding practices to nutritional outcomes in Latino families. Copyright © 2011 Elsevier Ltd. All rights reserved.

[Creation of a scale for evaluating attitudes of partners toward alcohol dependency].

PubMed

Sugawara, Tazuko; Morita, Noriaki; Nakatani, Youji

2013-12-01

The aim of this study was to develop a scale to evaluate characteristics of how alcohol-dependent people perceive the attitudes of their partners toward alcohol dependency. Based on previous research, we created the "Attitudes of partners toward alcohol dependency" scale, from the perspective of the alcohol dependent individual. Using the new scale, 71 alcohol-dependent people (52 men, 19 women) were surveyed after obtaining their consent, and the reliability and validity of the scale were tested. The results identified 3 factors, "indifference", "acceptance" and "hypersensitivity", and factorial validity was verified. Relatively high reliability was obtained on each sub-scale (alpha = .60-.82). Furthermore, correlations were obtained with the alcohol-dependency "Denial and Awareness Scale (for alcohol-dependent people)" and with the 13-item "Usefulness of heterosexual love relations for recovery from alcohol dependency" questionnaire, which includes content on "beneficial" or "obstructive" to recovery, and with the satisfaction and the importance of relations. This demonstrates that the "Attitudes of partners toward alcohol dependency" scale has reliability and criterion-related validity. The scale facilitates evaluation of types of attitudes of partners toward alcohol dependency, and may thus be useful as one tool for investigating the influence of partners in heterosexual love relationships for recovery, and for providing advice.

Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire.

PubMed

McEvoy, Maureen Patricia; Williams, Marie T; Olds, Timothy Stephen

2010-01-01

Previous survey tools operationalising knowledge, attitudes or beliefs about evidence-based practice (EBP) have shortcomings in content, psychometric properties and target audience. This study developed and psychometrically assessed a self-report trans-professional questionnaire to describe an EBP profile. Sixty-six items were collated from existing EBP questionnaires and administered to 526 academics and students from health and non-health backgrounds. Principal component factor analysis revealed the presence of five factors (Relevance, Terminology, Confidence, Practice and Sympathy). Following expert panel review and pilot testing, the 58-item final questionnaire was disseminated to 105 subjects on two occasions. Test-retest and internal reliability were quantified using intra-class correlation coefficients (ICCs) and Cronbach's alpha, convergent validity against a commonly used EBP questionnaire by Pearson's correlation coefficient and discriminative validity via analysis of variance (ANOVA) based on exposure to EBP training. The final questionnaire demonstrated acceptable internal consistency (Cronbach's alpha 0.96), test-retest reliability (ICCs range 0.77-0.94) and convergent validity (Practice 0.66, Confidence 0.80 and Sympathy 0.54). Three factors (Relevance, Terminology and Confidence) distinguished EBP exposure groups (ANOVA p < 0.001-0.004). The evidence-based practice profile (EBP(2)) questionnaire is a reliable instrument with the ability to discriminate for three factors, between respondents with differing EBP exposures.

Creating a measure of portion control self-efficacy.

PubMed

Fast, Lindsey C; Harman, Jennifer J; Maertens, Julie A; Burnette, Jeni L; Dreith, Francesca

2015-01-01

Over the last few decades, food portion sizes have steadily increased by as much as 700% (Young & Nestle, 2002). Food portions are often much larger than dietary guidelines recommend, leaving individuals to manage their food consumption on their own and making it necessary to understand individual factors impacting food consumption. In the current paper, we focus on self-efficacy for portion control. Specifically, across three studies, we developed and validated a new measure of portion control self-efficacy (PCSE). The PCSE measure yielded good fit statistics and had acceptable test-retest reliability using two cross-sectional surveys (Studies 1(a) and 1(b)). Results from Study 2 demonstrated construct and predictive validity of the PCSE using the Food Amount Rating Scale (FARS; Dohm, & Striegel-Moore, 2002). Study 3 offered additional support for reliability and validity with a sample of overweight and obese adults currently trying to lose weight. Overall, findings indicate that the new PCSE measure is reliable and valid. Individuals often make inaccurate food portion estimates (Slawson & Eck, 1997; Yuhas, Bolland, & Bolland, 1989) which can lead to overeating and weight-gain. Thus, the discussion centers on the need to incorporate PCSE in future research and intervention work targeting weight loss, health, and food consumption. Copyright © 2014 Elsevier Ltd. All rights reserved.

Reliability of the ecSatter Inventory as a tool to measure eating competence.

PubMed

Stotts, Jodi L; Lohse, Barbara

2007-01-01

To examine the reliability of the ecSatter Inventory (ecSI), a measure of eating competence. Self-report questionnaires were administered in person or by mail. Retesting occurred 2 to 6 weeks after completion of the first questionnaire. Both administrations of the questionnaire were completed by 259 participants who were mostly food secure, white females with some college education; mean age was 26.9 +/- 10.4 years. Test-retest reliability and internal consistency. Spearman's rank correlation coefficients to estimate test-retest reliability and Cronbach alpha coefficients to estimate internal consistency. Spearman's rank correlation coefficient for ecSI total score was 0.68; subscale coefficients were 0.70 for eating attitudes, 0.70 for contextual skills, 0.65 for food acceptance, and 0.52 for internal regulation. Cronbach alpha coefficient for ecSI total score was 0.77. Subscale alphas coefficients were 0.80 for eating attitudes, 0.69 for contextual skills, 0.68 for food acceptance, and 0.66 for internal regulation. This study provides psychometric evidence about the reliability of ecSI as a measure of eating competence in this sample. Although some ecSI items may require revision, results suggest that the instrument may be used to evaluate nutrition education designed to improve eating competence.

A Chinese Mandarin translation and validation of the Myocardial Infarction Dimensional Assessment Scale (MIDAS).

PubMed

Wang, W; Lopez, V; Thompson, D R

2006-09-01

To evaluate the validity, reliability, and cultural relevance of the Chinese Mandarin version of Myocardial Infarction Dimensional Assessment Scale (MIDAS) as a disease-specific quality of life measure. The cultural relevance and content validity of the Chinese Mandarin version of the MIDAS (CM-MIDAS) was evaluated by an expert panel. Measurement performance was tested on 180 randomly selected Chinese MI patents. Thirty participants from the primary group completed the CM-MIDAS for test-retest reliability after 2 weeks. Reliability, validity and discriminatory power of the CM-MIDAS were calculated. Two items were modified as suggested by the expert panel. The overall CM-MIDAS had acceptable internal consistency with Cronbach's alpha coefficient 0.93 for the scale and 0.71-0.94 for the seven domains. Test-retest reliability by intraclass correlations was 0.85 for the overall scale and 0.74-0.94 for the seven domains. There was acceptable concurrent validity with significant (p < 0.05) correlations between the CM-MDAS and the Chinese Version of the Short Form 36. The principal components analysis extracted seven factors that explained 67.18% of the variance with high factor loading indicating good construct validity. Empirical data support CM-MIDAS as a valid and reliable disease-specific quality of life measure for Chinese Mandarin speaking patients with myocardial infarction.

Development of a short form of the Japanese version of the Interpersonal Relationship Inventory.

PubMed

Sumi, Katsunori

2009-10-01

The Interpersonal Relationship Inventory (Tilden, Nelson, & May, 1990a) is a 39-item self-report measure to assess three aspects (support, reciprocity, and conflict) of perceived social relationships. In this research, short forms of the Japanese version (Sumi, 2003) of the inventory were developed on the basis of data from two sources. For the item selection, data from 340 Japanese college students (148 women, 192 men; M age = 21.6 yr., SD = 1.6) who completed the original full form of the inventory were used to create three internally consistent short forms. The reliability and construct validity of the short forms were examined upon administering them to among 513 college students (226 women, 287 men; M age =19.9 yr., SD = 1.4). All the subscales of the short forms had acceptable internal consistency (alphas = .70-.90) and test-retest reliability (rs = .72-.81). Confirmatory factor analysis of each short form supported the fact that each form had a three-factor structure. Scores on the subscales shared acceptable overlapping variance with the corresponding subscale scores of the original full form, and these scores were weakly but significantly correlated with the scores for satisfaction with social support, loneliness, and perceived stress. All the short forms had acceptable reliability and construct validity.

Standardization of the Gordon Primary Measures of Music Audiation in Greece

ERIC Educational Resources Information Center

Stamou, Lelouda; Schmidt, Charles P.; Humphreys, Jere T.

2010-01-01

The purpose of this study was to standardize the Primary Measures of Music Audiation in Greece ( N = 1,188). Split-halves reliability was acceptable across grade levels (K through 3) for the Tonal and Rhythm subtests, but test-retest reliability was generally unacceptable, especially for the Rhythm subtest. Concurrent validity was mixed, with…

NASA program decisions using reliability analysis.

NASA Technical Reports Server (NTRS)

Steinberg, A.

1972-01-01

NASA made use of the analytical outputs of reliability people to make management decisions on the Apollo program. Such decisions affected the amount of the incentive fees, how much acceptance testing was necessary, how to optimize development testing, whether to approve engineering changes, and certification of flight readiness. Examples of such analysis are discussed and related to programmatic decisions.-

Reproducibility of the exponential rise technique of CO(2) rebreathing for measuring P(v)CO(2) and C(v)CO(2 )to non-invasively estimate cardiac output during incremental, maximal treadmill exercise.

PubMed

Cade, W Todd; Nabar, Sharmila R; Keyser, Randall E

2004-05-01

The purpose of this study was to determine the reproducibility of the indirect Fick method for the measurement of mixed venous carbon dioxide partial pressure (P(v)CO(2)) and venous carbon dioxide content (C(v)CO(2)) for estimation of cardiac output (Q(c)), using the exponential rise method of carbon dioxide rebreathing, during non-steady-state treadmill exercise. Ten healthy participants (eight female and two male) performed three incremental, maximal exercise treadmill tests to exhaustion within 1 week. Non-invasive Q(c) measurements were evaluated at rest, during each 3-min stage, and at peak exercise, across three identical treadmill tests, using the exponential rise technique for measuring mixed venous PCO(2) and CCO(2) and estimating venous-arterio carbon dioxide content difference (C(v-a)CO(2)). Measurements were divided into measured or estimated variables [heart rate (HR), oxygen consumption (VO(2)), volume of expired carbon dioxide (VCO(2)), end-tidal carbon dioxide (P(ET)CO(2)), arterial carbon dioxide partial pressure (P(a)CO(2)), venous carbon dioxide partial pressure ( P(v)CO(2)), and C(v-a)CO(2)] and cardiorespiratory variables derived from the measured variables [Q(c), stroke volume (V(s)), and arteriovenous oxygen difference ( C(a-v)O(2))]. In general, the derived cardiorespiratory variables demonstrated acceptable (R=0.61) to high (R>0.80) reproducibility, especially at higher intensities and peak exercise. Measured variables, excluding P(a)CO(2) and C(v-a)CO(2), also demonstrated acceptable (R=0.6 to 0.79) to high reliability. The current study demonstrated acceptable to high reproducibility of the exponential rise indirect Fick method in measurement of mixed venous PCO(2) and CCO(2) for estimation of Q(c) during incremental treadmill exercise testing, especially at high-intensity and peak exercise.

Psychometric properties of neural responses to monetary and social rewards across development.

PubMed

Ethridge, Paige; Weinberg, Anna

2018-02-02

Reward-related event-related potentials (ERPs) are often used to index individual differences that signal the presence or predict the onset of psychopathology. However, relatively little research has explored the psychometric properties of reward-related ERPs. Without understanding their psychometric properties, the value of using ERPs as biomarkers for psychopathology is limited. The present study, therefore, sought to establish the internal consistency reliability and convergent validity of the reward positivity (RewP) and feedback negativity (FN) elicited by two types of incentives commonly used in individual differences research - monetary and social rewards. A large, developmentally-diverse sample completed a forced-choice guessing task in which they won or lost money, as well as a social interaction task in which they received acceptance and rejection feedback. Data were analyzed at both Cz and at a frontocentral region of interest (ROI) using techniques derived from classical test theory and generalizability theory. Results demonstrated good to excellent internal consistency of the RewP and FN within 20 trials in both tasks, in addition to convergent validity between the two tasks. Results from a regression-based approach to isolating activity specific to a single response demonstrated acceptable to good internal consistency within 20 trials in both tasks, while a subtraction-based approach (∆RewP) did not achieve acceptable internal consistency in either task. Internal consistency was not moderated by age and did not differ between Cz and the frontocentral ROI; however, the magnitudes of the RewP and FN were significantly associated with age at Cz but not at the ROI. This work replicates previous studies demonstrating good psychometric properties of the monetary RewP/FN and provides novel information about the psychometric properties of the social RewP/FN. These data support the use of reward-related ERPs elicited by multiple reward types in studies of biomarkers of psychopathology. Copyright © 2018 Elsevier B.V. All rights reserved.

Psychometric evaluation of the ostomy complication severity index.

PubMed

Pittman, Joyce; Bakas, Tamilyn; Ellett, Marsha; Sloan, Rebecca; Rawl, Susan M

2014-01-01

The purpose of this study was to evaluate the psychometric properties of a new instrument to measure incidence and severity of ostomy complications early in the postoperative period. 71 participants were enrolled, most were men (52%), white (96%), and married or partnered (55%). The mean age of participants was 57 ± 15.09 years (mean ± SD). Fifty-two participants (84%) experienced at least 1 ostomy complication in the 60-day postoperative period. The research setting was 3 acute care settings within a large healthcare system in the Midwestern United States. We developed an evidence-based conceptual model to guide development and evaluation of a new instrument, the Pittman Ostomy Complication Severity Index (OCSI). The OCSI format includes Likert-like scale with 9 individual items scored 0 to 3 and a total score computed by summing the individual items. Higher scores indicate more severe ostomy complications. This study consisted of 2 phases: (1) an expert review, conducted to establish content validity; and (2) a prospective, longitudinal study design, to examine psychometric properties of the instrument. A convenience sample of 71 adult patients who underwent surgery to create a new fecal ostomy was recruited from 3 hospitals. Descriptive analyses, content validity indices, interrater reliability testing, and construct validity testing were employed. Common complications included leakage (60%), peristomal moisture-associated dermatitis (50%), stomal pain (42%), retraction (39%), and bleeding (32%). The OCSI demonstrated acceptable evidence of content validity index (CVI = 0.9) and interrater reliability for individual items (k = 0.71-1.0), as well as almost perfect agreement for total scores among raters (ICC = 0.991, P ≤ .001). Construct validity of the OCSI was supported by significant correlations among variables in the conceptual model (complications, risk factors, stoma care self-efficacy, and ostomy adjustment). OCSI demonstrated acceptable validity and reliability and can be used to assess incidence and severity of ostomy complications in the early postoperative period. We found the OCSI to be brief, easy-to-use, and clinically practical. It can be used to (a) identify priority areas for nursing intervention related to the ostomy, (b) determine appropriate interventions to prevent or treat complications, and (c) evaluate the effects of nursing interventions designed to improve outcomes for patients with ostomies.

The reliability of psychiatric diagnosis in the emergency room.

PubMed

Lieberman, P B; Baker, F M

1985-03-01

The authors compared the diagnoses made for 50 patients in an emergency room with those made during a subsequent inpatient hospitalization. They found an acceptable level of reliability for broad diagnostic categories, such as psychosis, depression, and alcoholism. The authors believe such diagnostic reliability is sufficient for emergency assessment and triage. However, the diagnosis of more specific subtypes of mental illness, such as schizophrenia and bipolar disorder, were not made reliably in the emergency room. The authors point out the risk of diagnostic labeling, and suggest that the tendency to overlook nonalcoholic substance abuse deserves special attention.

Establishing inter-rater reliability scoring in a state trauma system.

PubMed

Read-Allsopp, Christine

2004-01-01

Trauma systems rely on accurate Injury Severity Scoring (ISS) to describe trauma patient populations. Twenty-seven (27) Trauma Nurse Coordinators and Data Managers across the state of New South Wales, Australia trauma network were instructed in the uses and techniques of the Abbreviated Injury Scale (AIS) from the Association for the Advancement of Automotive Medicine. The aim is to provide accurate, reliable and valid data for the state trauma network. Four (4) months after the course a coding exercise was conducted to assess inter-rater reliability. The results show that inter-rater reliability is with accepted international standards.

[Multiple mini interviews before the occupation of main training posts in paediatrics].

PubMed

Hertel, Niels Thomas; Bjerager, Mia; Boas, Malene; Boisen, Kirsten A; Børch, Klaus; Frederiksen, Marianne Sjølin; Holm, Kirsten; Grum-Nymann, Anette; Johnsen, Martin M; Whitehouse, Stine; Balslev, Thomas

2013-09-09

Interviews are mandatory in Denmark when selecting doctors for training positions. We used multiple mini interviews (MMI) at four recruitment rounds for the main training posts in paediatrics. In total, 125 candidates were evaluated and assessed by CV and MMI (4-5 stations). Reliability for individual stations in MMI assessed by Cronbach's alpha was adequate (0.63-0.92). The overall reliability assessed by G-theory was lower, suggesting that different skills were tested. The acceptability was high. Our experiences with MMI suggest good feasibility and reliability. An increasing number of stations may improve the overall reliability.

Communication latencies of wireless devices suitable for time-critical messaging to anesthesia providers.

PubMed

Epstein, Richard H; Dexter, Franklin; Rothman, Brian

2013-04-01

Rapid and reliable methods of text communication to mobile anesthesia care providers are important to patient care and to efficient operating room management. Anesthesia departments are implementing automated methods to send text messages to mobile devices for abnormal vital signs, clinical recommendations, quality of care, and compliance or billing issues. The most time-critical communications determine maximum acceptable latencies. We studied the reliability of several alphanumeric messaging systems to identify an appropriate technology for such use. Latencies between message initiation and delivery to 3 alphanumeric paging devices were measured over weeks. Two devices used Internet pathways outside the hospital's local network with an external paging vendor (SkyTel). The third device used only the internal hospital network (Zetron). Sequential cell phone text page latencies were examined for lag-1 autocorrelation using the runs test, with results binned by hour and by day. Message latencies subsequently were batched in successive 1-week bins for calculation of the mean and 99th percentiles of latencies. We defined acceptance criteria as a mean latency <30 seconds and no more than 1 in 200 pages (0.5%) having a latency longer than 100 seconds. Cell phone texting was used as a positive control to assure that the analysis was appropriate, because such devices have (known) poor reliability during high network activity. There was substantial correlation among latencies for sequential cell phone text messages when binned by hours (P < 0.0001), but not by days (P = 0.61). The 2 devices using Internet pathways outside the hospital's network demonstrated unacceptable performance, with 1.3% and 33% of latencies exceeding 100 seconds, respectively. The device dependent only on the internal network had a mean latency of 8 seconds, with 100% of 40,200 pages having latencies <100 seconds. The findings suggest that the network used was the deciding factor. Developers of anesthesia communication systems need to measure latencies of proposed communication pathways and devices used to deliver urgent messages to mobile users. Similar evaluation is relevant for text pagers used on an ad hoc basis for delivery of time-critical notifications. Testing over a period of hours to days is adequate only for disqualification of a candidate paging system, because acceptable results are not necessarily indicative of long-term performance. Rather, weeks of testing are required, with appropriate batching of pages for analysis.

Studying the Hurdles of Insulin Prescription (SHIP©): development, scoring and initial validation of a new self-administered questionnaire

PubMed Central

Martinez, Luc; Consoli, Silla M; Monnier, Louis; Simon, Dominique; Wong, Olivier; Yomtov, Bernard; Guéron, Béatrice; Benmedjahed, Khadra; Guillemin, Isabelle; Arnould, Benoit

2007-01-01

Background Although insulin therapy is well-accepted by symptomatic diabetic patients, it is still often delayed in less severe patients, in whom injectable insulin remains under-used. A better understanding of patients' perception of insulin would eventually help physicians to adopt the most appropriate dialogue when having to motivate patients to initiate or to intensify insulin injection. Methods The 'Studying the Hurdles of Insulin Prescription' (SHIP) questionnaire was developed based on a list of concepts derived from three diabetic patients' focus groups, and was included into two cross-sectional studies with similar design: SHIP Oral study and SHIP Premix study. Diabetic patients treated with oral hypoglycaemic agents (OHA; n = 1,494) and patients already treated with insulin (n = 1,150) completed the questionnaire at baseline, 6- and 12 months. Psychometric properties were assessed: 1) structure analysis by Principal Component Analysis (PCA) with Varimax rotation, 2) internal consistency reliability (Cronbach's alpha), and 3) concurrent validity (Spearman correlation coefficients with the Fear of Self-Injecting (FSI) score of the Diabetes Fear of Injecting and Self-testing Questionnaire. Reluctance/motivation towards insulin was assessed. Scores' ability to predict patients' insulin injection reluctance/motivation and initiation/intensification was evaluated with the Area Under the Receiver Operating Characteristic (ROC) Curve (AUC). Results PCA analysis confirmed the structure of the 14 items grouped into 3 dimensions: 'acceptance and motivation', 'fear and constraints', and 'restraints and barriers' towards insulin injection. Internal consistency reliability was excellent (Cronbach's alpha > 0.70); concurrent validity was good. The three scores were significantly predictive of patients' reluctance/motivation towards insulin injection initiation, as they were of patients' actual switch, except for the 'restraints and barriers' dimension. 'Acceptance and motivation' and 'fears and constraints' dimensions were also significantly predictive of patients' reluctance/motivation towards insulin intensification. By the end of the 12-month study, 179 of the initially OHA-treated patients had started insulin injections; 186 of the patients already treated with insulin had increased their injections. Conclusion The SHIP questionnaire provides reliable and valid assessment of diabetic patients' attitude towards insulin and injections. The predictive power of scores for patients' reluctance/motivation and actual treatment decisions demonstrates encouraging potential for further application in clinical practice. PMID:17727695

Dutch Translation and Psychometric Testing of the 9-Item Shared Decision Making Questionnaire (SDM-Q-9) and Shared Decision Making Questionnaire-Physician Version (SDM-Q-Doc) in Primary and Secondary Care

PubMed Central

Rodenburg-Vandenbussche, Sumayah; Pieterse, Arwen H.; Kroonenberg, Pieter M.; Scholl, Isabelle; van der Weijden, Trudy; Luyten, Gre P. M.; Kruitwagen, Roy F. P. M.; den Ouden, Henk; Carlier, Ingrid V. E.; van Vliet, Irene M.; Zitman, Frans G.; Stiggelbout, Anne M.

2015-01-01

Purpose The SDM-Q-9 and SDM-Q-Doc measure patient and physician perception of the extent of shared decision making (SDM) during a physician-patient consultation. So far, no self-report instrument for SDM was available in Dutch, and validation of the scales in other languages has been limited. The aim of this study was to translate both scales into Dutch and assess their psychometric characteristics. Methods Participants were patients and their treating physicians (general practitioners and medical specialists). Patients (N = 182) rated their consultation using the SDM-Q-9, 43 physicians rated their consultations using the SDM-Q-Doc (N = 201). Acceptability, reliability (internal consistency), and the factorial structure of the instruments were determined. For convergent validity the CPSpost was used. Results Reliabilities of both scales were high (alpha SDM-Q-9 0.88; SDM-Q-Doc 0.87). The SDM-Q-9 and SDM-Q-Doc total scores correlated as expected with the CPSpost (SDM-Q-9: r = 0.29; SDM-Q-Doc: r = 0.48) and were significantly different between the CPSpost categories, with lowest mean scores when the physician made the decision alone. Principal Component Analyses showed a two-component model for each scale. A confirmatory factor analysis yielded a mediocre, but acceptable, one-factor model, if Item 1 was excluded; for both scales the best indices of fit were obtained for a one-factor solution, if both Items 1 and 9 were excluded. Conclusion The Dutch SDM-Q-9 and SDM-Q-Doc demonstrate good acceptance and reliability; they correlated as expected with the CPSpost and are suitable for use in Dutch primary and specialised care. Although the best model fit was found when excluding Items 1 and 9, we believe these items address important aspects of SDM. Therefore, also based on the coherence with theory and comparability with other studies, we suggest keeping all nine items of the scale. Further research on the SDM-concept in patients and physicians, in different clinical settings and different countries, is necessary to gain a better understanding of the SDM-construct and its measurement. PMID:26151946

An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures.

PubMed

Ponterotto, Joseph G; Ruckdeschel, Daniel E

2007-12-01

The present article addresses issues in reliability assessment that are often neglected in psychological research such as acceptable levels of internal consistency for research purposes, factors affecting the magnitude of coefficient alpha (alpha), and considerations for interpreting alpha within the research context. A new reliability matrix anchored in classical test theory is introduced to help researchers judge adequacy of internal consistency coefficients with research measures. Guidelines and cautions in applying the matrix are provided.

Turkish version of the Academic Motivation Scale.

PubMed

Can, Gürhan

2015-04-01

The purpose of this study was to adapt the college version of the Academic Motivation Scale (AMS) into Turkish. The participants were 797 college students (437 men, 360 women) with a mean age of 20.1 yr. A seven-factor model of the scale, as well as alternative models (five-, three-, two-, and one-factor models) were investigated and compared through confirmatory factor analysis. The seven-factor model demonstrated adequate fit to the data. The fit indices obtained from the five-factor model were acceptable also. Hancock's coefficient H values and test-retest correlation coefficients of the subscales indicated that reliability of the scale was adequate except for the identified regulation subscale. The CFA conducted for the groups of men and women produced more acceptable fit indices values for men than women, but women obtained significantly higher scores from the AMS subscales. Correlations among the seven subscales partially supported the simplex pattern which claims that the neighboring subscales should have stronger positive correlations than the non-neighboring subscales and that the subscales which are the farthest apart should have the strongest negative relationships.

Melt inclusions come of age: Volatiles, volcanoes, and sorby's legacy

USGS Publications Warehouse

Lowenstern, J. B.

2003-01-01

Despite nearly forty years of modern research on silicate melt inclusions (MI), only within the past 10-15 years have volcanologists and petrologists come to regularly accept their utility for characterizing magmatic systems. Their relatively slow acceptance was likely due to a number of factors including: 1) Lack of reliable analytical techniques, 2) Concern that MI represent anomalous boundary-layer melts or are altered by leakage or post-entrapment crystallization, 3) Data sets indicative of heterogeneous melts and, 4) Homogenization temperatures greater than those calculated by other techniques. With improvements in analytical methods and careful studies of MI systematics, workers are increasingly convinced of the utility of these features to unravel the complexities of volcanic systems: melt inclusions have "come of age." Recent studies provide compelling evidence for the compositions of dissolved and exsolved volatiles in magma reservoirs. Evidence for immiscibility of gases, hydrosaline brines and pegmatitic fluids demonstrate that magmatic phase relations are often more complicated than can be inferred by inspection of crystalline phases alone. ?? 2003 Elsevier B.V. All rights reserved.

Development and Application of a New Learning Object for Teaching Operative Dentistry Using Augmented Reality.

PubMed

Espejo-Trung, Luciana Cardoso; Elian, Silvia Nagib; Luz, Maria Aparecia Alves De Cerqueira

2015-11-01

Learning objects (LOs) associated with augmented reality have been used as attractive new technologic tools in the educational process. However, the acceptance of new LOs must be verified with the purpose of using these innovations in the learning process in general. The aim of this study was to develop a new LO and investigate the acceptance of gold onlay in teaching preparation design at a dental school in Brazil. Questionnaires were designed to assess, first, the users' computational ability and knowledge of computers (Q1) and, second, the users' acceptance of the new LO (Q2). For both questionnaires, the internal consistency index was calculated to determine whether the questions were measuring the same construct. The reliability of Q2 was measured with a retest procedure. The LO was tested by dental students (n=28), professors and postgraduate students in dentistry and prosthetics (n=30), and dentists participating in a continuing education or remedial course in dentistry and/or prosthetics (n=19). Analyses of internal consistency (Kappa coefficient and Cronbach's alpha) demonstrated a high degree of confidence in the questionnaires. Tests for simple linear regressions were conducted between the response variable (Q2) and the following explanative variables: the Q1 score, age, gender, and group. The results showed wide acceptance regardless of the subjects' computational ability (p=0.99; R2=0), gender (p=0.27; R2=1.6%), age (p=0.27; R2=0.1%), or group (p=0.53; R2=1.9%). The methodology used enabled the development of an LO with a high index of acceptance for all groups.

Technical Adequacy of the easyCBM[R] Mathematics Measures: Grades 3-8, 2009-2010 Version. Technical Report #1007

ERIC Educational Resources Information Center

Nese, Joseph F. T.; Lai, Cheng-Fei; Anderson, Daniel; Jamgochian, Elisa M.; Kamata, Akihito; Saez, Leilani; Park, Bitnara J.; Alonzo, Julie; Tindal, Gerald

2010-01-01

In this technical report, data are presented on the practical utility, reliability, and validity of the easyCBM[R] mathematics (2009-2010 version) measures for students in grades 3-8 within four districts in two states. Analyses include: minimum acceptable within-year growth; minimum acceptable year-end benchmark performance; internal and…

Factor Structure and Reliability of the Dutch Version of Seven Scales of the Communication Profile for the Hearing Impaired (CPHI)

ERIC Educational Resources Information Center

Mokkink, Lidwine B.; Knol, Dirk L.; Zekveld, Adriana A.; Goverts, S. Theo; Kramer, Sophia E.

2009-01-01

Purpose: Seven scales of the Communication Profile for the Hearing Impaired (CPHI; M. E. Demorest & S. A. Erdman, 1987) were translated into Dutch: Maladaptive Behavior, Verbal Strategies, and Nonverbal Strategies (within the area of Communication Strategies) and Self-Acceptance, Acceptance of Loss, Stress, and Withdrawal (within the area of…

Nurses' assessments and patients' perceptions: development of the Night Nursing Care Instrument (NNCI), measuring nursing care at night.

PubMed

Johansson, Peter; Oléni, Magnus; Fridlund, Bengt

2005-07-01

Nursing care provided at night has a different purpose and objective to that provided during the day. A review of the literature does not reveal any scientifically tested research instruments for evaluating and comparing the nurse's assessment of nursing care with the patient's perception at night. The aim of this study was to develop and test an instrument for evaluating nursing care and to compare nurses' assessments with patients' perceptions of nursing care provided at night. The study was carried out in two phases; the first had an explorative design and the second an evaluative and comparative design. The Night Nursing Care Instrument (NNCI) included two questionnaires; one for nurses and one for patients. These questionnaires were developed from a nursing framework and covered the following three areas: 'nursing interventions', 'medical interventions' and 'evaluation'. Nurses (n = 40) on night duty on a medical ward at a central hospital in southern Sweden were consecutively selected, to participate in the study. The patients (n = 80) were selected by means of convenience sampling. In order to achieve construct validity, factor analysis of each individual area was carried out. Reliability in terms of internal consistency was tested by Cronbach's alpha. The overall NNCI had acceptable reliability and validity. There was no statistically significant difference between nurses' assessments and patients' perceptions in any of the three areas of 'nursing interventions', 'medical interventions' or 'evaluation'. The patients rated night nursing care as satisfactory for the majority of the items. These findings demonstrate that it is possible to create a short instrument with acceptable reliability and validity, which is easy to use in clinical practice. The results also show that night nurses need to improve their ability to assess patients' needs during the night to increase the quality of night nursing care.

Validation of the Kohnen Restless Legs Syndrome-Quality of Life instrument.

PubMed

Kohnen, Ralf; Martinez-Martin, Pablo; Benes, Heike; Trenkwalder, Claudia; Högl, Birgit; Dunkl, Elmar; Walters, Arthur S

2016-08-01

Due to the symptoms and the sleep disturbances it causes, Restless Legs Syndrome (RLS) has a negative impact on quality of life. Measurement of such impact can be performed by means of questionnaires, such as the Kohnen Restless Legs Syndrome-Quality of Life questionnaire (KRLS-QoL), a specific 12-item instrument that is self-applied by patients. The present study is aimed at performing a first formal validation study of this instrument. Eight hundred ninety-one patients were included for analysis. RLS severity was assessed by the International Restless Legs Scale (IRLS), Restless Legs Syndrome-6 scales (RLS-6), and Clinical Global Impression of Severity. In addition the Epworth Sleepiness Scale (ESS) was assessed. Acceptability, dimensionality, scaling assumptions, reliability, precision, hypotheses-related validity, and responsiveness were tested. There were missing data in 3.58% patients. Floor and ceiling effects were low for the subscales, global evaluation, and summary index derived from items 1 to 11 after checking that scaling assumptions were met. Exploratory parallel factor analysis showed that the KRLS-QoL may be deemed unidimensional, ie, that all components of the scale are part of one overall general quality of life factor. Indexes of internal consistency (alpha = 0.88), item-total correlation (r S  = 0.32-0.71), item homogeneity coefficient (0.41), and scale stability (ICC = 0.73) demonstrated a satisfactory reliability of the KRLS-QoL. Moderate or high correlations were obtained between KRLS-QoL scores and the IRLS, some components of the RLS-6, inter-KRLS-QoL domains, and global evaluations. Known-groups validity for severity levels grouping and responsiveness analysis results were satisfactory, the latter showing higher magnitudes of response for treated than for placebo arms. The KRLS-QoL was proven an acceptable, reliable, valid, and responsive measure to assess the impact of the RLS on quality of life. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Psychometric evaluation of ADAS-Cog and NTB for measuring drug response.

PubMed

Karin, A; Hannesdottir, K; Jaeger, J; Annas, P; Segerdahl, M; Karlsson, P; Sjögren, N; von Rosen, T; Miller, F

2014-02-01

To conduct a psychometric analysis to determine the adequacy of instruments that measure cognition in Alzheimer's disease trials. Both the Alzheimer's Disease Assessment Scale - Cognition (ADAS-Cog) and the Neuropsychological Test Battery (NTB) are validated outcome measures for clinical trials in Alzheimer's disease and are approved also for regulatory purposes. However, it is not clear how comparable they are in measuring cognitive function. In fact, many recent trials in Alzheimer's disease patients have failed and it has been questioned if ADAS-Cog still is a sensitive measure. The present paper examines the psychometric properties of ADAS-Cog and NTB, based on a post hoc analysis of data from a clinical trial (NCT01024660), which was conducted by AstraZeneca, in mild-to-moderate Alzheimer's disease (AD) patients, with a Mini Mental State Examination (MMSE) Total score 16-24. Acceptability, reliability, different types of validity and ability to detect change were assessed using relevant statistical methods. Total scores of both tests, as well as separate domains of both tests, including the Wechsler Memory Scale (WMS), Rey Auditory Verbal Learning Test (RAVLT) and Delis-Kaplan Executive Function System (D-KEFS) Verbal Fluency Condition, were analyzed. Overall, NTB performed well, with acceptable reliability and ability to detect change, while ADAS-Cog had insufficient psychometric properties, including ceiling effects in 8 out of a total of 11 ADAS-Cog items in mild AD patients, as well as low test-retest reliability in some of the items. Based on a direct comparison on the same patient sample, we see advantages of the NTB compared with the ADAS-Cog for the evaluation of cognitive function in the population of mild-to-moderate AD patients. The results suggest that not all of ADAS-Cog items are relevant for both mild and moderate AD population. This validation study demonstrates satisfactory psychometric properties of the NTB, while ADAS-Cog was found to be psychometrically inadequate. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Development and psychometric validation of a self-administered questionnaire assessing the acceptance of influenza vaccination: the Vaccinees' Perception of Injection (VAPI©) questionnaire

PubMed Central

Chevat, Catherine; Viala-Danten, Muriel; Dias-Barbosa, Carla; Nguyen, Van Hung

2009-01-01

Background Influenza is among the most common infectious diseases. The main protection against influenza is vaccination. A self-administered questionnaire was developed and validated for use in clinical trials to assess subjects' perception and acceptance of influenza vaccination and its subsequent injection site reactions (ISR). Methods The VAPI questionnaire was developed based on interviews with vaccinees. The initial version was administered to subjects in international clinical trials comparing intradermal with intramuscular influenza vaccination. Item reduction and scale construction were carried out using principal component and multitrait analyses (n = 549). Psychometric validation of the final version was conducted per country (n = 5,543) and included construct and clinical validity and internal consistency reliability. All subjects gave their written informed consent before being interviewed or included in the clinical studies. Results The final questionnaire comprised 4 dimensions ("bother from ISR"; "arm movement"; "sleep"; "acceptability") grouping 16 items, and 5 individual items (anxiety before vaccination; bother from pain during vaccination; satisfaction with injection system; willingness to be vaccinated next year; anxiety about vaccination next year). Construct validity was confirmed for all scales in most of the countries. Internal consistency reliability was good for all versions (Cronbach's alpha ranging from 0.68 to 0.94), as was clinical validity: scores were positively correlated with the severity of ISR and pain. Conclusion The VAPI questionnaire is a valid and reliable tool, assessing the acceptance of vaccine injection and reactions following vaccination. Trial registration NCT00258934, NCT00383526, NCT00383539. PMID:19261173

Reliability and Validity of an Internet-based Questionnaire Measuring Lifetime Physical Activity

PubMed Central

De Vera, Mary A.; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-01-01

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005–2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity. PMID:20876666

Reliability and discriminative validity of sudden ankle inversion measurements in patients with chronic ankle instability.

PubMed

Eechaute, Christophe; Vaes, Peter; Duquet, William; Van Gheluwe, Bart

2009-07-01

Studies investigating peroneal muscle reaction times in chronically unstable ankle joints present conflicting results. The degree of reliability and accuracy of these measurements is unknown in patients with chronic ankle instability (CAI). 40 patients with CAI and 30 healthy subjects were tested using a sudden ankle inversion of 50 degrees while standing on a trapdoor device. Sudden ankle inversion measurements were registered using electromyography, accelerometry and electrogoniometry. For reliability testing, intra-class coefficients (ICCs; model 3,1) and standard errors of measurements of the latency time, motor response time and electromechanical delay of the peroneus longus muscle, the time and angular position of onset of decelerations, the mean and maximum inversion speed and the total inversion time were calculated in 15 patients with CAI. To assess between-group differences, t-tests for independent samples (p<.05) were used. ICCs ranged from .20 (angular position of onset of the second deceleration) to .98 (electromechanical delay of the peroneus longus muscle). Significant between-group differences were observed in only 2 of the 12 variables (for the electromechanical delay of the peroneus longus muscle, p=.001; time of onset of the second deceleration, p=.040). The latency time and motor response time of the peroneus longus muscle, the total inversion time and the mean inversion speed demonstrate acceptable reliability in healthy subjects and patients. The latency time and motor response time of the peroneus longus muscle are not delayed in patients with CAI. Ankle inversion measurements are not discriminative for CAI.

Reliability and validity of an internet-based questionnaire measuring lifetime physical activity.

PubMed

De Vera, Mary A; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-11-15

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005-2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity.

Assessing shyness in Chinese older adults.

PubMed

Chou, Kee-Lee

2005-09-01

The Shyness Scale (SS) is a brief instrument for assessing shyness as a personality trait. The psychometric properties of the Chinese version of the SS were investigated in a random sample of 192 Macau Chinese older adults. The Chinese version of the SS possesses high internal consistency and exhibited satisfactory short-term test-retest reliability. The Chinese version of the SS exhibited acceptable convergent validity with other negative measures of psychological well-being including negative emotional states (assessed by the Negative Affect Scale), loneliness (assessed by the UCLA Loneliness Scale), and state anxiety and trait anxiety (assessed by STAI). The divergent validity of the Chinese version of the SS was demonstrated by the negative but significant association between the SS and self esteem (assessed by Rosenberg Self Esteem Inventory).

Unsteady three-dimensional thermal field prediction in turbine blades using nonlinear BEM

NASA Technical Reports Server (NTRS)

Martin, Thomas J.; Dulikravich, George S.

1993-01-01

A time-and-space accurate and computationally efficient fully three dimensional unsteady temperature field analysis computer code has been developed for truly arbitrary configurations. It uses boundary element method (BEM) formulation based on an unsteady Green's function approach, multi-point Gaussian quadrature spatial integration on each panel, and a highly clustered time-step integration. The code accepts either temperatures or heat fluxes as boundary conditions that can vary in time on a point-by-point basis. Comparisons of the BEM numerical results and known analytical unsteady results for simple shapes demonstrate very high accuracy and reliability of the algorithm. An example of computed three dimensional temperature and heat flux fields in a realistically shaped internally cooled turbine blade is also discussed.

The 200-kilowatt wind turbine project

NASA Technical Reports Server (NTRS)

1978-01-01

The three 200 kilowatt wind turbines described, compose the first of three separate systems. Proposed wind turbines of the two other systems, although similar in design, are larger in both physical size and rated power generation. The overall objective of the project is to obtain early operation and performance data while gaining initial experience in the operation of large, horizontal-axis wind turbines in typical utility environments. Several of the key issues addressed include the following: (1) impact of the variable power output (due to varying wind speeds) on the utility grid (2) compatibility with utility requirements (voltage and frequency control of generated power) (3) demonstration of unattended, fail-safe operation (4) reliability of the wind turbine system (5) required maintenance and (6) initial public reaction and acceptance.

Simple go/no-go test for subcritical damage in body armor panels

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fisher, Jason; Chimenti, D. E.

2011-06-23

The development of a simple test for subcritical damage in body armor panels using pressure-sensitive dye-indicator film has been performed and demonstrated effective. Measurements have shown that static indicator levels are accurately reproduced in dynamic loading events. Impacts from hard blunt impactors instrumented with an accelerometer and embedded force transducer were studied. Reliable correlations between the indicator film and instrumented impact force are shown for a range of impact energies. Force and acceleration waveforms with corresponding indicator film results are presented for impact events onto damaged and undamaged panels. We find that panel damage can occur at impact levels farmore » below the National Institute of Justice acceptance test standard.« less

New Horizons for Ninhydrin: Colorimetric Determination of Gender from Fingerprints.

PubMed

Brunelle, Erica; Huynh, Crystal; Le, Anh Minh; Halámková, Lenka; Agudelo, Juliana; Halámek, Jan

2016-02-16

In the past century, forensic investigators have universally accepted fingerprinting as a reliable identification method via pictorial comparison. One of the most traditional detection methods uses ninhydrin, a chemical that reacts with amino acids in the fingerprint content to produce the blue-purple color known as Ruhemann's purple. It has recently been demonstrated that the amino acid content in fingerprints can be used to differentiate between male and female fingerprints. Here, we present a modified approach to the traditional ninhydrin method. This new approach for using ninhydrin is combined with an optimized extraction protocol and the concept of determining gender from fingerprints. In doing so, we are able to focus on the biochemical material rather than exclusively the physical image.

Resilient Control Systems Practical Metrics Basis for Defining Mission Impact

DOE Office of Scientific and Technical Information (OSTI.GOV)

Craig G. Rieger

"Resilience” describes how systems operate at an acceptable level of normalcy despite disturbances or threats. In this paper we first consider the cognitive, cyber-physical interdependencies inherent in critical infrastructure systems and how resilience differs from reliability to mitigate these risks. Terminology and metrics basis are provided to integrate the cognitive, cyber-physical aspects that should be considered when defining solutions for resilience. A practical approach is taken to roll this metrics basis up to system integrity and business case metrics that establish “proper operation” and “impact.” A notional chemical processing plant is the use case for demonstrating how the system integritymore » metrics can be applied to establish performance, and« less

Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures

NASA Technical Reports Server (NTRS)

Bittner, A. C. Jr; Carter, R. C.; Kennedy, R. S.; Harbeson, M. M.; Krause, M.

1986-01-01

The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.

Psychometric evaluation of the Korean Version of the Self-Efficacy for Exercise Scale for older adults.

PubMed

Choi, Mona; Ahn, Sangwoo; Jung, Dukyoo

2015-01-01

We evaluated the psychometric properties of the Korean version of the Self-Efficacy for Exercise Scale (SEE-K). The SEE-K consists of nine items and was translated into Korean using the forward-backward translation method. We administered it to 212 community-dwelling older adults along with measures of outcome expectation for exercise, quality of life, and physical activity. The validity was determined using confirmatory factor analysis and Rasch analysis with INFIT and OUTFIT statistics, which showed acceptable model fit. The concurrent validity was confirmed according to positive correlations between the SEE-K, outcome expectation for exercise, and quality of life. Furthermore, the high physical activity group had higher SEE-K scores. Finally, the reliability of the SEE-K was deemed acceptable based on Cronbach's alpha, coefficients of determination, and person and item separation indices with reliability. Thus, the SEE-K appears to have satisfactory validity and reliability among older adults in South Korea. Copyright © 2015 Elsevier Inc. All rights reserved.

Development of an Instrument for Measuring Clinicians’ Power Perceptions in the Workplace

PubMed Central

Bartos, Christa E.; Fridsma, Douglas B.; Butler, Brian S.; Penrod, Louis E.; Becich, Michael J.; Crowley, Rebecca S.

2008-01-01

We report on the development of an instrument to measure clinicians’ perceptions of their personal power in the workplace in relation to resistance to computerized physician order entry (CPOE). The instrument is based on French and Raven’s six bases of social power and uses a semantic differential methodology. A measurement study was conducted to determine the reliability and validity of the survey. The survey was administered online and distributed via a URL by email to 19 physicians, nurses, and health unit coordinators from a university hospital. Acceptable reliability was achieved by removing or moving some semantic differential word pairs used to represent the six power bases (alpha range from 0.76–0.89). The Semantic Differential Power Perception (SDPP) survey validity was tested against an already validated instrument and found to be acceptable (correlation range from 0.51–0.81). The SDPP survey instrument was determined to be both reliable and valid. PMID:18375189

Reliability and Validity of the Alberta Context Tool (ACT) with Professional Nurses: Findings from a Multi-Study Analysis

PubMed Central

Squires, Janet E.; Hayduk, Leslie; Hutchinson, Alison M.; Mallick, Ranjeeta; Norton, Peter G.; Cummings, Greta G.; Estabrooks, Carole A.

2015-01-01

Although organizational context is central to evidence-based practice, underdeveloped measurement hindersitsassessment. The Alberta Context Tool, comprised of 59 items that tap10 modifiable contextual concepts, was developed to address this gap. The purpose of this study to examine the reliability and validity of scores obtained when the Alberta Context Tool is completed by professional nurses across different healthcare settings. Five separate studies (N = 2361 nurses across different care settings) comprised the study sample. Reliability and validity were assessed. Cronbach’s alpha exceeded 0.70 for9/10 Alberta Context Tool concepts. Item-total correlations exceeded acceptable standards for 56/59items. Confirmatory Factor Analysescoordinated acceptably with the Alberta Context Tool’s proposed latent structure. The mean values for each Alberta Context Tool concept increased from low to high levels of research utilization(as hypothesized) further supporting its validity. This study provides robust evidence forreliability and validity of scores obtained with the Alberta Context Tool when administered to professional nurses. PMID:26098857

Reliability of real-time ultrasound measurement of transversus abdominis thickness in healthy trained subjects.

PubMed

Gnat, Rafael; Saulicz, Edward; Miądowicz, Barbara

2012-08-01

To investigate intra- and inter-rater reliability of the ultrasound measurement of transversus abdominis (TrA) thickness and thickness change (difference between thickness at rest and during contraction) in asymptomatic, trained subjects. To define the number of repeated measurements that provide acceptable level of reliability. To investigate variability of the measurements over time of 5 days and the reliability of duplicate analysis of images. A single-group repeated-measures design was used to assess reliability. Healthy volunteers (n = 10) were subjected to 1-week training in voluntary activation of TrA. Real-time ultrasound imaging and subsequent measurement of the TrA thickness at rest and during voluntary contraction were repeated on Monday, Wednesday and Friday of the next week. Using a single repeated measurement, intraclass correlation coefficients (ICCs) for TrA thickness were: 0.86-0.95 (intra-rater), 0.86-0.92 (inter-rater); and for TrA thickness change: 0.34-0.56 (intra-rater), 0.47-0.61 (inter-rater). Using the mean of three repeated measurements respective values were: 0.97, 0.96-0.98; and 0.81-0.84, 0.80-0.90. No significant differences were found between mean values of TrA thickness as well as thickness change obtained on three consecutive measurement days. Duplicate analysis of the images was highly reliable with ICCs of 0.89-0.99. Two repeated measurements for TrA thickness and at least three measurements for TrA thickness change are needed to achieve acceptable levels of intra- and inter-rater reliability. In healthy trained volunteers TrA thickness and thickness change are relatively stable parameters over a 5-day period. Duplicate analysis of the same images by two blinded observers is reliable.

Reliability and validity of television food advertising questionnaire in Malaysia.

PubMed

Zalma, Abdul Razak; Safiah, Md Yusof; Ajau, Danis; Khairil Anuar, Md Isa

2015-09-01

Interventions to counter the influence of television food advertising amongst children are important. Thus, reliable and valid instrument to assess its effect is needed. The objective of this study was to determine the reliability and validity of such a questionnaire. The questionnaire was administered twice on 32 primary schoolchildren aged 10-11 years in Selangor, Malaysia. The interval between the first and second administration was 2 weeks. Test-retest method was used to examine the reliability of the questionnaire. Intra-rater reliability was determined by kappa coefficient and internal consistency by Cronbach's alpha coefficient. Construct validity was evaluated using factor analysis. The test-retest correlation showed moderate-to-high reliability for all scores (r = 0.40*, p = 0.02 to r = 0.95**, p = 0.00), with one exception, consumption of fast foods (r = 0.24, p = 0.20). Kappa coefficient showed acceptable-to-strong intra-rater reliability (K = 0.40-0.92), except for two items under knowledge on television food advertising (K = 0.26 and K = 0.21) and one item under preference for healthier foods (K = 0.33). Cronbach's alpha coefficient indicated acceptable internal consistency for all scores (0.45-0.60). After deleting two items under Consumption of Commonly Advertised Food, the items showed moderate-to-high loading (0.52, 0.84, 0.42 and 0.42) with the Scree plot showing that there was only one factor. The Kaiser-Meyer-Olkin was 0.60, showing that the sample was adequate for factor analysis. The questionnaire on television food advertising is reliable and valid to assess the effect of media literacy education on television food advertising on schoolchildren. © The Author (2013). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Alarms about structural alerts.

PubMed

Alves, Vinicius; Muratov, Eugene; Capuzzi, Stephen; Politi, Regina; Low, Yen; Braga, Rodolpho; Zakharov, Alexey V; Sedykh, Alexander; Mokshyna, Elena; Farag, Sherif; Andrade, Carolina; Kuz'min, Victor; Fourches, Denis; Tropsha, Alexander

2016-08-21

Structural alerts are widely accepted in chemical toxicology and regulatory decision support as a simple and transparent means to flag potential chemical hazards or group compounds into categories for read-across. However, there has been a growing concern that alerts disproportionally flag too many chemicals as toxic, which questions their reliability as toxicity markers. Conversely, the rigorously developed and properly validated statistical QSAR models can accurately and reliably predict the toxicity of a chemical; however, their use in regulatory toxicology has been hampered by the lack of transparency and interpretability. We demonstrate that contrary to the common perception of QSAR models as "black boxes" they can be used to identify statistically significant chemical substructures (QSAR-based alerts) that influence toxicity. We show through several case studies, however, that the mere presence of structural alerts in a chemical, irrespective of the derivation method (expert-based or QSAR-based), should be perceived only as hypotheses of possible toxicological effect. We propose a new approach that synergistically integrates structural alerts and rigorously validated QSAR models for a more transparent and accurate safety assessment of new chemicals.

Meta-analysis in evidence-based healthcare: a paradigm shift away from random effects is overdue.

PubMed

Doi, Suhail A R; Furuya-Kanamori, Luis; Thalib, Lukman; Barendregt, Jan J

2017-12-01

Each year up to 20 000 systematic reviews and meta-analyses are published whose results influence healthcare decisions, thus making the robustness and reliability of meta-analytic methods one of the world's top clinical and public health priorities. The evidence synthesis makes use of either fixed-effect or random-effects statistical methods. The fixed-effect method has largely been replaced by the random-effects method as heterogeneity of study effects led to poor error estimation. However, despite the widespread use and acceptance of the random-effects method to correct this, it too remains unsatisfactory and continues to suffer from defective error estimation, posing a serious threat to decision-making in evidence-based clinical and public health practice. We discuss here the problem with the random-effects approach and demonstrate that there exist better estimators under the fixed-effect model framework that can achieve optimal error estimation. We argue for an urgent return to the earlier framework with updates that address these problems and conclude that doing so can markedly improve the reliability of meta-analytical findings and thus decision-making in healthcare.

A rapid lateral-flow immunoassay for phytosanitary detection of Erwinia amylovora and on-site fire blight diagnosis.

PubMed

Braun-Kiewnick, A; Altenbach, D; Oberhänsli, T; Bitterlin, W; Duffy, B

2011-10-01

Fire blight is an invasive disease caused by Erwinia amylovora that threatens pome fruit production globally. Effective implementation of phytosanitary control measures depends upon rapid, reliable pathogen detection and disease diagnosis. We developed a lateral-flow immunoassay specific for E. amylovora with a detection limit of log 5.7 CFU/ml, typical of pathogen concentrations in symptomatic plant material. The simple assay had comparable sensitivity to standard culture plating, serum agglutination and nested PCR when validated for application in a phytosanitary laboratory as a confirmatory test of cultured isolates and for first-line diagnosis of phytosanitary samples that represent the full range of commercial, ornamental and forestry host species. On-site validation in ring-trials with local plant inspectors demonstrated robust and reliable detection (compared to subsequent plating and PCR analysis). The simplicity, inspector acceptance and facilitation of expedited diagnosis (from 2 days for laboratory submitted samples to 15 min with the immunoassay), offers a valuable tool for improved phytosanitary control of fire blight. Copyright © 2011 Elsevier B.V. All rights reserved.

Hypnosis, hypnotizability and treatment.

PubMed

Sutcher, Howard

2008-07-01

There is broad agreement that a phenomenon we call "hypnosis" exists. However, there is no generally accepted definition of hypnosis. A brief historical overview of the use of hypnosis in healing practices demonstrates how it evolved willy-nilly, and like Topsy, "just growed" into its current status in medicine, psychiatry, psychology and dentistry. The mechanisms underlying hypnosis and how hypnosis differs from other cognitive states are almost totally unknown. With the exceptions of suggestions for pain control, current concepts of high, medium, low or non-hypnotizability do not reliably predict clinical outcomes for most medical, psychiatric or dental disorders. We do know that it is relatively easy to reliably evaluate hypnotizability, but other than choosing volunteers or subjects who will or will not exhibit traditional hypnotic phenomena, we rarely know what to do with that evaluation with actual clinical patients. Four case studies, representative of many others, chosen retrospectively from a practice that spans 45 years, illustrate how traditional or modern hypnotizability assessment is irrelevant in the clinical setting. Although the four patients differed obviously and vastly in hypnotizability, they all benefited from the use of hypnosis.

[An attempt to construct a Japanese version of the Implicit Positive and Negative Affect Test (IPANAT)].

PubMed

Shimoda, Shunsuke; Okubo, Nobutoshi; Kobayashi, Mai; Sato, Shigetaka; Kitamura, Hideya

2014-08-01

The Implicit Positive and Negative Affect Test (IPANAT) is an instrument for the indirect assessment of positive and negative affect. A Japanese version of the IPANAT was developed and its reliability and validity were examined. In Study 1, factor analysis identified two independent factors that could be interpreted as implicit positive and negative affect, which corresponded to the original version. The Japanese IPANAT also had sufficient internal consistency and acceptable test-retest reliability. In Study 2, we demonstrated that the Japanese IPANAT was associated with explicit state affect (e.g., PANAS), extraversion, and neuroticism, which indicated its adequate construct validity. In Study 3, we examined the extent to which the Japanese IPANAT was sensitive to changes in affect by assessing a set of IPANAT items after the presentation of positive, negative, or neutral photographs. The results indicated that the Japanese IPANAT was sufficiently sensitive to changes in affect resulting from affective stimuli. Taken together, these studies suggest that the Japanese version of the IPANAT is a useful instrument for the indirect assessment of positive and negative affect.

Aversion to Ambiguity Regarding Medical Tests and Treatments: Measurement, Prevalence, and Relationship to Sociodemographic Factors

PubMed Central

HAN, PAUL K. J.; REEVE, BRYCE B.; MOSER, RICHARD P.; KLEIN, WILLIAM M. P.

2014-01-01

Aversion to “ambiguity”—uncertainty about the reliability, credibility, or adequacy of risk-related information—is an important problem that may influence judgments and decisions about medical interventions. Ambiguity aversion (AA) varies among individuals, however, and has been understudied in the health domain. To explore this phenomenon further, we developed a new theory-based measure of aversion to ambiguity regarding medical tests and treatments, and examined the prevalence and association of AA with sociodemographic factors. The “AA-Med” scale was developed using a large survey sample of the U.S. public (n = 4,398), and scale psychometric properties and the population distribution of AA were evaluated. The scale demonstrated acceptable reliability (α = .73) and validity as ascertained by association with respondents’ interest in a hypothetical ambiguous cancer screening test. Ambiguity aversion (AA) was associated with older age, non-White race, lower education and income, and female sex. The AA-Med scale is a promising new measure, and AA is associated with several sociodemographic factors. We discuss implications of these findings and potential applications of the scale for future research. PMID:19731127

The Reliability of Pedalling Rates Employed in Work Tests on the Bicycle Ergometer.

ERIC Educational Resources Information Center

Bolonchuk, W. W.

The purpose of this study was to determine whether a group of volunteer subjects could produce and maintain a pedalling cadence within an acceptable range of error. This, in turn, would aid in determining the reliability of pedalling rates employed in work tests on the bicycle ergometer. Forty male college students were randomly given four…

Reliability and Criterion Validity of a Novel Clinical Test of Simple and Complex Reaction Time in Athletes1

PubMed Central

Eckner, James T.; Richardson, James K.; Kim, Hogene; Joshi, Monica S.; Oh, Youkeun K.; Ashton-Miller, James A.

2015-01-01

Summary Slowed reaction time (RT) represents both a risk factor for and a consequence of sport concussion. The purpose of this study was to determine the reliability and criterion validity of a novel clinical test of simple and complex RT, called RTclin, in contact sport athletes. Both tasks were adapted from the well-known ruler drop test of RT and involve manually grasping a falling vertical shaft upon its release, with the complex task employing a go/no-go paradigm based on a slight cue. In 46 healthy contact sport athletes (24 males; M = 16.3 yr., SD = 5.0; 22 women: M age= 15.0 yr., SD = 4.0) whose sports included soccer, ice hockey, American football, martial arts, wrestling, and lacrosse, the latency and accuracy of simple and complex RTclin had acceptable test-retest and inter-rater reliabilities and correlated with a computerized criterion standard, the Axon Computerized Cognitive Assessment Tool. Medium to large effect sizes were found. The novel RTclin tests have acceptable reliability and criterion validity for clinical use and hold promise as concussion assessment tools. PMID:26106803

An acceptance-oriented cognitive-behavioral therapy in multimodal rehabilitation: a pre-post test evaluation in highly distressed patients with rheumatic diseases.

PubMed

Vriezekolk, Johanna E; Eijsbouts, Agnes M M; van Lankveld, Wim G J M; Beenackers, Hanneke; Geenen, Rinie; van den Ende, Cornelia H M

2013-06-01

To examine the potential effectiveness of a multimodal rehabilitation program including an acceptance-oriented cognitive-behavioral therapy for highly distressed patients with rheumatic diseases. An observational study employing a one-group pre-post test design (N=25). The primary outcome was psychological distress. Secondary outcomes were quality of life, illness acceptance, and coping flexibility. Group pre-to-post and pre-to-12 months follow-up treatment changes were evaluated by paired-samples t-tests and Cohen's effect sizes (d). Individual changes were evaluated by the reliable change index (RCI) and clinically significant change (CSC) parameters. Significant effects were found post-treatment and maintained at 12 months in psychological distress (d>0.80), illness acceptance (d=1.48) and the SF-36 subscales role physical, vitality, and mental health (d ≥ 0.65). No significant effects were found for coping flexibility and the SF-36 subscales physical functioning, bodily pain, social functioning, and role emotional. Both a reliable (RCI) and clinically significant (CSC) improvement was observed for almost half of the highly distressed patients. The patients enrolled in the multimodal rehabilitation program showed improved psychological health status from pre to post-treatment. A randomized clinical trial is needed to confirm or refute the added value of an acceptance-oriented cognitive-behavioral therapy for highly distressed patients in rehabilitation. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Test-retest reliability and comparability of paper and computer questionnaires for the Finnish version of the Tampa Scale of Kinesiophobia.

PubMed

Koho, P; Aho, S; Kautiainen, H; Pohjolainen, T; Hurri, H

2014-12-01

To estimate the internal consistency, test-retest reliability and comparability of paper and computer versions of the Finnish version of the Tampa Scale of Kinesiophobia (TSK-FIN) among patients with chronic pain. In addition, patients' personal experiences of completing both versions of the TSK-FIN and preferences between these two methods of data collection were studied. Test-retest reliability study. Paper and computer versions of the TSK-FIN were completed twice on two consecutive days. The sample comprised 94 consecutive patients with chronic musculoskeletal pain participating in a pain management or individual rehabilitation programme. The group rehabilitation design consisted of physical and functional exercises, evaluation of the social situation, psychological assessment of pain-related stress factors, and personal pain management training in order to regain overall function and mitigate the inconvenience of pain and fear-avoidance behaviour. The mean TSK-FIN score was 37.1 [standard deviation (SD) 8.1] for the computer version and 35.3 (SD 7.9) for the paper version. The mean difference between the two versions was 1.9 (95% confidence interval 0.8 to 2.9). Test-retest reliability was 0.89 for the paper version and 0.88 for the computer version. Internal consistency was considered to be good for both versions. The intraclass correlation coefficient for comparability was 0.77 (95% confidence interval 0.66 to 0.85), indicating substantial reliability between the two methods. Both versions of the TSK-FIN demonstrated substantial intertest reliability, good test-retest reliability, good internal consistency and acceptable limits of agreement, suggesting their suitability for clinical use. However, subjects tended to score higher when using the computer version. As such, in an ideal situation, data should be collected in a similar manner throughout the course of rehabilitation or clinical research. Copyright © 2014 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Measurement of supernatural belief: sex differences and locus of control.

PubMed

Randall, T M; Desrosiers, M

1980-10-01

Although we live in an age dominated by science and technology, there exists an increasingly popular anti-science sentiment. This study describes the development of a scale to assess the degree of personal acceptance of supernatural causality versus acceptance of scientific explanation. In addition to the psychometric data concerning validity and reliability of the scale, data are presented which showed the personality factor of supernaturalism to be independent of orthodox religious attitudes. Results indicated a significantly greater supernatural acceptance for women, and a positive relation of supernaturalism with external locus of control.

Measuring physical activity during pregnancy - Cultural adaptation of the Pregnancy Physical Activity Questionnaire (PPAQ) and assessment of its reliability in Polish conditions.

PubMed

Krzepota, Justyna; Sadowska, Dorota; Sempolska, Katarzyna; Pelczar, Małgorzata

2017-12-23

The assessment of physical activity during pregnancy is crucial in perinatal care and it is an important research topic. Unfortunately, in Poland there is a lack of one commonly accepted questionnaire of physical activity during pregnancy. The aim of this study was to adapt the Pregnancy Physical Activity Questionnaire (PPAQ) to Polish conditions and assess the reliability of its Polish version (PPAQ-PL). The PPAQ was translated from English into Polish and its reliability tested. 64 correctly completed (twice, one week apart) questionnaires were qualified for analysis. Test-retest reliability was assessed using Intraclass Correlation Coefficient (ICC). As a result of the adaptation and psychometric assessment, in the Polish version of the questionnaire the number of questions was reduced from 36 to 35 by removing the question concerning 'mowing lawn while on a riding mower'. The ICC value for total activity was 0.75, which confirms a substantial level of reliability. The ICC values for subscales of intensity ranged from 0.53 (light) - 0.86 (vigorous). For subscales of type, ICC values ranged from 0.59 (transportation) - 0.89 (household/caregiving). The PPAQ-PL can be accepted as a reliable tool for the assessing physical activity of pregnant women in Poland. Information obtained using the questionnaire might be helpful in monitoring health behaviours, preventing obesity, as well as designing and promoting physical activity programmes for pregnant women.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Development of a simple computerized torsion test to quantify subjective ocular torsion.

PubMed

Kim, Y D; Yang, H K; Hwang, J-M

2017-11-01

PurposeThe double Maddox-rod test (DMRT) and Lancaster red-green test (LRGT) are the most widely used tests worldwide to assess subjective ocular torsion. However, these tests require equipment and the quantified results of ocular torsion are only provided in rough values. Here we developed a novel computerized torsion test (CTT) for individual assessment of subjective ocular torsion and validated the reliability and accuracy of the test compared with those of the DMRT and LRGT.MethodsA total of 30 patients with cyclovertical strabismus and 30 controls were recruited. The CTT was designed using Microsoft Office PowerPoint. Subjects wore red-green filter spectacles and viewed gradually tilted red and cyan lines on an LCD monitor and pressed the keyboard to go through the slides, until both lines seemed parallel. All subjects underwent the CTT, DMRT, and LRGT. Intraclass correlation coefficients and Bland-Altman plots were analyzed to assess the acceptability of the CTT compared with that of the DMRT.ResultsBoth the DMRT and CTT showed no significant test-retest differences in the strabismus and control groups. The DMRT and CTT results demonstrated an acceptable agreement. The reliability of the CTT was better than that of the DMRT. The LRGT showed low sensitivity for the detection of ocular torsion compared with the DMRT (40.0%) and CTT (39.1%).ConclusionOur results suggest that the assessment of subjective ocular torsion using the CTT based on PowerPoint software is simple, reproducible, and accurate and can be applied in clinical practice.

The Assumption of a Reliable Instrument and Other Pitfalls to Avoid When Considering the Reliability of Data

PubMed Central

Nimon, Kim; Zientek, Linda Reichwein; Henson, Robin K.

2012-01-01

The purpose of this article is to help researchers avoid common pitfalls associated with reliability including incorrectly assuming that (a) measurement error always attenuates observed score correlations, (b) different sources of measurement error originate from the same source, and (c) reliability is a function of instrumentation. To accomplish our purpose, we first describe what reliability is and why researchers should care about it with focus on its impact on effect sizes. Second, we review how reliability is assessed with comment on the consequences of cumulative measurement error. Third, we consider how researchers can use reliability generalization as a prescriptive method when designing their research studies to form hypotheses about whether or not reliability estimates will be acceptable given their sample and testing conditions. Finally, we discuss options that researchers may consider when faced with analyzing unreliable data. PMID:22518107

Validation of the Filovirus Plaque Assay for Use in Preclinical Studies

PubMed Central

Shurtleff, Amy C.; Bloomfield, Holly A.; Mort, Shannon; Orr, Steven A.; Audet, Brian; Whitaker, Thomas; Richards, Michelle J.; Bavari, Sina

2016-01-01

A plaque assay for quantitating filoviruses in virus stocks, prepared viral challenge inocula and samples from research animals has recently been fully characterized and standardized for use across multiple institutions performing Biosafety Level 4 (BSL-4) studies. After standardization studies were completed, Good Laboratory Practices (GLP)-compliant plaque assay method validation studies to demonstrate suitability for reliable and reproducible measurement of the Marburg Virus Angola (MARV) variant and Ebola Virus Kikwit (EBOV) variant commenced at the United States Army Medical Research Institute of Infectious Diseases (USAMRIID). The validation parameters tested included accuracy, precision, linearity, robustness, stability of the virus stocks and system suitability. The MARV and EBOV assays were confirmed to be accurate to ±0.5 log10 PFU/mL. Repeatability precision, intermediate precision and reproducibility precision were sufficient to return viral titers with a coefficient of variation (%CV) of ≤30%, deemed acceptable variation for a cell-based bioassay. Intraclass correlation statistical techniques for the evaluation of the assay’s precision when the same plaques were quantitated by two analysts returned values passing the acceptance criteria, indicating high agreement between analysts. The assay was shown to be accurate and specific when run on Nonhuman Primates (NHP) serum and plasma samples diluted in plaque assay medium, with negligible matrix effects. Virus stocks demonstrated stability for freeze-thaw cycles typical of normal usage during assay retests. The results demonstrated that the EBOV and MARV plaque assays are accurate, precise and robust for filovirus titration in samples associated with the performance of GLP animal model studies. PMID:27110807

Translation, reliability, and clinical utility of the Melbourne Assessment 2.

PubMed

Gerber, Corinna N; Plebani, Anael; Labruyère, Rob

2017-10-12

The aims were to (i) provide a German translation of the Melbourne Assessment 2 (MA2), a quantitative test to measure unilateral upper limb function in children with neurological disabilities and (ii) to evaluate its reliability and aspects of clinical utility. After its translation into German and approval of the back translation by the original authors, the MA2 was performed and videotaped twice with 30 children with neuromotor disorders. For each participant, two raters scored the video of the first test for inter-rater reliability. To determine test-retest reliability, one rater additionally scored the video of the second test while the other rater repeated the scoring of the first video to evaluate intra-rater reliability. Time needed for rater training, test administration, and scoring was recorded. The four subscale scores showed excellent intra-, inter-rater, and test-retest reliability with intraclass correlation coefficients of 0.90-1.00 (95%-confidence intervals 0.78-1.00). Score items revealed substantial to almost perfect intra-rater reliability (weighted kappa k w  = 0.66-1.00) for the more affected side. Score item inter-rater and test-retest reliability of the same extremity were, with one exception, moderate to almost perfect (k w  = 0.42-0.97; k w  = 0.40-0.89). Furthermore, the MA2 was feasible and acceptable for patients and clinicians. The MA2 showed excellent subscale and moderate to almost perfect score item reliability. Implications for Rehabilitation There is a lack of high-quality studies about psychometric properties of upper limb measurement tools in the neuropediatric population. The Melbourne Assessment 2 is a promising tool for reliable measurement of unilateral upper limb movement quality in the neuropediatric population. The Melbourne Assessment 2 is acceptable and practicable to therapists and patients for routine use in clinical care.

Reliability of Computerized Neurocognitive Tests for Concussion Assessment: A Meta-Analysis.

PubMed

Farnsworth, James L; Dargo, Lucas; Ragan, Brian G; Kang, Minsoo

2017-09-01

  Although widely used, computerized neurocognitive tests (CNTs) have been criticized because of low reliability and poor sensitivity. A systematic review was published summarizing the reliability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) scores; however, this was limited to a single CNT. Expansion of the previous review to include additional CNTs and a meta-analysis is needed. Therefore, our purpose was to analyze reliability data for CNTs using meta-analysis and examine moderating factors that may influence reliability.   A systematic literature search (key terms: reliability, computerized neurocognitive test, concussion) of electronic databases (MEDLINE, PubMed, Google Scholar, and SPORTDiscus) was conducted to identify relevant studies.   Studies were included if they met all of the following criteria: used a test-retest design, involved at least 1 CNT, provided sufficient statistical data to allow for effect-size calculation, and were published in English.   Two independent reviewers investigated each article to assess inclusion criteria. Eighteen studies involving 2674 participants were retained. Intraclass correlation coefficients were extracted to calculate effect sizes and determine overall reliability. The Fisher Z transformation adjusted for sampling error associated with averaging correlations. Moderator analyses were conducted to evaluate the effects of the length of the test-retest interval, intraclass correlation coefficient model selection, participant demographics, and study design on reliability. Heterogeneity was evaluated using the Cochran Q statistic.   The proportion of acceptable outcomes was greatest for the Axon Sports CogState Test (75%) and lowest for the ImPACT (25%). Moderator analyses indicated that the type of intraclass correlation coefficient model used significantly influenced effect-size estimates, accounting for 17% of the variation in reliability.   The Axon Sports CogState Test, which has a higher proportion of acceptable outcomes and shorter test duration relative to other CNTs, may be a reliable option; however, future studies are needed to compare the diagnostic accuracy of these instruments.

Anti-MRSA beta-lactams in development, with a focus on ceftobiprole: the first anti-MRSA beta-lactam to demonstrate clinical efficacy.

PubMed

Bush, Karen; Heep, Markus; Macielag, Mark J; Noel, Gary J

2007-04-01

Ceftobiprole is the first of the investigational beta-lactam antibiotics with in vitro activity against methicillin-resistant staphylococci to reach and complete Phase III therapeutic trials. Its antibacterial spectrum includes methicillin-resistant Staphylococcus aureus (MRSA), Enterococcus faecalis, penicillin-resistant streptococci and many Gram-negative pathogens. It has demonstrated in vivo activity against many experimental infections caused by these pathogens. Ceftobiprole has completed Phase III clinical trials for complicated skin and skin structure infections, is being studied in Phase III pneumonia trials and has demonstrated non-inferiority compared with vancomycin in a Phase III complicated skin and skin structure infections trial, resulting in > 90% clinical cures of infections caused by MRSA. Other anti-MRSA beta-lactams in therapeutic clinical trials include the carbapenem CS-023/RO-4908463 and the cephalosporin ceftaroline (PPI-0903). The future of all of these agents will depend on their clinical efficacy, safety and their ability to be accepted as beta-lactams for the reliable treatment of a broad spectrum of infections, including those caused by MRSA.

Physician and Staff Acceptance of Care Managers in Primary Care Offices.

PubMed

Malouin, Jean M; Malouin, Rebecca A; Sarinopoulos, Issidoros; Beisel, Marie; Bechel-Marriot, Diane; First, Amanda; Gamble, Ginger M; Tanner, Clare

2017-01-01

Embedded care managers are increasingly implemented as part of the care team within primary care practices, yet previous studies have indicated variability in acceptance by physicians and staff. This study assesses the acceptability of care managers among staff and physicians within the Michigan Primary Care Transformation (MiPCT) demonstration. Care manager acceptance was measured using a web-based survey distributed to practices participating in the MiPCT demonstration. Both physicians and staff reported high levels of care manager acceptance. Longer length of care manager employment at the practice, higher care manager FTE dedicated to care management, and care manager employed by practice were all significantly associated with care manager acceptance. The MiPCT demonstration found high care manager acceptance across all care team members. The high level of acceptance may be due to the structures and processes developed by MiPCT to support implementation of care managers and the length of the intervention period. The MiPCT demonstration confirms that following three years of implementation, embedded care managers are acceptable to both physicians and staff within primary care practices. Importantly, embeddedness, or the amount of time care managers are located within practices, is associated with increased acceptance. © Copyright 2017 by the American Board of Family Medicine.

Psychometric properties of HeartQoL, a core heart disease-specific health-related quality of life questionnaire, in Danish implantable cardioverter defibrillator recipients.

PubMed

Zangger, Graziella; Zwisler, Ann-Dorthe; Kikkenborg Berg, Selina; Kristensen, Marie S; Grønset, Charlotte N; Uddin, Jamal; Pedersen, Susanne S; Oldridge, Neil B; Thygesen, Lau C

2018-01-01

Background Patient-reported health-related quality of life is increasingly used as an outcome measure in clinical trials and as a performance measure to evaluate quality of care. The objective of this study was to assess the psychometric properties of the Danish HeartQoL questionnaire, a core heart disease-specific health-related quality of life questionnaire, in implantable cardioverter defibrillator recipients. Design This study involved cross-sectional and test-retest study designs. Method Implantable cardioverter defibrillator recipients in the cross-sectional study completed the HeartQoL, the Short-Form 36 Health Survey, and the Hospital Anxiety and Depression Scale. The HeartQoL structure, construct-related validity (convergent and discriminative) and reliability (internal consistency) were assessed. HeartQoL reproducibility (test-retest) was assessed in an independent sample of implantable cardioverter defibrillator recipients. Results Mokken scale analysis supported the bi-dimensional structure of HeartQoL among 358 implantable cardioverter defibrillator recipients. Convergent ( r > 0.72) and discriminative validity were confirmed. The HeartQoL scales demonstrated satisfactory internal consistency (Cronbach's alpha > 0.90). Test-retest reliability (two weeks interval) was assessed in 89 implantable cardioverter defibrillator recipients and found to be acceptable for each scale (intra-class correlation > 0.90). Conclusion The Danish HeartQoL questionnaire demonstrated satisfactory key psychometric attributes of validity and reliability in this implantable cardioverter defibrillator population. This study adds support for the HeartQoL as a core heart-specific health-related quality of life questionnaire in a broad group of patients with heart disease including implantable cardioverter defibrillator recipients.

Effect of data gaps on correlation dimension computed from light curves of variable stars

NASA Astrophysics Data System (ADS)

George, Sandip V.; Ambika, G.; Misra, R.

2015-11-01

Observational data, especially astrophysical data, is often limited by gaps in data that arises due to lack of observations for a variety of reasons. Such inadvertent gaps are usually smoothed over using interpolation techniques. However the smoothing techniques can introduce artificial effects, especially when non-linear analysis is undertaken. We investigate how gaps can affect the computed values of correlation dimension of the system, without using any interpolation. For this we introduce gaps artificially in synthetic data derived from standard chaotic systems, like the Rössler and Lorenz, with frequency of occurrence and size of missing data drawn from two Gaussian distributions. Then we study the changes in correlation dimension with change in the distributions of position and size of gaps. We find that for a considerable range of mean gap frequency and size, the value of correlation dimension is not significantly affected, indicating that in such specific cases, the calculated values can still be reliable and acceptable. Thus our study introduces a method of checking the reliability of computed correlation dimension values by calculating the distribution of gaps with respect to its size and position. This is illustrated for the data from light curves of three variable stars, R Scuti, U Monocerotis and SU Tauri. We also demonstrate how a cubic spline interpolation can cause a time series of Gaussian noise with missing data to be misinterpreted as being chaotic in origin. This is demonstrated for the non chaotic light curve of variable star SS Cygni, which gives a saturated D2 value, when interpolated using a cubic spline. In addition we also find that a careful choice of binning, in addition to reducing noise, can help in shifting the gap distribution to the reliable range for D2 values.

Assessing patient-centered care: one approach to health disparities education.

PubMed

Wilkerson, LuAnn; Fung, Cha-Chi; May, Win; Elliott, Donna

2010-05-01

Patient-centered care has been described as one approach to cultural competency education that could reduce racial and ethnic health disparities by preparing providers to deliver care that is respectful and responsive to the preferences of each patient. In order to evaluate the effectiveness of a curriculum in teaching patient-centered care (PCC) behaviors to medical students, we drew on the work of Kleinman, Eisenberg, and Good to develop a scale that could be embedded across cases in an objective structured clinical examination (OSCE). To compare the reliability, validity, and feasibility of an embedded patient-centered care scale with the use of a single culturally challenging case in measuring students' use of PCC behaviors as part of a comprehensive OSCE. A total of 322 students from two California medical schools participated in the OSCE as beginning seniors. Cronbach's alpha was used to assess the internal consistency of each approach. Construct validity was addressed by establishing convergent and divergent validity using the cultural challenge case total score and OSCE component scores. Feasibility assessment considered cost and training needs for the standardized patients (SPs). Medical students demonstrated a moderate level of patient-centered skill (mean = 63%, SD = 11%). The PCC Scale demonstrated an acceptable level of internal consistency (alpha = 0.68) over the single case scale (alpha = 0.60). Both convergent and divergent validities were established through low to moderate correlation coefficients. The insertion of PCC items across multiple cases in a comprehensive OSCE can provide a reliable estimate of students' use of PCC behaviors without incurring extra costs associated with implementing a special cross-cultural OSCE. This approach is particularly feasible when an OSCE is already part of the standard assessment of clinical skills. Reliability may be increased with an additional investment in SP training.

Automated Measurement of Visual Acuity in Pediatric Ophthalmic Patients Using Principles of Game Design and Tablet Computers.

PubMed

Aslam, Tariq M; Tahir, Humza J; Parry, Neil R A; Murray, Ian J; Kwak, Kun; Heyes, Richard; Salleh, Mahani M; Czanner, Gabriela; Ashworth, Jane

2016-10-01

To report on the utility of a computer tablet-based method for automated testing of visual acuity in children based on the principles of game design. We describe the testing procedure and present repeatability as well as agreement of the score with accepted visual acuity measures. Reliability and validity study. Setting: Manchester Royal Eye Hospital Pediatric Ophthalmology Outpatients Department. Total of 112 sequentially recruited patients. For each patient 1 eye was tested with the Mobile Assessment of Vision by intERactIve Computer for Children (MAVERIC-C) system, consisting of a software application running on a computer tablet, housed in a bespoke viewing chamber. The application elicited touch screen responses using a game design to encourage compliance and automatically acquire visual acuity scores of participating patients. Acuity was then assessed by an examiner with a standard chart-based near ETDRS acuity test before the MAVERIC-C assessment was repeated. Reliability of MAVERIC-C near visual acuity score and agreement of MAVERIC-C score with near ETDRS chart for visual acuity. Altogether, 106 children (95%) completed the MAVERIC-C system without assistance. The vision scores demonstrated satisfactory reliability, with test-retest VA scores having a mean difference of 0.001 (SD ±0.136) and limits of agreement of 2 SD (LOA) of ±0.267. Comparison with the near EDTRS chart showed agreement with a mean difference of -0.0879 (±0.106) with LOA of ±0.208. This study demonstrates promising utility for software using a game design to enable automated testing of acuity in children with ophthalmic disease in an objective and accurate manner. Copyright © 2016 Elsevier Inc. All rights reserved.

Quantitative measurement of hypertrophic scar: intrarater reliability, sensitivity, and specificity.

PubMed

Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo

2008-01-01

The comparison of scar evaluation over time requires measurement tools with acceptable intrarater reliability and the ability to discriminate skin characteristics of interest. The objective of this study was to evaluate the intrarater reliability and sensitivity and specificity of the Cutometer, the Mexameter, and the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar (donor sites), and hypertrophic scar (HSc). A single investigator evaluated four tissue types (severe HSc, less severe HSc, donor site, and normal skin) in 30 burn survivors with all four measurement tools. The intraclass correlation coefficient (ICC) for the Cutometer was acceptable (> or =0.75) for the maximum deformation measure for the donor site and normal skin (>0.78) but was below the acceptable range for the HSc sites and all other parameters. The ICC for the Mexameter erythema (>0.75) and melanin index (>0.89) and the DermaScan C total thickness measurement (>0.82) were acceptable for all sites. The ICC for the total of the height, pliability, and vascularity subscales of the mVSS was acceptable (0.81) for normal scar but below the acceptable range for the scar sites. The DermaScan C was clearly able to discriminate HSc from normal scar and normal skin based on the total thickness measure. The Cutometer was less discriminating but was still able to discriminate HSc from normal scar and normal skin. The Mexameter erythema index was not a good discriminator of HSc and normal scar. Receiver operating characteristic curves were generated to establish the best cutoff point for the DermaScan C total thickness and the Cutometer maximum deformation, which were 2.034 and 0.387 mm, respectively. This study showed that although the Cutometer, the DermaScan C, and the Mexameter have measurement properties that make them attractive substitutes for the mVSS, caution must be used when interpreting results since the Cutometer has a ceiling effect when measuring rigid tissue such as HSc and the Mexameter erythema index does not discriminate normal scar from HSc.

Changes in Pelvic Incidence, Pelvic Tilt, and Sacral Slope in Situations of Pelvic Rotation.

PubMed

Jin, Hai-Ming; Xu, Dao-Liang; Xuan, Jun; Chen, Jiao-Xiang; Chen, Kai; Goswami, Amit; Chen, Yu; Kong, Qiu-Yan; Wang, Xiang-Yang

2017-08-01

Digitally reconstructed radiograph-based study. Using a computer-based method to determine what degree of pelvic rotation is acceptable for measuring the pelvic incidence (PI), pelvic tilt (PT), and sacral slope (SS). The effectiveness of a geometrical formula used to calculate the angle of pelvic rotation proposed in a previous article was assessed. It is unclear whether PI, PT, and SS are valid with pelvic rotation while acquiring a radiograph. Ten 3-dimensionally reconstructed models were established with software and placed in a neutral orientation to orient all of the bones in a standing position. Next, 140 digitally reconstructed radiographs were obtained by rotating the models around the longitudinal axis of each pelvis in the software from 0 to 30 degrees at 2.5-degree intervals. PI, PT, and SS were measured. The rotation angle was considered to be acceptable when the change in the measured angle (compared with the "correct" position) was <6 degrees. The rotation angle (α) on the images was calculated by a geometrical formula. Consistency between the measured value and the set angle was assessed. The acceptable maximum angle of rotation for reliable measurements of PI was 17.5 degrees, and the changes in PT and SS were within an acceptable range (<6 degrees) when the pelvic rotation increased from 0 to 30 degrees. The effectiveness of the geometrical formula was shown by the consistency between the set and the calculated rotation angles of the pelvis (intraclass correlation coefficient=0.99). Our study provides insight into the influence of pelvic rotation on the PI, PT, and SS. PI changes with pelvic rotation. The acceptable maximum angle for reliable values of PI, PT, and SS was 17.5 degrees, and the rotation angle of the pelvis on a lateral spinopelvic radiograph can be calculated reliably.

Psychometric performance of the National Eye Institute visual function questionnaire in Latinos and non-Latinos.

PubMed

Baker, Richard S; Bazargan, Mohsen; Calderón, José L; Hays, Ron D

2006-08-01

To compare the psychometric performance of Spanish versions of the 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25) and the NEI VFQ-39 administered to Latino patients with the psychometric performance of the standard English NEI VFQ-25 and NEI VFQ-39 administered to non-Latino patients. Clinic-based cross-sectional survey. Four hundred three patients (160 Latinos and 243 non-Latinos) recruited from general ophthalmology clinics of an urban public hospital over a 6-month period. Structured face-to-face interviews were conducted in Spanish and English to collect data for the NEI VFQ-25 and NEI VFQ-39. We calculated the mean, standard deviation, and percentage of participants having the minimum (floor) and maximum (ceiling) possible score for each item and scale. Internal consistency reliability of the NEI VFQ-25 and NEI VFQ-39 was estimated using the Cronbach alpha and average inter-item correlation. Construct validity for the instruments was assessed by comparing scores for participants classified as having normal versus impaired visual acuity. Instrument scales for general health; general vision; ocular pain; near activities; distance activities; vision-specific social functioning, mental health, role difficulties, and dependency; driving; color vision; and peripheral vision. Internal consistency reliability was significantly lower in the Spanish version than in the English version for 3 scales of the NEI VFQ-25. More importantly, 3 scales in the Spanish version manifested inadequate reliability (alpha< or =0.70), compared with only 1 inadequately reliable subscale in the English version. Reliability coefficients associated with the Spanish NEI VFQ-39 scales exceeded commonly accepted minimum standards. Comparison of reliability coefficients between Latino and non-Latino subgroups demonstrated statistically significant differences for 4 scales: Ocular Pain, Mental Health, Role Difficulties, and Dependency. In each case, the Latino group had the lower internal consistency reliability. However, only for the Ocular Pain subscale was reliability both significantly lower and inadequate (alpha<0.70). Overall performance of the NEI VFQ in Latino populations is adequate. However, in the absence of modifications to improve the reliability of specific Spanish version subscales, comparisons between Latino and non-Latino subgroups using the NEI VFQ must be interpreted with appropriate caution.

The better way to determine the validity, reliability, objectivity and accuracy of measuring devices.

PubMed

Pazira, Parvin; Rostami Haji-Abadi, Mahdi; Zolaktaf, Vahid; Sabahi, Mohammadfarzan; Pazira, Toomaj

2016-06-08

In relation to statistical analysis, studies to determine the validity, reliability, objectivity and precision of new measuring devices are usually incomplete, due in part to using only correlation coefficient and ignoring the data dispersion. The aim of this study was to demonstrate the best way to determine the validity, reliability, objectivity and accuracy of an electro-inclinometer or other measuring devices. Another purpose of this study is to answer the question of whether reliability and objectivity represent accuracy of measuring devices. The validity of an electro-inclinometer was examined by mechanical and geometric methods. The objectivity and reliability of the device was assessed by calculating Cronbach's alpha for repeated measurements by three raters and by measurements on the same person by mechanical goniometer and the electro-inclinometer. Measurements were performed on "hip flexion with the extended knee" and "shoulder abduction with the extended elbow." The raters measured every angle three times within an interval of two hours. The three-way ANOVA was used to determine accuracy. The results of mechanical and geometric analysis showed that validity of the electro-inclinometer was 1.00 and level of error was less than one degree. Objectivity and reliability of electro-inclinometer was 0.999, while objectivity of mechanical goniometer was in the range of 0.802 to 0.966 and the reliability was 0.760 to 0.961. For hip flexion, the difference between raters in joints angle measurement by electro-inclinometer and mechanical goniometer was 1.74 and 16.33 degree (P<0.05), respectively. The differences for shoulder abduction measurement by electro-inclinometer and goniometer were 0.35 and 4.40 degree (P<0.05). Although both the objectivity and reliability are acceptable, the results showed that measurement error was very high in the mechanical goniometer. Therefore, it can be concluded that objectivity and reliability alone cannot determine the accuracy of a device and it is preferable to use other statistical methods to compare and evaluate the accuracy of these two devices.

Confirmatory Factor Analysis and Test-Retest Reliability of the Alcohol and Drug Confrontation Scale (ADCS)

PubMed Central

Polcin, Douglas L.; Galloway, Gantt P.; Bond, Jason; Korcha, Rachael; Greenfield, Thomas K.

2008-01-01

The addiction field lacks an accepted definition and reliable measure of confrontation. The Alcohol and Drug Confrontation Scale (ADCS) defines confrontation as warnings about the potential consequences of substance use. To assess psychometric properties, 323 individual entering recovery houses in U.S. urban and suburban areas were interviewed between 2003 and 2005 (20% women, 68% white). Analyses included test-retest reliability, confirmatory factor analysis, and measures of internal consistency. Findings support the ADCS as a reliable way of assessing two factors: Internal Support and External intensity. Confrontation was experienced as supportive, accurate and helpful. Additional studies should assess confrontation in different contexts. PMID:20686635

The PLX- α project: demonstrating the viability of spherically imploding plasma liners as an MIF driver

NASA Astrophysics Data System (ADS)

Hsu, S. C.; Witherspoon, F. D.; Cassibry, J. T.; Gilmore, M.; Samulyak, R.; Stoltz, P.; the PLX-α Team

2015-11-01

Under ARPA-E's ALPHA program, the Plasma Liner Experiment-ALPHA (PLX- α) project aims to demonstrate the viability and scalability of spherically imploding plasma liners as a standoff, high-implosion-velocity magneto-inertial-fusion (MIF) driver that is potentially compatible with both low- and high- β targets. The project has three major objectives: (a) advancing existing contoured-gap coaxial-gun technology to achieve higher operational reliability/precision and better control/reproducibility of plasma-jet properties and profiles; (2) conducting ~ π / 2 -solid-angle plasma-liner experiments with 9 guns to demonstrate (along with extrapolations from modeling) that the jet-merging process leads to Mach-number degradation and liner uniformity that are acceptable for MIF; and (3) conducting 4 π experiments with up to 60 guns to demonstrate the formation of an imploding spherical plasma liner for the first time, and to provide empirical ram-pressure and uniformity scaling data for benchmarking our codes and informing us whether the scalings justify further development beyond ALPHA. This talk will provide an overview of the PLX- α project as well as key research results to date. Supported by ARPA-E's ALPHA program; original PLX construction supported by DOE Fusion Energy Sciences.

Measurement properties of the Dizziness Handicap Inventory by cross-sectional and longitudinal designs

PubMed Central

2009-01-01

Background The impact of dizziness on quality of life is often assessed by the Dizziness Handicap Inventory (DHI), which is used as a discriminate and evaluative measure. The aim of the present study was to examine reliability and validity of a translated Norwegian version (DHI-N), also examining responsiveness to important change in the construct being measured. Methods Two samples (n = 92 and n = 27) included participants with dizziness of mainly vestibular origin. A cross-sectional design was used to examine the factor structure (exploratory factor analysis), internal consistency (Cronbach's α), concurrent validity (Pearson's product moment correlation r), and discriminate ability (ROC curve analysis). Longitudinal designs were used to examine test-retest reliability (intraclass correlation coefficient (ICC) statistics, smallest detectable difference (SDD)), and responsiveness (Pearson's product moment correlation, ROC curve analysis; area under the ROC curve (AUC), and minimally important change (MIC)). The DHI scores range from 0 to 100. Results Factor analysis revealed a different factor structure than the original DHI, resulting in dismissal of subscale scores in the DHI-N. Acceptable internal consistency was found for the total scale (α = 0.95). Concurrent correlations between the DHI-N and other related measures were moderate to high, highest with Vertigo Symptom Scale-short form-Norwegian version (r = 0.69), and lowest with preferred gait (r = - 0.36). The DHI-N demonstrated excellent ability to discriminate between participants with and without 'disability', AUC being 0.89 and best cut-off point = 29 points. Satisfactory test-retest reliability was demonstrated, and the change for an individual should be ≥ 20 DHI-N points to exceed measurement error (SDD). Correlations between change scores of DHI-N and other self-report measures of functional health and symptoms were high (r = 0.50 - 0.57). Responsiveness of the DHI-N was excellent, AUC = 0.83, discriminating between self-perceived 'improved' versus 'unchanged' participants. The MIC was identified as 11 DHI-N points. Conclusions The DHI-N total scale demonstrated satisfactory measurement properties. This is the first study that has addressed and demonstrated responsiveness to important change of the DHI, and provided values of SDD and MIC to help interpret change scores. PMID:20025754

The Australian Racism, Acceptance, and Cultural-Ethnocentrism Scale (RACES): item response theory findings.

PubMed

Grigg, Kaine; Manderson, Lenore

2016-03-17

Racism and associated discrimination are pervasive and persistent challenges with multiple cumulative deleterious effects contributing to inequities in various health outcomes. Globally, research over the past decade has shown consistent associations between racism and negative health concerns. Such research confirms that race endures as one of the strongest predictors of poor health. Due to the lack of validated Australian measures of racist attitudes, RACES (Racism, Acceptance, and Cultural-Ethnocentrism Scale) was developed. Here, we examine RACES' psychometric properties, including the latent structure, utilising Item Response Theory (IRT). Unidimensional and Multidimensional Rating Scale Model (RSM) Rasch analyses were utilised with 296 Victorian primary school students and 182 adolescents and 220 adults from the Australian community. RACES was demonstrated to be a robust 24-item three-dimensional scale of Accepting Attitudes (12 items), Racist Attitudes (8 items), and Ethnocentric Attitudes (4 items). RSM Rasch analyses provide strong support for the instrument as a robust measure of racist attitudes in the Australian context, and for the overall factorial and construct validity of RACES across primary school children, adolescents, and adults. RACES provides a reliable and valid measure that can be utilised across the lifespan to evaluate attitudes towards all racial, ethnic, cultural, and religious groups. A core function of RACES is to assess the effectiveness of interventions to reduce community levels of racism and in turn inequities in health outcomes within Australia.

PROMIS Peer Relationships Short Form: How Well Does Self-Report Correlate With Data From Peers?

PubMed

Devine, Katie A; Willard, Victoria W; Hocking, Matthew C; Stapleton, Jerod L; Rotter, David; Bukowski, William M; Noll, Robert B

2018-05-24

To examine the psychometric properties of the Patient-Reported Outcomes Measurement Information System (PROMIS®) peer relationships short form (PR-SF), including association with peer-reported friendships, likeability, and social reputation. 203 children (Mage = 10.12 years, SD = 2.37, range = 6-14) in Grades 1-8 completed the 8-item PR-SF and friendship nominations, like ratings, and social reputation measures about their peers during 2 classroom visits approximately 4 months apart, as part of a larger study. A confirmatory factor analysis, followed by an exploratory factor analysis, was conducted to examine the factor structure of the PR-SF. Spearman correlations between the PR-SF and peer-reported outcomes evaluated construct validity. For the PR-SF, a 2-factor solution demonstrated better fit than a 1-factor solution. The 2 factors appear to assess friendship quality (3 items) and peer acceptance (5 items). Reliability was marginal for the friendship quality factor (.66) but adequate for the acceptance factor (.85); stability was .34 for the PR-SF over 4 months. The PR-SF (8 items) and acceptance factor (5 items) both had modest but significant correlations with measures of friendship (rs = .25-.27), likeability (rs = .21-.22), and social reputation (rs = .29-.44). The PR-SF appears to be measuring two distinct aspects of social functioning. The 5-item peer acceptance scale is modestly associated with peer-reported friendship, likeability, and social reputation. Although not a replacement for peer-reported outcomes, the PR-SF is a promising patient-reported outcome for peer relationships in youth.

When Failure Means Success: Accepting Risk in Aerospace Development

NASA Technical Reports Server (NTRS)

Dumbacher, Daniel L.; Singer, Christopher E.

2009-01-01

Over the last three decades, NASA has been diligent in qualifying systems for human space flight. As the Agency transitions from operating the Space Shuttle, its employees must learn to accept higher risk levels to generate the data needed to certify its next human space flight system. The Marshall Center s Engineering workforce is developing the Ares I crew launch vehicle and designing the Ares V cargo launch vehicle for safety, reliability, and cost-effective operations. This presentation will provide a risk retrospective, using first-hand examples from the Delta Clipper-Experimental Advanced (DC-XA) and the X-33 single-stage-to-orbit flight demonstrators, while looking ahead to the upcoming Ares I-X uncrewed test flight. The DC-XA was successfully flown twice in 26 hours, setting a new turnaround-time record. Later, one of its 3 landing gears did not deploy, it tipped over, and was destroyed. During structural testing, the X-33 s advanced composite tanks were unable to withstand the forces to which it was subjected and the project was later cancelled. These are examples of successful failures, as the data generated are captured in databases used by vehicle designers today. More recently, the Ares I-X flight readiness review process was streamlined in keeping with the mission's objectives, since human lives are not at stake, which reflects the beginning of a cultural change. Failures are acceptable during testing, as they provide the lessons that actually lead to mission success. These and other examples will stimulate the discussion of when to accept risk in aerospace projects.

Introducing the Professionalism Mini-Evaluation Exercise (P-MEX) in Japan: results from a multicenter, cross-sectional study.

PubMed

Tsugawa, Yusuke; Ohbu, Sadayoshi; Cruess, Richard; Cruess, Sylvia; Okubo, Tomoya; Takahashi, Osamu; Tokuda, Yasuharu; Heist, Brian S; Bito, Seiji; Itoh, Toshiyuki; Aoki, Akiko; Chiba, Tsutomu; Fukui, Tsuguya

2011-08-01

Despite the growing importance of and interest in medical professionalism, there is no standardized tool for its measurement. The authors sought to verify the validity, reliability, and generalizability of the Professionalism Mini-Evaluation Exercise (P-MEX), a previously developed and tested tool, in the context of Japanese hospitals. A multicenter, cross-sectional evaluation study was performed to investigate the validity, reliability, and generalizability of the P-MEX in seven Japanese hospitals. In 2009-2010, 378 evaluators (attending physicians, nurses, peers, and junior residents) completed 360-degree assessments of 165 residents and fellows using the P-MEX. The content validity and criterion-related validity were examined, and the construct validity of the P-MEX was investigated by performing confirmatory factor analysis through a structural equation model. The reliability was tested using generalizability analysis. The contents of the P-MEX achieved good acceptance in a preliminary working group, and the poststudy survey revealed that 302 (79.9%) evaluators rated the P-MEX items as appropriate, indicating good content validity. The correlation coefficient between P-MEX scores and external criteria was 0.78 (P < .001), demonstrating good criterion-related validity. Confirmatory factor analysis verified high path coefficient (0.60-0.99) and adequate goodness of fit of the model. The generalizability analysis yielded a high dependability coefficient, suggesting good reliability, except when evaluators were peers or junior residents. Findings show evidence of adequate validity, reliability, and generalizability of the P-MEX in Japanese hospital settings. The P-MEX is the only evaluation tool for medical professionalism verified in both a Western and East Asian cultural context.

A rapid beverage intake questionnaire can detect changes in beverage intake.

PubMed

Hedrick, Valisa E; Comber, Dana L; Ferguson, Katherine E; Estabrooks, Paul A; Savla, Jyoti; Dietrich, Andrea M; Serrano, Elena; Davy, Brenda M

2013-01-01

Attention on beverage intake, specifically sugar-sweetened beverages (SSB), has increased in recent years. A brief valid, reliable and sensitive assessment tool for quantifying beverage consumption and determining its influence on weight status could help to advance research on this topic. The valid and reliable 15-item beverage questionnaire (BEVQ-15) estimates mean daily intake of water, SSB and total beverages (g, kcal) across multiple beverage categories. to determine the ability of the BEVQ-15 to detect changes in beverage intake over time. Participants (n=70; age=37±2 yr; BMI=24.5±0.4 kg/m(2)) underwent two randomly assigned 30-day periods (intervention, increased water and fruit juice consumption; control, increased solid fruit consumption), with a 30-day washout phase between feeding periods. The BEVQ-15 was administered at the beginning and end of each period. Reliability was assessed by Pearson's correlations, paired sample t tests and Cronbach's alpha. Paired sample t tests and repeated measures ANOVA were used to evaluate sensitivity to change. Sixty-nine participants completed all study sessions. Reliability was acceptable for most beverages (range: R(2)=0.52-0.95, P<0.001), but not for energy drinks. Increases in water (g), juice (kcal, g) and total beverage (g) were detected during the intervention period (P<0.001); no changes in these variables were detected in the control period. The BEVQ-15 demonstrates the ability to detect changes in beverage intake over time. This brief (~2 min), self-administered, valid, reliable and sensitive beverage intake assessment tool may be used by researchers and practitioners who evaluate and intervene upon beverage intake patterns in adults. Published by Elsevier Ltd.

Cross-cultural adaptation, reliability and construct validity of the Tampa scale for kinesiophobia for temporomandibular disorders (TSK/TMD-Br) into Brazilian Portuguese.

PubMed

Aguiar, A S; Bataglion, C; Visscher, C M; Bevilaqua Grossi, D; Chaves, T C

2017-07-01

Fear of movement (kinesiophobia) seems to play an important role in the development of chronic pain. However, for temporomandibular disorders (TMD), there is a scarcity of studies about this topic. The Tampa Scale for Kinesiophobia for TMD (TSK/TMD) is the most widely used instrument to measure fear of movement and it is not available in Brazilian Portuguese. The purpose of this study was to culturally adapt the TSK/TMD to Brazilian Portuguese and to assess its psychometric properties regarding internal consistency, reliability, and construct and structural validity. A total of 100 female patients with chronic TMD participated in the validation process of the TSK/TMD-Br. The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Spearman's rank correlation for construct validity and confirmatory factor analysis (CFA) for structural validity. CFA endorsed the pre-specified model with two domains and 12-items (Activity Avoidance - AA/Somatic Focus - SF) and all items obtained a loading factor greater than 0·4. Acceptable levels of reliability were found (ICC > 0·75) for all questions and domains of the TSK/TMD-Br. For internal consistency, Cronbach's α of 0·78 for both domains were found. Moderate correlations (0·40 < r < 0.60) were observed for 84% of the analyses conducted between TSK/TMD-Br scores versus catastrophising, depression and jaw functional limitation. TSK/TMD-Br 12 items and two-factor demonstrated sound psychometric properties (transcultural validity, reliability, internal consistency and structural validity). In such a way, the instrument can be used in clinical settings and for research purposes. © 2017 John Wiley & Sons Ltd.

Reliability of a Skin Diagnostic Device in Assessing Hydration and Erythema.

PubMed

Huimin, Koh; Rowledge, Alexandra M; Borzdynski, Caroline J; Miller, Charne; Frescos, Nicoletta; McKenzie, Gayle; Perry, Elizabeth; McGuiness, William

2017-10-01

To examine the reliability of a skin diagnostic device, the SD202 (Courage+Khazaka GmBH, Cologne, Germany), in assessing hydration and erythema of periwound skin and pressure injury-prone areas. Intrarater reliabilities from 3 cross-sectional and prospective studies are reported. Patients attending an outpatient, nurse-led wound dressing clinic (n = 16), a podiatrist-led high-risk foot clinic (n = 17), and residents (n = 38) at a single residential aged-care facility. Skin hydration and erythema levels assessed using the SD202. High internal consistency was maintained for consecutive skin hydration and erythema measures at a single point on the venous leg ulcer periwound (α > .996 and α > .970 for hydration and erythema, respectively) and for the pressure-prone areas of the sacrum (α > .916), right (α > .994) and left (α > .967) ischium, right (α > .989) and left (α > .916) trochanter, right (α > .985) and left (α > .992) calcaneus, and right (α > .991) and left (α > .990) lateral malleolus. High consistency was also found for the measures obtained at 4 different locations around the periwound for the venous leg ulcer (α > .935 and α > .870 for hydration and erythema, respectively). In diabetic foot ulcer assessment, acceptable internal consistency of hydration measures around the periwound was observed (α > .634). Internal consistency of erythema measures was variable, ranging from low to high reliability, particularly among predebridement measures. Using the protocols outlined in this study, the SD202 demonstrates high reliability for assessing skin hydration and erythema levels. It is possible that the SD202 can be used in clinical practice as an appropriate tool for skin hydration and erythema assessment.

Reliability and validity of a smartphone pulse rate application for the assessment of resting and elevated pulse rate.

PubMed

Mitchell, Katy; Graff, Megan; Hedt, Corbin; Simmons, James

2016-08-01

Purpose/hypothesis: This study was designed to investigate the test-retest reliability, concurrent validity, and the standard error of measurement (SEm) of a pulse rate assessment application (Azumio®'s Instant Heart Rate) on both Android® and iOS® (iphone operating system) smartphones as compared to a FT7 Polar® Heart Rate monitor. Number of subjects: 111. Resting (sitting) pulse rate was assessed twice and then the participants were asked to complete a 1-min standing step test and then immediately re-assessed. The smartphone assessors were blinded to their measurements. Test-retest reliability (intraclass correlation coefficient [ICC 2,1] and 95% confidence interval) for the three tools at rest (time 1/time 2): iOS® (0.76 [0.67-0.83]); Polar® (0.84 [0.78-0.89]); and Android® (0.82 [0.75-0.88]). Concurrent validity at rest time 2 (ICC 2,1) with the Polar® device: IOS® (0.92 [0.88-0.94]) and Android® (0.95 [0.92-0.96]). Concurrent validity post-exercise (time 3) (ICC) with the Polar® device: iOS® (0.90 [0.86-0.93]) and Android® (0.94 [0.91-0.96]). The SEm values for the three devices at rest: iOS® (5.77 beats per minute [BPM]), Polar® (4.56 BPM) and Android® (4.96 BPM). The Android®, iOS®, and Polar® devices showed acceptable test-retest reliability at rest and post-exercise. Both the smartphone platforms demonstrated concurrent validity with the Polar® at rest and post-exercise. The Azumio® Instant Heart Rate application when used by either platform appears to be a reliable and valid tool to assess pulse rate in healthy individuals.

CONSISTENCY OF FIELD-BASED MEASURES OF NEUROMUSCULAR CONTROL USING FORCE PLATE DIAGNOSTICS IN ELITE MALE YOUTH SOCCER PLAYERS

PubMed Central

READ, PAUL; OLIVER, JON L.; DE STE CROIX, MARK B.A.; MYER, GREGORY D.; LLOYD, RHODRI S.

2016-01-01

Deficits in neuromuscular control during movement patterns such as landing are suggested pathomechanics that underlie sport-related injury. A common mode of assessment is measurement of landing forces during jumping tasks; however, these measures have been used less frequently in male youth soccer players and reliability data is sparse. The aim of this study was to examine the reliability of a field-based neuromuscular control screening battery using force plate diagnostics in this cohort. Twenty six pre-peak height velocity (PHV) and twenty five post-PHV elite male youth soccer players completed a drop vertical jump (DVJ), single leg 75% horizontal hop and stick (75%HOP) and single leg countermovement jump (SLCMJ). Measures of peak landing vertical ground reaction force (pVGRF), time to stabilisation (TTS), time to pVGRF, and pVGRF asymmetry were recorded. A test, re-test design was used and reliability statistics included: change in mean, intraclass correlation coefficient (ICC) and coefficient of variation (CV). No significant differences in mean score were reported for any of the assessed variables between test sessions. In both groups, pVGRF and asymmetry during the 75%HOP and SLCMJ demonstrated largely acceptable reliability (CV ≤ 10%). Greater variability was evident in DVJ pVGRF and all other assessed variables, across the three protocols (CV range = 13.8 – 49.7%). ICC values ranged from small to large and were generally higher in the post-PHV players. The results of this study suggest that pVGRF and asymmetry can be reliably assessed using a 75%HOP and SLCMJ in this cohort. These measures could be utilized to support a screening battery for elite male youth soccer players and for test re-test comparison. PMID:27075641

eHealth literacy in chronic disease patients: An item response theory analysis of the eHealth literacy scale (eHEALS).

PubMed

Paige, Samantha R; Krieger, Janice L; Stellefson, Michael; Alber, Julia M

2017-02-01

Chronic disease patients are affected by low computer and health literacy, which negatively affects their ability to benefit from access to online health information. To estimate reliability and confirm model specifications for eHealth Literacy Scale (eHEALS) scores among chronic disease patients using Classical Test (CTT) and Item Response Theory techniques. A stratified sample of Black/African American (N=341) and Caucasian (N=343) adults with chronic disease completed an online survey including the eHEALS. Item discrimination was explored using bi-variate correlations and Cronbach's alpha for internal consistency. A categorical confirmatory factor analysis tested a one-factor structure of eHEALS scores. Item characteristic curves, in-fit/outfit statistics, omega coefficient, and item reliability and separation estimates were computed. A 1-factor structure of eHEALS was confirmed by statistically significant standardized item loadings, acceptable model fit indices (CFI/TLI>0.90), and 70% variance explained by the model. Item response categories increased with higher theta levels, and there was evidence of acceptable reliability (ω=0.94; item reliability=89; item separation=8.54). eHEALS scores are a valid and reliable measure of self-reported eHealth literacy among Internet-using chronic disease patients. Providers can use eHEALS to help identify patients' eHealth literacy skills. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Addressing the Lack of Measurement Invariance for the Measure of Acceptance of the Theory of Evolution

NASA Astrophysics Data System (ADS)

Wagler, Amy; Wagler, Ron

2013-09-01

The Measure of Acceptance of the Theory of Evolution (MATE) was constructed to be a single-factor instrument that assesses an individual's overall acceptance of evolutionary theory. The MATE was validated and the scores resulting from the MATE were found to be reliable for the population of inservice high school biology teachers. However, many studies have utilized the MATE for different populations, such as university students enrolled in a biology or genetics course, high school students, and preservice teachers. This is problematic because the dimensionality and reliability of the MATE may not be consistent across populations. It is not uncommon in science education research to find examples where scales are applied to novel populations without proper assessment of the validity and reliability. In order to illustrate this issue, a case study is presented where the dimensionality of the MATE is evaluated for a population of non-science major preservice elementary teachers. With this objective in mind, factor analytic and item response models are fit to the observed data to provide evidence for or against a one-dimensional latent structure and to detect which items do not conform to the theoretical construct for this population. The results of this study call into question any findings and conclusions made using the MATE for a Hispanic population of preservice teachers and point out the error of assuming invariance across substantively different populations.

Psychometric evaluation and wording effects on the Chinese version of the parent-proxy Kid-KINDL.

PubMed

Lee, Chih-Ting; Lin, Chung-Ying; Tsai, Meng-Che; Strong, Carol; Lin, Yi-Ching

2016-09-05

The pediatric quality of life (QoL) questionnaire, the child-rated Kid-KINDL, has wording effects. However, no studies have examined for its parallel questionnaire, the parent-proxy Kid-KINDL. This study aimed to examine the psychometric properties and wording effects of the parent-proxy Kid-KINDL. Parents with 8- to 12-year-old children (n = 247) completed the parent-proxy Kid-KINDL, 83 of them completed it again 7-14 days later, and 241 of their children completed the child-rated Kid-KINDL. Internal consistency was examined using Cronbach's α; test-retest reliability and concurrent validity, using Pearson correlation coefficients (r); construct validity and wording effects, using confirmatory factor analyses (CFAs). The internal consistency of the parent-proxy Kid-KINDL total score was acceptable (α = .86). Test-retest reliability (r = .33-.60) and concurrent validity (r = .27-.42) were acceptable or nearly acceptable for all subscales and the total score. The CFA models simultaneously accounting for QoL traits and wording effects had satisfactory fit indices, and outperformed the model accounting only for QoL traits. However, four subscales had unsatisfactory internal consistency, which might be attributable to wording effects. When children are unable to complete a QoL questionnaire, the parent-proxy Kid-KINDL can substitute with all due cautions to wording effects and inconsistent reliability among different raters.

Critical issues in assuring long lifetime and fail-safe operation of optical communications network

NASA Astrophysics Data System (ADS)

Paul, Dilip K.

1993-09-01

Major factors in assuring long lifetime and fail-safe operation in optical communications networks are reviewed in this paper. Reliable functionality to design specifications, complexity of implementation, and cost are the most critical issues. As economics is the driving force to set the goals as well as priorities for the design, development, safe operation, and maintenance schedules of reliable networks, a balance is sought between the degree of reliability enhancement, cost, and acceptable outage of services. Protecting both the link and the network with high reliability components, hardware duplication, and diversity routing can ensure the best network availability. Case examples include both fiber optic and lasercom systems. Also, the state-of-the-art reliability of photonics in space environment is presented.

48 CFR 14.201-9 - Simplified contract format.

Code of Federal Regulations, 2011 CFR

2011-10-01

.... (6) Inspection and acceptance, quality assurance, and reliability requirements. (7) Place of delivery... particular acquisition. (d) List of documents and attachments. Include if necessary. (e) Representations and...

48 CFR 14.201-9 - Simplified contract format.

Code of Federal Regulations, 2010 CFR

2010-10-01

.... (6) Inspection and acceptance, quality assurance, and reliability requirements. (7) Place of delivery... particular acquisition. (d) List of documents and attachments. Include if necessary. (e) Representations and...

ACCEPT 2: A public library of cluster properties

NASA Astrophysics Data System (ADS)

Donahue, Megan

2012-09-01

The current public ACCEPT database of cluster properties includes radial profiles of Tx, n_elec, entropy, and cooling time. We propose to more than double the current number of clusters in ACCEPT and to expand the current suite of properties to include uniformly measured profiles of gas mass and hydrostatic equilibrium mass along with signatures of dynamical relaxation (centroid shift, power ratios, surface brightness concentration, temperature ratios) and global quantities such as core-excised Tx, Lx, and metallicities. We will explore the relationship between cool cores and dynamical relaxation, the reliability of hydrostatic mass profiles, and the dependence of the gas mass fraction on halo mass, redshift, and the degree of relaxation. ACCEPT2 will enable further community science.

Reliability and testing

NASA Technical Reports Server (NTRS)

Auer, Werner

1996-01-01

Reliability and its interdependence with testing are important topics for development and manufacturing of successful products. This generally accepted fact is not only a technical statement, but must be also seen in the light of 'Human Factors.' While the background for this paper is the experience gained with electromechanical/electronic space products, including control and system considerations, it is believed that the content could be also of interest for other fields.

40 CFR 80.141 - Interim detergent gasoline program.

Code of Federal Regulations, 2010 CFR

2010-07-01

... considered acceptable for demonstration of IVD control performance. Examples of acceptable test procedures... carburetor deposits. Examples of acceptable test procedures for demonstration of carburetor deposit control... ultimate consumer; (ii) All additized post-refinery component (PRC); and (iii) All detergent additives sold...

40 CFR 80.141 - Interim detergent gasoline program.

Code of Federal Regulations, 2011 CFR

2011-07-01

... considered acceptable for demonstration of IVD control performance. Examples of acceptable test procedures... carburetor deposits. Examples of acceptable test procedures for demonstration of carburetor deposit control... ultimate consumer; (ii) All additized post-refinery component (PRC); and (iii) All detergent additives sold...

40 CFR 80.141 - Interim detergent gasoline program.

Code of Federal Regulations, 2012 CFR

2012-07-01

... considered acceptable for demonstration of IVD control performance. Examples of acceptable test procedures... carburetor deposits. Examples of acceptable test procedures for demonstration of carburetor deposit control... ultimate consumer; (ii) All additized post-refinery component (PRC); and (iii) All detergent additives sold...

40 CFR 80.141 - Interim detergent gasoline program.

Code of Federal Regulations, 2013 CFR

2013-07-01

... considered acceptable for demonstration of IVD control performance. Examples of acceptable test procedures... carburetor deposits. Examples of acceptable test procedures for demonstration of carburetor deposit control... ultimate consumer; (ii) All additized post-refinery component (PRC); and (iii) All detergent additives sold...

Validation of EORTC IN-PATSAT32 for Chinese cancer patients.

PubMed

Zhang, Lei; Dai, Zhenbo; Cheng, Siying; Xie, Shumin; Woo, Stephanie Mu-Lian; Luo, Zhiqin; Wu, Jinglian; Gao, Tianwen; Liu, Jiahao; Zhang, Kai; Zhang, Jing; Jia, Xinyu; Miller, Adam R; Wang, Changli

2015-09-01

The aim of this study is to test the psychometric properties and acceptability of the European Organization for Research and Treatment of Cancer (EORTC) inpatient satisfaction with care questionnaire 32 (IN-PATSAT32) for evaluating Chinese cancer patients and to analyze the influence of age, educational level, diagnostic time, and tumor stage on patient satisfaction. Three hundred two cancer inpatients in Tianjin Cancer Institution and Hospital from June 2013 to December 2013 were recruited for this study. All participants self-administered the EORTC IN-PATSAT32 and EORTC quality of life questionnaire-core 30 (QLQ-C30). Psychometric evaluation of the validity, reliability, acceptability, as well as the influence of age, educational level, diagnostic time, and tumor stage on patient satisfaction, was conducted. A favorable internal consistency reliability was confirmed, as the Cronbach's α coefficients were >0.80 for all scales in the EORTC IN-PATSAT32, ranging from 0.849 to 0.944. Multi-trait scaling analysis showed that all item-scale correlation coefficients met the standard of convergent validity, and 79.3 % met the standard of discriminant validity. Weak correlations were found between the scales and single items of the EORTC IN-PATSAT32 and EORTC QLQ-C30, proving the validity of EORTC IN-PATSAT32. None of the EORTC IN-PATSAT32 scales were able to discriminate between patients across age categories, while significant influences of educational level on doctors' and nurses' conduct, as well as influences of diagnostic time and tumor stage on nurses' conduct, and information provision scales were discovered. The questionnaire was easily understood with a satisfactory acceptability. The EORTC IN-PATSAT32 appears to be a reliable, valid, and acceptable instrument to use on cancer patients and is appropriate for measuring the patient satisfaction of Chinese patients.

[Cultural adaptation of the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire].

PubMed

São-João, Thaís Moreira; Rodrigues, Roberta Cunha Matheus; Gallani, Maria Cecilia Bueno Jayme; Miura, Cinthya Tamie de Passos; Domingues, Gabriela de Barros Leite; Godin, Gaston

2013-06-01

To conduct the cultural adaptation of the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire (GSLTPAQ) and to assess its content validity, practicability, acceptability and reliability. The stages of translation, synthesis, back translation, expert committee review and pre-test were carried out, followed by the evaluation of the practicability, acceptability and reliability (test-retest). The judges assessed its semantic, idiomatic, conceptual, cultural and metabolic equivalences. The adapted version was submitted to the pre-test (n = 20), and test-retest (n = 80), in healthy individuals and in those suffering from cardiovascular disease in Limeira, SP, Southeastern Brazil, between 2010 and 2011. The proportion of agreement of the committee of judges was assessed using the Content Validity Index. Reliability was assessed by the criterion of stability, with 15 days between applications. Practicability was evaluated by the time spent interviewing and acceptability was estimated as the percentage of unanswered items and the proportion of patients who responded to all items. The translated version of the questionnaire showed evidence of appropriate semantic-idiomatic, conceptual, cultural and metabolic equivalence, with substitutions of several physical activities more appropriate to the Brazilian population. The practicability analysis showed short time needed for the application of the instrument (mean 3.0 minutes). As for acceptability, all patients answered 100% of the items. The test-retest analysis suggested that stability was good (Intraclass Correlation Coefficient value of 0.84). The Brazilian version of the questionnaire showed satisfactory measures of the qualities in question. Its application to diverse populations in future studies is recommended in order to provide robust measures of these qualities.

Development of the Consumer Refrigerator Safety Questionnaire: A Measure of Consumer Perceptions and Practices.

PubMed

Cairnduff, Victoria; Dean, Moira; Koidis, Anastasios

2016-09-01

Food preparation and storage behaviors in the home deviating from the "best practice" food safety recommendations may result in foodborne illnesses. Currently, there are limited tools available to fully evaluate the consumer knowledge, perceptions, and behavior in the area of refrigerator safety. The current study aimed to develop a valid and reliable tool in the form of a questionnaire, the Consumer Refrigerator Safety Questionnaire (CRSQ), for assessing systematically all these aspects. Items relating to refrigerator safety knowledge (n =17), perceptions (n =46), and reported behavior (n =30) were developed and pilot tested by an expert reference group and various consumer groups to assess face and content validity (n =20), item difficulty and consistency (n =55), and construct validity (n =23). The findings showed that the CRSQ has acceptable face and content validity with acceptable levels of item difficulty. Item consistency was observed for 12 of 15 in refrigerator safety knowledge. Further, all 5 of the subscales of consumer perceptions of refrigerator safety practices relating to risk of developing foodborne disease showed acceptable internal consistency (Cronbach's α value > 0.8). Construct validity of the CRSQ was shown to be very good (P = 0.022). The CRSQ exhibited acceptable test-retest reliability at 14 days with the majority of knowledge items (93.3%) and reported behavior items (96.4%) having correlation coefficients of greater than 0.70. Overall, the CRSQ was deemed valid and reliable in assessing refrigerator safety knowledge and behavior; therefore, it has the potential for future use in identifying groups of individuals at increased risk of deviating from recommended refrigerator safety practices, as well as the assessment of refrigerator safety knowledge and behavior for use before and after an intervention.

Assessing psychological inflexibility: the psychometric properties of the Avoidance and Fusion Questionnaire for Youth in two adult samples.

PubMed

Fergus, Thomas A; Valentiner, David P; Gillen, Michael J; Hiraoka, Regina; Twohig, Michael P; Abramowitz, Jonathan S; McGrath, Patrick B

2012-06-01

The current study examined whether the Avoidance and Fusion Questionnaire for Youth (AFQ-Y; L. A. Greco, W. Lambert, & R. A. Baer, 2008), a self-report measure of psychological inflexibility for children and adolescents, might be useful for measuring psychological inflexibility for adults. The psychometric properties of the AFQ-Y were examined using data from a college student sample (N = 387) and a clinical sample of patients with anxiety disorders (N = 115). The AFQ-Y, but not the Acceptance and Action Questionnaire-II (AAQ-II; F. W. Bond et al., in press), demonstrated a reading level at or below the recommended 5th or 6th grade reading level. The AFQ-Y also demonstrated adequate reliability (internal consistency), factorial validity, convergent and discriminant validity, and concurrent validity predicting psychological symptoms. Moreover, the AFQ-Y showed incremental validity over the AAQ-II in predicting several psychological symptom domains. Implications for the assessment of psychological inflexibility are discussed. (c) 2012 APA, all rights reserved

Catheter-based flexible microcoil RF detectors for internal magnetic resonance imaging

NASA Astrophysics Data System (ADS)

Ahmad, M. M.; Syms, R. R. A.; Young, I. R.; Mathew, B.; Casperz, W.; Taylor-Robinson, S. D.; Wadsworth, C. A.; Gedroyc, W. M. W.

2009-07-01

Flexible catheter probes for magnetic resonance imaging (MRI) of the bile duct are demonstrated. The probes consist of a cytology brush modified to accept a resonant RF detector based on a spiral microcoil and hybrid integrated capacitors, and are designed for insertion into the duct via a non-magnetic endoscope during endoscopic retrograde cholangiopancreatography (ERCP). The coil must be narrow enough (<3 mm) to pass through the biopsy channel of the endoscope and sufficiently flexible to turn through 90° to enter the duct. Coils are fabricated as multi-turn electroplated conductors on a flexible base, and two designs formed on SU-8 and polyimide substrates are compared. It is shown that careful control of thermal load is used to obtain useable mechanical properties from SU-8, and that polyimide/SU-8 composites offer improved mechanical reliability. Good electrical performance is demonstrated and sub-millimetre resolution is obtained in 1H MRI experiments at 1.5 T magnetic field strength using test phantoms and in vitro liver tissue.

Measuring family functioning in families with parental cancer: Reliability and validity of the German adaptation of the Family Assessment Device (FAD).

PubMed

Beierlein, Volker; Bultmann, Johanna Christine; Möller, Birgit; von Klitzing, Kai; Flechtner, Hans-Henning; Resch, Franz; Herzog, Wolfgang; Brähler, Elmar; Führer, Daniel; Romer, Georg; Koch, Uwe; Bergelt, Corinna

2017-02-01

The concept of family functioning is gaining importance in psycho-oncology research and health care services. The Family Assessment Device (FAD) is a well-established measure of family functioning. Psychometric properties inherent in the German 51-item adaptation of the FAD are examined in different samples of families with parental cancer. Acceptance, reliability, and validity of FAD scales are analysed in samples from different study settings (N=1701 cancer patients, N=261 partners, N=158 dependent adolescent children 11 to 18years old). Missing items in the FAD scales (acceptance) are rare for adults (<1.1%) and adolescent children (<4.4%). In samples of adults and older adolescents (15 to 18years), all FAD scales except for the Roles scale are significantly reliable (0.75≤Cronbach's α≤0.88). The scales correlate highly (0.46≤Pearson's r≤0.59) with the criterion satisfaction with family life (convergent validity), and have smaller correlations (0.16≤r≤0.49) with measures of emotional distress and subjective well-being (divergent validity). In most FAD scales, adults seeking family counselling report worse family functioning (0.24≤Cohen's d≤0.59) than adults in other samples with parental cancer (discriminative validity). Overall, the German 51-item adaptation of the FAD reveals good acceptance, reliability, and validity for cancer patients and their relatives. Particularly the scale General Functioning shows excellent psychometric properties. The FAD is suitable in the assessment of families with parental cancer for adults and adolescents older than 11years. Copyright © 2016 Elsevier Inc. All rights reserved.

Reliability and acceptability of the Multiple Sclerosis Quality of Life-29 questionnaire in an English-speaking cohort.

PubMed

Baker, Georgina; Nair, Krishnan Padmakumari Sivaraman; Baster, Kathleen; Rosato, Rosalba; Solari, Alessandra

2018-05-01

Multiple Sclerosis Quality-of-Life Questionnaire-54 (MSQoL-54) is a disease-specific instrument for assessing health-related quality of life (HRQoL). Due to the number of items, the time taken to complete it is long. A shorter 29-item version, Multiple Sclerosis Quality-of-Life Questionnaire-29 (MSQoL-29) is yet to be evaluated in English. To assess reliability and acceptability of English version of MSQoL-29. Among 100 participants with MS who first completed both MSQoL-54 and MSQoL-29, 91 completed MSQoL-29 after 4-8 weeks. We looked for internal consistency (Cronbach's alpha), acceptability, reliability (intraclass correlation coefficients (ICCs)) and agreement (Bland-Altman plots). ICCs were strongly positive between MSQoL-54 and MSQoL-29 (Physical Health Composite (PHC) -ICC = 0.914, confidence interval (CI) = 0.872-0.942; Mental Health Composite (MHC) - ICC = 0.875, CI = 0.814-0.916) and between the two MSQoL-29 (PHC - ICC = 0.970, CI = 0.955-0.980; MHC - ICC = 0.937, CI = 0.904-0.958). On Bland-Altman plots, the MSQoL-29 scores of 95% of participants during two visits were within the limits of agreement (LOAs). Time taken to complete MSQoL-29 was 7.2 ± 2.9 minutes and MSQoL-54 was 19.79 ± 5.4 minutes ( p = 0.0001). MSQoL-29 has good test-retest reliability in English-speaking population and was quicker to complete.

Measuring the anaesthesia clinical learning environment at the department level is feasible and reliable.

PubMed

Castanelli, D J; Smith, N A

2017-05-01

The learning environment describes the context and culture in which trainees learn. In order to establish the feasibility and reliability of measuring the anaesthetic learning environment in individual departments we implemented a previously developed instrument in hospitals across New South Wales. We distributed the instrument to trainees from 25 anaesthesia departments and supplied summarized results to individual departments. Exploratory and confirmatory factor analyses were performed to assess internal structure validity and generalizability theory was used to calculate reliability. The number of trainees required for acceptable precision in results was determined using the standard error of measurement. We received 172 responses (59% response rate). Suitable internal structure validity was confirmed. Measured reliability was acceptable (G-coefficient 0.69) with nine trainees per department. Eight trainees were required for a 95% confidence interval of plus or minus 0.25 in the mean total score. Eight trainees as assessors also allow a 95% confidence interval of approximately plus or minus 0.3 in the subscale mean scores. Results for individual departments varied, with scores below the expected level recorded on individual subscales, particularly the 'teaching' subscale. Our results confirm that, using this instrument, individual departments can obtain acceptable precision in results with achievable trainee numbers. Additionally, with the exception of departments with few trainees, implementation proved feasible across a training region. Repeated use would allow departments or accrediting bodies to monitor their individual learning environment and the impact of changes such as the introduction of new curricular elements, or local initiatives to improve trainee experience. © The Author 2017. Published by Oxford University Press on behalf of the British Journal of Anaesthesia. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Psychometric properties of the Finnish version of the Young Person's Clinical Outcomes in Routine Evaluation (YP-CORE) questionnaire.

PubMed

Gergov, Vera; Lahti, Jari; Marttunen, Mauri; Lipsanen, Jari; Evans, Chris; Ranta, Klaus; Laitila, Aarno; Lindberg, Nina

2017-05-01

An increasing need exists for suitable measures to evaluate treatment outcome in adolescents. YP-CORE is a pan-theoretical brief questionnaire developed for this purpose, but it lacks studies in different cultures or languages. To explore the acceptability, factor structure, reliability, validity, and sensitivity to change of the Finnish translation of YP-CORE. The study was conducted at the Department of Adolescent Psychiatry, Helsinki University Central Hospital. A Finnish translation was prepared by a team of professionals and adolescents. A clinical sample of 104 patients was asked to complete the form together with BDI-21 and BAI, and 92 of them filled the forms again after a 3-month treatment. Analysis included acceptability, confirmatory factor analysis, internal and test-re-test reliability, concurrent validity, influence of gender and age, and criteria for reliable change. YP-CORE was well accepted, and the rate of missing values was low. Internal consistency (α = 0.83-.92) and test-re-test reliability were good (r = 0.69), and the results of CFA supported a one-factor model. YP-CORE showed good concurrent validity against two widely used symptom-specific measures (r = 0.62-0.87). Gender had a moderately strong effect on the scores (d = 0.67), but the effect of age was not as evident. The measure was sensitive to change, showing a larger effect size (d = 0.55) than in the BDI-21 and BAI (d = 0.31-0.50). The results show that the translation of YP-CORE into Finnish has been successful, the YP-CORE has good psychometric properties, and the measure could be taken into wider use in clinical settings for outcome measurement in adolescents.

Acceptability and Reliability of a Novel Palliative Care Screening Tool Among Emergency Department Providers.

PubMed

Bowman, Jason; George, Naomi; Barrett, Nina; Anderson, Kelsey; Dove-Maguire, Kalie; Baird, Janette

2016-06-01

The Palliative Care and Rapid Emergency Screening (P-CaRES) Project is an initiative intended to improve access to palliative care (PC) among emergency department (ED) patients with life-limiting illness by facilitating early referral for inpatient PC consultations. In the previous two phases of this project, we derived and validated a novel PC screening tool. This paper reports on the third and final preimplementation phase. Examine the acceptability of the P-CaRES tool among PC and ED providers as well as test its reliability on case vignettes. Compare variations in reliability and acceptability of the tool based on ED providers' roles (attendings, residents, and nurses) and lengths of experience. A two-part electronic survey was distributed to ED providers at multiple sites across the United States. We tested the reliability of the tool in the first part of the survey, through a series of case vignettes. A criterion standard of correct responses was first defined by consensus input from expert PC physicians' interpretations of the vignettes. The experts' input was validated using the Gwet's AC1 coefficient for inter-rater reliability. ED providers were then presented with the case vignettes and asked to use the P-CaRES tool to correctly identify which patients had unmet PC needs. ED provider responses were compared both against the criterion standard and against different subsets of respondents (divided both by role and by level of experience). The second part of the survey assessed acceptability of the P-CaRES tool among ED providers using responses to questions from a modified Ottawa Acceptability of Decision Rules Instrument, based on a 1-5 Likert rating scale. Descriptive statistics were used to report all outcomes. In total, 213 ED providers employed in three different regions across the country responded to the survey (39.4%) and 185 (86.9%) of those completed it. The majority of providers felt that the tool would be useful in their practice (80.5%), agreed that the tool was clear and unambiguous (87.1%), thought that use of the tool would likely benefit patients (87.5%), and thought that it would result in improved use of resources to help severely ill patients (83.6%). Over three-quarters of ED providers (78.5%) also self-reported that they refer patients with unmet PC needs less than 10% of the time, and only 10.8% of respondents believed that they are already utilizing an effective strategy to screen or refer patients to PC. Applying our P-CaRES tool to case vignettes, ED providers generated PC referrals in concordance with PC experts over 88.7% of the time (95% confidence interval = 86.4% to 90.6%), with an overall sensitivity of more than 90%. These results varied minimally regardless of the respondent's role in the ED or their level of experience. Screening by emergency medicine providers for unmet PC needs using a brief, novel, content-validated screening tool is acceptable and is also reliable when applied to case vignettes-regardless of provider role or experience. Clinical trial and further study are warranted and are currently under way. © 2016 by the Society for Academic Emergency Medicine.

Anatomical landmark position--can we trust what we see? Results from an online reliability and validity study of osteopaths.

PubMed

Pattyn, Elise; Rajendran, Dévan

2014-04-01

Practitioners traditionally use observation to classify the position of patients' anatomical landmarks. This information may contribute to diagnosis and patient management. To calculate a) Inter-rater reliability of categorising the sagittal plane position of four anatomical landmarks (lateral femoral epicondyle, greater trochanter, mastoid process and acromion) on side-view photographs (with landmarks highlighted and not-highlighted) of anonymised subjects; b) Intra-rater reliability; c) Individual landmark inter-rater reliability; d) Validity against a 'gold standard' photograph. Online inter- and intra-rater reliability study. Photographed subjects: convenience sample of asymptomatic students; raters: randomly selected UK registered osteopaths. 40 photographs of 30 subjects were used, a priori clinically acceptable reliability was ≥0.4. Inter-rater arm: 20 photographs without landmark highlights plus 10 with highlights; Intra-rater arm: 10 duplicate photographs (non-highlighted landmarks). Validity arm: highlighted landmark scores versus 'gold standard' photographs with vertical line. Research ethics approval obtained. Osteopaths (n = 48) categorised landmark position relative to imagined vertical-line; Gwet's Agreement Coefficient 1 (AC1) calculated and chance-corrected coefficient benchmarked against Landis and Koch's scale; Validity calculation used Kendall's tau-B. Inter-rater reliability was 'fair' (AC1 = 0.342; 95% confidence interval (CI) = 0.279-0.404) for non-highlighted landmarks and 'moderate' (AC1 = 0.700; 95% CI = 0.596-0.805) for highlighted landmarks. Intra-rater reliability was 'fair' (AC1 = 0.522); range was 'poor' (AC1 = 0.160) to 'substantial' (AC1 = 0.896). No differences were found between individual landmarks. Validity was 'low' (TB = 0.327; p = 0.104). Both inter- and intra-rater reliability was 'fair' but below clinically acceptable levels, validity was 'low'. Together these results challenge the clinical practice of using observation to categorise anterio-posterior landmark position. Copyright © 2014 Elsevier Ltd. All rights reserved.

The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom.

PubMed

Murphy, Douglas J; Bruce, David A; Mercer, Stewart W; Eva, Kevin W

2009-05-01

To investigate the reliability and feasibility of six potential workplace-based assessment methods in general practice training: criterion audit, multi-source feedback from clinical and non-clinical colleagues, patient feedback (the CARE Measure), referral letters, significant event analysis, and video analysis of consultations. Performance of GP registrars (trainees) was evaluated with each tool to assess the reliabilities of the tools and feasibility, given raters and number of assessments needed. Participant experience of process determined by questionnaire. 171 GP registrars and their trainers, drawn from nine deaneries (representing all four countries in the UK), participated. The ability of each tool to differentiate between doctors (reliability) was assessed using generalisability theory. Decision studies were then conducted to determine the number of observations required to achieve an acceptably high reliability for "high-stakes assessment" using each instrument. Finally, descriptive statistics were used to summarise participants' ratings of their experience using these tools. Multi-source feedback from colleagues and patient feedback on consultations emerged as the two methods most likely to offer a reliable and feasible opinion of workplace performance. Reliability co-efficients of 0.8 were attainable with 41 CARE Measure patient questionnaires and six clinical and/or five non-clinical colleagues per doctor when assessed on two occasions. For the other four methods tested, 10 or more assessors were required per doctor in order to achieve a reliable assessment, making the feasibility of their use in high-stakes assessment extremely low. Participant feedback did not raise any major concerns regarding the acceptability, feasibility, or educational impact of the tools. The combination of patient and colleague views of doctors' performance, coupled with reliable competence measures, may offer a suitable evidence-base on which to monitor progress and completion of doctors' training in general practice.

Exploration of the (Interrater) Reliability and Latent Factor Structure of the Alcohol Use Disorders Identification Test (AUDIT) and the Drug Use Disorders Identification Test (DUDIT) in a Sample of Dutch Probationers.

PubMed

Hildebrand, Martin; Noteborn, Mirthe G C

2015-01-01

The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual (risk and need) assessments in probation practice. In this exploratory study, the basic psychometric properties of the Alcohol Use Disorders Identification Test (AUDIT) and the Drug Use Disorders Identification Test (DUDIT) are evaluated. The instruments were administered as an oral interview instead of a self-report questionnaire. The sample comprised 383 offenders (339 men, 44 women). A subset of 56 offenders (49 men, 7 women) participated in the interrater reliability study. Data collection took place between September 2011 and November 2012. Overall, both instruments have acceptable levels of interrater reliability for total scores and acceptable to good interrater reliabilities for most of the individual items. Confirmatory factor analyses (CFA) indicated that the a priori one-, two- and three-factor solutions for the AUDIT did not fit the observed data very well. Principal axis factoring (PAF) supported a two-factor solution for the AUDIT that included a level of alcohol consumption/consequences factor (Factor 1) and a dependence factor (Factor 2), with both factors explaining substantial variance in AUDIT scores. For the DUDIT, CFA and PAF suggest that a one-factor solution is the preferred model (accounting for 62.61% of total variance). The Dutch language versions of the AUDIT and the DUDIT are reliable screening instruments for use with probationers and both instruments can be reliably administered by probation officers in probation practice. However, future research on concurrent and predictive validity is warranted.

Assessing the environmental characteristics of cycling routes to school: a study on the reliability and validity of a Google Street View-based audit.

PubMed

Vanwolleghem, Griet; Van Dyck, Delfien; Ducheyne, Fabian; De Bourdeaudhuij, Ilse; Cardon, Greet

2014-06-10

Google Street View provides a valuable and efficient alternative to observe the physical environment compared to on-site fieldwork. However, studies on the use, reliability and validity of Google Street View in a cycling-to-school context are lacking. We aimed to study the intra-, inter-rater reliability and criterion validity of EGA-Cycling (Environmental Google Street View Based Audit - Cycling to school), a newly developed audit using Google Street View to assess the physical environment along cycling routes to school. Parents (n = 52) of 11-to-12-year old Flemish children, who mostly cycled to school, completed a questionnaire and identified their child's cycling route to school on a street map. Fifty cycling routes of 11-to-12-year olds were identified and physical environmental characteristics along the identified routes were rated with EGA-Cycling (5 subscales; 37 items), based on Google Street View. To assess reliability, two researchers performed the audit. Criterion validity of the audit was examined by comparing the ratings based on Google Street View with ratings through on-site assessments. Intra-rater reliability was high (kappa range 0.47-1.00). Large variations in the inter-rater reliability (kappa range -0.03-1.00) and criterion validity scores (kappa range -0.06-1.00) were reported, with acceptable inter-rater reliability values for 43% of all items and acceptable criterion validity for 54% of all items. EGA-Cycling can be used to assess physical environmental characteristics along cycling routes to school. However, to assess the micro-environment specifically related to cycling, on-site assessments have to be added.

Validity and reliability of the persian version of templer death anxiety scale in family caregivers of cancer patients.

PubMed

Soleimani, Mohammad Ali; Bahrami, Nasim; Yaghoobzadeh, Ameneh; Banihashemi, Hedieh; Nia, Hamid Sharif; Haghdoost, Ali Akbar

2016-01-01

Due to increasing recognition of the importance of death anxiety for understanding human nature, it is important that researchers who investigate death anxiety have reliable and valid methodology to measure. The purpose of this study was to evaluate the validity and reliability of the Persian version of Templer Death Anxiety Scale (TDAS) in family caregivers of cancer patients. A sample of 326 caregivers of cancer patients completed a 15-item questionnaire. Principal components analysis (PCA) followed by a varimax rotation was used to assess factor structure of the DAS. The construct validity of the scale was assessed using exploratory and confirmatory factor analyses. Convergent and discriminant validity were also examined. Reliability was assessed with Cronbach's alpha coefficients and construction reliability. Based on the results of the PCA and consideration of the meaning of our items, a three-factor solution, explaining 60.38% of the variance, was identified. A confirmatory factor analysis (CFA) then supported the adequacy of the three-domain structure of the DAS. Goodness-of-fit indices showed an acceptable fit overall with the full model {χ(2)(df) = 262.32 (61), χ(2)/df = 2.04 [adjusted goodness of fit index (AGFI) = 0.922, parsimonious comparative fit index (PCFI) = 0.703, normed fit Index (NFI) = 0.912, CMIN/DF = 2.048, root mean square error of approximation (RMSEA) = 0.055]}. Convergent and discriminant validity were shown with construct fulfilled. The Cronbach's alpha and construct reliability were greater than 0.70. The findings show that the Persian version of the TDAS has a three-factor structure and acceptable validity and reliability.

Professional changes induced by a redesigned immunization supply chain in the Comé Health Zone, Benin.

PubMed

Guillermet, Elise; Alfa, Daleb Abdoulaye; Gbodja, Romule; Jaillard, Philippe

2017-04-19

At the end of 2013, the Government of Benin and Agence de Médecine Préventive (AMP) launched a demonstration project in Comé Health Zone (HZ) to optimize the vaccine supply chain. A key part of the demonstration project was the creation of an "informed push model" of vaccine distribution supported by a new logistician position at the health zone (district) level. At the conclusion of the demonstration project in 2015, the authors conducted an anthropological study consisting of semi-structured interviews with 62 participants to assess how the new model changed the professional identities, roles, responsibilities, and practices of personnel involved in vaccine management during and just after the demonstration project end in Comé HZ. The study found that health workers considered the logistician as a key player in enabling them to perform their public health mission, notably by improving knowledge and practices in vaccine management, providing supportive supervision, and improving the availability of vaccines and other supplies so that immunization sessions could occur more reliably and professionally within the communities they served. The demonstration project was widely accepted among study participants. The study was approved by the Cotonou Ethics Committee (CER-ISBA No. 56 dated 09/04/2015). Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Cross-cultural evaluation of the French version of the LEIPAD, a health-related quality of life instrument for use in the elderly living at home.

PubMed

Jalenques, I; Auclair, C; Roblin, J; Morand, D; Tourtauchaux, R; May, R; Vaille-Perret, E; Watts, J; Gerbaud, L; De Leo, D

2013-04-01

To cross-culturally adapt a French version of the LEIPAD, a self-administered questionnaire assessing the health-related quality of life (HRQoL) in adults aged 65 years and over living at home, and to evaluate its psychometric properties. After having translated LEIPAD in accordance with guidelines, we studied psychometric properties: reliability and construct validity-factor analysis, relationships between items and scales, internal consistency, concurrent validity with the Medical Outcome Study Short-Form 36 and known-groups validity. The results obtained in a sample of 195 elderly from the general population showed very good acceptability, with response rates superior to 93 %. Exploratory factor analysis extracted eight factors providing a multidimensionality structure with five misclassifications of items in the seven theoretical scales. Good internal consistency (Cronbach's alpha ranging from 0.73 and 0.86) and strong test-retest reliability (ICCs higher than 0.80 for six scales and 0.70 for one) were demonstrated. Concurrent validity with the SF-36 showed small to strong expected correlations. This first evaluation of the French version of LEIPAD's psychometric properties provides evidence in construct validity and reliability. It would allow HRQoL assessment in clinical and common practice, and investigators would be able to take part in national and international research projects.

The JFK Coma Recovery Scale-Revised: measurement characteristics and diagnostic utility.

PubMed

Giacino, Joseph T; Kalmar, Kathleen; Whyte, John

2004-12-01

To determine the measurement properties and diagnostic utility of the JFK Coma Recovery Scale-Revised (CRS-R). Analysis of interrater and test-retest reliability, internal consistency, concurrent validity, and diagnostic accuracy. Acute inpatient brain injury rehabilitation hospital. Convenience sample of 80 patients with severe acquired brain injury admitted to an inpatient Coma Intervention Program with a diagnosis of either vegetative state (VS) or minimally conscious state (MCS). Not applicable. The CRS-R, the JFK Coma Recovery Scale (CRS), and the Disability Rating Scale (DRS). Interrater and test-retest reliability were high for CRS-R total scores. Subscale analysis showed moderate to high interrater and test-retest agreement although systematic differences in scoring were noted on the visual and oromotor/verbal subscales. CRS-R total scores correlated significantly with total scores on the CRS and DRS indicating acceptable concurrent validity. The CRS-R was able to distinguish 10 patients in an MCS who were otherwise misclassified as in a VS by the DRS. The CRS-R can be administered reliably by trained examiners and repeated measurements yield stable estimates of patient status. CRS-R subscale scores demonstrated good agreement across raters and ratings but should be used cautiously because some scores were underrepresented in the current study. The CRS-R appears capable of differentiating patients in an MCS from those in a VS.

Validating the Implementation Climate Scale (ICS) in Child Welfare Organizations

PubMed Central

Ehrhart, Mark G.; Torres, Elisa M.; Wright, Lisa A.; Martinez, Sandra Y.; Aarons, Gregory A.

2015-01-01

There is increasing emphasis on the use of evidence-based practices (EBPs) in child welfare settings and growing recognition of the importance of the organizational environment, and the organization’s climate in particular, for how employees perceive and support EBP implementation. Recently, Ehrhart, Aarons, and Farahnak (2014) reported on the development and validation of a measure of EBP implementation climate, the Implementation Climate Scale (ICS), in a sample of mental health clinicians. The ICS consists of 18 items and measures six critical dimensions of implementation climate: focus on EBP, educational support for EBP, recognition for EBP, rewards for EBP, selection or EBP, and selection for openness. The goal of the current study is to extend this work by providing evidence for the factor structure, reliability, and validity of the ICS in a sample of child welfare service providers. Survey data were collected from 215 child welfare providers across three states, 12 organizations, and 43 teams. Confirmatory factor analysis demonstrated good fit to the six-factor model and the alpha reliabilities for the overall measure and its subscales was acceptable. In addition, there was general support for the invariance of the factor structure across the child welfare and mental health sectors. In conclusion, this study provides evidence for the factor structure, reliability, and validity of the ICS measure for use in child welfare service organizations. PMID:26563643

Developmental Considerations on the Free-Piston Stirling Power Convertor for Use in Space

NASA Technical Reports Server (NTRS)

Schreiber, Jeffrey G.

2006-01-01

Free-piston Stirling power conversion has been considered a candidate for radioisotope power systems for space for more than a decade. Prior to the free-piston Stirling architecture, systems were designed with kinematic Stirling engines with rotary alternators to convert heat to electricity. These systems were proposed with lightly loaded linkages to achieve the necessary life. When the free-piston configuration was initially proposed, it was thought to be attractive due to the relatively high conversion efficiency, acceptable mass, and the potential for long life and high reliability. These features have consistently been recognized by teams that have studied technology options for radioisotope power systems. Since free-piston Stirling power conversion was first considered for space power applications, there have been major advances in three general areas of development: demonstration of life and reliability, the success achieved by Stirling cryocoolers in flight, and the overall developmental maturity of the technology for both flight and terrestrial applications. Based on these advances, free-piston Stirling convertors are currently being developed for a number of terrestrial applications. They commonly operate with the power, efficiency, life, and reliability as intended, and much of the development now centers on system integration. This paper will summarize the accomplishments of free-piston Stirling power conversion technology over the past decade, review the status, and discuss the challenges that remain.

Developmental Considerations on the Free-piston Stirling Power Convertor for Use in Space

NASA Technical Reports Server (NTRS)

Schreiber, Jeffrey G.

2007-01-01

Free-piston Stirling power conversion has been considered a candidate for radioisotope power systems for space for more than a decade. Prior to the free-piston Stirling architecture, systems were designed with kinematic Stirling engines with rotary alternators to convert heat to electricity. These systems were proposed with lightly loaded linkages to achieve the necessary life. When the free-piston configuration was initially proposed, it was thought to be attractive due to the relatively high conversion efficiency, acceptable mass, and the potential for long life and high reliability. These features have consistently been recognized by teams that have studied technology options for radioisotope power systems. Since free-piston Stirling power conversion was first considered for space power applications, there have been major advances in three general areas of development: demonstration of life and reliability, the success achieved by Stirling cryocoolers in flight, and the overall developmental maturity of the technology for both flight and terrestrial applications. Based on these advances, free-piston Stirling convertors are currently being developed for a number of terrestrial applications. They commonly operate with the power, efficiency, life, and reliability as intended, and much of the development now centers on system integration. This paper will summarize the accomplishments of free-piston Stirling power conversion technology over the past decade, review the status, and discuss the challenges that remain.

Development and validation of the client engagement and service use scale: A pilot study.

PubMed

Kline, Emily R; DeTore, Nicole R; Keefe, Kristen; Seidman, Larry J; Srihari, Vinod H; Keshavan, Matcheri S; Guyer, Margaret

2018-05-12

Specialized treatment for first episode psychosis offers clients a menu of services coordinated within a specialized treatment team. To enhance the impact of these services, promoting engagement and preventing early treatment drop-out is critical. However, engagement is poorly tracked and typically quantified through proxy variables such as session attendance, medication adherence, or working alliance. The aim of this study is to introduce and pilot a new measure of engagement for first episode psychosis coordinated specialty care, the Client Engagement and Service Use Scale (CENSUS). The CENSUS was evaluated for reliability and validated against the Service Engagement Scale and an appointment count for a small sample (N = 10) of first episode clients. The measure was also evaluated for acceptability by a consumer advocacy group. Clinicians achieved high inter-rater reliability after minimal training. CENSUS items demonstrated medium to large correlations with other measures of engagement. Feedback from the consumer group emphasized that clinicians should ask questions in a way that is nonjudgmental and successfully elicits authentic client feedback about their service preferences. This pilot study yielded preliminary evidence of reliability and validity, suggesting that the CENSUS is a useful and novel tool for tracking and differentiating degrees of client engagement across multiple intervention components and for facilitating structured discussions regarding clients' service utilization and preferences. Copyright © 2018. Published by Elsevier B.V.

Validating the Implementation Climate Scale (ICS) in child welfare organizations.

PubMed

Ehrhart, Mark G; Torres, Elisa M; Wright, Lisa A; Martinez, Sandra Y; Aarons, Gregory A

2016-03-01

There is increasing emphasis on the use of evidence-based practices (EBPs) in child welfare settings and growing recognition of the importance of the organizational environment, and the organization's climate in particular, for how employees perceive and support EBP implementation. Recently, Ehrhart, Aarons, and Farahnak (2014) reported on the development and validation of a measure of EBP implementation climate, the Implementation Climate Scale (ICS), in a sample of mental health clinicians. The ICS consists of 18 items and measures six critical dimensions of implementation climate: focus on EBP, educational support for EBP, recognition for EBP, rewards for EBP, selection or EBP, and selection for openness. The goal of the current study is to extend this work by providing evidence for the factor structure, reliability, and validity of the ICS in a sample of child welfare service providers. Survey data were collected from 215 child welfare providers across three states, 12 organizations, and 43 teams. Confirmatory factor analysis demonstrated good fit to the six-factor model and the alpha reliabilities for the overall measure and its subscales was acceptable. In addition, there was general support for the invariance of the factor structure across the child welfare and mental health sectors. In conclusion, this study provides evidence for the factor structure, reliability, and validity of the ICS measure for use in child welfare service organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Acceptance and Commitment Therapy for chronic pain: A diary study of treatment process in relation to reliable change in disability

PubMed Central

Vowles, Kevin E.; Fink, Brandi C.; Cohen, Lindsey L.

2016-01-01

In chronic pain treatment, a primary goal is reduced disability. It is often assumed that a central process by which disability reduction occurs is pain reduction. Conversely, approaches such as Acceptance and Commitment Therapy (ACT) posit that pain reduction is not necessary for reduced disability. Instead, disability reduction occurs when responses to pain are changed, such that as unsuccessful struggles for pain control decreases and engagement in personally-valued activities increases. Treatment outcome studies have supported ACT’s effectiveness; however, less work has examined how within-treatment patterns of change relate to treatment success or failure (i.e., decreased or sustained disability). The present study, therefore, sought to examine this issue. Specifically, struggles for pain control and engagement in valued activities were recorded weekly in 21 patients who completed a four week interdisciplinary ACT intervention for chronic pain. It was hypothesized that the presence or absence of reliable change in disability at a three month follow-up would be predicted by within treatment patterns of change in the weekly data. At follow-up, 47.6% of patients evidenced reliable disability reduction. The expected pattern of change occurred in 81.0% of patients–specifically, when pain control attempts decreased and engagement in valued activities increased, reliably reduced disability typically occurred, while the absence of this pattern was typically associated with a lack of reliable change. Further, changes in pain intensity, also assessed weekly, were unrelated to reliable change. Overall, these results provide additional support for the ACT model and further suggest some possible requirements for treatment success. PMID:27818931

Development and evaluation of a quality score for abstracts

PubMed Central

Timmer, Antje; Sutherland, Lloyd R; Hilsden, Robert J

2003-01-01

Background The evaluation of abstracts for scientific meetings has been shown to suffer from poor inter observer reliability. A measure was developed to assess the formal quality of abstract submissions in a standardized way. Methods Item selection was based on scoring systems for full reports, taking into account published guidelines for structured abstracts. Interrater agreement was examined using a random sample of submissions to the American Gastroenterological Association, stratified for research type (n = 100, 1992–1995). For construct validity, the association of formal quality with acceptance for presentation was examined. A questionnaire to expert reviewers evaluated sensibility items, such as ease of use and comprehensiveness. Results The index comprised 19 items. The summary quality scores showed good interrater agreement (intra class coefficient 0.60 – 0.81). Good abstract quality was associated with abstract acceptance for presentation at the meeting. The instrument was found to be acceptable by expert reviewers. Conclusion A quality index was developed for the evaluation of scientific meeting abstracts which was shown to be reliable, valid and useful. PMID:12581457

Establishing cephalometric landmarks for the translational study of Le Fort-based facial transplantation in Swine: enhanced applications using computer-assisted surgery and custom cutting guides.

PubMed

Santiago, Gabriel F; Susarla, Srinivas M; Al Rakan, Mohammed; Coon, Devin; Rada, Erin M; Sarhane, Karim A; Shores, Jamie T; Bonawitz, Steven C; Cooney, Damon; Sacks, Justin; Murphy, Ryan J; Fishman, Elliot K; Brandacher, Gerald; Lee, W P Andrew; Liacouras, Peter; Grant, Gerald; Armand, Mehran; Gordon, Chad R

2014-05-01

Le Fort-based, maxillofacial allotransplantation is a reconstructive alternative gaining clinical acceptance. However, the vast majority of single-jaw transplant recipients demonstrate less-than-ideal skeletal and dental relationships, with suboptimal aesthetic harmony. The purpose of this study was to investigate reproducible cephalometric landmarks in a large-animal model, where refinement of computer-assisted planning, intraoperative navigational guidance, translational bone osteotomies, and comparative surgical techniques could be performed. Cephalometric landmarks that could be translated into the human craniomaxillofacial skeleton, and that would remain reliable following maxillofacial osteotomies with midfacial alloflap inset, were sought on six miniature swine. Le Fort I- and Le Fort III-based alloflaps were harvested in swine with osteotomies, and all alloflaps were either autoreplanted or transplanted. Cephalometric analyses were performed on lateral cephalograms preoperatively and postoperatively. Critical cephalometric data sets were identified with the assistance of surgical planning and virtual prediction software and evaluated for reliability and translational predictability. Several pertinent landmarks and human analogues were identified, including pronasale, zygion, parietale, gonion, gnathion, lower incisor base, and alveolare. Parietale-pronasale-alveolare and parietale-pronasale-lower incisor base were found to be reliable correlates of sellion-nasion-A point angle and sellion-nasion-B point angle measurements in humans, respectively. There is a set of reliable cephalometric landmarks and measurement angles pertinent for use within a translational large-animal model. These craniomaxillofacial landmarks will enable development of novel navigational software technology, improve cutting guide designs, and facilitate exploration of new avenues for investigation and collaboration.

Reliability and validity of a brief sleep questionnaire for children in Japan.

PubMed

Okada, Masakazu; Kitamura, Shingo; Iwadare, Yoshitaka; Tachimori, Hisateru; Kamei, Yuichi; Higuchi, Shigekazu; Mishima, Kazuo

2017-09-15

There is a dearth of sleep questionnaires with few items and confirmed reliability and validity that can be used for the early detection of sleep problems in children. The aim of this study was to develop a questionnaire with few items and assess its reliability and validity in both children at high risk of sleep disorders and a community population. Data for analysis were derived from two populations targeted by the Children's Sleep Habits Questionnaire (CSHQ): 178 children attending elementary school and 432 children who visited a pediatric psychiatric hospital (aged 6-12 years). The new questionnaire was constructed as a subset of the CSHQ. The newly developed short version of the sleep questionnaire for children (19 items) had an acceptable internal consistency (0.65). Using the cutoff value of the CSHQ, the total score of the new questionnaire was confirmed to have discriminant validity (27.2 ± 3.9 vs. 22.0 ± 2.1, p < 0.001) and yielded a sensitivity of 0.83 and specificity of 0.78 by receiver operator characteristic curve analysis. Total score of the new questionnaire was significantly correlated with total score (r = 0.81, p < 0.001) and each subscale score (r = 0.29-0.65, p < 0.001) of the CSHQ. The new questionnaire demonstrated an adequate reliability and validity in both high-risk children and a community population, as well as similar screening ability to the CSHQ. It could thus be a convenient instrument to detect sleep problems in children.

Space vehicle onboard command encoder

NASA Technical Reports Server (NTRS)

1975-01-01

A flexible onboard encoder system was designed for the space shuttle. The following areas were covered: (1) implementation of the encoder design into hardware to demonstrate the various encoding algorithms/code formats, (2) modulation techniques in a single hardware package to maintain comparable reliability and link integrity of the existing link systems and to integrate the various techniques into a single design using current technology. The primary function of the command encoder is to accept input commands, generated either locally onboard the space shuttle or remotely from the ground, format and encode the commands in accordance with the payload input requirements and appropriately modulate a subcarrier for transmission by the baseband RF modulator. The following information was provided: command encoder system design, brassboard hardware design, test set hardware and system packaging, and software.

Validation of a Behavioral Approach for Measuring Saccades in Parkinson's Disease.

PubMed

Turner, Travis H; Renfroe, Jenna B; Duppstadt-Delambo, Amy; Hinson, Vanessa K

2017-01-01

Speed and control of saccades are related to disease progression and cognitive functioning in Parkinson's disease (PD). Traditional eye-tracking complexities encumber application for individual evaluations and clinical trials. The authors examined psychometric properties of standalone tasks for reflexive prosaccade latency, volitional saccade initiation, and saccade inhibition (antisaccade) in a heterogeneous sample of 65 PD patients. Demographics had minimal impact on task performance. Thirty-day test-retest reliability estimates for behavioral tasks were acceptable and similar to traditional eye tracking. Behavioral tasks demonstrated concurrent validity with traditional eye-tracking measures; discriminant validity was less clear. Saccade initiation and inhibition discriminated PD patients with cognitive impairment. The present findings support further development and use of the behavioral tasks for assessing latency and control of saccades in PD.

Some Observations on the Current Status of Performing Finite Element Analyses

NASA Technical Reports Server (NTRS)

Raju, Ivatury S.; Knight, Norman F., Jr; Shivakumar, Kunigal N.

2015-01-01

Aerospace structures are complex high-performance structures. Advances in reliable and efficient computing and modeling tools are enabling analysts to consider complex configurations, build complex finite element models, and perform analysis rapidly. Many of the early career engineers of today are very proficient in the usage of modern computers, computing engines, complex software systems, and visualization tools. These young engineers are becoming increasingly efficient in building complex 3D models of complicated aerospace components. However, the current trends demonstrate blind acceptance of the results of the finite element analysis results. This paper is aimed at raising an awareness of this situation. Examples of the common encounters are presented. To overcome the current trends, some guidelines and suggestions for analysts, senior engineers, and educators are offered.

Effects of side-stick controllers on rotorcraft handling qualities for terrain flight

NASA Technical Reports Server (NTRS)

Aiken, E. W.

1985-01-01

Pertinent fixed and rotary-wing feasibility studies and handling-qualities research programs are reviewed and the effects of certain controller characteristics on handling qualities for specific rotorcraft flight tasks are summarized. The effects of the controller force-deflection relationship and the number of controlled axes that are integrated in a single controller are examined. Simulation studies were conducted which provide a significant part of the available handling qualities data. The studies demonstrate the feasibility of using a single, properly designed, limited-displacement, multiaxis controller for certain relatively routine flight tasks in a two-crew rotorcraft with nominal levels of stability and control augmentation with a high degree of reliability are incorporated, separated three or two-axis controller configurations are required for acceptable handling qualities.

Innovation and reliability of atomic standards for PTTI applications

NASA Technical Reports Server (NTRS)

Kern, R.

1981-01-01

Innovation and reliability in hyperfine frequency standards and clock systems are discussed. Hyperfine standards are defined as those precision frequency sources and clocks which use a hyperfine atomic transition for frequency control and which have realized significant commercial production and acceptance (cesium, hydrogen, and rubidium atoms). References to other systems such as thallium and ammonia are excluded since these atomic standards have not been commercially exploited in this country.

Adaptive method of recognition of signals for one and two-frequency signal system in the telephony on the background of speech

NASA Astrophysics Data System (ADS)

Kuznetsov, Michael V.

2006-05-01

For reliable teamwork of various systems of automatic telecommunication including transferring systems of optical communication networks it is necessary authentic recognition of signals for one- or two-frequency service signal system. The analysis of time parameters of an accepted signal allows increasing reliability of detection and recognition of the service signal system on a background of speech.

Evaluation of the psychometric properties of the phlebitis and infiltration scales for the assessment of complications of peripheral vascular access devices.

PubMed

Groll, Dianne; Davies, Barbara; Mac Donald, Joan; Nelson, Susanne; Virani, Tazim

2010-01-01

To prevent complications from peripheral vascular access device (PVAD) therapy, the Infusion Nurses Society (INS) developed 2 scales to measure the extent and severity of phlebitis and infiltration in PVADs. This study evaluated the psychometric properties of these scales to validate them with respect to their interrater reliability, concurrent validity, feasibility, and acceptability. A total of 182 patients at 2 sites were enrolled, and 416 observations of PVAD sites were made. Two nurses independently rated each PVAD site for the presence or absence of phlebitis and/or infiltration by using the INS scales. The interrater reliability was calculated, as was the agreement of the observed versus charted incidence of phlebitis and infiltration (concurrent validity) and the ease of use of the scales (feasibility, acceptability). Interrater reliability for both the Phlebitis and Infiltration scales and concurrent validity were found to be statistically significant (P < .05). The study nurses reported the scales to be easy to use, taking an average of 1.3 minutes to complete both. The importance of valid measures for use in research cannot be underestimated. The INS Phlebitis and Infiltration scales have been shown to be easy to use, valid, and reliable scales.

Adaptation and Validation of the Arabic Version of the Infant Breastfeeding Knowledge Questionnaire among Lebanese Women.

PubMed

Tamim, Hani; Ghandour, Lilian A; Shamsedine, Lama; Charafeddine, Lama; Nasser, Fatima; Khalil, Yvette; Nabulsi, Mona

2016-11-01

Valid instruments that can reliably assess maternal breastfeeding knowledge in Arabic-speaking populations are nonexistent. The availability of such an instrument is essential for investigators working in this field. This study aimed to describe the adaptation and validation of the Arabic Breastfeeding Knowledge Questionnaire (BFK-A) from the original 20-item English version. A translated version of the 20-item BFK was validated among 417 Lebanese women after pilot testing for clarity, comprehension, length, and cultural appropriateness. Exploratory factor analysis was run to examine dimensionality of the instrument and Kuder-Richardson-20 (KR-20) was used to assess its internal consistency. The BFK-A is a unidimensional scale with acceptable internal consistency reliability (KR-20 = 0.652) after the exclusion of 4 items. Higher breastfeeding knowledge levels were strongly and statistically significantly associated with higher mean scores for the validated Arabic Iowa Infant Feeding Attitude Scale ( P < .001), thus confirming its construct validity. The Arabic 16-item BFK-A has an acceptable reliability, similar to the original instrument. Further studies are encouraged to confirm the validity of the 16-item BFK-A among other Arab populations. There is also a need to develop more reliable instruments to use in lactation research in this context.

Reliability and validity of a measure of role functioning among people with psychiatric disabilities.

PubMed

Harris, Meredith; Gladman, Beverley; Hennessy, Nicole; Lloyd, Chris; Mowry, Bryan; Waghorn, Geoffrey

2011-06-01

The aim was to investigate the reliability and validity of the Socially Valued Role Classification Scale (SRCS), a domain-specific measure of role functioning designed for use with community residents with psychiatric disabilities. Test-retest reliability, concurrent validity, face validity, consumer and clinician acceptability and utility were examined. Sixty community residents with schizophrenia or schizoaffective disorder participated in this study where the SRCS was administered by telephone. Test-retest reliability showed good or very good agreement for subscale scores (intraclass correlations (ICCs): 0.78-0.89) and for items capturing amount of participation in domain-specific activities (ICC: 0.67-1.00). Greater variation was observed for items capturing assistance required with activities (κ: 0.40-0.75), and standard of activities performed (κ: 0.43-1.00). Concurrent validity was supported by moderate to very good associations in the directions expected. Face validity, user acceptability and utility in telephone interviews were adequate. These findings add to previous psychometric evidence and support the continued development of the SRCS for use in community mental health settings. The SRCS has promising utility for occupational therapists involved in psychiatric rehabilitation outcome measurement. © 2011 Queensland Health - QCMHR. Australian Occupational Therapy Journal © 2011 Australian Association of Occupational Therapists.

Construct validity and reliability of the Finnish version of the Knee Injury and Osteoarthritis Outcome Score.

PubMed

Multanen, Juhani; Honkanen, Mikko; Häkkinen, Arja; Kiviranta, Ilkka

2018-05-22

The Knee Injury and Osteoarthritis Outcome Score (KOOS) is a commonly used knee assessment and outcome tool in both clinical work and research. However, it has not been formally translated and validated in Finnish. The purpose of this study was to translate and culturally adapt the KOOS questionnaire into Finnish and to determine its validity and reliability among Finnish middle-aged patients with knee injuries. KOOS was translated and culturally adapted from English into Finnish. Subsequently, 59 patients with knee injuries completed the Finnish version of KOOS, Western Ontario and McMaster Osteoarthritis Index (WOMAC), Short-Form 36 Health Survey (SF-36) and Numeric Pain Rating Scale (Pain-NRS). The same KOOS questionnaire was re-administered 2 weeks later. Psychometric assessment of the Finnish KOOS was performed by testing its construct validity and reliability by using internal consistency, test-retest reliability and measurement error. The floor and ceiling effects were also examined. The cross-cultural adaptation revealed only minor cultural differences and was well received by the patients. For construct validity, high to moderate Spearman's Correlation Coefficients were found between the KOOS subscales and the WOMAC, SF-36, and Pain-NRS subscales. The Cronbach's alpha was from 0.79 to 0.96 for all subscales indicating acceptable internal consistency. The test-retest reliability was good to excellent, with Intraclass Correlation Coefficients ranging from 0.73 to 0.86 for all KOOS subscales. The minimal detectable change ranged from 17 to 34 on an individual level and from 2 to 4 on a group level. No floor or ceiling effects were observed. This study yielded an appropriately translated and culturally adapted Finnish version of KOOS which demonstrated good validity and reliability. Our data indicate that the Finnish version of KOOS is suitable for assessment of the knee status of Finnish patients with different knee complaints. Further studies are needed to evaluate the predictive ability of KOOS in the Finnish population.

A Protocol for Advanced Psychometric Assessment of Surveys

PubMed Central

Squires, Janet E.; Hayduk, Leslie; Hutchinson, Alison M.; Cranley, Lisa A.; Gierl, Mark; Cummings, Greta G.; Norton, Peter G.; Estabrooks, Carole A.

2013-01-01

Background and Purpose. In this paper, we present a protocol for advanced psychometric assessments of surveys based on the Standards for Educational and Psychological Testing. We use the Alberta Context Tool (ACT) as an exemplar survey to which this protocol can be applied. Methods. Data mapping, acceptability, reliability, and validity are addressed. Acceptability is assessed with missing data frequencies and the time required to complete the survey. Reliability is assessed with internal consistency coefficients and information functions. A unitary approach to validity consisting of accumulating evidence based on instrument content, response processes, internal structure, and relations to other variables is taken. We also address assessing performance of survey data when aggregated to higher levels (e.g., nursing unit). Discussion. In this paper we present a protocol for advanced psychometric assessment of survey data using the Alberta Context Tool (ACT) as an exemplar survey; application of the protocol to the ACT survey is underway. Psychometric assessment of any survey is essential to obtaining reliable and valid research findings. This protocol can be adapted for use with any nursing survey. PMID:23401759

Multi-version software reliability through fault-avoidance and fault-tolerance

NASA Technical Reports Server (NTRS)

Vouk, Mladen A.; Mcallister, David F.

1989-01-01

A number of experimental and theoretical issues associated with the practical use of multi-version software to provide run-time tolerance to software faults were investigated. A specialized tool was developed and evaluated for measuring testing coverage for a variety of metrics. The tool was used to collect information on the relationships between software faults and coverage provided by the testing process as measured by different metrics (including data flow metrics). Considerable correlation was found between coverage provided by some higher metrics and the elimination of faults in the code. Back-to-back testing was continued as an efficient mechanism for removal of un-correlated faults, and common-cause faults of variable span. Software reliability estimation methods was also continued based on non-random sampling, and the relationship between software reliability and code coverage provided through testing. New fault tolerance models were formulated. Simulation studies of the Acceptance Voting and Multi-stage Voting algorithms were finished and it was found that these two schemes for software fault tolerance are superior in many respects to some commonly used schemes. Particularly encouraging are the safety properties of the Acceptance testing scheme.

Developing acceptance limits for measured bearing wear of the Space Shuttle Main Engine high pressure oxidizer turbopump

NASA Technical Reports Server (NTRS)

Genge, Gary G.

1991-01-01

The probabilistic design approach currently receiving attention for structural failure modes has been adapted for obtaining measured bearing wear limits in the Space Shuttle Main Engine high-pressure oxidizer turbopump. With the development of the shaft microtravel measurements to determine bearing health, an acceptance limit was neeed that protects against all known faiure modes yet is not overly conservative. This acceptance criteria limit has been successfully determined using probabilistic descriptions of preflight hardware geometry, empirical bearing wear data, mission requirements, and measurement tool precision as an input for a Monte Carlo simulation. The result of the simulation is a frequency distribution of failures as a function of preflight acceptance limits. When the distribution is converted into a reliability curve, a conscious risk management decision is made concerning the acceptance limit.

Eliminative Argumentation: A Basis for Arguing Confidence in System Properties

DTIC Science & Technology

2015-02-01

errors to acceptable system reliability is unsound . But this is not an acceptable undercutting defeater; it does not put the conclusion about system...first to note sources of unsoundness in arguments, namely, questionable inference rules and weaknesses in proffered evidence. However, the notions of...This material is based upon work funded and supported by the Department of Defense under Contract No. FA8721-05-C-0003 with Carnegie Mellon University

Model construction for the intention to use telecare in patients with chronic diseases.

PubMed

Huang, Jui-Chen; Lee, Yii-Ching

2013-01-01

Objective. This study chose patients with chronic diseases as study subjects to investigate their intention to use telecare. Methods. A large medical institute in Taiwan was used as the sample unit. Patients older than 20 years, who had chronic diseases, were sampled by convenience sampling and surveyed with a structural questionnaire, and a total of 500 valid questionnaires were collected. Model construction was based on the Health Belief Model. The reliability and validity of the measurement model were tested using confirmatory factor analysis (CFA), and the causal model was explained by structural equation modeling (SEM). Results. The priority should be on promoting the perceived benefits of telecare, with a secondary focus on the external cues to action, such as promoting the influences of important people on the patients. Conclusion. The findings demonstrated that patients with chronic diseases use telecare differently from the general public. To promote the use and acceptance of telecare in patients with chronic diseases, technology developers should prioritize the promotion of the usefulness of telecare. In addition, policy makers can strengthen the marketing from media and medical personnel, in order to increase the acceptance of telecare by patients with chronic diseases.

Consumer acceptability and understanding of front-of-pack nutrition labels.

PubMed

Mejean, C; Macouillard, P; Péneau, S; Hercberg, S; Castetbon, K

2013-10-01

Front-of-pack (FOP) nutrition labelling has been proposed as a tool for helping consumers make healthy choices. Before determining its effects on consumer behaviour, factors involved in its use must be elucidated, i.e. understanding and acceptability on the part of the consumer. Among five FOP labels, we sought to determine which formats were most easily understood and accepted by a large sample of adults. Among 39 370 adults who participated in the French Nutrinet-Santé cohort study, understanding and indicators of acceptability (attitude, liking, visual attractiveness and perceived cognitive workload) were measured for five FOP labels: The currently used 'multiple traffic lights' (MTL) and 'simple traffic lights' (STL), and the 'colour range' logo (CR), the 'green tick' and the PNNS logo. We investigated the contribution of the different elements to consumer perception of FOP labels using multiple correspondence analyses. Over half of the sample population showed a high level of understanding and perceived no discomfort in terms of the different logos. Label formats were positioned along an acceptability gradient ranging from acceptance to rejection, consisting of 'liking', 'attractiveness' and indicators of perceived cognitive workload. MTL was significantly more often liked and was viewed as reliable and informative. MTL, STL and the green tick performed better than the CR and PNNS logos in terms of ease of identification and comprehension. CR was clearly the least appreciated and it had the most complex format. Consumers prefer FOP labels which give complete, reliable and simplified information on the nutrient quality of foods. © 2013 The Authors Journal of Human Nutrition and Dietetics © 2013 The British Dietetic Association Ltd.

Developing an assessment of fire-setting to guide treatment in secure settings: the St Andrew's Fire and Arson Risk Instrument (SAFARI).

PubMed

Long, Clive G; Banyard, Ellen; Fulton, Barbara; Hollin, Clive R

2014-09-01

Arson and fire-setting are highly prevalent among patients in secure psychiatric settings but there is an absence of valid and reliable assessment instruments and no evidence of a significant approach to intervention. To develop a semi-structured interview assessment specifically for fire-setting to augment structured assessments of risk and need. The extant literature was used to frame interview questions relating to the antecedents, behaviour and consequences necessary to formulate a functional analysis. Questions also covered readiness to change, fire-setting self-efficacy, the probability of future fire-setting, barriers to change, and understanding of fire-setting behaviour. The assessment concludes with indications for assessment and a treatment action plan. The inventory was piloted with a sample of women in secure care and was assessed for comprehensibility, reliability and validity. Staff rated the St Andrews Fire and Risk Instrument (SAFARI) as acceptable to patients and easy to administer. SAFARI was found to be comprehensible by over 95% of the general population, to have good acceptance, high internal reliability, substantial test-retest reliability and validity. SAFARI helps to provide a clear explanation of fire-setting in terms of the complex interplay of antecedents and consequences and facilitates the design of an individually tailored treatment programme in sympathy with a cognitive-behavioural approach. Further studies are needed to verify the reliability and validity of SAFARI with male populations and across settings.

A Turkish Version of the Critical-Care Pain Observation Tool: Reliability and Validity Assessment.

PubMed

Aktaş, Yeşim Yaman; Karabulut, Neziha

2017-08-01

The study aim was to evaluate the validity and reliability of the Critical-Care Pain Observation Tool in critically ill patients. A repeated measures design was used for the study. A convenience sample of 66 patients who had undergone open-heart surgery in the cardiovascular surgery intensive care unit in Ordu, Turkey, was recruited for the study. The patients were evaluated by using the Critical-Care Pain Observation Tool at rest, during a nociceptive procedure (suctioning), and 20 minutes after the procedure while they were conscious and intubated after surgery. The Turkish version of the Critical-Care Pain Observation Tool has shown statistically acceptable levels of validity and reliability. Inter-rater reliability was supported by moderate-to-high-weighted κ coefficients (weighted κ coefficient = 0.55 to 1.00). For concurrent validity, significant associations were found between the scores on the Critical-Care Pain Observation Tool and the Behavioral Pain Scale scores. Discriminant validity was also supported by higher scores during suctioning (a nociceptive procedure) versus non-nociceptive procedures. The internal consistency of the Critical-Care Pain Observation Tool was 0.72 during a nociceptive procedure and 0.71 during a non-nociceptive procedure. The validity and reliability of the Turkish version of the Critical-Care Pain Observation Tool was determined to be acceptable for pain assessment in critical care, especially for patients who cannot communicate verbally. Copyright © 2016 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Psychometric properties of the revised Malay version Medical Outcome Study Social Support Survey using confirmatory factor analysis among postpartum mothers.

PubMed

Norhayati, Mohd Noor; Aniza, Abd Aziz; Nik Hazlina, Nik Hussain; Azman, Mohd Yacob

2015-12-01

Social support is an essential component for the physical and emotional well-being of postpartum mothers. The objective of this study is to determine the psychometric properties of the revised Malay version Medical Outcome Study (MOS) Social Support Survey using a confirmatory validity approach. A cross-sectional study was conducted involving 144 postpartum mothers attending Obstetric and Gynecology Clinic, Universiti Sains Malaysia Hospital. Construct validity and internal consistency assessment was performed after the translation, content validity and face validity process. The data were analyzed using SPSS 20.0 (SPSS Inc., Chicago, IL, USA) and AMOS 20.0 (SPSS Inc., Chicago, IL, USA). The original questionnaire consists of four domains (emotional/informational support, tangible support, affectionate support and positive social interaction) and 19 items. Affectionate support domain with three items only was treated as a separate construct and was not included in the factor analysis. The final confirmatory model with three constructs and 13 items demonstrated acceptable factor loadings, domain to domain correlation and best fit; (χ2[df]=1.665 [61]; P-value=0.001; Tucker-Lewis Index=0.944; comparative fit index=0.956; root mean square error of approximation=0.068). Composite reliability, average variance extracted and Cronbach's α of the domains ranged from 0.649 to 0.903; 0.390 to 0.699; 0.616 to 0.902, respectively. The study suggested that the four-factor model with 16 items (including one separate factor of affectionate) of the revised Malay version MOS Social Support Survey was acceptable to be used to measure social support after childbirth because it is valid, reliable and simple. © 2015 Wiley Publishing Asia Pty Ltd.

IV busulfan dose individualization in children undergoing hematopoietic stem cell transplant: limited sampling strategies.

PubMed

Dupuis, L Lee; Sibbald, Cathryn; Schechter, Tal; Ansari, Marc; Gassas, Adam; Théorêt, Yves; Kassir, Nastya; Champagne, Martin A; Doyle, John

2008-05-01

We currently calculate area under the busulfan concentration time curve (AUC) using 7 plasma busulfan concentrations (AUC7) drawn after the first of 16 i.v. busulfan doses given as a 2-hour infusion every 6 hours. The aim of this study was to develop and validate limited sampling strategies (LSSs) using 3 or fewer busulfan concentration values with which to reliably calculate AUC in children undergoing hematopoietic stem cell transplant (HSCT). Children in the development group (44) received i.v. busulfan at Sick Kids; the validation group consisted of 35 children who received care at CHU Ste-Justine. Busulfan doses given and subsequent plasma busulfan concentrations were recorded. LSSs using 1 to 3 concentration-time points were developed using multiple linear regression. LSS were considered to be acceptable when adjusted r(2) > 0.9, mean bias <15% and precision <15%. Extent of agreement between the AUC7 values and the LSS AUC was assessed by the intraclass correlation coefficient (ICC) and Bland-Altman (BA) analysis. Agreement was considered to be excellent when the lower limit of the 95% confidence limit of the ICC exceeded 0.9 and when the limits of agreement in the BA analysis were +/-15% for both AUC and dose. Administration of the theoretic adjusted busulfan doses based on each LSS was simulated and cases where the resulting AUC was >1500 or <900 microM x min were noted. LSSs using 1, 2, or 3 plasma busulfan concentrations were developed that showed excellent agreement with AUC7 and adjusted busulfan doses. In the validation sample, only the 2- and 3-point LSSs demonstrated acceptable precision and lack of bias. LSSs using 2 or 3 plasma busulfan concentrations can be used to reliably estimate busulfan AUC after IV administration in children undergoing HSCT.

Assessing Lifetime Stress Exposure Using the Stress and Adversity Inventory for Adults (Adult STRAIN): An Overview and Initial Validation.

PubMed

Slavich, George M; Shields, Grant S

2018-01-01

Numerous theories have proposed that acute and chronic stressors may exert a cumulative effect on life-span health by causing biological "wear and tear," or allostatic load, which in turn promotes disease. Very few studies have directly tested such models, though, partly because of the challenges associated with efficiently assessing stress exposure over the entire life course. To address this issue, we developed the first online system for systematically assessing lifetime stress exposure, called the Stress and Adversity Inventory (STRAIN), and describe its initial validation here. Adults recruited from the community (n = 205) were administered the STRAIN, Childhood Trauma Questionnaire-Short Form, and Perceived Stress Scale, as well as measures of socioeconomic status, personality, social desirability, negative affect, mental and physical health complaints, sleep quality, computer-assessed executive function, and doctor-diagnosed general health problems and autoimmune disorders. The STRAIN achieved high acceptability and was completed relatively quickly (mean = 18 minutes 39 seconds; interquartile range = 12-23 minutes). The structure of the lifetime stress data best fit two latent classes overall and five distinct trajectories over time. Concurrent associations with the Childhood Trauma Questionnaire-Short Form and Perceived Stress Scale were good (r values = .147-.552). Moreover, the STRAIN was not significantly related to personality traits or social desirability characteristics and, in adjusted analyses, emerged as the measure most strongly associated with all six of the health and cognitive outcomes assessed except current mental health complaints (β values = .16-.41; risk ratios = 1.02-1.04). Finally, test-retest reliability for the main stress exposure indices over 2-4 weeks was excellent (r values = .904-.919). The STRAIN demonstrated good usability and acceptability; very good concurrent, discriminant, and predictive validity; and excellent test-retest reliability.

Acceptability and User Satisfaction of a Smartphone-Based, Interactive Blood Glucose Management System in Women With Gestational Diabetes Mellitus

PubMed Central

Mackillop, Lucy; Loerup, Lise; Kevat, Dev A.; Bartlett, Katy; Gibson, Oliver; Kenworthy, Yvonne; Levy, Jonathan C.; Tarassenko, Lionel; Farmer, Andrew

2014-01-01

Background: The increase in gestational diabetes mellitus (GDM) is challenging maternity services. We have developed an interactive, smartphone-based, remote blood glucose (BG) monitoring system, GDm-health. Aims: The objective was to determine women’s satisfaction with using the GDm-health system and their attitudes toward their diabetes care. Methods: In a service development program involving 52 pregnant women (September 2012 to June 2013), BG was monitored using GDm-health from diagnosis until delivery. Following birth, women completed a structured questionnaire assessing (1) general satisfaction, (2) equipment issues, and (3) relationship with the diabetes care team. Responses were scored on a 7-point Likert-type scale. Reliability and validity of the questionnaire were assessed using statistical methods. Results: Of 52 women, 49 completed the questionnaire; 32 had glucose tolerance test confirmed GDM (gestation at recruitment 29 ± 4 weeks (mean ± SD), and 17 women previous GDM recommended for BG monitoring (18 ± 6 weeks). In all, 45 of 49 women agreed their care was satisfactory and the best for them, 47 of 49 and 43 of 49 agreed the equipment was convenient and reliable respectively, 42 of 49 agreed GDm-health fitted into their lifestyle, and 46 of 49 agreed they had a good relationship with their care team. Written comments supported these findings, with very positive reactions from the majority of women. Cronbach’s alpha was .89 with factor analysis corresponding with question thematic trends. Conclusions: This pilot demonstrates that GDm-health is acceptable and convenient for a large proportion of women. Effects on clinical and economic outcomes are currently under investigation in a randomized trial (clinicaltrials.gov NCT01916694). PMID:25361643

Evaluation of rail test frequencies using risk analysis

DOT National Transportation Integrated Search

2009-03-03

Several industries now use risk analysis to develop : inspection programs to ensure acceptable mechanical integrity : and reliability. These industries include nuclear and electric : power generation, oil refining, gas processing, onshore and : offsh...

The Functional Arm Scale for Throwers (FAST)-Part II: Reliability and Validity of an Upper Extremity Region-Specific and Population-Specific Patient-Reported Outcome Scale for Throwing Athletes.

PubMed

Huxel Bliven, Kellie C; Snyder Valier, Alison R; Bay, R Curtis; Sauers, Eric L

2017-04-01

The Functional Arm Scale for Throwers (FAST) is an upper extremity (UE) region-specific and population-specific patient-reported outcome (PRO) scale developed to measure health-related quality of life in throwers with UE injuries. Stages I and II, described in a companion paper, of FAST development produced a 22-item scale and a 9-item pitcher module. Stage III of scale development, establishing reliability and validity of the FAST, is reported herein. To describe stage III of scale development: reliability and validity of the FAST. Cohort study (diagnosis); Level of evidence, 2. Data from throwing athletes collected over 5 studies were pooled to assess reliability and validity of the FAST. Reliability was estimated using FAST scores from 162 throwing athletes who were injured (n = 23) and uninjured (n = 139). Concurrent validity was estimated using FAST scores and Disabilities of the Arm, Shoulder, and Hand (DASH) and Kerlan-Jobe Orthopaedic Clinic (KJOC) scores from 106 healthy, uninjured throwing athletes. Known-groups validity was estimated using FAST scores from 557 throwing athletes who were injured (n = 142) and uninjured (n = 415). Reliability and validity were assessed using intraclass correlation coefficients (ICCs), and measurement error was assessed using standard error of measurement (SEM) and minimum detectable change (MDC). Receiver operating characteristic curves and sensitivity/specificity values were estimated for known-groups validity. Data from a separate group (n = 18) of postsurgical and nonoperative/conservative rehabilitation patients were analyzed to report responsiveness of the FAST. The FAST total, subscales, and pitcher module scores demonstrated excellent test-retest reliability (ICC, 0.91-0.98). The SEM 95 and MDC 95 for the FAST total score were 3.8 and 10.5 points, respectively. The SEM 95 and MDC 95 for the pitcher module score were 5.7 and 15.7 points, respectively. The FAST scores showed acceptable correlation with DASH (ICC, 0.49-0.82) and KJOC (ICC, 0.62-0.81) scores. The FAST total score classified 85.1% of players into the correct injury group. For predicting UE injury status, a FAST total cutoff score of 10.0 out of 100.0 was 91% sensitive and 75% specific, and a pitcher module score of 10.0 out of 100.0 was 87% sensitive and 78% specific. The FAST total score demonstrated responsiveness on several indices between intake and discharge time points. The FAST is a reliable, valid, and responsive UE region-specific and population-specific PRO scale for measuring patient-reported health care outcomes in throwing athletes with injury.

The Functional Arm Scale for Throwers (FAST)—Part II: Reliability and Validity of an Upper Extremity Region-Specific and Population-Specific Patient-Reported Outcome Scale for Throwing Athletes

PubMed Central

Huxel Bliven, Kellie C.; Snyder Valier, Alison R.; Bay, R. Curtis; Sauers, Eric L.

2017-01-01

Background: The Functional Arm Scale for Throwers (FAST) is an upper extremity (UE) region-specific and population-specific patient-reported outcome (PRO) scale developed to measure health-related quality of life in throwers with UE injuries. Stages I and II, described in a companion paper, of FAST development produced a 22-item scale and a 9-item pitcher module. Stage III of scale development, establishing reliability and validity of the FAST, is reported herein. Purpose: To describe stage III of scale development: reliability and validity of the FAST. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data from throwing athletes collected over 5 studies were pooled to assess reliability and validity of the FAST. Reliability was estimated using FAST scores from 162 throwing athletes who were injured (n = 23) and uninjured (n = 139). Concurrent validity was estimated using FAST scores and Disabilities of the Arm, Shoulder, and Hand (DASH) and Kerlan-Jobe Orthopaedic Clinic (KJOC) scores from 106 healthy, uninjured throwing athletes. Known-groups validity was estimated using FAST scores from 557 throwing athletes who were injured (n = 142) and uninjured (n = 415). Reliability and validity were assessed using intraclass correlation coefficients (ICCs), and measurement error was assessed using standard error of measurement (SEM) and minimum detectable change (MDC). Receiver operating characteristic curves and sensitivity/specificity values were estimated for known-groups validity. Data from a separate group (n = 18) of postsurgical and nonoperative/conservative rehabilitation patients were analyzed to report responsiveness of the FAST. Results: The FAST total, subscales, and pitcher module scores demonstrated excellent test-retest reliability (ICC, 0.91-0.98). The SEM95 and MDC95 for the FAST total score were 3.8 and 10.5 points, respectively. The SEM95 and MDC95 for the pitcher module score were 5.7 and 15.7 points, respectively. The FAST scores showed acceptable correlation with DASH (ICC, 0.49-0.82) and KJOC (ICC, 0.62-0.81) scores. The FAST total score classified 85.1% of players into the correct injury group. For predicting UE injury status, a FAST total cutoff score of 10.0 out of 100.0 was 91% sensitive and 75% specific, and a pitcher module score of 10.0 out of 100.0 was 87% sensitive and 78% specific. The FAST total score demonstrated responsiveness on several indices between intake and discharge time points. Conclusion: The FAST is a reliable, valid, and responsive UE region-specific and population-specific PRO scale for measuring patient-reported health care outcomes in throwing athletes with injury. PMID:28451614

Reliability reporting across studies using the Buss Durkee Hostility Inventory.

PubMed

Vassar, Matt; Hale, William

2009-01-01

Empirical research on anger and hostility has pervaded the academic literature for more than 50 years. Accurate measurement of anger/hostility and subsequent interpretation of results requires that the instruments yield strong psychometric properties. For consistent measurement, reliability estimates must be calculated with each administration, because changes in sample characteristics may alter the scale's ability to generate reliable scores. Therefore, the present study was designed to address reliability reporting practices for a widely used anger assessment, the Buss Durkee Hostility Inventory (BDHI). Of the 250 published articles reviewed, 11.2% calculated and presented reliability estimates for the data at hand, 6.8% cited estimates from a previous study, and 77.1% made no mention of score reliability. Mean alpha estimates of scores for BDHI subscales generally fell below acceptable standards. Additionally, no detectable pattern was found between reporting practices and publication year or journal prestige. Areas for future research are also discussed.

Chinese version of the Constant-Murley questionnaire for shoulder pain and disability: a reliability and validation study.

PubMed

Yao, Min; Yang, Long; Cao, Zuo-Yuan; Cheng, Shao-Dan; Tian, Shuang-Lin; Sun, Yue-Li; Wang, Jing; Xu, Bao-Ping; Hu, Xiao-Chun; Wang, Yong-Jun; Zhang, Ying; Cui, Xue-Jun

2017-09-18

Shoulder pain is a common musculoskeletal disorder in Chinese population, which affects more than 1,3 billion individuals. To the best of our knowledge, there has been no available Chinese-language version of measurements of shoulder pain and disability so far. Moreover, the Constant-Murley score (CMS) questionnaire is a universally recognized patient-reported questionnaire for clinical practice and research. The present study was designed to evaluate a Chinese translational version of CMS and subsequently assess its reliability and validity. The Chinese translational version of CMS was formulated by means of forward-backward translation. Meanwhile, a final review was carried out by an expert committee, followed by conducting a test of the pre-final version. Therefore, the reliability and validity of the Chinese translational version of CMS could be assessed using the internal consistency, construct validity, factor analysis, reliability and floor and ceiling effects. Specifically, the reliability was assessed by testing the internal consistency (Cronbach's α) and test-retest reliability (intraclass coefficient correlation [ICC]), while the construct validity was evaluated via comparison between the Chinese translational version of CMS with visual analog scale (VAS) score and the 36-Item Short Form Health Survey (SF-36, Spearman correlation). The questionnaire was verified to be acceptable after distribution among 120 subjects with unilateral shoulder pain. Factor analysis had revealed a two-factor and 10-item solution. Moreover, the assessment results indicated that the Chinese translational version of CMS questionnaire harbored good internal consistency (Cronbach's α = 0.739) and test-retest reliability (ICC = 0.827). In addition, the Chinese translational version of CMS was moderately correlated with VAS score (r = 0.497) and SF-36 (r = 0.135). No obvious floor and ceiling effects were observed in the Chinese translational version of CMS questionnaire. Chinese translational version of CMS exhibited good reliability, which is relatively acceptable and is likely to be widely used in this population.

Risk-based maintenance of ethylene oxide production facilities.

PubMed

Khan, Faisal I; Haddara, Mahmoud R

2004-05-20

This paper discusses a methodology for the design of an optimum inspection and maintenance program. The methodology, called risk-based maintenance (RBM) is based on integrating a reliability approach and a risk assessment strategy to obtain an optimum maintenance schedule. First, the likely equipment failure scenarios are formulated. Out of many likely failure scenarios, the ones, which are most probable, are subjected to a detailed study. Detailed consequence analysis is done for the selected scenarios. Subsequently, these failure scenarios are subjected to a fault tree analysis to determine their probabilities. Finally, risk is computed by combining the results of the consequence and the probability analyses. The calculated risk is compared against known acceptable criteria. The frequencies of the maintenance tasks are obtained by minimizing the estimated risk. A case study involving an ethylene oxide production facility is presented. Out of the five most hazardous units considered, the pipeline used for the transportation of the ethylene is found to have the highest risk. Using available failure data and a lognormal reliability distribution function human health risk factors are calculated. Both societal risk factors and individual risk factors exceeded the acceptable risk criteria. To determine an optimal maintenance interval, a reverse fault tree analysis was used. The maintenance interval was determined such that the original high risk is brought down to an acceptable level. A sensitivity analysis is also undertaken to study the impact of changing the distribution of the reliability model as well as the error in the distribution parameters on the maintenance interval.

Psychometric properties of the Portuguese version of the Acceptance and Action Questionnaire-Trauma Specific (AAQ-TS): A study with Portuguese Colonial War Veterans.

PubMed

Pinto-Gouveia, José; Carvalho, Teresa; Cunha, Marina; Duarte, Joana; Walser, Robyn D

2015-10-01

The Acceptance and Action Questionnaire-Trauma Specific (AAQ-TS) is a self-report measure designed to assess-trauma-related psychological (in)flexibility, as conceptualized in Acceptance and Commitment Therapy. However, there are no studies to date regarding its psychometric properties. This study explores such properties in the Portuguese version of the AAQ-TS, in Portuguese Colonial War Veterans. A Principal Components Analysis (PCA) was conducted in a sample from the general population of war Veterans (N=371). Confirmatory Factor Analysis (CFA) as well as reliability and convergent validity studies were performed in a different sample from the same population (N=312). For the discriminant validity a clinical sample with a war-related PTSD (N=42) and a non-clinical sample without PTSD (N=44) were used. The CFA suggested a re-specified 15-item model with good global adjustment and factorial validity. The AAQ-TS showed internal consistency, a good temporal reliability, convergent validity with psychopathological symptoms (related to PTSD, anxiety, depression and stress) and peritraumatic dissociation (altered awareness and depersonalization/derealization). The questionnaire also discriminates between war Veterans with and without a PTSD diagnosis. The major limitation relates to the samples' characteristics and sampling methods, which can limit the generalization of results. The Portuguese version of the AAQ-TS is a reliable and valid measure to assess experiential avoidance related to trauma in Portuguese Colonial War Veterans. Copyright © 2015 Elsevier B.V. All rights reserved.

Parts and Components Reliability Assessment: A Cost Effective Approach

NASA Technical Reports Server (NTRS)

Lee, Lydia

2009-01-01

System reliability assessment is a methodology which incorporates reliability analyses performed at parts and components level such as Reliability Prediction, Failure Modes and Effects Analysis (FMEA) and Fault Tree Analysis (FTA) to assess risks, perform design tradeoffs, and therefore, to ensure effective productivity and/or mission success. The system reliability is used to optimize the product design to accommodate today?s mandated budget, manpower, and schedule constraints. Stand ard based reliability assessment is an effective approach consisting of reliability predictions together with other reliability analyses for electronic, electrical, and electro-mechanical (EEE) complex parts and components of large systems based on failure rate estimates published by the United States (U.S.) military or commercial standards and handbooks. Many of these standards are globally accepted and recognized. The reliability assessment is especially useful during the initial stages when the system design is still in the development and hard failure data is not yet available or manufacturers are not contractually obliged by their customers to publish the reliability estimates/predictions for their parts and components. This paper presents a methodology to assess system reliability using parts and components reliability estimates to ensure effective productivity and/or mission success in an efficient manner, low cost, and tight schedule.

Influence of sensor ingestion timing on consistency of temperature measures.

PubMed

Goodman, Daniel A; Kenefick, Robert W; Cadarette, Bruce S; Cheuvront, Samuel N

2009-03-01

The validity and the reliability of using intestinal temperature (T int) via ingestible temperature sensors (ITS) to measure core body temperature have been demonstrated. However, the effect of elapsed time between ITS ingestion and T int measurement has not been thoroughly studied. Eight volunteers (six men and two women) swallowed ITS 5 h (ITS-5) and 29 h (ITS-29) before 4 h of varying intensity activity. T int was measured simultaneously from both ITS, and T int differences between the ITS-5 and the ITS-29 over the 4 h of activity were plotted and compared relative to a meaningful threshold of acceptance (+/-0.25 degrees C). The percentage of time in which the differences between paired ITS (ITS-5 vs ITS-29) were greater than or less than the threshold of acceptance was calculated. T int values showed no systematic bias, were normally distributed, and ranged from 36.94 degrees C to 39.24 degrees C. The maximum T int difference between paired ITS was 0.83 degrees C with a minimum difference of 0.00 degrees C. The typical magnitude of the differences (SE of the estimate) was 0.24 degrees C, and these differences were uniform across the entire range of observed temperatures. Paired T int measures fell outside of the threshold of acceptance 43.8% of the time during the 4 h of activity. The differences between ITS-5 and ITS-29 were larger than the threshold of acceptance during a substantial portion of the observed 4-h activity period. Ingesting an ITS more than 5 h before activity will not completely eliminate confounding factors but may improve accuracy and consistency of core body temperature.

Accuracy of digital American Board of Orthodontics Discrepancy Index measurements.

PubMed

Dragstrem, Kristina; Galang-Boquiren, Maria Therese S; Obrez, Ales; Costa Viana, Maria Grace; Grubb, John E; Kusnoto, Budi

2015-07-01

A digital analysis that is shown to be accurate will ease the demonstration of initial case complexity. To date, no literature exists on the accuracy of the digital American Board of Orthodontics Discrepancy Index (DI) calculations when applied to pretreatment digital models. Plaster models were obtained from 45 previous patients with varying degrees of malocclusion. Total DI scores and the target disorders were computed manually with a periodontal probe on the original plaster casts (gold standard) and digitally using Ortho Insight 3D (Motion View Software, Hixson, Tenn) and OrthoCAD (Cadent, Carlstadt, NJ). Intrarater and interrater reliabilities were assessed for 15 subjects using the Spearman rho correlation test. Accuracies of the DI scores and target disorders were assessed for all 45 subjects using Wilcoxon signed ranks tests. Intrarater and interrater reliabilities were high for total DI scores and most target disorders (r > 0.8). No significant difference was found between total DI score when measured with OrthoCAD compared with manual calculations. The total DI scores calculated by Ortho Insight 3D were found to be significantly greater than those by manual calculation by 2.71 points. The findings indicate that a DI calculated by Ortho Insight 3D may lead the clinician to overestimate case complexity. OrthoCAD's DI module was demonstrated to be a clinically acceptable alternative to manual calculation of the total scores. Copyright © 2015 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

Big Software for SmallSats: Adapting CFS to CubeSat Missions

NASA Technical Reports Server (NTRS)

Cudmore, Alan P.; Crum, Gary; Sheikh, Salman; Marshall, James

2015-01-01

Expanding capabilities and mission objectives for SmallSats and CubeSats is driving the need for reliable, reusable, and robust flight software. While missions are becoming more complicated and the scientific goals more ambitious, the level of acceptable risk has decreased. Design challenges are further compounded by budget and schedule constraints that have not kept pace. NASA's Core Flight Software System (cFS) is an open source solution which enables teams to build flagship satellite level flight software within a CubeSat schedule and budget. NASA originally developed cFS to reduce mission and schedule risk for flagship satellite missions by increasing code reuse and reliability. The Lunar Reconnaissance Orbiter, which launched in 2009, was the first of a growing list of Class B rated missions to use cFS. Large parts of cFS are now open source, which has spurred adoption outside of NASA. This paper reports on the experiences of two teams using cFS for current CubeSat missions. The performance overheads of cFS are quantified, and the reusability of code between missions is discussed. The analysis shows that cFS is well suited to use on CubeSats and demonstrates the portability and modularity of cFS code.

Virtual surgical planning and 3D printing in prosthetic orbital reconstruction with percutaneous implants: a technical case report

PubMed Central

Huang, Yu-Hui; Seelaus, Rosemary; Zhao, Linping; Patel, Pravin K; Cohen, Mimis

2016-01-01

Osseointegrated titanium implants to the cranial skeleton for retention of facial prostheses have proven to be a reliable replacement for adhesive systems. However, improper placement of the implants can jeopardize prosthetic outcomes, and long-term success of an implant-retained prosthesis. Three-dimensional (3D) computer imaging, virtual planning, and 3D printing have become accepted components of the preoperative planning and design phase of treatment. Computer-aided design and computer-assisted manufacture that employ cone-beam computed tomography data offer benefits to patient treatment by contributing to greater predictability and improved treatment efficiencies with more reliable outcomes in surgical and prosthetic reconstruction. 3D printing enables transfer of the virtual surgical plan to the operating room by fabrication of surgical guides. Previous studies have shown that accuracy improves considerably with guided implantation when compared to conventional template or freehand implant placement. This clinical case report demonstrates the use of a 3D technological pathway for preoperative virtual planning through prosthesis fabrication, utilizing 3D printing, for a patient with an acquired orbital defect that was restored with an implant-retained silicone orbital prosthesis. PMID:27843356

Virtual surgical planning and 3D printing in prosthetic orbital reconstruction with percutaneous implants: a technical case report.

PubMed

Huang, Yu-Hui; Seelaus, Rosemary; Zhao, Linping; Patel, Pravin K; Cohen, Mimis

2016-01-01

Osseointegrated titanium implants to the cranial skeleton for retention of facial prostheses have proven to be a reliable replacement for adhesive systems. However, improper placement of the implants can jeopardize prosthetic outcomes, and long-term success of an implant-retained prosthesis. Three-dimensional (3D) computer imaging, virtual planning, and 3D printing have become accepted components of the preoperative planning and design phase of treatment. Computer-aided design and computer-assisted manufacture that employ cone-beam computed tomography data offer benefits to patient treatment by contributing to greater predictability and improved treatment efficiencies with more reliable outcomes in surgical and prosthetic reconstruction. 3D printing enables transfer of the virtual surgical plan to the operating room by fabrication of surgical guides. Previous studies have shown that accuracy improves considerably with guided implantation when compared to conventional template or freehand implant placement. This clinical case report demonstrates the use of a 3D technological pathway for preoperative virtual planning through prosthesis fabrication, utilizing 3D printing, for a patient with an acquired orbital defect that was restored with an implant-retained silicone orbital prosthesis.

A Retrospective Performance Assessment of the Developmental Neurotoxicity Study in Support of OECD Test Guideline 426

PubMed Central

Makris, Susan L.; Raffaele, Kathleen; Allen, Sandra; Bowers, Wayne J.; Hass, Ulla; Alleva, Enrico; Calamandrei, Gemma; Sheets, Larry; Amcoff, Patric; Delrue, Nathalie; Crofton, Kevin M.

2009-01-01

Objective We conducted a review of the history and performance of developmental neurotoxicity (DNT) testing in support of the finalization and implementation of Organisation of Economic Co-operation and Development (OECD) DNT test guideline 426 (TG 426). Information sources and analysis In this review we summarize extensive scientific efforts that form the foundation for this testing paradigm, including basic neurotoxicology research, interlaboratory collaborative studies, expert workshops, and validation studies, and we address the relevance, applicability, and use of the DNT study in risk assessment. Conclusions The OECD DNT guideline represents the best available science for assessing the potential for DNT in human health risk assessment, and data generated with this protocol are relevant and reliable for the assessment of these end points. The test methods used have been subjected to an extensive history of international validation, peer review, and evaluation, which is contained in the public record. The reproducibility, reliability, and sensitivity of these methods have been demonstrated, using a wide variety of test substances, in accordance with OECD guidance on the validation and international acceptance of new or updated test methods for hazard characterization. Multiple independent, expert scientific peer reviews affirm these conclusions. PMID:19165382

Psychometric properties of the Spanish version of the Controlling Coach Behaviors Scale in the sport context.

PubMed

Castillo, Isabel; Tomás, Inés; Ntoumanis, Nikos; Bartholomew, Kimberley; Duda, Joan L; Balaguer, Isabel

2014-01-01

The purpose of this research was to translate into Spanish and examine the psychometric properties of the Spanish version of the Controlling Coach Behaviors Scale (CCBS) in male soccer players. The CCBS is a questionnaire designed to assess athletes' perceptions of sports coaches' controlling interpersonal style from the perspective of the self-determination theory. Study 1 tested the factorial structure of the translated scale using confirmatory factor analysis (CFA) and provided evidence of discriminant validity. Studies 2 and 3 examined the invariance across time and across competitive level via multi-sample CFA. Reliability analyses were also conducted. The CFA results revealed that a four-factor model was acceptable, indicating that a controlling interpersonal style is a multidimensional construct represented by four separate and related controlling coaching strategies. Further, results supported the invariance of the CCBS factor structure across time and competitive level and provided support for the internal consistency of the scale. Overall, the CCBS demonstrated adequate internal consistency, as well as good factorial validity. The Spanish version of the CCBS represents a valid and reliable adaptation of the instrument, which can be confidently used to measure soccer players' perceptions of their coaches' controlling interpersonal style.

Spanish version of the Talent Development Environment Questionnaire for sport: Cultural adaptation and initial validation

PubMed Central

Olivares, Pedro R.; Andronikos, Georgios; Martindale, Russell J. J.

2017-01-01

This study aimed to translate the Talent Development Environment Questionnaire into Spanish and provide an initial validation. A recommended methodology for translation and cultural adaptation of questionnaires was applied. Once this had been completed, three hundred and thirty-two young athletes completed the Talent Development Environment Questionnaire. The results revealed that the five factor solution Talent Development Environment Questionnaire was confirmed. With the exclusion of one item due to low factor loading, the Talent Development Environment Questionnaire-5 had robust statistical support for its factor structure (χ2 (df = 305) = 499.64, p<0.01, CFI = 0.90, RMSEA = 0.045, SRMR = 0.055). It also demonstrated adequate convergent and discriminant validity. While the internal reliability was lower than in previous studies, it revealed acceptable levels. Specifically the overall 27 item Talent Development Environment Questionnaire-5 had a Cronbach α score of .877, and the reliability scores for individual factors 1–5 were .622; .761; .658; .605; .602 respectively. As such, it is recommended that the Spanish Talent Development Environment Questionnaire-5 can be used with confidence in Spain in both applied and research settings. PMID:28582387

Spanish version of the Talent Development Environment Questionnaire for sport: Cultural adaptation and initial validation.

PubMed

Brazo-Sayavera, Javier; Olivares, Pedro R; Andronikos, Georgios; Martindale, Russell J J

2017-01-01

This study aimed to translate the Talent Development Environment Questionnaire into Spanish and provide an initial validation. A recommended methodology for translation and cultural adaptation of questionnaires was applied. Once this had been completed, three hundred and thirty-two young athletes completed the Talent Development Environment Questionnaire. The results revealed that the five factor solution Talent Development Environment Questionnaire was confirmed. With the exclusion of one item due to low factor loading, the Talent Development Environment Questionnaire-5 had robust statistical support for its factor structure (χ2 (df = 305) = 499.64, p<0.01, CFI = 0.90, RMSEA = 0.045, SRMR = 0.055). It also demonstrated adequate convergent and discriminant validity. While the internal reliability was lower than in previous studies, it revealed acceptable levels. Specifically the overall 27 item Talent Development Environment Questionnaire-5 had a Cronbach α score of .877, and the reliability scores for individual factors 1-5 were .622; .761; .658; .605; .602 respectively. As such, it is recommended that the Spanish Talent Development Environment Questionnaire-5 can be used with confidence in Spain in both applied and research settings.

Developing and validating a scale to measure Food and Nutrition Literacy (FNLIT) in elementary school children in Iran.

PubMed

Doustmohammadian, Aazam; Omidvar, Nasrin; Keshavarz-Mohammadi, Nastaran; Abdollahi, Morteza; Amini, Maryam; Eini-Zinab, Hassan

2017-01-01

Food and nutrition literacy is an emerging term which is increasingly used in policy and research. Though research in this area is growing, progression is limited by the lack of an accepted method to measure food and nutrition literacy. The aim of this study is to develop a valid and reliable questionnaire to assess food and nutrition literacy in elementary school children in the city of Tehran. The study was conducted in three phases. To develop Food and Nutrition Literacy (FNLIT) questionnaire, a comprehensive literature review and a qualitative study were initially performed to identify food and nutrition literacy dimensions and its components. Content and face validity of the questionnaire were evaluated by an expert panel as well as students. In the second phase, construct validity of the scale was evaluated using Explanatory Factor Analyses (EFA) and Confirmatory Factor Analyses (CFA). In the last phase (confirmatory phase), the final version of the questionnaire was evaluated on 400 students. Findings show Content Validity Ratio (CVR) and Content Validity Index (CVI) of the 62-item questionnaire at acceptable levels of 0.87 and 0.92, respectively. EFA suggested a six-factor construct, namely, understanding food and nutrition information, knowledge, functional, interactive, food choice, and critical. The results of CFA indicated acceptable fit indices for the proposed models. All subscales demonstrated satisfactory internal consistency (Cronbach's alpha≥0.70), except for critical skill subscale (0.48). The intraclass correlation coefficient (ICC = 0.90, CI: 0.83-0.94) indicated that Food and Nutrition Literacy (FNLIT) scale had satisfactory stability. Each phase of development progressively improved the questionnaire, which resulted in a 46-item (42 likert-type items and 4 true-false items) Food and Nutrition Literacy (FNLIT) scale. The questionnaire measured two domains with 6 subscales, including: 1) cognitive domain: understanding and knowledge; 2) skill domain: functional, food choice, interactive, and critical skills. The developed food and nutrition literacy scale is a valid and reliable instrument to measure food and nutrition literacy in children. This measure lays a solid empirical and theoretical foundation for future research and tailored interventions to promote food and nutrition literacy in this age group.

Use of the Theory of Planned Behaviour to assess factors influencing the identification of students at clinical high-risk for psychosis in 16+ Education.

PubMed

Russo, Debra A; Stochl, Jan; Painter, Michelle; Shelley, Gillian F; Jones, Peter B; Perez, Jesus

2015-09-23

The longer psychotic disorders are untreated the worse their prognosis. Increasing the awareness of early psychosis by professionals who come into regular contact with young people is one strategy that could reduce treatment delay. As teachers engage with students on a daily basis, their role could be exploited to increase awareness of the early signs of psychosis. This study employed the Theory of Planned Behaviour (TPB) to identify and measure factors that influence identification of students at high-risk (HR) of developing psychosis in 16+ educational institutions. An elicitation phase revealed beliefs underlying teachers' motivations to detect HR students and informed the construction of a preliminary 114-item questionnaire incorporating all constructs outlined in the TPB. To define the determinants of teachers' intention to identify HR students, 75 teachers from secondary and further education institutions in 12 counties surrounding Cambridgeshire completed the questionnaire. A psychometric model of item response theory was used to identify redundant items and produce a reduced questionnaire that would be acceptable to teachers. The final instrument comprised 73 items and showed acceptable reliability (α  = 0.69-0.81) for all direct measures. Teacher's confidence and control over identification of HR students was low. Although identification of HR students was considered worthwhile, teachers believed that their peers, students and particularly their managers might not approve. Path analysis revealed that direct measures of attitude and PBC significantly predicted intention, but subjective norm did not. PBC was the strongest predictor of intention. Collectively, the direct measures explained 37 % of the variance of intention to identify HR for psychosis. This research demonstrated how the TPB can be used to identify and measure factors that influence identification of students at HR of developing psychosis in 16+ educational institutions and confirmed the feasibility, reliability and acceptability of a TPB-based questionnaire for teachers. Consideration of the key determinants of identification in schools will facilitate the design of successful educational intervention strategies with the potential to reduce treatment delays for HR students.

Recycled water for stream flow augmentation: benefits, challenges, and the presence of wastewater-derived organic compounds.

PubMed

Plumlee, Megan H; Gurr, Christopher J; Reinhard, Martin

2012-11-01

Stream flow augmentation with recycled water has the potential to improve stream habitat and increase potable water supply, but the practice is not yet well understood or documented. The objectives of this report are to present a short review illustrated by a case study, followed by recommendations for future stream flow augmentation projects. Despite the fact that wastewater discharge to streams is commonplace, a water agency pursuing stream flow augmentation with recycled water will face unique challenges. For example, recycled water typically contains trace amounts of organic wastewater-derived compounds (OWCs) for which the potential ecological risks must be balanced against the benefits of an augmentation project. Successful stream flow augmentation with recycled water requires that the lead agency clearly articulate a strong project rationale and identify key benefits. It must be assumed that the public will have some concerns about water quality. Public acceptance may be better if an augmentation project has co-benefits beyond maintaining stream ecosystems, such as improving water system supply and reliability (i.e. potable use offset). Regulatory or project-specific criteria (acceptable concentrations of priority OWCs) would enable assessment of ecosystem impacts and demonstration of practitioner compliance. Additional treatment (natural or engineered) of the recycled water may be considered. If it is not deemed necessary or feasible, existing recycled water quality may be adequate to achieve project goals depending on project rationale, site and water quality evaluation, and public acceptance.

Reliability of Examination Findings in Suspected Community-Acquired Pneumonia.

PubMed

Florin, Todd A; Ambroggio, Lilliam; Brokamp, Cole; Rattan, Mantosh S; Crotty, Eric J; Kachelmeyer, Andrea; Ruddy, Richard M; Shah, Samir S

2017-09-01

The authors of national guidelines emphasize the use of history and examination findings to diagnose community-acquired pneumonia (CAP) in outpatient children. Little is known about the interrater reliability of the physical examination in children with suspected CAP. This was a prospective cohort study of children with suspected CAP presenting to a pediatric emergency department from July 2013 to May 2016. Children aged 3 months to 18 years with lower respiratory signs or symptoms who received a chest radiograph were included. We excluded children hospitalized ≤14 days before the study visit and those with a chronic medical condition or aspiration. Two clinicians performed independent examinations and completed identical forms reporting examination findings. Interrater reliability for each finding was reported by using Fleiss' kappa (κ) for categorical variables and intraclass correlation coefficient (ICC) for continuous variables. No examination finding had substantial agreement (κ/ICC > 0.8). Two findings (retractions, wheezing) had moderate to substantial agreement (κ/ICC = 0.6-0.8). Nine findings (abdominal pain, pleuritic pain, nasal flaring, skin color, overall impression, cool extremities, tachypnea, respiratory rate, and crackles/rales) had fair to moderate agreement (κ/ICC = 0.4-0.6). Eight findings (capillary refill time, cough, rhonchi, head bobbing, behavior, grunting, general appearance, and decreased breath sounds) had poor to fair reliability (κ/ICC = 0-0.4). Only 3 examination findings had acceptable agreement, with the lower 95% confidence limit >0.4: wheezing, retractions, and respiratory rate. In this study, we found fair to moderate reliability of many findings used to diagnose CAP. Only 3 findings had acceptable levels of reliability. These findings must be considered in the clinical management and research of pediatric CAP. Copyright © 2017 by the American Academy of Pediatrics.

Development and validation of a quantitative snack and beverage food frequency questionnaire for adolescents.

PubMed

De Cock, N; Van Camp, J; Kolsteren, P; Lachat, C; Huybregts, L; Maes, L; Deforche, B; Verstraeten, R; Vangeel, J; Beullens, K; Eggermont, S; Van Lippevelde, W

2017-04-01

A short, reliable and valid tool to measure snack and beverage consumption in adolescents, taking into account the correct definitions, would benefit both epidemiological and intervention research. The present study aimed to develop a short quantitative beverage and snack food frequency questionnaire (FFQ) and to assess the reliability and validity of this FFQ against three 24-h recalls. Reliability was assessed by comparing estimates of the FFQ administered 14 days apart (FFQ1 and FFQ2) in a convenience sample of 179 adolescents [60.3% male; mean (SD) 14.7 (0.9) years]. Validity was assessed by comparing FFQ1 with three telephone-administered 24-h recalls in a convenience sample of 99 adolescents [52.5% male, mean (SD) 14.8 (0.9) years]. Reliability and validity were assessed using Bland-Altman plots, classification agreements and correlation coefficients for the amount and frequency of consumption of unhealthy snacks, healthy snacks, unhealthy beverages, healthy beverages, and for the healthy snack and beverage ratios. Small mean differences (FFQ1 versus FFQ2) were observed for reliability, ranking ability ranged from fair to substantial, and Spearman coefficients fell within normal ranges. For the validity, mean differences (FFQ1 versus recalls) were small for beverage intake but large for snack intake, except for the healthy snack ratio. Ranking ability ranged from slightly to moderate, and Spearman coefficients fell within normal ranges. Reliability and validity of the FFQ for all outcomes were found to be acceptable at a group level for epidemiological purposes, whereas for intervention purposes only the healthy snack and beverage ratios were found to be acceptable at a group level. © 2016 The British Dietetic Association Ltd.

Test and Evaluation Master Plan (TEMP) for the Navy Occupational Health Information Management System (NOHIMS). Appendix A through Appendix U.

DTIC Science & Technology

1985-04-24

reliability/ downtime/ communication lines/ man-machine interface/ other: 2. A noticeable (to the user) failure happens about and that number has been...improving/ steady/ getting.worse. 3. The number of failures /errors for NOHIMS is acceptable/ somewhat acceptable/ somewhat unacceptable/ unacceptable...somewhat fast/ somewhat slow/ slow. 7. When a NWHIMS failure occurs, it affects the day-to-day provision of medical care because work procedures must

Development of an Individualism-Collectivism Scale revisited: a Korean sample.

PubMed

Kim, Kitae; Cho, Bongsoon

2011-04-01

A 13-item Individualism-Collectivism scale comprising source of identity, goal priority, mode of social relation, and norm acceptance is presented. A validation of this scale was conducted using a survey of 773 Korean employees. An exploratory factor analysis and a second-order confirmatory factor analysis supported the measure as having theoretical face validity and acceptable internal consistency reliability. Among the four facets, goal priority most strongly predicted the general Individualism-Collectivism latent factor.

Design criteria monograph on turbopump gears

NASA Technical Reports Server (NTRS)

1975-01-01

Turbopump power gears were brought to acceptable levels of usefulness and reliability through refinements in interdependent areas of design, materials, processing, and quality control combined with extensive development testing that explored problem areas and evaluated potential solutions.

The interrater reliability of DSM III in children.

PubMed

Werry, J S; Methven, R J; Fitzpatrick, J; Dixon, H

1983-09-01

A total of 195 admissions to a child psychiatric inpatient unit were diagnosed independently by two to four clinicians on the basis of case presentations at the first ward-round after admission. The DSM III as a whole and the major categories were of high or acceptable reliability, though a few were clearly unreliable. The results are generally consistent with other studies. Unlike other studies, the subcategories were examined and found to vary widely in reliability both as a whole across the system and within parent major categories, throwing considerable doubt upon their utility. The results indicate the need both for improved diagnostic data-gathering techniques in child psychiatry and for more better-designed studies of reliability and, most necessarily, of validity.

Toward a unifying taxonomy and definition for meditation

PubMed Central

Nash, Jonathan D.; Newberg, Andrew

2013-01-01

One of the well-documented concerns confronting scholarly discourse about meditation is the plethora of semantic constructs and the lack of a unified definition and taxonomy. In recent years there have been several notable attempts to formulate new lexicons in order to define and categorize meditation methods. While these constructs have been useful and have encountered varying degrees of acceptance, they have also been subject to misinterpretation and debate, leaving the field devoid of a consensual paradigm. This paper attempts to influence this ongoing discussion by proposing two new models which hold the potential for enhanced scientific reliability and acceptance. Regarding the quest for a universally acceptable taxonomy, we suggest a paradigm shift away from the norm of fabricatIng new terminology from a first-person perspective. As an alternative, we propose a new taxonomic system based on the historically well-established and commonly accepted third-person paradigm of Affect and Cognition, borrowed, in part, from the psychological and cognitive sciences. With regard to the elusive definitional problem, we propose a model of meditation which clearly distinguishes “method” from “state” and is conceptualized as a dynamic process which is inclusive of six related but distinct stages. The overall goal is to provide researchers with a reliable nomenclature with which to categorize and classify diverse meditation methods, and a conceptual framework which can provide direction for their research and a theoretical basis for their findings. PMID:24312060

Reliability of Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory in a test-retest design.

PubMed

Larson, Tomas; Kerekes, Nóra; Selinus, Eva Norén; Lichtenstein, Paul; Gumpert, Clara Hellner; Anckarsäter, Henrik; Nilsson, Thomas; Lundström, Sebastian

2014-02-01

The Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory is used in epidemiological research to assess neurodevelopmental problems and coexisting conditions. Although the A-TAC has been applied in various populations, data on retest reliability are limited. The objective of the present study was to present additional reliability data. The A-TAC was administered by lay assessors and was completed on two occasions by parents of 400 individual twins, with an average interval of 70 days between test sessions. Intra- and inter-rater reliability were analysed with intraclass correlations and Cohen's kappa. A-TAC showed excellent test-retest intraclass correlations for both autism spectrum disorder and attention deficit hyperactivity disorder (each at .84). Most modules in the A-TAC had intra- and inter-rater reliability intraclass correlation coefficients of > or = .60. Cohen's kappa indi- cated acceptable reliability. The current study provides statistical evidence that the A-TAC yields good test-retest reliability in a population-based cohort of children.

User acceptance of mobile commerce: an empirical study in Macau

NASA Astrophysics Data System (ADS)

Lai, Ivan K. W.; Lai, Donny C. F.

2014-06-01

This study aims to examine the positive and negative factors that can significantly explain user acceptance of mobile commerce (m-commerce) in Macau. A technology acceptance model for m-commerce with five factors is constructed. The proposed model is tested using data collected from 219 respondents. Confirmatory factor analysis is performed to examine the reliability and validity of the model, and structural equation modelling is performed to access the relationship between behaviour intention and each factor. The acceptance of m-commerce is influenced by factors including performance expectancy, social influence, facilitating conditions and privacy concern; while effort expectancy is insignificant in this case. The results of the study are useful for m-commerce service providers to adjust their strategies for promoting m-commerce services. This study contributes to the practice by providing a user technology acceptance model for m-commerce that can be used as a foundation for future research.

The reliability and validity of a sexual functioning questionnaire.

PubMed

Corty, E W; Althof, S E; Kurit, D M

1996-01-01

The present study assessed the reliability and validity of a measure of sexual functioning, the CMSH-SFQ, for male patients and their partners. The CMSH-SFQ measures erectile and orgasmic functioning, sexual drive, frequency of sexual behavior, and sexual satisfaction. Test-retest reliability was assessed with 19 males and 19 females for the baseline CMSH-SFQ. Criterion validity was measured by comparing the answers of 25 male patients to those of their partners at baseline and follow-up. The majority of items had acceptable levels of reliability and validity. The CMSH-SFQ provides a reliable and valid device that can be used to measure global sexual functioning in men and their partners and may be used to evaluate the efficacy of treatments for sexual dysfunctions. Limitations and suggestions for use of the CMSH-SFQ are addressed.

A Study on the Requirements for Fast Active Turbine Tip Clearance Control Systems

NASA Technical Reports Server (NTRS)

DeCastro, Jonathan A.; Melcher, Kevin J.

2004-01-01

This paper addresses the requirements of a control system for active turbine tip clearance control in a generic commercial turbofan engine through design and analysis. The control objective is to articulate the shroud in the high pressure turbine section in order to maintain a certain clearance set point given several possible engine transient events. The system must also exhibit reasonable robustness to modeling uncertainties and reasonable noise rejection properties. Two actuators were chosen to fulfill such a requirement, both of which possess different levels of technological readiness: electrohydraulic servovalves and piezoelectric stacks. Identification of design constraints, desired actuator parameters, and actuator limitations are addressed in depth; all of which are intimately tied with the hardware and controller design process. Analytical demonstrations of the performance and robustness characteristics of the two axisymmetric LQG clearance control systems are presented. Takeoff simulation results show that both actuators are capable of maintaining the clearance within acceptable bounds and demonstrate robustness to parameter uncertainty. The present model-based control strategy was employed to demonstrate the tradeoff between performance, control effort, and robustness and to implement optimal state estimation in a noisy engine environment with intent to eliminate ad hoc methods for designing reliable control systems.

GTest: a software tool for graphical assessment of empirical distributions' Gaussianity.

PubMed

Barca, E; Bruno, E; Bruno, D E; Passarella, G

2016-03-01

In the present paper, the novel software GTest is introduced, designed for testing the normality of a user-specified empirical distribution. It has been implemented with two unusual characteristics; the first is the user option of selecting four different versions of the normality test, each of them suited to be applied to a specific dataset or goal, and the second is the inferential paradigm that informs the output of such tests: it is basically graphical and intrinsically self-explanatory. The concept of inference-by-eye is an emerging inferential approach which will find a successful application in the near future due to the growing need of widening the audience of users of statistical methods to people with informal statistical skills. For instance, the latest European regulation concerning environmental issues introduced strict protocols for data handling (data quality assurance, outliers detection, etc.) and information exchange (areal statistics, trend detection, etc.) between regional and central environmental agencies. Therefore, more and more frequently, laboratory and field technicians will be requested to utilize complex software applications for subjecting data coming from monitoring, surveying or laboratory activities to specific statistical analyses. Unfortunately, inferential statistics, which actually influence the decisional processes for the correct managing of environmental resources, are often implemented in a way which expresses its outcomes in a numerical form with brief comments in a strict statistical jargon (degrees of freedom, level of significance, accepted/rejected H0, etc.). Therefore, often, the interpretation of such outcomes is really difficult for people with poor statistical knowledge. In such framework, the paradigm of the visual inference can contribute to fill in such gap, providing outcomes in self-explanatory graphical forms with a brief comment in the common language. Actually, the difficulties experienced by colleagues and their request for an effective tool for addressing such difficulties motivated us in adopting the inference-by-eye paradigm and implementing an easy-to-use, quick and reliable statistical tool. GTest visualizes its outcomes as a modified version of the Q-Q plot. The application has been developed in Visual Basic for Applications (VBA) within MS Excel 2010, which demonstrated to have all the characteristics of robustness and reliability needed. GTest provides true graphical normality tests which are as reliable as any statistical quantitative approach but much easier to understand. The Q-Q plots have been integrated with the outlining of an acceptance region around the representation of the theoretical distribution, defined in accordance with the alpha level of significance and the data sample size. The test decision rule is the following: if the empirical scatterplot falls completely within the acceptance region, then it can be concluded that the empirical distribution fits the theoretical one at the given alpha level. A comprehensive case study has been carried out with simulated and real-world data in order to check the robustness and reliability of the software.

Various methods for assessing static lower extremity alignment: implications for prospective risk-factor screenings.

PubMed

Nguyen, Anh-Dung; Boling, Michelle C; Slye, Carrie A; Hartley, Emily M; Parisi, Gina L

2013-01-01

Accurate, efficient, and reliable measurement methods are essential to prospectively identify risk factors for knee injuries in large cohorts. To determine tester reliability using digital photographs for the measurement of static lower extremity alignment (LEA) and whether values quantified with an electromagnetic motion-tracking system are in agreement with those quantified with clinical methods and digital photographs. Descriptive laboratory study. Laboratory. Thirty-three individuals participated and included 17 (10 women, 7 men; age = 21.7 ± 2.7 years, height = 163.4 ± 6.4 cm, mass = 59.7 ± 7.8 kg, body mass index = 23.7 ± 2.6 kg/m2) in study 1, in which we examined the reliability between clinical measures and digital photographs in 1 trained and 1 novice investigator, and 16 (11 women, 5 men; age = 22.3 ± 1.6 years, height = 170.3 ± 6.9 cm, mass = 72.9 ± 16.4 kg, body mass index = 25.2 ± 5.4 kg/m2) in study 2, in which we examined the agreement among clinical measures, digital photographs, and an electromagnetic tracking system. We evaluated measures of pelvic angle, quadriceps angle, tibiofemoral angle, genu recurvatum, femur length, and tibia length. Clinical measures were assessed using clinically accepted methods. Frontal- and sagittal-plane digital images were captured and imported into a computer software program. Anatomic landmarks were digitized using an electromagnetic tracking system to calculate static LEA. Intraclass correlation coefficients and standard errors of measurement were calculated to examine tester reliability. We calculated 95% limits of agreement and used Bland-Altman plots to examine agreement among clinical measures, digital photographs, and an electromagnetic tracking system. Using digital photographs, fair to excellent intratester (intraclass correlation coefficient range = 0.70-0.99) and intertester (intraclass correlation coefficient range = 0.75-0.97) reliability were observed for static knee alignment and limb-length measures. An acceptable level of agreement was observed between clinical measures and digital pictures for limb-length measures. When comparing clinical measures and digital photographs with the electromagnetic tracking system, an acceptable level of agreement was observed in measures of static knee angles and limb-length measures. The use of digital photographs and an electromagnetic tracking system appears to be an efficient and reliable method to assess static knee alignment and limb-length measurements.

A disease-specific measure of health-related quality of life for use in adults with immune thrombocytopenic purpura: its development and validation.

PubMed

Mathias, Susan D; Bussel, James B; George, James N; McMillan, Robert; Okano, Gary J; Nichol, Janet L

2007-02-22

No validated disease-specific measures are available to assess health-related quality of life (HRQoL) in adult subjects with immune thrombocytopenic purpura (ITP). Therefore, we sought to develop and validate the ITP-Patient Assessment Questionnaire (ITP-PAQ) for adult subjects with ITP. Information from literature reviews, focus groups with subjects, and clinicians were used to develop 50 ITP-PAQ items. Factor analyses were conducted to develop the scale structure and reduce the number of items. The final 44-item ITP-PAQ, which includes ten scales [Symptoms (S), Bother-Physical Health (B), Fatigue/Sleep (FT), Activity (A), Fear (FR), Psychological Health (PH), Work (W), Social Activity (SA), Women's Reproductive Health (RH), and Overall (QoL)], was self-administered to adult ITP subjects at baseline and 7-10 days later. Test-retest reliability, internal consistency reliability, construct and known groups validity of the final ITP-PAQ were evaluated. Seventy-three subjects with ITP completed the questionnaire twice. Test-retest reliability, as measured by the intra-class correlation, ranged from 0.52-0.90. Internal consistency reliability was demonstrated with Cronbach's alpha for all scales above the acceptable level of 0.70 (range: 0.71-0.92), except for RH (0.66). Construct validity, assessed by correlating ITP-PAQ scales with established measures (Short Form-36 v.1, SF-36 and Center for Epidemiologic Studies Depression Scale, CES-D), was demonstrated through moderate correlations between the ITP-PAQ SA and SF-36 Social Function scales (r = 0.67), and between ITP-PAQ PH and SF-36 Mental Health Scales (r = 0.63). Moderate to strong inter-scale correlations were reported between ITP-PAQ scales and the CES-D, except for the RH scale. Known groups validity was evaluated by comparing mean scores for groups that differed clinically. Statistically significant differences (p < 0.01) were observed when subjects were categorized by treatment status [S, FT, B, A, PH, and QoL, perceived effectiveness of ITP treatment [S], and time elapsed since ITP diagnosis [PH]. Results provide preliminary evidence of the reliability and validity of the ITP-PAQ in adult subjects with ITP. Further work should be conducted to assess the responsiveness and to estimate the minimal clinical important difference of the ITP-PAQ to more fully understand the impact of ITP and its treatments on HRQoL.

Workplace-based assessment of communication skills: A pilot project addressing feasibility, acceptance and reliability

PubMed Central

Weyers, Simone; Jemi, Iman; Karger, André; Raski, Bianca; Rotthoff, Thomas; Pentzek, Michael; Mortsiefer, Achim

2016-01-01

Background: Imparting communication skills has been given great importance in medical curricula. In addition to standardized assessments, students should communicate with real patients in actual clinical situations during workplace-based assessments and receive structured feedback on their performance. The aim of this project was to pilot a formative testing method for workplace-based assessment. Our investigation centered in particular on whether or not physicians view the method as feasible and how high acceptance is among students. In addition, we assessed the reliability of the method. Method: As part of the project, 16 students held two consultations each with chronically ill patients at the medical practice where they were completing GP training. These consultations were video-recorded. The trained mentoring physician rated the student’s performance and provided feedback immediately following the consultations using the Berlin Global Rating scale (BGR). Two impartial, trained raters also evaluated the videos using BGR. For qualitative and quantitative analysis, information on how physicians and students viewed feasibility and their levels of acceptance was collected in written form in a partially standardized manner. To test for reliability, the test-retest reliability was calculated for both of the overall evaluations given by each rater. The inter-rater reliability was determined for the three evaluations of each individual consultation. Results: The formative assessment method was rated positively by both physicians and students. It is relatively easy to integrate into daily routines. Its significant value lies in the personal, structured and recurring feedback. The two overall scores for each patient consultation given by the two impartial raters correlate moderately. The degree of uniformity among the three raters in respect to the individual consultations is low. Discussion: Within the scope of this pilot project, only a small sample of physicians and students could be surveyed to a limited extent. There are indications that the assessment can be improved by integrating more information on medical context and student self-assessments. Despite the current limitations regarding test criteria, it is clear that workplace-based assessment of communication skills in the clinical setting is a valuable addition to the communication curricula of medical schools. PMID:27990466

Workplace-based assessment of communication skills: A pilot project addressing feasibility, acceptance and reliability.

PubMed

Weyers, Simone; Jemi, Iman; Karger, André; Raski, Bianca; Rotthoff, Thomas; Pentzek, Michael; Mortsiefer, Achim

2016-01-01

Background: Imparting communication skills has been given great importance in medical curricula. In addition to standardized assessments, students should communicate with real patients in actual clinical situations during workplace-based assessments and receive structured feedback on their performance. The aim of this project was to pilot a formative testing method for workplace-based assessment. Our investigation centered in particular on whether or not physicians view the method as feasible and how high acceptance is among students. In addition, we assessed the reliability of the method. Method: As part of the project, 16 students held two consultations each with chronically ill patients at the medical practice where they were completing GP training. These consultations were video-recorded. The trained mentoring physician rated the student's performance and provided feedback immediately following the consultations using the Berlin Global Rating scale (BGR). Two impartial, trained raters also evaluated the videos using BGR. For qualitative and quantitative analysis, information on how physicians and students viewed feasibility and their levels of acceptance was collected in written form in a partially standardized manner. To test for reliability, the test-retest reliability was calculated for both of the overall evaluations given by each rater. The inter-rater reliability was determined for the three evaluations of each individual consultation. Results: The formative assessment method was rated positively by both physicians and students. It is relatively easy to integrate into daily routines. Its significant value lies in the personal, structured and recurring feedback. The two overall scores for each patient consultation given by the two impartial raters correlate moderately. The degree of uniformity among the three raters in respect to the individual consultations is low. Discussion: Within the scope of this pilot project, only a small sample of physicians and students could be surveyed to a limited extent. There are indications that the assessment can be improved by integrating more information on medical context and student self-assessments. Despite the current limitations regarding test criteria, it is clear that workplace-based assessment of communication skills in the clinical setting is a valuable addition to the communication curricula of medical schools.

Quality of prenatal care questionnaire: instrument development and testing.

PubMed

Heaman, Maureen I; Sword, Wendy A; Akhtar-Danesh, Noori; Bradford, Amanda; Tough, Suzanne; Janssen, Patricia A; Young, David C; Kingston, Dawn A; Hutton, Eileen K; Helewa, Michael E

2014-06-03

Utilization indices exist to measure quantity of prenatal care, but currently there is no published instrument to assess quality of prenatal care. The purpose of this study was to develop and test a new instrument, the Quality of Prenatal Care Questionnaire (QPCQ). Data for this instrument development study were collected in five Canadian cities. Items for the QPCQ were generated through interviews with 40 pregnant women and 40 health care providers and a review of prenatal care guidelines, followed by assessment of content validity and rating of importance of items. The preliminary 100-item QPCQ was administered to 422 postpartum women to conduct item reduction using exploratory factor analysis. The final 46-item version of the QPCQ was then administered to another 422 postpartum women to establish its construct validity, and internal consistency and test-retest reliability. Exploratory factor analysis reduced the QPCQ to 46 items, factored into 6 subscales, which subsequently were validated by confirmatory factor analysis. Construct validity was also demonstrated using a hypothesis testing approach; there was a significant positive association between women's ratings of the quality of prenatal care and their satisfaction with care (r = 0.81). Convergent validity was demonstrated by a significant positive correlation (r = 0.63) between the "Support and Respect" subscale of the QPCQ and the "Respectfulness/Emotional Support" subscale of the Prenatal Interpersonal Processes of Care instrument. The overall QPCQ had acceptable internal consistency reliability (Cronbach's alpha = 0.96), as did each of the subscales. The test-retest reliability result (Intra-class correlation coefficient = 0.88) indicated stability of the instrument on repeat administration approximately one week later. Temporal stability testing confirmed that women's ratings of their quality of prenatal care did not change as a result of giving birth or between the early postpartum period and 4 to 6 weeks postpartum. The QPCQ is a valid and reliable instrument that will be useful in future research as an outcome measure to compare quality of care across geographic regions, populations, and service delivery models, and to assess the relationship between quality of care and maternal and infant health outcomes.