Test-retest reliability and cross validation of the functioning everyday with a wheelchair instrument.

PubMed

Mills, Tamara L; Holm, Margo B; Schmeler, Mark

2007-01-01

The purpose of this study was to establish the test-retest reliability and content validity of an outcomes tool designed to measure the effectiveness of seating-mobility interventions on the functional performance of individuals who use wheelchairs or scooters as their primary seating-mobility device. The instrument, Functioning Everyday With a Wheelchair (FEW), is a questionnaire designed to measure perceived user function related to wheelchair/scooter use. Using consumer-generated items, FEW Beta Version 1.0 was developed and test-retest reliability was established. Cross-validation of FEW Beta Version 1.0 was then carried out with five samples of seating-mobility users to establish content validity. Based on the content validity study, FEW Version 2.0 was developed and administered to seating-mobility consumers to examine its test-retest reliability. FEW Beta Version 1.0 yielded an intraclass correlation coefficient (ICC) Model (3,k) of .92, p < .001, and the content validity results revealed that FEW Beta Version 1.0 captured 55% of seating-mobility goals reported by consumers across five samples. FEW Version 2.0 yielded ICC(3,k) = .86, p < .001, and captured 98.5% of consumers' seating-mobility goals. The cross-validation study identified new categories of seating-mobility goals for inclusion in FEW Version 2.0, and the content validity of FEW Version 2.0 was confirmed. FEW Beta Version 1.0 and FEW Version 2.0 were highly stable in their measurement of participants' seating-mobility goals over a 1-week interval.

Psychometrics of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults.

PubMed

Tomita, Machiko R; Saharan, Sumandeep; Rajendran, Sheela; Nochajski, Susan M; Schweitzer, Jo A

2014-01-01

OBJECTIVE. To identify psychometric properties of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults. METHOD. We tested content validity, test-retest reliability, interrater reliability, construct validity, convergent and discriminant validity, and responsiveness to change. RESULTS. The content validity index was .98, the intraclass correlation coefficient for test-retest reliability was .97, and the interrater reliability was .89. The difference on identified risk factors between the use and nonuse of the HSSAT was significant (p = .005). Convergent validity with the Centers for Disease Control and Prevention Home Safety Checklist was high (r = .65), and discriminant validity with fear of falling was very low (r = .10). The responsiveness to change was moderate (standardized response mean = 0.57). CONCLUSION. The HSSAT is a reliable and valid instrument to identify fall risks in a home environment, and the HSSAT booklet is effective as educational material leading to improvement in home safety. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Valid and Reliable Science Content Assessments for Science Teachers

ERIC Educational Resources Information Center

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-01-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

The development of an instrument to match individuals with disabilities and service animals.

PubMed

Zapf, S A; Rough, R B

There has been an increase in the use of service animals assisting persons with disabilities in the past decade. However many of the service dog agencies do not utilize an assessment that is designed to match the person to the animal in the rehabilitation and psycho-social domains. The purpose of this study was to develop the Service Animal Adaptive Intervention Assessment (SAAIA) and to measure the content validity, inter-rater reliability and clinical utility of the assessment. Two subject groups were used. Subject group one had 43 subjects who measured the content validity and clinical utility of the SAAIA Survey. Subject group two had 12 subjects who measured the inter-rater reliability by completing the SAAIA using information obtained through a video-taped client case scenario. Content validity results indicated a good to high percentage of agreement and a fair percentage of agreement for clinical utility. Inter-rater reliability results indicate good to high agreement on six of the eight variables of the SAAIA. However, the Kappa score indicates low inter-rater reliability. Results indicate the SAAIA has good content validity and inter-rater reliability and fair clinical utility based on percent agreement. However, further research is needed on the reliability of the SAAIA.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Development and validation of health related quality of life questionnaire (Indian scenario) in diabetic foot ulcer patients.

PubMed

Kateel, Ramya; Augustine, Alfred J; Ullal, Sheetal; Prabhu, Shivananda; Bhat, Rahul; Adhikari, Prabha

2017-12-01

To develop and validate Health Related Quality of Life Questionnaire in Diabetic Foot Ulcer Patients (HRQLQDFU) for Indian scenario. This study was conducted in two phases. First phase was Development of HRQLQDFU which included literature search and expert interview. Second phase was validation of HRQLQDFL which included face validation, content validation and construct validation. Face validation was done by ten diabetic foot ulcer patients, ten practicing nurses and ten care givers. They were asked to read and respond to questionnaire and report any difficulty in understanding the questions. Further they were asked to add any item to the questionnaire which according to them has a significant effect on quality of life. Content validation was done by six subject experts who judged the content relevance of questionnaire with score ranging from zero to four; zero being least relevant and four being most relevant. Content validity index was calculated for each question. Questions having content validity index≥0.8 were selected for the study. Reliability was tested by calculating Cronbach's alpha. In the development phase a questionnaire containing 37 questions with six domains was developed. None of patient had difficulty in understanding questions. After content validation a new questionnaire containing 20 questions was developed. Cronbach's alpha was 0.86 which shows good reliability. The new health related quality of life questionnaire on diabetic foot ulcer patients for an Indian scenario is validated and can be a reliably measure for quality of life in diabetic foot ulcer patients. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers

PubMed Central

Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

2015-01-01

The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82–0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers’ muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

Development and psychometric evaluation of supportive leadership scales.

PubMed

McGilton, Katherine S

2003-12-01

The purpose of this study was to develop and evaluate the psychometric properties of 2 supportive leadership scales, the Charge Nurse Support Scale and the Unit Manager Support Scale, designed for long-term-care environments. These 6-item self-report scales were administered to 70 nursing staff and their internal consistency reliability, test-retest reliability, content validity, factor structure, and construct validity investigated. Content validity was established with the assistance of experts. Both scales were deemed reliable. As hypothesized, a significant relationship was found between the measure of how nursing staff related to residents and measures of charge nurses' supportive behaviours (r = .42, p = .05). Reliable and valid measures of supportive leadership could be developed for use in identifying the quality of support provided to staff in long-term-care environments.

Valid and Reliable Science Content Assessments for Science Teachers

NASA Astrophysics Data System (ADS)

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-03-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

Validity and reliability of a scale to measure genital body image.

PubMed

Zielinski, Ruth E; Kane-Low, Lisa; Miller, Janis M; Sampselle, Carolyn

2012-01-01

Women's body image dissatisfaction extends to body parts usually hidden from view--their genitals. Ability to measure genital body image is limited by lack of valid and reliable questionnaires. We subjected a previously developed questionnaire, the Genital Self Image Scale (GSIS) to psychometric testing using a variety of methods. Five experts determined the content validity of the scale. Then using four participant groups, factor analysis was performed to determine construct validity and to identify factors. Further construct validity was established using the contrasting groups approach. Internal consistency and test-retest reliability was determined. Twenty one of 29 items were considered content valid. Two items were added based on expert suggestions. Factor analysis was undertaken resulting in four factors, identified as Genital Confidence, Appeal, Function, and Comfort. The revised scale (GSIS-20) included 20 items explaining 59.4% of the variance. Women indicating an interest in genital cosmetic surgery exhibited significantly lower scores on the GSIS-20 than those who did not. The final 20 item scale exhibited internal reliability across all sample groups as well as test-retest reliability. The GSIS-20 provides a measure of genital body image demonstrating reliability and validity across several populations of women.

Development and testing of an assessment instrument for the formative peer review of significant event analyses.

PubMed

McKay, J; Murphy, D J; Bowie, P; Schmuck, M-L; Lough, M; Eva, K W

2007-04-01

To establish the content validity and specific aspects of reliability for an assessment instrument designed to provide formative feedback to general practitioners (GPs) on the quality of their written analysis of a significant event. Content validity was quantified by application of a content validity index. Reliability testing involved a nested design, with 5 cells, each containing 4 assessors, rating 20 unique significant event analysis (SEA) reports (10 each from experienced GPs and GPs in training) using the assessment instrument. The variance attributable to each identified variable in the study was established by analysis of variance. Generalisability theory was then used to investigate the instrument's ability to discriminate among SEA reports. Content validity was demonstrated with at least 8 of 10 experts endorsing all 10 items of the assessment instrument. The overall G coefficient for the instrument was moderate to good (G>0.70), indicating that the instrument can provide consistent information on the standard achieved by the SEA report. There was moderate inter-rater reliability (G>0.60) when four raters were used to judge the quality of the SEA. This study provides the first steps towards validating an instrument that can provide educational feedback to GPs on their analysis of significant events. The key area identified to improve instrument reliability is variation among peer assessors in their assessment of SEA reports. Further validity and reliability testing should be carried out to provide GPs, their appraisers and contractual bodies with a validated feedback instrument on this aspect of the general practice quality agenda.

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

The reliability and validity of hand-held refractometry water content measures of hydrogel lenses.

PubMed

Nichols, Jason J; Mitchell, G Lynn; Good, Gregory W

2003-06-01

To investigate within- and between-examiner reliability and validity of hand-held refractometry water content measures of hydrogel lenses. Nineteen lenses of various nominal water contents were examined by two examiners on two occasions separated by 1 hour. An Atago N2 hand-held refractometer was used for all water content measures. Lenses were presented in a random order to each examiner by a third party, and examiners were masked to any potential lens identifiers. Intraclass correlation coefficients (ICC), 95% limits of agreement, and Wilcoxon signed rank test were used to characterize the within- and between-examiner reliability and validity of lens water content measures. Within-examiner reliability was excellent (ICC, 0.97; 95% limits of agreement, -3.6% to +5.7%), and the inter-visit mean difference of 1.1 +/- 2.4% was not biased (p = 0.08). Between-examiner reliability was also excellent (ICC, 0.98; 95% limits of agreement, -4.1% to +3.9%). The mean difference between examiners was -0.1 +/- 2.1% (p = 0.83). The mean difference between the nominally reported water content and our water content measures was -2.1 +/- 1.7% (p < 0.001); the 95% limits of agreement for this difference were -5.4% to +1.1%. There is good reliability within and between examiners in measuring water content of hydrogel lenses. However, with our sample of lenses, examiners tended to overestimate the nominal water content of hydrogel lenses. As discussed, this bias may be associated with the Brix scale used in refractometry and is material dependent. Therefore, investigators may need to account for bias when measuring hydrogel lens water content via hand-held refractometry.

Development and psychometric properties rating scale of “clinical competency evaluation in mental health nurses”: Exploratory factor analysis

PubMed Central

Moskoei, Sara; Mohtashami, Jamileh; Ghalenoeei, Mahdie; Nasiri, Maliheh; Tafreshi, Mansoreh Zaghari

2017-01-01

Introduction Evaluation of clinical competency in nurses has a distinct importance in healthcare due to its significant impact on improving the quality of patient care and creation of opportunities for professional promotion. This is a psychometric study for development of the “Clinical Competency of Mental Health Nursing”(CCMHN) rating scale. Methods In this methodological research that was conducted in 2015, in Tehran, Iran, the main items were developed after literature review and the validity and reliability of the tool were identified. The face, content (content validity ratio and content validity index) and construct validities were calculated. For face and content validity, experts’ comments were used. Exploratory factor analysis was used to determine the construct validity. The reliability of scale was determined by the internal consistency and inter-rater correlation. The collected data were analyzed by SPSS version 16, using descriptive statistical analysis. Results A scale with 45 items in two parts including Emotional/Moral and Specific Care competencies was developed. Content validity ratio and content validity index were 0.88, 0.97 respectively. Exploratory factor analysis indicated two factors: The first factor with 23.93 eigenvalue and second factor with eigenvalue 2.58. Cronbach’s alpha coefficient for determination of internal consistency was 0.98 and the ICC for confirmation inter-rater correlation was 0.98. Conclusion A scale with 45 items and two areas was developed with appropriate validity and reliability. This scale can be used to assess the clinical competency in nursing students and mental health nurses. PMID:28607650

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

ERIC Educational Resources Information Center

Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

2011-01-01

Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five BAMF ordinal scales designed for quick documentation of gross, fine, and oral motor skill levels. Designed to be independent of age and…

The Development, Validity and Reliability of TPACK-Deep: A Technological Pedagogical Content Knowledge Scale

ERIC Educational Resources Information Center

Yurdakul, Isil Kabakci; Odabasi, Hatice Ferhan; Kilicer, Kerem; Coklar, Ahmet Naci; Birinci, Gurkay; Kurt, Adile Askim

2012-01-01

The purpose of this study is to develop a TPACK (technological pedagogical content knowledge) scale based on the centered component of TPACK framework in order to measure preservice teachers' TPACK. A systematic and step-by-step approach was followed for the development of the scale. The validity and reliability studies of the scale were carried…

A Scale for E-Content Preparation Skills: Development, Validity and Reliability

ERIC Educational Resources Information Center

Tekin, Ahmet; Polat, Ebru

2016-01-01

Problem Statement: For an effective teaching and learning process it is critical to provide support for teachers in the development of e-content, and teachers should play an active role in this development. Purpose of the Study: The purpose of this study is to develop a valid and reliable Likert-type scale that will determine pre-service teachers'…

Reliability and construct validity of the Malay version of the Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan, Malaysia.

PubMed

Hadi, Azlihanis Abdul; Naing, Nyi Nyi; Daud, Aziah; Nordin, Rusli

2006-11-01

This study was conducted to assess the reliability and construct validity of the Malay version of Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan. A total of 68 teachers consented to participate in the study and were administered the Malay version of JCQ. Reliability was determined using Cronbach's alpha for internal consistency whilst construct validity was assessed using factor analysis. The results indicated that Cronbach's alpha coefficients revealed decision latitude (0.75), psychological job demand (0.50) and social support (0.84). Factor analysis showed three meaningful common factors that could explain the construct of Karasek's demand-control-social support model. The study suggests the JCQ scales are reliable and valid tools for assessing job stress in school teachers.

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Factor structure, validity and reliability of the Cambridge Worry Scale in a pregnant population.

PubMed

Green, Josephine M; Kafetsios, Konstantinos; Statham, Helen E; Snowdon, Claire M

2003-11-01

This article presents the Cambridge Worry Scale (CWS), a content-based measure for assessing worries, and discusses its psychometric properties based on a longitudinal study of 1,207 pregnant women. Principal components analysis revealed a four-factor structure of women's concerns during pregnancy: socio-medical, own health, socio-economic and relational. The measure demonstrated good reliability and validity. Total CWS scores were strongly associated with state and trait anxiety (convergent validity) but also had significant and unique predictive value for mood outcomes (discriminant validity). The CWS discriminated better between women with different reproductive histories than measures of state and trait anxiety. We conclude that the CWS is a reliable and valid tool for assessing the extent and content of worries in specific situations.

34 CFR 462.11 - What must an application contain?

Code of Federal Regulations, 2010 CFR

2010-07-01

... the methodology and procedures used to measure the reliability of the test. (h) Construct validity... previous test, and results from validity, reliability, and equating or standard-setting studies undertaken... NRS educational functioning levels (content validity). Documentation of the extent to which the items...

Elaboration and Validation of the Medication Prescription Safety Checklist 1

PubMed Central

Pires, Aline de Oliveira Meireles; Ferreira, Maria Beatriz Guimarães; do Nascimento, Kleiton Gonçalves; Felix, Márcia Marques dos Santos; Pires, Patrícia da Silva; Barbosa, Maria Helena

2017-01-01

ABSTRACT Objective: to elaborate and validate a checklist to identify compliance with the recommendations for the structure of medication prescriptions, based on the Protocol of the Ministry of Health and the Brazilian Health Surveillance Agency. Method: methodological research, conducted through the validation and reliability analysis process, using a sample of 27 electronic prescriptions. Results: the analyses confirmed the content validity and reliability of the tool. The content validity, obtained by expert assessment, was considered satisfactory as it covered items that represent the compliance with the recommendations regarding the structure of the medication prescriptions. The reliability, assessed through interrater agreement, was excellent (ICC=1.00) and showed perfect agreement (K=1.00). Conclusion: the Medication Prescription Safety Checklist showed to be a valid and reliable tool for the group studied. We hope that this study can contribute to the prevention of adverse events, as well as to the improvement of care quality and safety in medication use. PMID:28793128

A Turkish version of myocardial infarction dimensional assessment scale (TR-MIDAS): reliability-validity assesment.

PubMed

Uysal, Hilal; Ozcan, Şeyda

2011-06-01

Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Psychometric Properties of Korean Version of the Second Victim Experience and Support Tool (K-SVEST).

PubMed

Kim, Eun-Mi; Kim, Sun-Aee; Lee, Ju-Ry; Burlison, Jonathan D; Oh, Eui Geum

2018-02-13

"Second victims" are defined as healthcare professionals whose wellness is influenced by adverse clinical events. The Second Victim Experience and Support Tool (SVEST) was used to measure the second-victim experience and quality of support resources. Although the reliability and validity of the original SVEST have been validated, those for the Korean tool have not been validated. The aim of the study was to evaluate the psychometric properties of the Korean version of the SVEST. The study included 305 clinical nurses as participants. The SVEST was translated into Korean via back translation. Content validity was assessed by seven experts, and test-retest reliability was evaluated by 30 clinicians. Internal consistency and construct validity were assessed via confirmatory factor analysis. The analyses were performed using SPSS 23.0 and STATA 13.0 software. The content validity index value demonstrated validity; item- and scale-level content validity index values were both 0.95. Test-retest reliability and internal consistency reliability were satisfactory: the intraclass consistent coefficient was 0.71, and Cronbach α values ranged from 0.59 to 0.87. The CFA showed a significantly good fit for an eight-factor structure (χ = 578.21, df = 303, comparative fit index = 0.92, Tucker-Lewis index = 0.90, root mean square error of approximation = 0.05). The K-SVEST demonstrated good psychometric properties and adequate validity and reliability. The results showed that the Korean version of SVEST demonstrated the extent of second victimhood and support resources in Korean healthcare workers and could aid in the development of support programs and evaluation of their effectiveness.

Validity and Reliability of General Nutrition Knowledge Questionnaire for Adults in Uganda

PubMed Central

Bukenya, Richard; Ahmed, Abhiya; Andrade, Jeanette M.; Grigsby-Toussaint, Diana S.; Muyonga, John; Andrade, Juan E.

2017-01-01

This study sought to develop and validate a general nutrition knowledge questionnaire (GNKQ) for Ugandan adults. The initial draft consisted of 133 items on five constructs associated with nutrition knowledge; expert recommendations (16 items), food groups (70 items), selecting food (10 items), nutrition and disease relationship (23 items), and food fortification in Uganda (14 items). The questionnaire validity was evaluated in three studies. For the content validity (study 1), a panel of five content matter nutrition experts reviewed the GNKQ draft before and after face validity. For the face validity (study 2), head teachers and health workers (n = 27) completed the questionnaire before attending one of three focus groups to review the clarity of the items. For the construct and test-rest reliability (study 3), head teachers (n = 40) from private and public primary schools and nutrition (n = 52) and engineering (n = 49) students from Makerere University took the questionnaire twice (two weeks apart). Experts agreed (content validity index, CVI > 0.9; reliability, Gwet’s AC1 > 0.85) that all constructs were relevant to evaluate nutrition knowledge. After the focus groups, 29 items were identified as unclear, requiring major (n = 5) and minor (n = 24) reviews. The final questionnaire had acceptable internal consistency (Cronbach α > 0.95), test-retest reliability (r = 0.89), and differentiated (p < 0.001) nutrition knowledge scores between nutrition (67 ± 5) and engineering (39 ± 11) students. Only the construct on nutrition recommendations was unreliable (Cronbach α = 0.51, test-retest r = 0.55), which requires further optimization. The final questionnaire included topics on food groups (41 items), selecting food (2 items), nutrition and disease relationship (14 items), and food fortification in Uganda (22 items) and had good content, construct, and test-retest reliability to evaluate nutrition knowledge among Ugandan adults. PMID:28230779

Reliability and validity of the Wolfram Unified Rating Scale (WURS)

PubMed Central

2012-01-01

Background Wolfram syndrome (WFS) is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS) to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS). Methods A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease). WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age). Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated. Results The WURS had high inter-rater reliability (ICCs>.93), moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91) and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, p<.03), between the WURS Behavioral Scale and reports of mood and behavior (rs>.76, p<.04) and between WURS Total scores and quality of life (rs=-.86, p=.001). The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83). Conclusions These preliminary findings demonstrate that the WURS has acceptable reliability and validity and captures individual differences in disease severity in children and young adults with WFS. PMID:23148655

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Final Report of a Study To Assess the Validity and Reliability of the Standards of Eight Allied Health Professions.

ERIC Educational Resources Information Center

Lyons, Kevin J.; Greening, Shirley; Robeson, Mary

2000-01-01

A modified Delphi procedure assessed the content validity of accreditation standards for cardiovascular technologists, cytotechnologists, medical sonographers, electroneurodiagnostic technologists, medical assistants, perfusionists, physician assistants, and surgical technologists. Although validity and reliability were extremely high, some…

Reliability and validity of a tool to measure the severity of tongue thrust in children: the Tongue Thrust Rating Scale.

PubMed

Serel Arslan, S; Demir, N; Karaduman, A A

2017-02-01

This study aimed to develop a scale called Tongue Thrust Rating Scale (TTRS), which categorised tongue thrust in children in terms of its severity during swallowing, and to investigate its validity and reliability. The study describes the developmental phase of the TTRS and presented its content and criterion-based validity and interobserver and intra-observer reliability. For content validation, seven experts assessed the steps in the scale over two Delphi rounds. Two physical therapists evaluated videos of 50 children with cerebral palsy (mean age, 57·9 ± 16·8 months), using the TTRS to test criterion-based validity, interobserver and intra-observer reliability. The Karaduman Chewing Performance Scale (KCPS) and Drooling Severity and Frequency Scale (DSFS) were used for criterion-based validity. All the TTRS steps were deemed necessary. The content validity index was 0·857. A very strong positive correlation was found between two examinations by one physical therapist, which indicated intra-observer reliability (r = 0·938, P < 0·001). A very strong positive correlation was also found between the TTRS scores of two physical therapists, indicating interobserver reliability (r = 0·892, P < 0·001). There was also a strong positive correlation between the TTRS and KCPS (r = 0·724, P < 0·001) and a very strong positive correlation between the TTRS scores and DSFS (r = 0·822 and r = 0·755; P < 0·001). These results demonstrated the criterion-based validity of the TTRS. The TTRS is a valid, reliable and clinically easy-to-use functional instrument to document the severity of tongue thrust in children. © 2016 John Wiley & Sons Ltd.

Establishing Reliability and Validity of the Criterion Referenced Exam of GeoloGy Standards EGGS

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, S. J.; Slater, T. F.; Schleigh, S.; Burrows, A. C.

2016-12-01

Discipline-based geoscience education researchers have considerable need for a criterion-referenced, easy-to-administer and -score conceptual diagnostic survey for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing education research across the geosciences, we are continuing to rigorously and systematically work to firmly establish the reliability and validity of the recently released Exam of GeoloGy Standards, EGGS. In educational testing, reliability refers to the consistency or stability of test scores whereas validity refers to the accuracy of the inferences or interpretations one makes from test scores. There are several types of reliability measures being applied to the iterative refinement of the EGGS survey, including test-retest, alternate form, split-half, internal consistency, and interrater reliability measures. EGGS rates strongly on most measures of reliability. For one, Cronbach's alpha provides a quantitative index indicating the extent to which if students are answering items consistently throughout the test and measures inter-item correlations. Traditional item analysis methods further establish the degree to which a particular item is reliably assessing students is actually quantifiable, including item difficulty and item discrimination. Validity, on the other hand, is perhaps best described by the word accuracy. For example, content validity is the to extent to which a measurement reflects the specific intended domain of the content, stemming from judgments of people who are either experts in the testing of that particular content area or are content experts. Perhaps more importantly, face validity is a judgement of how representative an instrument is reflective of the science "at face value" and refers to the extent to which a test appears to measure a the targeted scientific domain as viewed by laypersons, examinees, test users, the public, and other invested stakeholders.

Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia.

PubMed

Kadar, Masne; Ibrahim, Suhaili; Razaob, Nor Afifi; Chai, Siaw Chui; Harun, Dzalani

2018-02-01

The Lawton Instrumental Activities of Daily Living Scale is a tool often used to assess independence among elderly at home. Its suitability to be used with the elderly population in Malaysia has not been validated. This current study aimed to assess the validity and reliability of the Lawton Instrumental Activities of Daily Living Scale - Malay Version to Malay speaking elderly in Malaysia. This study was divided into three phases: (1) translation and linguistic validity involving both forward and backward translations; (2) establishment of face validity and content validity; and (3) establishment of reliability involving inter-rater, test-retest and internal consistency analyses. Data used for these analyses were obtained by interviewing 65 elderly respondents. Percentages of Content Validity Index for 4 criteria were from 88.89 to 100.0. The Cronbach α coefficient for internal consistency was 0.838. Intra-class Correlation Coefficient of inter-rater reliability and test-retest reliability was 0.957 and 0.950 respectively. The result shows that the Lawton Instrumental Activities of Daily Living Scale - Malay Version has excellent reliability and validity for use with the Malay speaking elderly people in Malaysia. This scale could be used by professionals to assess functional ability of elderly who live independently in community. © 2018 Occupational Therapy Australia.

Assessment and risk classification protocol for patients in emergency units1

PubMed Central

Silva, Michele de Freitas Neves; Oliveira, Gabriela Novelli; Pergola-Marconato, Aline Maino; Marconato, Rafael Silva; Bargas, Eliete Boaventura; Araujo, Izilda Esmenia Muglia

2014-01-01

Objective to develop, validate the contents and verify the reliability of a risk classification protocol for an Emergency Unit. Method the content validation was developed in a University Hospital in a country town located in the state of Sao Paulo and was carried out in two stages: the first with the individual assessment of specialists and the second with the meeting between the researchers and the specialists. The use of the protocol followed a specific guide. Concerning reliability, the concordance or equivalent method among observers was used. Results the protocol developed showed to have content validity and, after the suggested changes were made, there were excellent results concerning reliability. Conclusion the assistance flow chart was shown to be easy to use, and facilitate the search for the complaint in each assistance priority. PMID:26107828

[Turkish validity and reliability study of fear of pain questionnaire-III].

PubMed

Ünver, Seher; Turan, Fatma Nesrin

2018-01-01

This study aimed to develop a Turkish version of the Fear of Pain Questionnaire-III developed by McNeil and Rainwater (1998) and examine its validity and reliability indicators. The study was conducted with 459 university students studying in the nursing department. The Turkish translation of the scale was conducted by language experts and the original scale owner. Expert opinions were taken for language validity, and the Lawshe's content validity ratio formula was used to calculate the content validity. Exploratory factor analysis was used to assess the construct validity. The factors were rotated using the Varimax rotation (orthogonal) method. For reliability indicators of the questionnaire, the internal consistency coefficient and test re-test reliability were utilized. Explanatory factor analyses using the three-factor model (explaining 50.5% of the total variance) revealed that the item factor loads varied were above the limit value of 0.30 which indicated that the questionnaire had good construct validity. The Cronbach's alpha value for the total questionnaire was 0.938, and test re-test value was 0.846 for the total scale. The Turkish version of the Fear of Pain Questionnaire-III had sufficiently high reliability and validity to be used as a tool in evaluating the fear of pain among the young Turkish population.

The Intra-Rater Reliability of Nine Content-Validated Technical Skill Assessment Instruments (TSAI) for Athletic Taping Skills

ERIC Educational Resources Information Center

Lagumen, Niko G.; Butterwick, Dale J.; Paskevich, David M.; Fung, Tak S.; Donnon, Tyrone L.

2008-01-01

Objective: To establish the intra-rater reliability of nine content-validated Technical Skill Assessment Instruments (TSAI) for the skills of athletic taping. Setting: University of Calgary. Subjects: Canadian Certified Athletic Therapists, CAT(C), with a mean ± SD of 9.6 ± 10.8 years as a CAT(C), 7.8 ± 10.9 years as a Supervisory Athletic…

Measuring decision quality: psychometric evaluation of a new instrument for breast cancer surgery

PubMed Central

2012-01-01

Background The purpose of this paper is to examine the acceptability, feasibility, reliability and validity of a new decision quality instrument that assesses the extent to which patients are informed and receive treatments that match their goals. Methods Cross-sectional mail survey of recent breast cancer survivors, providers and healthy controls and a retest survey of survivors. The decision quality instrument includes knowledge questions and a set of goals, and results in two scores: a breast cancer surgery knowledge score and a concordance score, which reflects the percentage of patients who received treatments that match their goals. Hypotheses related to acceptability, feasibility, discriminant validity, content validity, predictive validity and retest reliability of the survey instrument were examined. Results We had responses from 440 eligible patients, 88 providers and 35 healthy controls. The decision quality instrument was feasible to implement in this study, with low missing data. The knowledge score had good retest reliability (intraclass correlation coefficient = 0.70) and discriminated between providers and patients (mean difference 35%, p < 0.001). The majority of providers felt that the knowledge items covered content that was essential for the decision. Five of the 6 treatment goals met targets for content validity. The five goals had moderate to strong retest reliability (0.64 to 0.87). The concordance score was 89%, indicating that a majority had treatments concordant with that predicted by their goals. Patients who had concordant treatment had similar levels of confidence and regret as those who did not. Conclusions The decision quality instrument met the criteria of feasibility, reliability, discriminant and content validity in this sample. Additional research to examine performance of the instrument in prospective studies and more diverse populations is needed. PMID:22681763

Validity and reliability of Persian version of Listening Styles Profile-Revised (LSP- R) in Iranian students.

PubMed

Fatehi, Zahra; Baradaran, Hamid Reza; Asadpour, Mohamad; Rezaeian, Mohsen

2017-01-01

Background: Individuals' listening styles differs based on their characters, professions and situations. This study aimed to assess the validity and reliability of Listening Styles Profile- Revised (LSP- R) in Iranian students. Methods: After translating into Persian, LSP-R was employed in a sample of 240 medical and nursing Persian speaking students in Iran. Statistical analysis was performed to test the reliability and validity of the LSP-R. Results: The study revealed high internal consistency and good test-retest reliability for the Persian version of the questionnaire. The Cronbach's alpha coefficient was 0.72 and intra-class correlation coefficient 0.87. The means for the content validity index and the content validity ratio (CVR) were 0.90 and 0.83, respectively. Exploratory factor analysis (EFA) yielded a four-factor solution accounted for 60.8% of the observed variance. Majority of medical students (73%) as well as majority of nursing students (70%) stated that their listening styles were task-oriented. Conclusion: In general, the study finding suggests that the Persian version of LSP-R is a valid and reliable instrument for assessing listening styles profile in the studied sample.

Development and Validation of a Safety Climate Scale for Manufacturing Industry

PubMed Central

Ghahramani, Abolfazl; Khalkhali, Hamid R.

2015-01-01

Background This paper describes the development of a scale for measuring safety climate. Methods This study was conducted in six manufacturing companies in Iran. The scale developed through conducting a literature review about the safety climate and constructing a question pool. The number of items was reduced to 71 after performing a screening process. Results The result of content validity analysis showed that 59 items had excellent item content validity index (≥ 0.78) and content validity ratio (> 0.38). The exploratory factor analysis resulted in eight safety climate dimensions. The reliability value for the final 45-item scale was 0.96. The result of confirmatory factor analysis showed that the safety climate model is satisfactory. Conclusion This study produced a valid and reliable scale for measuring safety climate in manufacturing companies. PMID:26106508

Development and content validity testing of a comprehensive classification of diagnoses for pediatric nurse practitioners.

PubMed

Burns, C

1991-01-01

Pediatric nurse practitioners (PNPs) need an integrated, comprehensive classification that includes nursing, disease, and developmental diagnoses to effectively describe their practice. No such classification exists. Further, methodologic studies to help evaluate the content validity of any nursing taxonomy are unavailable. A conceptual framework was derived. Then 178 diagnoses from the North American Nursing Diagnosis Association (NANDA) 1986 list, selected diagnoses from the International Classification of Diseases, the Diagnostic and Statistical Manual, Third Revision, and others were selected. This framework identified and listed, with definitions, three domains of diagnoses: Developmental Problems, Diseases, and Daily Living Problems. The diagnoses were ranked using a 4-point scale (4 = highly related to 1 = not related) and were placed into the three domains. The rating scale was assigned by a panel of eight expert pediatric nurses. Diagnoses that were assigned to the Daily Living Problems domain were then sorted into the 11 Functional Health patterns described by Gordon (1987). Reliability was measured using proportions of agreement and Kappas. Content validity of the groups created was measured using indices of content validity and average congruency percentages. The experts used a new method to sort the diagnoses in a new way that decreased overlaps among the domains. The Developmental and Disease domains were judged reliable and valid. The Daily Living domain of nursing diagnoses showed marginally acceptable validity with acceptable reliability. Six Functional Health Patterns were judged reliable and valid, mixed results were determined for four categories, and the Coping/Stress Tolerance category was judged reliable but not valid using either test. There were considerable differences between the panel's, Gordon's (1987), and NANDA's clustering of NANDA diagnoses. This study defines the diagnostic practice of nurses from a holistic, patient-centered perspective. It is the first study to use quantitative methods to test a diagnostic classification system for nursing. The classification model could also be adapted for other nurse specialties.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Cyber Victim and Bullying Scale: A Study of Validity and Reliability

ERIC Educational Resources Information Center

Cetin, Bayram; Yaman, Erkan; Peker, Adem

2011-01-01

The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

The Universal Design for Play Tool: Establishing Validity and Reliability

ERIC Educational Resources Information Center

Ruffino, Amy Goetz; Mistrett, Susan G.; Tomita, Machiko; Hajare, Poonam

2006-01-01

The Universal Design for Play (UDP) Tool is an instrument designed to evaluate the presence of universal design (UD) features in toys. This study evaluated its psychometric properties, including content validity, construct validity, and test-retest reliability. The UDP tool was designed to assist in selecting toys most appropriate for children…

Construction and validation of educational materials for the prevention of metabolic syndrome in adolescents 1

PubMed Central

de Moura, Ionara Holanda; da Silva, Antônia Fabiana Rodrigues; Rocha, Aparecida do Espírito Santo de Holanda; Lima, Luisa Helena de Oliveira; Moreira, Thereza Maria Magalhães; da Silva, Ana Roberta Vilarouca

2017-01-01

ABSTRACT Objective: To develop and validate an educational technology focused on prevention of metabolic syndrome among adolescents. Methods: This was methodological research. Using an integrative review, the available publications on the subject were analyzed. Then, this knowledge was used to describe the theoretical content and, with the help of a graphic designer, the art and layout of the pages were developed. In the third phase, the booklet was evaluated and validated by 21 specialists and 39 adolescents. Data collection included three different questionnaires, according to the focus of evaluation of each group of participants, analyzed for reliability (Cronbach’s Alpha) and agreement by Infraclass Correlation Coefficient. Results: The mean score attributed by technical content experts was 91.7%, and the content validity index, measured by experts responses, was 0.98, showing high reliability and agreement. In addition, the level of agreement of the positive responses given by adolescents was 88.4%. Conclusion: the educational booklet has proved to be a valid and reliable tool to be used for promoting adolescent health. PMID:29020125

Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

ERIC Educational Resources Information Center

Lafave, Mark; Katz, Larry; Butterwick, Dale

2008-01-01

Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

Preliminary validation and reliability of the Short Form Chronic Respiratory Disease Questionnaire in a lung cancer population.

PubMed

Charalambous, A; Molassiotis, A

2017-01-01

The Short Form Chronic Respiratory Questionnaire (SF-CRQ) is frequently used in patients with obstructive pulmonary disease and it has demonstrated excellent psychometric properties. Since there is no psychometric information for its use with lung cancer patients, this study explored its validity and reliability in this population. Forty-six patients were assessed at two time points (with a 4-week interval) using the SF-CRQ, the modified Borg Scale, five numerical rating scales related to Perceived Severity of Breathlessness, and the Hospital Anxiety and Depression Scale. Internal consistency reliability was investigated by Cronbach's alpha reliability coefficient, test-retest reliability by Spearman-Brown reliability coefficient (P), content validity as well as convergent validity by Pearson's correlation coefficient between the SF-CRQ, and the conceptual similar scales mentioned above were explored. A principal component factor analysis was performed. The internal consistency was high [α = 0.88 (baseline) and 0.91 (after 1 month)]. The SF-CRQ had good stability with test-retest reliability ranging from r = 0.64 to 0.78, P < 0.001. Factor analysis suggests a single construct in this population. The preliminary data analyses supported the convergent, content, and construct validity of the SF-CRQ providing promising evidence that this can be a valid and reliable instrument for the assessment of quality of life related to breathlessness in lung cancer patients. © 2015 John Wiley & Sons Ltd.

Introducing the Professionalism Mini-Evaluation Exercise (P-MEX) in Japan: results from a multicenter, cross-sectional study.

PubMed

Tsugawa, Yusuke; Ohbu, Sadayoshi; Cruess, Richard; Cruess, Sylvia; Okubo, Tomoya; Takahashi, Osamu; Tokuda, Yasuharu; Heist, Brian S; Bito, Seiji; Itoh, Toshiyuki; Aoki, Akiko; Chiba, Tsutomu; Fukui, Tsuguya

2011-08-01

Despite the growing importance of and interest in medical professionalism, there is no standardized tool for its measurement. The authors sought to verify the validity, reliability, and generalizability of the Professionalism Mini-Evaluation Exercise (P-MEX), a previously developed and tested tool, in the context of Japanese hospitals. A multicenter, cross-sectional evaluation study was performed to investigate the validity, reliability, and generalizability of the P-MEX in seven Japanese hospitals. In 2009-2010, 378 evaluators (attending physicians, nurses, peers, and junior residents) completed 360-degree assessments of 165 residents and fellows using the P-MEX. The content validity and criterion-related validity were examined, and the construct validity of the P-MEX was investigated by performing confirmatory factor analysis through a structural equation model. The reliability was tested using generalizability analysis. The contents of the P-MEX achieved good acceptance in a preliminary working group, and the poststudy survey revealed that 302 (79.9%) evaluators rated the P-MEX items as appropriate, indicating good content validity. The correlation coefficient between P-MEX scores and external criteria was 0.78 (P < .001), demonstrating good criterion-related validity. Confirmatory factor analysis verified high path coefficient (0.60-0.99) and adequate goodness of fit of the model. The generalizability analysis yielded a high dependability coefficient, suggesting good reliability, except when evaluators were peers or junior residents. Findings show evidence of adequate validity, reliability, and generalizability of the P-MEX in Japanese hospital settings. The P-MEX is the only evaluation tool for medical professionalism verified in both a Western and East Asian cultural context.

Construct Validity of the Nutrition and Activity Knowledge Scale in a French Sample of Adolescents with Mild to Moderate Intellectual Disability

ERIC Educational Resources Information Center

Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Garbarino, Jean-Marie; Ninot, Gregory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual…

Reliability and validity of the Chinese CECA10 questionnaire for Chinese patients with condyloma acuminata

PubMed Central

Guo, Xinying; Wu, Xinjuan; Guo, Aimin; Zhao, Yanwei

2018-01-01

Abstract Condyloma acuminata (CA) is a sexually transmitted disease that affects quality of life (QOL). CECA10 is an English-language questionnaire for assessing QOL in patients with CA, but there is no equivalent in China. This study aimed to develop a validated and reliable Chinese version of CECA10. The Chinese CECA10 was developed from the English version by forward translation, back translation, comparison with the original, cultural adjustments, and a pre-test (5 patients). The Chinese CECA10 and EuroQol Five Dimensions Three Level Questionnaire (EQ-5D-3L) was administered to patients with CA. Content validity (item/scale content validity indexes, I-CVI/S-CVI), test–retest reliability (intraclass coefficient, ICC), internal consistency (Cronbach α), criterion validity (comparison with the Dermatology Life Quality Index, DLQL, using Spearman correlation analysis), construct validity (exploratory factor analysis), and discriminant validity (between subgroups based on number of warts, number of recurrences, or number of sites involved) were assessed. The Chinese CECA10 had good test–retest reliability (ICC = 0.98, P < .001), internal consistency (Cronbach α values of 0.88, 0.84, and 0.83 for the total questionnaire, psychological dimension, and sexual dimension, respectively), content validity (I-CVI = 1 for all items), and criterion validity (r = -0.50, P < .001). Exploratory factor analysis extracted 2 factors with a cumulative contribution of 61.75%; the factor loading with each item was >0.4. Discriminant validity was not high. The mean CECA10 and EQ-VAS scores of 211 patients with CA (28.19 ± 7.16 years; 139 males) were 34.56 ± 19.01 and 64.64 ± 19.28, respectively. The Chinese CECA10 has good reliability and validity for evaluating the QOL of Chinese patients with CA. PMID:29489693

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

Life-Space Assessment questionnaire: Novel measurement properties for Brazilian community-dwelling older adults.

PubMed

Simões, Maria do Socorro Mp; Garcia, Isabel Ff; Costa, Lucíola da Cm; Lunardi, Adriana C

2018-05-01

The Life-Space Assessment (LSA) assesses mobility from the spaces that older adults go, and how often and how independent they move. Despite its increased use, LSA measurement properties remain unclear. The aim of the present study was to analyze the content validity, reliability, construct validity and interpretability of the LSA for Brazilian community-dwelling older adults. In this clinimetric study we analyzed the measurement properties (content validity, reliability, construct validity and interpretability) of the LSA administered to 80 Brazilian community-dwelling older adults. Reliability was analyzed by Cronbach's alpha (internal consistency), intraclass correlation coefficients and 95% confidence interval (reproducibility), and standard error of measurement (measurement error). Construct validity was analyzed by Pearson's correlations between the LSA and accelerometry (time in inactivity and moderate-to-vigorous activities), and interpretability was analyzed by determination of the minimal detectable change, and floor and ceiling effects. The LSA met the criteria for content validity. The Cronbach's alpha was 0.92, intraclass correlation coefficient was 0.97 (95% confidence interval 0.95-0.98) and standard error of measurement was 4.12. The LSA showed convergence with accelerometry (negative correlation with time in inactivity and positive correlation with time in moderate to vigorous activities), the minimal detectable change was 0.36 and we observed no floor or ceiling effects. The LSA showed adequate reliability, validity and interpretability for life-space mobility assessment of Brazilian community-dwelling older adults. Geriatr Gerontol Int 2018; 18: 783-789. © 2018 Japan Geriatrics Society.

Development of Islamic Spiritual Health Scale (ISHS).

PubMed

Khorashadizadeh, Fatemeh; Heydari, Abbas; Nabavi, Fatemeh Heshmati; Mazlom, Seyed Reza; Ebrahimi, Mahdi; Esmaili, Habibollah

2017-03-01

To develop and psychometrically assess spiritual health scale based on Islamic view in Iran. The cross-sectional study was conducted at Imam Ali and Quem hospitals in Mashhad and Imam Ali and Imam Reza hospitals in Bojnurd, Iran, from 2015 to 2016 In the first stage, an 81-item Likert-type scale was developed using a qualitative approach. The second stage comprised quantitative component. The scale's impact factor, content validity ratio, content validity index, face validity and exploratory factor analysis were calculated. Test-retest and internal consistency was used to examine the reliability of the instrument. Data analysis was done using SPSS 11. Of 81 items in the scale, those with impact factor above 1.5, content validity ratio above 0.62, and content validity index above 0.79 were considered valid and the rest were discarded, resulting in a 61-item scale. Exploratory factor analysis reduced the list of items to 30, which were divided into seven groups with a minimum eigen value of 1 for each factor. But according to scatter plot, attributes of the concept of spiritual health included love to creator, duty-based life, religious rationality, psychological balance, and attention to afterlife. Internal reliability of the scale was calculated by alpha Cronbach coefficient as 0.91. There was solid evidence of the strength factor structure and reliability of the Islamic Spiritual Health Scale which provides a unique way for spiritual health assessment of Muslims.

Validity and Reliability of Field-Based Measures for Assessing Movement Skill Competency in Lifelong Physical Activities: A Systematic Review.

PubMed

Hulteen, Ryan M; Lander, Natalie J; Morgan, Philip J; Barnett, Lisa M; Robertson, Samuel J; Lubans, David R

2015-10-01

It has been suggested that young people should develop competence in a variety of 'lifelong physical activities' to ensure that they can be active across the lifespan. The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71% reporting inter-rater reliability and 41% reporting intra-rater reliability. Only four studies in this review reported test-retest reliability. Ten studies reported validity results; content validity was cited in 41% of these studies. Construct validity was reported in 24% of studies, while criterion validity was only reported in 12% of studies. Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test-retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of 'lifelong physical activity' movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Determining the Appropriateness of the "What If" Situations Test (WIST) with Turkish Pre-Schoolers.

PubMed

Citak Tunc, Gulseren; Gorak, Gulay; Ozyazicioglu, Nurcan; Ak, Bedriye; Isil, Ozlem; Vural, Pinar

2018-04-01

Measurement instruments are needed to assess the child's sexual abuse prevention program. The purpose of the study was to determine the reliability and validity of the WIST (What If Situations Test) for Turkish culture. Participants were children of the 3-6 age group attending pre-school education institutions and the sample size was identified by means of a power analysis. Seventy children were identified as the sample with 0.85 power and 0.05 type I error according to the power analysis. Language validity, content validity, internal validity coefficient (Cronbach alpha coefficient), and test-retest analyses were conducted in terms of validity and reliability in the scope of efforts for adaptation to Turkish culture. Firstly, Kendall W = 0.83 was the score for the expert opinions concerning the content validity of the language validity scale. It was found that the Cronbach alpha coefficients were between 0.68 and 0.90 for the scale sub-dimensions of appropriate and inappropriate recognition, saying, doing, telling, and reporting. The test-retest reliability of the scale was found to be r = 0.89 and the test-retest reliabilities for the sub-dimensions (appropriate recognition, inappropriate recognition, say skills, do skills, tell skills, and reporting skills) were between r = 0.48 and r = 0.92. The test-retest reliability for the Personal Safety Questionnaire (PSQ), as having complimentary items to the WIST, was found to be r = 0.82. The reliability and validity analysis of the 'What If' Situations Test (WIST), used to evaluate pre-schoolers' skills regarding self-protection against sexual abuse, showed that the Test's adaptation to Turkish culture was reliable and valid.

Validation of the Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST) and association of PSST scores with health-related quality of life.

PubMed

Câmara, Rachel de A; Köhler, Cristiano A; Frey, Benicio N; Hyphantis, Thomas N; Carvalho, André F

2017-01-01

To develop and validate a Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST), a questionnaire used for the screening of premenstrual syndrome (PMS) and of the most severe form of PMS, premenstrual dysphoric disorder (PMDD). The PSST also rates the impact of premenstrual symptoms on daily activities. A consecutive sample of 801 women aged ≥ 18 years completed the study protocol. The internal consistency, test-retest reliability, and content validity of the Brazilian PSST were determined. The independent association of a positive screen for PMS or PMDD and quality of life determined by the World Health Organization Quality of Life instrument-Abbreviated version (WHOQOL-Bref) was also assessed. Of 801 participants, 132 (16.5%) had a positive screening for PMDD. The Brazilian PSST had adequate internal consistency (Cronbach's alpha = 0.91) and test-retest reliability. The PSST also had adequate convergent/discriminant validity, without redundancy. Content validity ratio and content validity index were 0.61 and 0.94 respectively. Finally, a positive screen for PMS/PMDD was associated with worse WHOQOL-Bref scores. These findings suggest that PSST is a reliable and valid instrument to screen for PMS/PMDD in Brazilian women.

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire.

PubMed

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II ( r s = -0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (-0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702-0.828 ( P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

The development and psychometric testing of a Disaster Response Self-Efficacy Scale among undergraduate nursing students.

PubMed

Li, Hong-Yan; Bi, Rui-Xue; Zhong, Qing-Ling

2017-12-01

Disaster nurse education has received increasing importance in China. Knowing the abilities of disaster response in undergraduate nursing students is beneficial to promote teaching and learning. However, there are few valid and reliable tools that measure the abilities of disaster response in undergraduate nursing students. To develop a self-report scale of self-efficacy in disaster response for Chinese undergraduate nursing students and test its psychometric properties. Nursing students (N=318) from two medical colleges were chosen by purposive sampling. The Disaster Response Self-Efficacy Scale (DRSES) was developed and psychometrically tested. Reliability and content validity were studied. Construct validity was tested by exploratory and confirmatory factor analysis. Reliability was tested by internal consistency and test-retest reliability. The DRSES consisted of 3 factors and 19 items with a 5-point rating. The content validity was 0.91, Cronbach's alpha coefficient was 0.912, and the intraclass correlation coefficient for test-retest reliability was 0.953. The construct validity was good (χ 2 /df=2.440, RMSEA=0.068, NFI=0.907, CFI=0.942, IFI=0.430, p<0.001). The newly developed DRSES has proven good reliability and validity. It could therefore be used as an assessment tool to evaluate self-efficacy in disaster response for Chinese undergraduate nursing students. Copyright © 2017. Published by Elsevier Ltd.

An Adaptation of the Original Fresno Test to Measure Evidence-Based Practice Competence in Pediatric Bedside Nurses.

PubMed

Laibhen-Parkes, Natasha; Kimble, Laura P; Melnyk, Bernadette Mazurek; Sudia, Tanya; Codone, Susan

2018-06-01

Instruments used to assess evidence-based practice (EBP) competence in nurses have been subjective, unreliable, or invalid. The Fresno test was identified as the only instrument to measure all the steps of EBP with supportive reliability and validity data. However, the items and psychometric properties of the original Fresno test are only relevant to measure EBP with medical residents. Therefore, the purpose of this paper is to describe the development of the adapted Fresno test for pediatric nurses, and provide preliminary validity and reliability data for its use with Bachelor of Science in Nursing-prepared pediatric bedside nurses. General adaptations were made to the original instrument's case studies, item content, wording, and format to meet the needs of a pediatric nursing sample. The scoring rubric was also modified to complement changes made to the instrument. Content and face validity, and intrarater reliability of the adapted Fresno test were assessed during a mixed-methods pilot study conducted from October to December 2013 with 29 Bachelor of Science in Nursing-prepared pediatric nurses. Validity data provided evidence for good content and face validity. Intrarater reliability estimates were high. The adapted Fresno test presented here appears to be a valid and reliable assessment of EBP competence in Bachelor of Science in Nursing-prepared pediatric nurses. However, further testing of this instrument is warranted using a larger sample of pediatric nurses in diverse settings. This instrument can be a starting point for evaluating the impact of EBP competence on patient outcomes. © 2018 Sigma Theta Tau International.

OA Go Away: Development and Preliminary Validation of a Self-Management Tool to Promote Adherence to Exercise and Physical Activity for People with Osteoarthritis of the Hip or Knee

PubMed Central

Toupin April, Karine; Backman, Catherine; Tugwell, Peter

2016-01-01

Purpose: To determine the face and content validity, construct validity, and test–retest reliability of the OA Go Away (OGA), a personalized self-management tool to promote adherence to exercise and physical activity for people with osteoarthritis (OA) of the hip or knee. Methods: The face and content validity of OGA version 1.0 were determined via interviews with 10 people with OA of the hip or knee and 10 clinicians. A revised OGA version 2.0 was then tested for construct validity and test–retest reliability with a new sample of 50 people with OA of the hip or knee by comparing key items in the OGA journal with validated outcome measures assessing similar health outcomes and comparing scores on key items of the journal 4–7 days apart. Face and content validity were then confirmed with a new sample of 5 people with OA of the hip or knee and 5 clinicians. Results: Eighteen of 30 items from the OGA version 1.0 and 41 of 43 items from the OGA version 2.0 journal, goals and action plan, and exercise log had adequate content validity. Construct validity and test–retest reliability were acceptable for the main items of the OGA version 2.0 journal. The OGA underwent modifications based on results and participant feedback. Conclusion: The OGA is a novel self-management intervention and assessment tool for people with OA of the hip or knee that shows adequate preliminary measurement properties. PMID:27909359

Measuring engagement in nurses: the psychometric properties of the Persian version of Utrecht Work Engagement Scale

PubMed Central

Torabinia, Mansour; Mahmoudi, Sara; Dolatshahi, Mojtaba; Abyaz, Mohamad Reza

2017-01-01

Background: Considering the overall tendency in psychology, researchers in the field of work and organizational psychology have become progressively interested in employees’ effective and optimistic experiments at work such as work engagement. This study was conducted to investigate 2 main purposes: assessing the psychometric properties of the Utrecht Work Engagement Scale, and finding any association between work engagement and burnout in nurses. Methods: The present methodological study was conducted in 2015 and included 248 females and 34 males with 6 months to 30 years of job experience. After the translation process, face and content validity were calculated by qualitative and quantitative methods. Moreover, content validation ratio, scale-level content validity index and item-level content validity index were measured for this scale. Construct validity was determined by factor analysis. Moreover, internal consistency and stability reliability were assessed. Factor analysis, test-retest, Cronbach’s alpha, and association analysis were used as statistical methods. Results: Face and content validity were acceptable. Exploratory factor analysis suggested a new 3- factor model. In this new model, some items from the construct model of the original version were dislocated with the same 17 items. The new model was confirmed by divergent Copenhagen Burnout Inventory as the Persian version of UWES. Internal consistency reliability for the total scale and the subscales was 0.76 to 0.89. Results from Pearson correlation test indicated a high degree of test-retest reliability (r = 0. 89). ICC was also 0.91. Engagement was negatively related to burnout and overtime per month, whereas it was positively related with age and job experiment. Conclusion: The Persian 3– factor model of Utrecht Work Engagement Scale is a valid and reliable instrument to measure work engagement in Iranian nurses as well as in other medical professionals. PMID:28955665

Content validation: clarity/relevance, reliability and internal consistency of enunciative signs of language acquisition.

PubMed

Crestani, Anelise Henrich; Moraes, Anaelena Bragança de; Souza, Ana Paula Ramos de

2017-08-10

To analyze the results of the validation of building enunciative signs of language acquisition for children aged 3 to 12 months. The signs were built based on mechanisms of language acquisition in an enunciative perspective and on clinical experience with language disorders. The signs were submitted to judgment of clarity and relevance by a sample of six experts, doctors in linguistic in with knowledge of psycholinguistics and language clinic. In the validation of reliability, two judges/evaluators helped to implement the instruments in videos of 20% of the total sample of mother-infant dyads using the inter-evaluator method. The method known as internal consistency was applied to the total sample, which consisted of 94 mother-infant dyads to the contents of the Phase 1 (3-6 months) and 61 mother-infant dyads to the contents of Phase 2 (7 to 12 months). The data were collected through the analysis of mother-infant interaction based on filming of dyads and application of the parameters to be validated according to the child's age. Data were organized in a spreadsheet and then converted to computer applications for statistical analysis. The judgments of clarity/relevance indicated no modifications to be made in the instruments. The reliability test showed an almost perfect agreement between judges (0.8 ≤ Kappa ≥ 1.0); only the item 2 of Phase 1 showed substantial agreement (0.6 ≤ Kappa ≥ 0.79). The internal consistency for Phase 1 had alpha = 0.84, and Phase 2, alpha = 0.74. This demonstrates the reliability of the instruments. The results suggest adequacy as to content validity of the instruments created for both age groups, demonstrating the relevance of the content of enunciative signs of language acquisition.

[Development of an instrument to measure psychosocial determinants of physical activity behavior among coronary heart disease patients].

PubMed

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Cornélio, Marilia Estevam; Gallani, Maria Cecília Bueno Jayme; Godin, Gaston

2010-09-01

The aim of this study was to report the development and the analysis of content validity and reliability of the Psychosocial Determinants of Physical Activity among Coronary Heart Disease Patients Questionnaire, based on an extension of the Theory of Planned Behavior. In the content validity step, three experts evaluated the instrument which was, afterwards, pre-tested with five subjects in order to obtain a conceptually appropriate and easily understood instrument. Fifty-one patients participated in the evaluation of internal consistency of the reviewed instrument. Cronbach's alpha coefficients above 0.75 were observed for the constructs: Intention, Attitude, Subjective Norm, Self-efficacy and Habit. The new instrument demonstrated acceptable evidence of content validity and reliability.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals.

PubMed

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-03-01

Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach's alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach's alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

34 CFR 200.4 - State law exception.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Academic assessments meet the requirements in § 200.2, particularly regarding validity and reliability... equivalent to one another in their content coverage, difficulty, and quality; (B) Have comparable validity and reliability with respect to groups of students described in section 1111(b)(2)(C)(v) of the Act...

Developing the Irrational Beliefs in Mathematics Scale (IBIMS): A Validity and Reliability Study

ERIC Educational Resources Information Center

Kaya, Deniz

2017-01-01

The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

Developing and Validating the Communication Function Classification System for Individuals with Cerebral Palsy

ERIC Educational Resources Information Center

Hidecker, Mary Jo Cooley; Paneth, Nigel; Rosenbaum, Peter L.; Kent, Raymond D.; Lillie, Janet; Eulenberg, John B.; Chester, Ken, Jr.; Johnson, Brenda; Michalsen, Lauren; Evatt, Morgan; Taylor, Kara

2011-01-01

Aim: The purpose of this study was to create and validate the Communication Function Classification System (CFCS) for children with cerebral palsy (CP), for use by a wide variety of individuals who are interested in CP. This paper reports the content validity, interrater reliability, and test-retest reliability of the CFCS for children with CP.…

Development of Creative Behavior Observation Form: A Study on Validity and Reliability

ERIC Educational Resources Information Center

Dere, Zeynep; Ömeroglu, Esra

2018-01-01

This study, Creative Behavior Observation Form was developed to assess creativity of the children. While the study group on the reliability and validity of Creative Behavior Observation Form was being developed, 257 children in total who were at the ages of 5-6 were used as samples with stratified sampling method. Content Validity Index (CVI) and…

Psychometric Properties of the Persian Language Version of Yang Internet Addiction Questionnaire: An Explanatory Factor Analysis.

PubMed

Mohammadsalehi, Narges; Mohammadbeigi, Abolfazl; Jadidi, Rahmatollah; Anbari, Zohreh; Ghaderi, Ebrahim; Akbari, Mojtaba

2015-09-01

Reliability and validity are the key concepts in measurement processes. Young internet addiction test (YIAT) is regarded as a valid and reliable questionnaire in English speaking countries for diagnosis of Internet-related behavior disorders. This study aimed at validating the Persian version of YIAT in the Iranian society. A pilot and a cross-sectional study were conducted on 28 and 254 students of Qom University of Medical Sciences, respectively, in order to validate the Persian version of YIAT. Forward and backward translations were conducted to develop a Persian version of the scale. Reliability was measured by test-retest, Cronbach's alpha and interclass correlation coefficient (ICC). Face, content and construct validity were approved by the importance score index, content validity ratio (CVR), content validity index (CVI), correlation matrix and factor analysis. The SPSS software was used for data analysis. The Cronbach's alpha was 0.917 (CI 95%; 0.901 - 0.931). The average of scale-level CVI was calculated to be 0.74; the CVI index for each item was higher than 0.83 and the average of CVI index was equal to 0.89. Factor analysis extracted three factors including personal activities disorder (PAD), emotional and mood disorder (EMD) and social activities disorder (SAD), with more than 55.8% of total variances. The ICC for different factors of Persian version of Young Questionnaire including PAD, EMD and for SAD was r = 0.884; CI 95%; 0.861 - 0.904, r = 0.766; CI 95%; 0.718 - 0.808 and r = 0.745; CI 95%; 0.686 - 0.795, respectively. Our study showed that the Persian version of YIAT is good and usable on Iranian people. The reliability of the instrument was very good. Moreover, the validity of the Persian translated version of the scale was sufficient. In addition, the reliability and validity of the three extracted factors of YIAT were evaluated and were acceptable.

Psychometric Properties of the Persian Language Version of Yang Internet Addiction Questionnaire: An Explanatory Factor Analysis

PubMed Central

Mohammadsalehi, Narges; Mohammadbeigi, Abolfazl; Jadidi, Rahmatollah; Anbari, Zohreh; Ghaderi, Ebrahim; Akbari, Mojtaba

2015-01-01

Background: Reliability and validity are the key concepts in measurement processes. Young internet addiction test (YIAT) is regarded as a valid and reliable questionnaire in English speaking countries for diagnosis of Internet-related behavior disorders. Objectives: This study aimed at validating the Persian version of YIAT in the Iranian society. Patients and Methods: A pilot and a cross-sectional study were conducted on 28 and 254 students of Qom University of Medical Sciences, respectively, in order to validate the Persian version of YIAT. Forward and backward translations were conducted to develop a Persian version of the scale. Reliability was measured by test-retest, Cronbach’s alpha and interclass correlation coefficient (ICC). Face, content and construct validity were approved by the importance score index, content validity ratio (CVR), content validity index (CVI), correlation matrix and factor analysis. The SPSS software was used for data analysis. Results: The Cronbach’s alpha was 0.917 (CI 95%; 0.901 - 0.931). The average of scale-level CVI was calculated to be 0.74; the CVI index for each item was higher than 0.83 and the average of CVI index was equal to 0.89. Factor analysis extracted three factors including personal activities disorder (PAD), emotional and mood disorder (EMD) and social activities disorder (SAD), with more than 55.8% of total variances. The ICC for different factors of Persian version of Young Questionnaire including PAD, EMD and for SAD was r = 0.884; CI 95%; 0.861 - 0.904, r = 0.766; CI 95%; 0.718 - 0.808 and r = 0.745; CI 95%; 0.686 - 0.795, respectively. Conclusions: Our study showed that the Persian version of YIAT is good and usable on Iranian people. The reliability of the instrument was very good. Moreover, the validity of the Persian translated version of the scale was sufficient. In addition, the reliability and validity of the three extracted factors of YIAT were evaluated and were acceptable. PMID:26495253

An evaluation of pediatric dental patient education materials using contemporary health literacy measures.

PubMed

Kang, Edith; Fields, Henry W; Cornett, Sandy; Beck, F Michael

2005-01-01

The purpose of this study was to determine the appropriateness of nationally available dental information materials according to the suitability assessment of materials (SAM) method. Clinically related, professionally produced patient dental health education materials (N=22) provided by the American Academy of Pediatric Dentistry (AAPD) were evaluated using the SAM method that had previously been judged valid and reliable. A rater was trained by an experienced health literacy evaluator to establish validity. The rater then rated all materials for 5 categories of assessment (content, literacy demand, graphics, layout and typography, and learning stimulation/motivation) and an overall assessment, and repeated 5 materials to establish intrarater reliability. When compared to the experienced rater, the validity was K=0.43. The reliability was established for all ratings as K=0.52. The consistently weakest categories were content, graphics, and learning stimulation, while reading level as part of literacy demand was often not suitable. The overall suitability of the AAPD materials was generally classified as superior. Reliable and valid evaluation of available dental patient information materials can be accomplished. The materials were largely superior. There is great variability within the categories of evaluation. The categories of content, graphics, and learning stimulation require attention and could raise the overall quality of the materials.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder.

PubMed

Alavi, Seyyed Salman; Mohammadi, Mohammad Reza; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-04-01

The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under "impulse control disorder not elsewhere classified". This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. The content validity of the semi- structured clinical interview matched the DSM-IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including "SMS pathological use" and "High monthly cost of using the mobile phone" were added to promote its validity. Internal reliability (Kappa) and test-retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder.

Military Families' Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure.

PubMed

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families.

Military Families’ Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure

PubMed Central

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families. PMID:28936370

Reliability and validity of a scale to measure consumer attitudes regarding the private food safety certification of restaurants.

PubMed

Uggioni, Paula Lazzarin; Salay, Elisabete

2012-04-01

Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

Nutrition Environment Food Pantry Assessment Tool (NEFPAT): Development and Evaluation.

PubMed

Nikolaus, Cassandra J; Laurent, Emily; Loehmer, Emily; An, Ruopeng; Khan, Naiman; McCaffrey, Jennifer

2018-04-24

To develop and evaluate a nutrition environment assessment tool to assess the consumer nutrition environment and use of recommended practices in food pantries. The Nutrition Environment Food Pantry Assessment Tool (NEFPAT) was developed based on a literature review and guidance from professionals working with food pantries. The tool was pilot-tested at 9 food pantries, an expert panel assessed content validity, and interrater reliability was evaluated by pairs in 3 pantries. After revisions, the NEFPAT was used in 27 pantries. Pilot tests indicated positive appraisal for the NEFPAT and recommendations were addressed. The NEFPAT's 6 objectives and the overall tool were rated as content valid by experts, with an average section rating of 3.85 ± 0.10. Intraclass correlation coefficients for interrater reliability were >0.90. The NEFPAT is content valid with high interrater reliability. It provides baseline data that could be valuable for interventions within the nutrition environment of food pantries. Published by Elsevier Inc.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Validity evidence and reliability of a simulated patient feedback instrument.

PubMed

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Assessing communication skills of clinical call handlers working at an out-of-hours centre: development of the RICE rating scale.

PubMed

Derkx, Hay P; Rethans, Jan-Joost E; Knottnerus, J André; Ram, Paul M

2007-05-01

Out-of-hours centres provide telephone support to patients with medical problems. In most of these centres specially-trained nurses handle incoming telephone calls. They assess patients' needs, the degree of urgency, and determine the level of care required. Assessment of the medical problem and the quality of 'care-by-phone' depend on the medical and communication skills of the call handlers. To develop a valid, reliable, and practical rating scale to evaluate the communication skills of call handlers working at an out-of-hours centre and to improve quality of communication. Qualitative study with focus groups followed by validation of the rating scale and measurement of reliability (internal consistency). Out-of-hours centres in the Netherlands. A focus group developed the rating scale. Experts with experience in training and evaluating communication skills of medical students and GPs commented on the scale to ensure content validity. The reliability of the rating scale was tested in a pilot in which ten specially-trained assessors scored six telephone calls each. The scale, known as the RICE rating scale, has 17 items divided over four different phases of the telephone consultation: Reason for calling; Information gathering; Conclusion; and Evaluation (RICE). Content validity of the scale was assessed by two experts. Reliability of the scale tested in the pilot was 0.73 (Cronbach's alpha). Establishing a rating scale to assess the communication skills of call handlers which meets common scientific demands, such as content validity and reliability, proved successful. This instrument can be used to give feedback to call handlers.

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire

PubMed Central

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

Objective: To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. Methods: After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Results: Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II (rs = −0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (−0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702–0.828 (P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. Conclusions: The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses. PMID:29379839

The analysis of reliability and validity of the IT-MAIS, MAIS and MUSS.

PubMed

Zhong, Yan; Xu, Tianqiu; Dong, Ruijuan; Lyu, Jing; Liu, Bo; Chen, Xueqing

2017-05-01

The aim of this study was to investigate the reliability and validity of the Infant-toddler Meaningful Auditory Integration Scale (IT-MAIS), Meaningful Auditory Integration Scale (MAIS), and Meaningful Use of Speech Scale (MUSS). IT-MAIS, MAIS and MUSS were divided into 3 sub dimensions. 300 children with cochlear implants (CI) were included in the investigation. To assess test-retest reliability of these questionnaires, 30 children were selected randomly to be evaluated at a two-week interval indicated that there were no significant changes between test and retest. Furthermore random test analysis by different evaluators was also administered to 30 users. Reliability test: Test-retest reliability of the three scales was proved to be satisfactory. All domains had correlation coefficients that exceeded 0.750(P < 0.01). The Cronbach's α of the three scales and their three domains were greater than 0.700. Reliability between evaluators of the three scales were considered to be satisfactory. All domains had correlation coefficients that exceeded 0.750(P < 0.01). Validity test: The evaluation of content validity by expert review showed the questionnaire had good content validity; The correlation coefficients between the overall scores of the three scales and their three domains were 0.699-0.978(P < 0.01). There were correlations among the three sub-domains but the strength of the correlations was relatively low. There was certain construct validity. IT-MAIS, MAIS, MUSS scales have good reliability and validity, and can be used to measure the outcome for children with cochlear implants hearing and speech evaluation. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals

PubMed Central

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-01-01

Introduction Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. Methods To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach’s alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. Results The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach’s alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. Conclusion The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals. PMID:28461863

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Psychometric properties of the Social Cognitive Theory questionnaire for physical activity in a sample of Iranian adolescent girl students.

PubMed

Ardestani, M S; Niknami, S; Hidarnia, A; Hajizadeh, E

2016-08-18

This research examined the validity and reliability of a researcher-developed questionnaire based on Social Cognitive Theory (SCT) to assess the physical activity behaviour of Iranian adolescent girls (SCT-PAIAGS). Psychometric properties of the SCT-PAIAGS were assessed by determining its face validity, content and construct validity as well as its reliability. In order to evaluate factor structure, cross-sectional research was conducted on 400 high-school girls in Tehran. Content validity index, content validity ratio and impact score for the SCT-PAIAGS varied between 0.97-1, 0.91-1 and 4.6-4.9 respectively. Confirmatory factor analysis approved a six-factor structure comprising self-efficacy, self-regulation, family support, friend support, outcome expectancy and self-efficacy to overcoming impediments. Factor loadings, t-values and fit indices showed that the SCT model was fitted to the data. Cronbach's α-coefficient ranged from 0.78 to 0.85 and intraclass correlation coefficient from 0.73 to 0.90.

Interrater Reliability to Assure Valid Content in Peer Review of CME-Accredited Presentations

ERIC Educational Resources Information Center

Quigg, Mark; Lado, Fred A.

2009-01-01

Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

The reliability and validity of the Turkish version of Fullerton Advanced Balance (FAB-T) scale.

PubMed

Iyigun, Gozde; Kirmizigil, Berkiye; Angin, Ender; Oksuz, Sevim; Can, Filiz; Eker, Levent; Rose, Debra J

2018-06-04

The aim of this study was to evaluate the reliability and validity of the Turkish version of the FAB(FAB-T) scale in the older Turkish adults. The reliability and validity of the scale was tested on 200 community-dwelling older adults. FAB-T scale was scored by different physiotherapists on different days to evaluate inter-rater and intrarater reliability. The Berg Balance Scale (BBS) was used for the evaluation of convergent validity, and the content validity of the FAB-T scale was investigated. The FAB-T scale showed very high inter- and intra-rater reliability. For inter-rater agreement, on the individual test items and total score ICC values were 0.92 (95 %CI; 0.90-0.94) and 0.96 (95% CI; 0.95-0.97) respectively. The intra-rater agreement, on the individual test items and total score ICC values were 0.93 (95 %CI; 0.91- 0.95) and 0.96 (95% CI; 0.95- 0.97) respectively. There was a good agreement between the FAB-T and BBS scales. A high correlation was found between the BBS and FAB-T scales [rho = 0.70 (%95 CI; 0.62-0.76)] indicating good convergent validity. Considering the content validity of the FAB-T scale, no floor (floor score: 0%) or ceiling (ceiling score: 6.5%) effect was detected. The FAB-T scale was successfully translated from the original English version (FAB) and demonstrated strong psychometric features. It was found that the FAB-T scale has very high inter-rater and intra-rater reliability. Considering the convergent validity, the scale has high correlation with the BBS. The FAB-T has no floor and ceiling effect. Copyright © 2018 Elsevier B.V. All rights reserved.

Psychometric Properties of the Chinese Version of the Occupational Fatigue Exhaustion/Recovery Scale: A Test in a Nursing Population.

PubMed

Fang, Jin-Bo; Zhou, Chun-Fen; Huang, Jing; Qiu, Chang-Jian

2018-06-01

The Occupational Fatigue Exhaustion/Recovery Scale (OFER) was designed to assess occupational fatigue in nurses. Although the original English version of this instrument has shown high degrees of reliability and validity, a Chinese version of this scale has yet to be verified. The aim of this study was to evaluate the psychometric properties of the OFER in a population of Chinese nurses. The scale was translated using translation and back-translation. The validities and reliabilities were evaluated on 923 qualified participants using content validity index, concurrent validity, factorial validity, internal consistency reliability, and test-retest reliability. The content validity index for the OFER was .92. The correlation coefficients between the scores of the OFER subscales and the criteria in this study (varying from -.498 to .705) verified that the OFER has acceptable concurrent validity. Principal component analysis and confirmatory factor analysis revealed that three factors correspond to the structure of the original instrument and that recovery mediates the relationship between acute and chronic fatigue. The Cronbach's alpha for the chronic fatigue, acute fatigue, and intershift recovery subscales were .83, .85, and .86, respectively. Test-retest reliabilities with correlation coefficients from .61 to .78 were found in the three subscales. OFER is a reliable and valid instrument for assessing work-related fatigue in Chinese nurses. However, further improvement of the acute fatigue subscale is recommended. The OFER has the potential to elicit information that is useful for assessing fatigue in nurses in China. Furthermore, as it differentiates between acute and chronic fatigue, OFER may be an effective tool for guiding the development and implementation of various, related intervention measures.

Development of an audit instrument for nursing care plans in the patient record

PubMed Central

Bjorvell, C; Thorell-Ekstrand, I; Wredling, R

2000-01-01

Objectives—To develop, validate, and test the reliability of an audit instrument that measures the extent to which patient records describe important aspects of nursing care. Material—Twenty records from each of three hospital wards were collected and audited. The auditors were registered nurses with a knowledge of nursing documentation in accordance with the VIPS model—a model designed to structure nursing documentation. (VIPS is an acronym formed from the Swedish words for wellbeing, integrity, prevention, and security.) Methods—An audit instrument was developed by determining specific criteria to be met. The audit questions were aimed at revealing the content of the patient for nursing assessment, nursing diagnosis, planned interventions, and outcome. Each of the 60 records was reviewed by the three auditors independently and the reliability of the instrument was tested by calculating the inter-rater reliability coefficient. Content validity was tested by using an expert panel and calculating the content validity ratio. The criterion related validity was estimated by the correlation between the score of the Cat-ch-Ing instrument and the score of an earlier developed and used audit instrument. The results were then tested by using Pearson's correlation coefficient. Results—The new audit instrument, named Cat-ch-Ing, consists of 17 questions designed to judge the nursing documentation. Both quantity and quality variables are judged on a rating scale from zero to three, with a maximum score of 80. The inter-rater reliability coefficients were 0.98, 0.98, and 0.92, respectively for each group of 20 records, the content validity ratio ranged between 0.20 and 1.0 and the criterion related validity showed a significant correlation of r = 0.68 (p< 0.0001, 95% CI 0.57 to 0.76) between the two audit instruments. Conclusion—The Cat-ch-Ing instrument has proved to be a valid and reliable audit instrument for nursing records when the VIPS model is used as the basis of the documentation. (Quality in Health Care 2000;9:6–13) Key Words: audit instrument; nursing care plans; quality assurance PMID:10848373

Reliability and Validity of the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A).

PubMed

Bervoets, Liene; Van Noten, Caroline; Van Roosbroeck, Sofie; Hansen, Dominique; Van Hoorenbeeck, Kim; Verheyen, Els; Van Hal, Guido; Vankerckhoven, Vanessa

2014-01-01

This study was designed to validate the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A). After adjustment of the original Canadian PAQ-C and PAQ-A (i.e. translation/back-translation and evaluation by expert committee), content validity of both PAQs was assessed and calculated using item-level (I-CVI) and scale-level (S-CVI) content validity indexes. Inter-item and inter-rater reliability of 196 PAQ-C and 95 PAQ-A filled in by both children or adolescents and their parent, were evaluated. Inter-item reliability was calculated by Cronbach's alpha (α) and inter-rater reliability was examined by percent observed agreement and weighted kappa (κ). Concurrent validity of PAQ-A was examined in a subsample of 28 obese and 16 normal-weight children by comparing it with concurrently measured physical activity using a maximal cardiopulmonary exercise test for the assessment of peak oxygen uptake (VO2 peak). For both PAQs, I-CVI ranged 0.67-1.00. S-CVI was 0.89 for PAQ-C and 0.90 for PAQ-A. A total of 192 PAQ-C and 94 PAQ-A were fully completed by both child and parent. Cronbach's α was 0.777 for PAQ-C and 0.758 for PAQ-A. Percent agreement ranged 59.9-74.0% for PAQ-C and 51.1-77.7% for PAQ-A, and weighted κ ranged 0.48-0.69 for PAQ-C and 0.51-0.68 for PAQ-A. The correlation between total PAQ-A score and VO2 peak - corrected for age, gender, height and weight - was 0.516 (p = 0.001). Both PAQs have an excellent content validity, an acceptable inter-item reliability and a moderate to good strength of inter-rater agreement. In addition, total PAQ-A score showed a moderate positive correlation with VO2 peak. Both PAQs have an acceptable to good reliability and validity, however, further validity testing is recommended to provide a more complete assessment of both PAQs.

Psychometric validation of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool for older Chinese inpatients.

PubMed

Zhang, Junhong; Wang, Min; Liu, Yu

2016-10-01

To culturally adapt and evaluate the reliability and validity of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool among older inpatients in the mainland of China. Patient falls are an important safety consideration within hospitals among older inpatients. Nurses need specific risk assessment tools for older inpatients to reliably identify at-risk populations and guide interventions that highlight fixable risk factors for falls and consequent injuries. In China, a few tools have been developed to measure fall risk. However, they lack the solid psychometric development necessary to establish their validity and reliability, and they are not widely used for elderly inpatients. A cross-sectional study. A convenient sampling was used to recruit 201 older inpatients from two tertiary-level hospitals in Beijing and Xiamen, China. The Johns Hopkins Fall Risk Assessment Tool was translated using forward and backward translation procedures and was administered to these 201 older inpatients. Reliability of the tool was calculated by inter-rater reliability and Cronbach's alpha. Validity was analysed through content validity index and construct validity. The Inter-rater reliability of Chinese version of Johns Hopkins Fall Risk Assessment Tool was 97·14% agreement with Cohen's Kappa of 0·903. Cronbach's α was 0·703. Content of Validity Index was 0·833. Two factors represented intrinsic and extrinsic risk factors were explored that together explained 58·89% of the variance. This study provided evidence that Johns Hopkins Fall Risk Assessment Tool is an acceptable, valid and reliable tool to identify older inpatients at risk of falls and falls with injury. Further psychometric testing on criterion validity and evaluation of its advanced utility in geriatric clinical settings are warranted. The Chinese version of Johns Hopkins Fall Risk Assessment Tool may be useful for health care personnel to identify older Chinese inpatients at risk of falls and falls with injury. © 2016 John Wiley & Sons Ltd.

Tobacco Use Prevention for the Young (TUPY-S): Development, Validity and Reliability of an Interactive Multimedia Strategy from the Adolescents’ Perspective in Malaysia

PubMed Central

Zin, Faridah Mohd; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-01-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. PMID:28612599

Patient Assessment of Constipation Quality of Life Questionnaire: Translation, Cultural Adaptation, Reliability, and Validity of the Persian Version.

PubMed

Nikjooy, Afsaneh; Jafari, Hassan; Saba, Maryam A; Ebrahimi, Naghmeh; Mirzaei, Rezvan

2018-05-01

The Patient Assessment of Constipation Quality of Life (PAC-QOL) questionnaire is the most validated and the most specific tool for measuring the quality of life of patients with constipation. Over 120 million people live in countries whose official language is Persian. There is no reported Persian version of the PAC-QOL questionnaire yet. The aim of this study was to translate and culturally adapt the PAC-QOL questionnaire and to assess its reliability and validity among Persian patients with chronic constipation. Following the translation and cultural adaptation of the PAC-QOL questionnaire to Persian, 100 patients (mean±SD age=40.51±13.67) with constipation were recruited for validity measurement and 20 patients were re-examined for reliability. Content validity was assessed based on the opinions of an expert committee and the floor/ceiling effect. Construct validity was evaluated according to the hypothesis test. The SF-36 questionnaire was used for concurrent criterion validity, intra-class correlation coefficient for reliability, and Cronbach's alpha for internal consistency. The content validity of the PAC-QOL questionnaire was proven, and there was no floor/ceiling effect. Construct validity also was confirmed based on the hypothesis test. The overall Cronbach's alpha of the PAC-QOL questionnaire was 0.92 (range=0.72-0.92), and the overall intra-class correlation coefficient of the questionnaire was 0.88 (range=0.69-0.87). The correlation between the SF-36 and PAC-QOL questionnaires was moderate. The Persian version of the PAC-QOL questionnaire demonstrated good validity and reliability properties in chronic constipation. Accordingly, Persian researchers and clinicians can benefit from this questionnaire in further research and assessment of treatment outcomes.

Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan.

PubMed

Moore, Amy Lawson; Miller, Terissa M

2018-01-01

The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills. This study included 2,737 participants aged 5-85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test-retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement. Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test-retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93. The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan.

Development of a new instrument for determining the level of chewing function in children.

PubMed

Serel Arslan, S; Demir, N; Barak Dolgun, A; Karaduman, A A

2016-07-01

This study aimed to develop a chewing performance scale that classifies chewing from normal to severely impaired and to investigate its validity and reliability. The study included the developmental phase and reported the content, structural, criterion validity, interobserver and intra-observer reliability of the chewing performance scale, which was called the Karaduman Chewing Performance Scale (KCPS). A dysphagia literature review, other questionnaires and clinical experiences were used in the developmental phase. Seven experts assessed the steps for content validity over two Delphi rounds. To test structural, criterion validity, interobserver and intra-observer reliability, two swallowing therapists evaluated chewing videos of 144 children (Group I: 61 healthy children without chewing disorders, mean age of 42·38 ± 9·36 months; Group II: 83 children with cerebral palsy who have chewing disorders, mean age of 39·09 ± 22·95 months) using KCPS. The Behavioral Pediatrics Feeding Assessment Scale (BPFAS) was used for criterion validity. The KCPS steps arranged between 0-4 were found to be necessary. The content validity index was 0·885. The KCPS levels were found to be different between groups I and II (χ(2) = 123·286, P < 0·001). A moderately strong positive correlation was found between the KCPS and the subscales of the BPFAS (r = 0·444-0·773, P < 0·001). An excellent positive correlation was detected between two swallowing therapists and between two examinations of one swallowing therapist (r = 0·962, P < 0·001; r = 0·990, P < 0·001, respectively). The KCPS is a valid, reliable, quick and clinically easy-to-use functional instrument for determining the level of chewing function in children. © 2016 John Wiley & Sons Ltd.

Designing a valid and reliable Likert attitude scale on the generation of electricity from nuclear power plants

DOE Office of Scientific and Technical Information (OSTI.GOV)

Calhoun, L.D.

A 15-step flowchart model was applied to the construction of a 20-item long form and a 6-item short form of the scale. Both scales were field-tested on 829 respondents representing a diverse range of subjects: high school juniors and seniors, nuclear engineering students, pre-service teachers, and members of a citizens action group. Both scales are available for immediate use. The 20-item scale appears to be reliable, content valid, and construct valid. Content validity was examined through factor analysis and the use of two separate juries of nuclear experts. Construct validity was examined by application of the known-groups approach. Scale reliabilitymore » and homogeneity were evidenced by a 0.93 coefficient alpha, a range of positive interim correlations of 0.15 to 0.73, and a range of adjusted item-total correlations of 0.46 to 0.80. The 20-item scale also has evaluative quality; means ranged from 2.80 to 3.70. Content validity for the 6-item scale was examined by a jury of nuclear experts. An obtained coefficient alpha of 0.82, a range of interim correlations of 0.51 to 0.72 suggest the scale is reliable and homogeneous. The 6-item short form also appears to have evaluative quality; means ranged from 2.37 to 3.18.« less

Reliability and validity of job content questionnaire for university research laboratory staff in Malaysia.

PubMed

Nehzat, F; Huda, B Z; Tajuddin, S H Syed

2014-03-01

Job Content Questionnaire (JCQ) has been proven a reliable and valid instrument to assess job stress in many countries and among various occupations. In Malaysia, both English and Malay versions of the JCQ have been administered to automotive workers, schoolteachers, and office workers. This study assessed the reliability and validity of the instrument with research laboratory staff in a university. A cross sectional study was conducted among 258 research laboratory staff in Universiti Putra Malaysia (UPM). Malaysian laboratory staff who have worked for at least one year were randomly selected from nine faculties and institutes in the university that have research laboratory. A self-administered English and Malay version of Job Content Questionnaire (JCQ) was used. Three major scales of JCQ: decision latitude, psychological job demands, and social support were assessed. Cronbach's alpha coefficients of two scales were acceptable, decision latitude and psychological job demands (0.70 and 0.72, respectively), while Cronbach's alpha coefficient for social support (0.86) was good. Exploratory factor analysis showed five factors that correspond closely to the theoretical construct of the questionnaire. The results of this research suggest that the JCQ is reliable and valid for examining psychosocial work situations and job strain among research laboratory staff. Further studies should be done for confirmative results, and further evaluation is needed on the decision authority subscale for this occupation.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder

PubMed Central

Alavi, Seyyed Salman; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-01-01

Objective: The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under “impulse control disorder not elsewhere classified”. This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Method: Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. Results: The content validity of the semi- structured clinical interview matched the DSM–IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including “SMS pathological use” and “High monthly cost of using the mobile phone” were added to promote its validity. Internal reliability (Kappa) and test–retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. Conclusion: The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder. PMID:27437008

Developing Form Assembly Specifications for Exams with Multiple Choice and Constructed Response Items: Balancing Reliability and Validity Concerns

ERIC Educational Resources Information Center

Hendrickson, Amy; Patterson, Brian; Ewing, Maureen

2010-01-01

The psychometric considerations and challenges associated with including constructed response items on tests are discussed along with how these issues affect the form assembly specifications for mixed-format exams. Reliability and validity, security and fairness, pretesting, content and skills coverage, test length and timing, weights, statistical…

Development and psychometric testing of the Knowledge, Attitudes and Practices (KAP) questionnaire among student Tuberculosis (TB) Patients (STBP-KAPQ) in China.

PubMed

Fan, Yahui; Zhang, Shaoru; Li, Yan; Li, Yuelu; Zhang, Tianhua; Liu, Weiping; Jiang, Hualin

2018-05-08

TB outbreaking in schools is extremely complex, and presents a major challenge for public health. Understanding the knowledge, attitudes and practices among student TB patients in such settings is fundamental when it comes to decreasing future TB cases. The objective of this study was to develop a Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ), and evaluate its psychometric properties. This study was conducted in three stages: item construction, pilot testing in 10 student TB patients and psychometric testing, including reliability and validity. The item pool for the questionnaire was compiled from literature review and early individual interviews. The questionnaire items were evaluated by the Delphi method based on 12 experts. Reliability and validity were assessed using student TB patients (n = 416) and healthy students (n = 208). Reliability was examined with internal consistency reliability and test-retest reliability. Content validity was calculated by content validity index (CVI); Construct validity was examined using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA); The Public Tuberculosis Knowledge, Attitudes and Practices Questionnaire (PTB-KAPQ) was applied to evaluate criterion validity; As concerning discriminant validity, T-test was performed. The final STBP-KAPQ consisted of three dimensions and 25 items. Cronbach's α coefficient and intraclass correlation coefficient (ICC) was 0.817 and 0.765, respectively. Content validity index (CVI) was 0.962. Seven common factors were extracted by principal factor analysis and varimax rotation, with a cumulative contribution of 66.253%. The resulting CFA model of the STBP-KAPQ exhibited an appropriate model fit (χ2/df = 1.74, RMSEA = 0.082, CFI = 0.923, NNFI = 0.962). STBP-KAPQ and PTB-KAPQ had a strong correlation in the knowledge part, and the correlation coefficient was 0.606 (p < 0.05). Discriminant validity was supported through a significant difference between student TB patients and healthy students across all domains (p < 0.05). An instrument, "Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ)" was developed. Psychometric testing indicated that it had adequate validity and reliability for use in KAP researches with student TB patients in China. The new tool might help public health researchers evaluate the level of KAP in student TB patients, and it could also be used to examine the effects of TB health education.

Validity evidence and reliability of a simulated patient feedback instrument

PubMed Central

2012-01-01

Background In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients. PMID:22284898

Development and validation of the Myasthenia Gravis Impairment Index.

PubMed

Barnett, Carolina; Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M

2016-08-30

We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test-retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test-retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79-0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79-0.94). The MGII correlated well with comparison measures, with higher correlations with the MG-activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. © 2016 American Academy of Neurology.

Development and validation of the Myasthenia Gravis Impairment Index

PubMed Central

Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M.

2016-01-01

Objective: We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. Methods: The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test–retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. Results: The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test–retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79–0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79–0.94). The MGII correlated well with comparison measures, with higher correlations with the MG–activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. Conclusions: The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. PMID:27402891

Measuring stakeholder participation in evaluation: an empirical validation of the Participatory Evaluation Measurement Instrument (PEMI).

PubMed

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joël

2012-08-01

Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. This study consists of a first empirical validation of a measurement instrument that fully covers the content of participation, namely the Participatory Evaluation Measurement Instrument (PEMI). It specifically examines (1) the intercoder reliability of scores derived by two research assistants on published evaluation cases; (2) the convergence between the scores of coders and those of key respondents (i.e., authors); and (3) the convergence between the authors' scores on the PEMI and the Evaluation Involvement Scale (EIS). A purposive sample of 40 cases drawn from the evaluation literature was used to assess reliability. One author per case in this sample was then invited to participate in a survey; 25 fully usable questionnaires were received. Stakeholder participation was measured on nominal and ordinal scales. Cohen's κ, the intraclass correlation coefficient, and Spearman's ρ were used to assess reliability and convergence. Reliability results ranged from fair to excellent. Convergence between coders' and authors' scores ranged from poor to good. Scores derived from the PEMI and the EIS were moderately associated. Evidence from this study is strong in the case of intercoder reliability and ranges from weak to strong in the case of convergent validation. Globally, this suggests that the PEMI can produce scores that are both reliable and valid.

Assessing impact of physical activity-based youth development programs: validation of the Life Skills Transfer Survey (LSTS).

PubMed

Weiss, Maureen R; Bolter, Nicole D; Kipp, Lindsay E

2014-09-01

A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program. In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the Life Skills Transfer Survey (LSTS), a measure of perceived life skills transfer. Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS. RESULTS from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Psychometric Evaluation of the Revised Michigan Diabetes Knowledge Test (V.2016) in Arabic: Translation and Validation

PubMed Central

Alhaiti, Ali Hassan; Alotaibi, Alanod Raffa; Jones, Linda Katherine; DaCosta, Cliff

2016-01-01

Objective. To translate the revised Michigan Diabetes Knowledge Test into the Arabic language and examine its psychometric properties. Setting. Of the 139 participants recruited through King Fahad Medical City in Riyadh, Saudi Arabia, 34 agreed to the second-round sample for retesting purposes. Methods. The translation process followed the World Health Organization's guidelines for the translation and adaptation of instruments. All translations were examined for their validity and reliability. Results. The translation process revealed excellent results throughout all stages. The Arabic version received 0.75 for internal consistency via Cronbach's alpha test and excellent outcomes in terms of the test-retest reliability of the instrument with a mean of 0.90 infraclass correlation coefficient. It also received positive content validity index scores. The item-level content validity index for all instrument scales fell between 0.83 and 1 with a mean scale-level index of 0.96. Conclusion. The Arabic version is proven to be a reliable and valid measure of patient's knowledge that is ready to be used in clinical practices. PMID:27995149

Reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire: a pilot study amongst older car drivers and motorcycle riders.

PubMed

Ang, B H; Chen, W S; Ngin, C K; Oxley, J A; Lee, S W H

2018-02-01

This study aimed to examine the reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire. An observational study with a mix-method approach by utilising both questionnaire and short debriefing interviews. Forward and backward translations of the original questionnaire were performed. The translated questionnaire was assessed for clarity by a multidisciplinary research team, translators, and several Malay native speakers. A total of 24 subjects participated in the pilot study. Reliability (Cronbach's alpha) and validity (content validity) of the original and translated questionnaires were examined. The English and Malay versions of the Driving and Riding Questionnaire were found to be reliable tools in measuring driving behaviours amongst older drivers and riders, with Cronbach's alpha of 0.9158 and 0.8919, respectively. For content validity, the questionnaires were critically reviewed in terms of relevance, clarity, simplicity, and ambiguity. The feedback obtained from participants addressed various aspects of the questionnaire related to the improvement of wordings used and inclusion of visual guide to enhance the understanding of the items in the questionnaire. This feedback was incorporated into the final versions of the English and Malay questionnaires. The findings of this study demonstrated both the English and Malay versions of the Driving and Riding Questionnaire to be valid and reliable. Copyright © 2017 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

The Multitheoretical List of Therapeutic Interventions - 30 items (MULTI-30).

PubMed

Solomonov, Nili; McCarthy, Kevin S; Gorman, Bernard S; Barber, Jacques P

2018-01-16

To develop a brief version of the Multitheoretical List of Therapeutic Interventions (MULTI-60) in order to decrease completion time burden by approximately half, while maintaining content coverage. Study 1 aimed to select 30 items. Study 2 aimed to examine the reliability and internal consistency of the MULTI-30. Study 3 aimed to validate the MULTI-30 and ensure content coverage. In Study 1, the sample included 186 therapist and 255 patient MULTI ratings, and 164 ratings of sessions coded by trained observers. Internal consistency (Chronbach's alpha and McDonald's omega) was calculated and confirmatory factor analysis was conducted. Psychotherapy experts rated content relevance. Study 2 included a sample of 644 patient and 522 therapist ratings, and 793 codings of psychotherapy sessions. In Study 3, the sample included 33 codings of sessions. A series of regression analyses was conducted to examine replication of previously published findings using the MULTI-30. The MULTI-30 was found valid, reliable, and internally consistent across 2564 ratings examined across the three studies presented. The MULTI-30 a brief and reliable process measure. Future studies are required for further validation.

Development, content validity and test-retest reliability of the Lifelong Physical Activity Skills Battery in adolescents.

PubMed

Hulteen, Ryan M; Barnett, Lisa M; Morgan, Philip J; Robinson, Leah E; Barton, Christian J; Wrotniak, Brian H; Lubans, David R

2018-03-28

Numerous skill batteries assess fundamental motor skill (e.g., kick, hop) competence. Few skill batteries examine lifelong physical activity skill competence (e.g., resistance training). This study aimed to develop and assess the content validity, test-retest and inter-rater reliability of the "Lifelong Physical Activity Skills Battery". Development of the skill battery occurred in three stages: i) systematic reviews of lifelong physical activity participation rates and existing motor skill assessment tools, ii) practitioner consultation and iii) research expert consultation. The final battery included eight skills: grapevine, golf swing, jog, push-up, squat, tennis forehand, upward dog and warrior I. Adolescents (28 boys, 29 girls; M = 15.8 years, SD = 0.4 years) completed the Lifelong Physical Activity Skills Battery on two occasions two weeks apart. The skill battery was highly reliable (ICC = 0.84, 95% CI = 0.72-0.90) with individual skill reliability scores ranging from moderate (warrior I; ICC = 0.56) to high (tennis forehand; ICC = 0.82). Typical error (4.0; 95% CI 3.4-5.0) and proportional bias (r = -0.21, p = .323) were low. This study has provided preliminary evidence for the content validity and reliability of the Lifelong Physical Activity Skills Battery in an adolescent population.

Development and psychometric testing of the Protective Reasons Against Suicide Inventory for assessing older Chinese-speaking outpatients in primary care settings.

PubMed

Wang, Yi-Wen; Tsai, Yun-Fang; Lee, Shwu-Hua; Chen, Ying-Jen; Chen, Hsiu-Fang

2016-07-01

To develop and psychometrically test the Protective Reasons against Suicide Inventory among older Chinese-speaking outpatients. Tools currently exist to test reasons for living among individuals of all ages in western countries, but few are available to assess older adults' protective reasons against suicide in Asia. A cross-sectional survey to investigate protective reasons against suicide among older Chinese-speaking outpatients. The Protective Reasons against Suicide Inventory was developed based on individual interviews with 83 older outpatients in Taiwan, the literature and the authors' clinical experiences. The resulting Inventory was examined in 2013 for content validity, face validity, construct validity, criterion-related validity, internal consistency reliability and test-retest reliability. The Inventory had excellent content validity and face validity. Factor analysis yielded a seven-factor solution, accounting for 87·7% of the variance. Scores on the global Inventory and its subscales tended to be higher in outpatients diagnosed without suicidal ideation than in outpatients diagnosed with suicidal ideation, indicating good criterion validity. Inventory reliability and the intraclass correlation coefficient were satisfactory. The Protective Reasons against Suicide Inventory can be completed in 5 minutes and is perceived as easy to complete. Moreover, the Inventory yielded highly acceptable parameters for validity and reliability. The Protective Reasons against Suicide Inventory can be used to assess older Chinese-speaking outpatients for factors that protect them from attempting suicide. © 2016 John Wiley & Sons Ltd.

[Reliability and validity of Driving Anger Scale in professional drivers in China].

PubMed

Li, Z; Yang, Y M; Zhang, C; Li, Y; Hu, J; Gao, L W; Zhou, Y X; Zhang, X J

2017-11-10

Objective: To assess the reliability and validity of the Chinese version of Driving Anger Scale (DAS) in professional drivers in China and provide a scientific basis for the application of the scale in drivers in China. Methods: Professional drivers, including taxi drivers, bus drivers, truck drivers and school bus drivers, were selected to complete the questionnaire. Cronbach's α and split-half reliability were calculated to evaluate the reliability of DAS, and content, contract, discriminant and convergent validity were performed to measure the validity of the scale. Results: The overall Cronbach's α of DAS was 0.934 and the split-half reliability was 0.874. The correlation coefficient of each subscale with the total scale was 0.639-0.922. The simplified version of DAS supported a presupposed six-factor structure, explaining 56.371% of the total variance revealed by exploratory factor analysis. The DAS had good convergent and discriminant validity, with the success rate of calibration experiment of 100%. Conclusion: DAS has a good reliability and validity in professional drivers in China, and the use of DAS is worth promoting in divers.

Cross-cultural adaptation, validity, and reliability of the Parenting Styles and Dimensions Questionnaire - Short Version (PSDQ) for use in Brazil.

PubMed

Oliveira, Thaís D; Costa, Danielle de S; Albuquerque, Maicon R; Malloy-Diniz, Leandro F; Miranda, Débora M; de Paula, Jonas J

2018-06-11

The Parenting Styles and Dimensions Questionnaire (PSDQ) is used worldwide to assess three styles (authoritative, authoritarian, and permissive) and seven dimensions of parenting. In this study, we adapted the short version of the PSDQ for use in Brazil and investigated its validity and reliability. Participants were 451 mothers of children aged 3 to 18 years, though sample size varied with analyses. The translation and adaptation of the PSDQ followed a rigorous methodological approach. Then, we investigated the content, criterion, and construct validity of the adapted instrument. The scale content validity index (S-CVI) was considered adequate (0.97). There was evidence of internal validity, with the PSDQ dimensions showing strong correlations with their higher-order parenting styles. Confirmatory factor analysis endorsed the three-factor, second-order solution (i.e., three styles consisting of seven dimensions). The PSDQ showed convergent validity with the validated Brazilian version of the Parenting Styles Inventory (Inventário de Estilos Parentais - IEP), as well as external validity, as it was associated with several instruments measuring sociodemographic and behavioral/emotional-problem variables. The PSDQ is an effective and reliable psychometric instrument to assess childrearing strategies according to Baumrind's model of parenting styles.

Environmental education curriculum evaluation questionnaire: A reliability and validity study

NASA Astrophysics Data System (ADS)

Minner, Daphne Diane

The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating that the questionnaire can discriminate differences in quality of environmental education curricula. Of the 35 curricula evaluated, 6 were high quality, 14 were medium quality and 15 were low quality. The criterion-related validity of the instrument is at current time unable to be established due to the lack of comparable measures or a concretely usable set of multidisciplinary standards. Face and content validity were sufficiently demonstrated.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms - Part II.

PubMed

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms – Part II

PubMed Central

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources. PMID:28584367

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Content Validity and Inter-Rater Reliability of the Halliwick-Concept-Based Instrument "Swimming with Independent Measure"

ERIC Educational Resources Information Center

Srsen, Katja Groleger; Vidmar, Gaj; Pikl, Masa; Vrecar, Irena; Burja, Cirila; Krusec, Klavdija

2012-01-01

The Halliwick concept is widely used in different settings to promote joyful movement in water and swimming. To assess the swimming skills and progression of an individual swimmer, a valid and reliable measure should be used. The Halliwick-concept-based Swimming with Independent Measure (SWIM) was introduced for this purpose. We aimed to determine…

Psychometric evaluation of the Swedish adaptation of the Inventory for Assessing the Process of Cultural Competence Among Healthcare Professionals--Revised (IAPCC-R).

PubMed

Olt, Helen; Jirwe, Maria; Gustavsson, Petter; Emami, Azita

2010-01-01

The purpose of this study was to describe the translation, adaption, and psychometric evaluation process in relation to validity and reliability of the Swedish version of the instrument, Inventory for Assessing The Process of Cultural Competence Among Healthcare Professionals-Revised (IAPCC-R) following the translation, adaptation, and psychometric evaluation process. Validity tests were conducted on the response processes (N = 15), the content (N = 7), and the internal structure of the instrument (N = 334). Reliability (alpha = .65 for the total scale varying between -.01 and .65 for the different subscales) was evaluated in terms of internal consistency. Results indicated weak validity and reliability though it is difficult to conclude whether this is related to adaptation issues or the original construction.The testing of the response process identified problems in relation to respondents' conceptualization of cultural competence. The test of the content identified a weak correspondence between the items and the underlying model. In addition, a confirmatory factor analysis did not confirm the proposed structure of the instrument. This study concludes that this instrument is not valid and reliable for use with a Swedish population of practicing nurses or nursing students.

Affordances in the home environment for motor development: Validity and reliability for the use in daycare setting.

PubMed

Müller, Alessandra Bombarda; Valentini, Nadia Cristina; Bandeira, Paulo Felipe Ribeiro

2017-05-01

The range of stimuli provided by physical space, toys and care practices contributes to the motor, cognitive and social development of children. However, assessing the quality of child education environments is a challenge, and can be considered a health promotion initiative. This study investigated the validity of the criterion, content, construct and reliability of the Affordances in the Home Environment for Motor Development - Infant Scale (AHEMD-IS), version 3-18 months, for the use in daycare settings. Content validation was conducted with the participation of seven motor development and health care experts; and, face validity by 20 specialists in health and education. The results indicate the suitability of the adapted AHEMD-IS, evidencing its validity for the daycare setting a potential tool to assess the opportunities that the collective context offers to child development. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of knowledge tests for multi-disciplinary emergency training: a review and an example.

PubMed

Sørensen, J L; Thellesen, L; Strandbygaard, J; Svendsen, K D; Christensen, K B; Johansen, M; Langhoff-Roos, P; Ekelund, K; Ottesen, B; Van Der Vleuten, C

2015-01-01

The literature is sparse on written test development in a post-graduate multi-disciplinary setting. Developing and evaluating knowledge tests for use in multi-disciplinary post-graduate training is challenging. The objective of this study was to describe the process of developing and evaluating a multiple-choice question (MCQ) test for use in a multi-disciplinary training program in obstetric-anesthesia emergencies. A multi-disciplinary working committee with 12 members representing six professional healthcare groups and another 28 participants were involved. Recurrent revisions of the MCQ items were undertaken followed by a statistical analysis. The MCQ items were developed stepwise, including decisions on aims and content, followed by testing for face and content validity, construct validity, item-total correlation, and reliability. To obtain acceptable content validity, 40 out of originally 50 items were included in the final MCQ test. The MCQ test was able to distinguish between levels of competence, and good construct validity was indicated by a significant difference in the mean score between consultants and first-year trainees, as well as between first-year trainees and medical and midwifery students. Evaluation of the item-total correlation analysis in the 40 items set revealed that 11 items needed re-evaluation, four of which addressed content issues in local clinical guidelines. A Cronbach's alpha of 0.83 for reliability was found, which is acceptable. Content and construct validity and reliability were acceptable. The presented template for the development of this MCQ test could be useful to others when developing knowledge tests and may enhance the overall quality of test development. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Developing and validating the Communication Function Classification System for individuals with cerebral palsy

PubMed Central

HIDECKER, MARY JO COOLEY; PANETH, NIGEL; ROSENBAUM, PETER L; KENT, RAYMOND D; LILLIE, JANET; EULENBERG, JOHN B; CHESTER, KEN; JOHNSON, BRENDA; MICHALSEN, LAUREN; EVATT, MORGAN; TAYLOR, KARA

2011-01-01

Aim The purpose of this study was to create and validate a Communication Function Classification System (CFCS) for children with cerebral palsy (CP) that can be used by a wide variety of individuals who are interested in CP. This paper reports the content validity, interrater reliability, and test–retest reliability of the CFCS for children with CP. Method An 11-member development team created comprehensive descriptions of the CFCS levels, and four nominal groups comprising 27 participants critiqued these levels. Within a Delphi survey, 112 participants commented on the clarity and usefulness of the CFCS. Interrater reliability was completed by 61 professionals and 68 parents/relatives who classified 69 children with CP aged 2 to 18 years. Test–retest reliability was completed by 48 professionals who allowed at least 2 weeks between classifications. The participants who assessed the CFCS were all relevant stakeholders: adults with CP, parents of children with CP, educators, occupational therapists, physical therapists, physicians, and speech–language pathologists. Results The interrater reliability of the CFCS was 0.66 between two professionals and 0.49 between a parent and a professional. Professional interrater reliability improved to 0.77 for classification of children older than 4 years. The test–retest reliability was 0.82. Interpretation The CFCS demonstrates content validity and shows very good test–retest reliability, good professional interrater reliability, and moderate parent–professional interrater reliability. Combining the CFCS with the Gross Motor Function Classification System and the Manual Ability Classification System contributes to a functional performance view of daily life for individuals with CP, in accordance with the World Health Organization’s International Classification of Functioning, Disability and Health. PMID:21707596

The Turkish adaptation of scale to measure patient perceptions of the quality of nursing care and related hospital services: A validity and reliability study

PubMed Central

Oren, Besey; Zengin, Neriman; Yildiz, Nebahat

2016-01-01

OBJECTIVE: This study aimed to test the validity and reliability of a version of the tool developed in Sri Lanka in 2011 to assess patient perceptions of the quality of nursing care and related hospital services created for use with Turkish patients. METHODS: This methodological study was conducted between November 2013 and November 2014 after obtaining ethical approval and organizational permission. Data was collected during discharge from 180 adult patients who were hospitalized for at least 3 days at a medical school hospital located in Istanbul. After language validation, validity and reliability analyses of the scale were conducted. Content validity, content validity index (CVI), construct validity, and exploratory factor analysis were assessed and examined, and reliability was tested using the Cronbach’s alpha coefficient and item-total correlations. RESULTS: Mean CVI was found to be 0.95, which is above expected value. Exploratory factor analysis revealed 4 factors with eigenvalues above 1, which explained 82.4% of total variance in the Turkish version of the tool to measure patient perceptions of nursing care and other hospital services. Factor loading for each item was ≥.40. Cronbach’s alpha coefficient of sub-dimensions and total scale were found to be 0.84-0.98 and 0.98, respectively. Item-total correlations ranged from 0.56 to 0.83 for the entire group, which was above expected values. CONCLUSION: The Turkish version of the scale to assess patient perceptions of the quality of nursing care and related hospital services, which comprised 4 sub-dimensions and 36 items, was found to be valid and reliable for use with the Turkish population. PMID:28275750

The Turkish adaptation of scale to measure patient perceptions of the quality of nursing care and related hospital services: A validity and reliability study.

PubMed

Oren, Besey; Zengin, Neriman; Yildiz, Nebahat

2016-01-01

This study aimed to test the validity and reliability of a version of the tool developed in Sri Lanka in 2011 to assess patient perceptions of the quality of nursing care and related hospital services created for use with Turkish patients. This methodological study was conducted between November 2013 and November 2014 after obtaining ethical approval and organizational permission. Data was collected during discharge from 180 adult patients who were hospitalized for at least 3 days at a medical school hospital located in Istanbul. After language validation, validity and reliability analyses of the scale were conducted. Content validity, content validity index (CVI), construct validity, and exploratory factor analysis were assessed and examined, and reliability was tested using the Cronbach's alpha coefficient and item-total correlations. Mean CVI was found to be 0.95, which is above expected value. Exploratory factor analysis revealed 4 factors with eigenvalues above 1, which explained 82.4% of total variance in the Turkish version of the tool to measure patient perceptions of nursing care and other hospital services. Factor loading for each item was ≥.40. Cronbach's alpha coefficient of sub-dimensions and total scale were found to be 0.84-0.98 and 0.98, respectively. Item-total correlations ranged from 0.56 to 0.83 for the entire group, which was above expected values. The Turkish version of the scale to assess patient perceptions of the quality of nursing care and related hospital services, which comprised 4 sub-dimensions and 36 items, was found to be valid and reliable for use with the Turkish population.

Development and psychometric evaluation of a cardiovascular risk and disease management knowledge assessment tool.

PubMed

Rosneck, James S; Hughes, Joel; Gunstad, John; Josephson, Richard; Noe, Donald A; Waechter, Donna

2014-01-01

This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.

Validity of Multiprocess IRT Models for Separating Content and Response Styles

ERIC Educational Resources Information Center

Plieninger, Hansjörg; Meiser, Thorsten

2014-01-01

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

Development and Validation of the Physics Anxiety Rating Scale

ERIC Educational Resources Information Center

Sahin, Mehmet; Caliskan, Serap; Dilek, Ufuk

2015-01-01

This study reports the development and validation process for an instrument to measure university students' anxiety in physics courses. The development of the Physics Anxiety Rating Scale (PARS) included the following steps: Generation of scale items, content validation, construct validation, and reliability calculation. The results of construct…

Critical thinking evaluation in reflective writing: Development and testing of Carter Assessment of Critical Thinking in Midwifery (Reflection).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-11-01

develop and test a tool designed for use by academics to evaluate pre-registration midwifery students' critical thinking skills in reflective writing. a descriptive cohort design was used. a random sample (n = 100) of archived student reflective writings based on a clinical event or experience during 2014 and 2015. a staged model for tool development was used to develop a fifteen item scale involving item generation; mapping of draft items to critical thinking concepts and expert review to test content validity; inter-rater reliability testing; pilot testing of the tool on 100 reflective writings; and psychometric testing. Item scores were analysed for mean, range and standard deviation. Internal reliability, content and construct validity were assessed. expert review of the tool revealed a high content validity index score of 0.98. Using two independent raters to establish inter-rater reliability, good absolute agreement of 72% was achieved with a Kappa coefficient K = 0.43 (p<0.0001). Construct validity via exploratory factor analysis revealed three factors: analyses context, reasoned inquiry, and self-evaluation. The mean total score for the tool was 50.48 (SD = 12.86). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of .93. this study establishedthe reliability and validity of the CACTiM (reflection) for use by academics to evaluate midwifery students' critical thinking in reflective writing. Validation with large diverse samples is warranted. reflective practice is a key learning and teaching strategy in undergraduate Bachelor of Midwifery programmes and essential for safe, competent practice. There is the potential to enhance critical thinking development by assessingreflective writing with the CACTiM (reflection) tool to provide formative and summative feedback to students and inform teaching strategies. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

The development of form two mathematics i-Think module (Mi-T2)

NASA Astrophysics Data System (ADS)

Yao, Foo Jing; Abdullah, Mohd Faizal Nizam Lee; Tien, Lee Tien

2017-05-01

This study aims to develop a training module i-THINK Mathematics Form Two (Mi-T2) to increase the higher-order thinking skills of students. The Mi-T2 training module was built based on the Sidek Module Development Model (2001). Constructivist learning theory, cognitive learning theory, i-THINK map and higher order thinking skills were the building blocks of the module development. In this study, researcher determined the validity and reliability of Mi-T2 module. The design being used in this study was descriptive study. To determine the needs of Mi-T2 module, questionnaires and literature review were used to collect data. When the need of the module was determined, the module was built and a pilot study was conducted to test the reliability of the Mi-T2 module. The pilot study was conducted at a secondary school in North Kinta, Perak. A Form Two class was selected to be the sample study through clustered random sampling. The pilot study was conducted for two months and one topic had been studied. The Mi-T2 module was evaluated by five expert panels to determine the content validity of the module. The instruments being used in the study were questionnaires about the necessity of the Mi-T2 module for guidance, questionnaires about the validity of the module and questionnaires concerning the reliability of the module. Statistical analysis was conducted to determine the validity and reliability coefficients of the Mi-T2 module. The content validity of Mi-T2 module was determined by Cohen's Kappa's (1968) agreement coefficient and the reliability of Mi-T2 module was determined by Cronbach Alpha's value scale. The content validity of Mi-T2 module was 0.89 and the Cronbach Alpha's value of Mi-T2 module was 0.911.

Assessment of a condition-specific quality-of-life measure for patients with developmentally absent teeth: validity and reliability testing.

PubMed

Akram, A J; Ireland, A J; Postlethwaite, K C; Sandy, J R; Jerreat, A S

2013-11-01

This article describes the process of validity and reliability testing of a condition-specific quality-of-life measure for patients with hypodontia presenting for orthodontic treatment. The development of the instrument is described in a previous article. Royal Devon and Exeter NHS Foundation Trust & Musgrove Park Hospital, Taunton. The child perception questionnaire was used as a standard against which to test criterion validity. The Bland and Altman method was used to check agreement between the two questionnaires. Construct validity was tested using principal component analysis on the four sections of the questionnaire. Test-retest reliability was tested using intraclass correlation coefficient and Bland and Altman method. Cronbach's alpha was used to test internal consistency reliability. Overall the questionnaire showed good reliability, criterion and construct validity. This together with previous evidence of good face and content validity suggests that the instrument may prove useful in clinical practice and further research. This study has demonstrated that the newly developed condition-specific quality-of-life questionnaire is both valid and reliable for use in young patients with hypodontia. © 2013 John Wiley & Sons A/S. Published by Blackwell Publishing Ltd.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Measuring Certified Registered Nurse Anesthetist Organizational Climate: Instrument Adaptation.

PubMed

Boyd, Donald; Poghosyan, Lusine

2017-08-01

No tool exists measuring certified registered nurse anesthetist (CRNA) organizational climate. The study's purpose is to adapt a validated tool to measure CRNA organizational climate. Content validity of the Certified Registered Nurse Anesthetist Organizational Climate Questionnaire (CRNA-OCQ) was established. Pilot testing was conducted to determine internal reliability consistency of the subscales. Experts rated the tool as content valid. The subscales had high internal consistency reliability (with respective Cronbach's alphas): CRNA-Anesthesiologist Relations (.753), CRNA-Physician Relations (.833), CRNA-Administration Relations (.895), Independent Practice (.830), Support for CRNA Practice (.683), and Professional Visibility (.772). Further refinement of the CRNA-OCQ is necessary. Measurement and assessment of CRNA organizational climate may produce evidence needed to improve provider and patient outcomes.

Measuring social alienation in adolescence: translation and validation of the Jessor and Jessor Social Alienation Scale.

PubMed

Safipour, Jalal; Tessma, Mesfin Kassaye; Higginbottom, Gina; Emami, Azita

2010-12-01

The objective of the study is to translate and examine the reliability and validity of the Jessor and Jessor Social Alienation Scale for use in a Swedish context. The study involved four phases of testing: (1) Translation and back-translation; (2) a pilot test to evaluate the translation; (3) reliability testing; and (4) a validity test. Main participants of this study were 446 students (Age = 15-19, SD = 1.01, Mean = 17). Results from the reliability test showed high internal consistency and stability. Face, content and construct validity were demonstrated using experts and confirmatory factor analysis. The results of testing the Swedish version of the alienation scale revealed an acceptable level of reliability and validity, and is appropriate for use in the Swedish context. © 2010 The Authors. Scandinavian Journal of Psychology © 2010 The Scandinavian Psychological Associations.

Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research.

PubMed

Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara

2010-03-01

This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

A validation of the construct and reliability of an emotional intelligence scale applied to nursing students1

PubMed Central

Espinoza-Venegas, Maritza; Sanhueza-Alvarado, Olivia; Ramírez-Elizondo, Noé; Sáez-Carrillo, Katia

2015-01-01

OBJECTIVE: The current study aimed to validate the construct and reliability of an emotional intelligence scale. METHOD: The Trait Meta-Mood Scale-24 was applied to 349 nursing students. The process included content validation, which involved expert reviews, pilot testing, measurements of reliability using Cronbach's alpha, and factor analysis to corroborate the validity of the theoretical model's construct. RESULTS: Adequate Cronbach coefficients were obtained for all three dimensions, and factor analysis confirmed the scale's dimensions (perception, comprehension, and regulation). CONCLUSION: The Trait Meta-Mood Scale is a reliable and valid tool to measure the emotional intelligence of nursing students. Its use allows for accurate determinations of individuals' abilities to interpret and manage emotions. At the same time, this new construct is of potential importance for measurements in nursing leadership; educational, organizational, and personal improvements; and the establishment of effective relationships with patients. PMID:25806642

Development of a scale to measure diabetes self-management behaviors among older Koreans with type 2 diabetes, based on the seven domains identified by the American Association of Diabetes Educators.

PubMed

Seo, Kyoungsan; Song, Misoon; Choi, Suyoung; Kim, Se-An; Chang, Sun Ju

2017-04-01

The purpose of this study was to develop the Diabetes Self-Management Behavior for Older Koreans (DSMB-O). This scale is based on the seven relevant domains that have been identified by the American Association of Diabetes Educators (AADE) and is adjusted for sociocultural and age-related characteristics. Four phases were used to develop of the DSMB-O as a criterion-referenced measure. In phases 1 and 2, the DSMB-O adopted the AADE's seven domains and established a self-report questionnaire using a small number of items that are applicable to older Koreans. In phase 3, the DSMB-O was formulated with 16 preliminary items, including seven subitems. By assessing the content validity, 14 items (including five subitems) were selected. The final phase involved evaluating the DSMB-O's psychometric properties, including test-retest reliability, content validity, and criterion-related validity, using data from 150 older Koreans with type 2 diabetes. The coefficients of agreement and Cohen's Kappa for the test-retest reliability test ranged from 0.32 to 1.0 and -0.07 to 1.0, respectively. For the content validity, the values of both the item- and scale-level content validity indices were 1.0. The scores from the DSMB-O were positively correlated with the scores from the Korean version of the Summary of Diabetes Self-Care Activities Questionnaire. The DSMB-O is short and easy for older Koreans to use, as well as having acceptable levels of reliability and validity. Hence, the DSMB-O can be a useful tool to evaluate diabetes self-management behaviors in older Koreans with type 2 diabetes. © 2016 Japan Academy of Nursing Science.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Psychometric Properties of the Death Anxiety Scale-Extended among Patients with End-Stage Renal Disease.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Koocher, Gerald P; Yaghoobzadeh, Ameneh; Haghdoost, Ali Akbar; Mar Win, Ma Thin; Soleimani, Mohammad Ali

2017-01-01

This study aimed to evaluate the validity and reliability of the Persian version of Death Anxiety Scale-Extended (DAS-E). A total of 507 patients with end-stage renal disease completed the DAS-E. The factor structure of the scale was evaluated using exploratory factor analysis with an oblique rotation and confirmatory factor analysis. The content and construct validity of the DAS-E were assessed. Average variance extracted, maximum shared squared variance, and average shared squared variance were estimated to assess discriminant and convergent validity. Reliability was assessed using Cronbach's alpha coefficient (α = .839 and .831), composite reliability (CR = .845 and .832), Theta (θ = .893 and .867), and McDonald Omega (Ω = .796 and .743). The analysis indicated a two-factor solution. Reliability and discriminant validity of the factors was established. Findings revealed that the present scale was a valid and reliable instrument that can be used in assessment of death anxiety in Iranian patients with end-stage renal disease.

Cultural adaptation of an instrument to assess physical fitness in cardiac patients.

PubMed

Domingues, Gabriela de Barros Leite; Gallani, Maria Cecília; Gobatto, Claudio Alexandre; Miura, Cinthya Tamie Passos; Rodrigues, Roberta Cunha Matheus; Myers, Jonathan

2011-04-01

To validate the content and to evaluate the reliability of the Veterans Specific Activity Questionnaire instrument, culturally adapted for use in the Brazilian population of cardiac patients. The instrument was translated and back-translated and subsequently analyzed by a committee of judges to evaluate its semantic-idiomatic and cultural equivalences. Physical activities were replaced when indicated in the instrument, but uncommon in the daily life of the target population. Another committee of specialists analyzed the metabolic equivalence of replaced activities. The proportion of agreement of evaluation of the judges was quantified by the Content Validity Index. The pre-test was performed in two stages (n1 and n2=15). Reliability was assessed using the test-retest (interval of 7-15 days, n = 50). In the evaluation of semantic-idiomatic and cultural equivalences, items with a Content Validity Index < 1 were reviewed until consensus among the judges was obtained. The second committee found 100% of agreement in the analysis of metabolic equivalence between original and replaced activities. Test-retest analysis indicated a Kappa coefficient of agreement (k = 0.86; (p<0.001), suggesting temporal stability of the instrument. The Brazilian version of the Veterans Specific Activity Questionnaire showed evidence of reliability, according to the temporal stability criterion and adequate cultural content.

Test – Retest Reliability and Concurrent Validity of in vivo Myelin Content Indices: Myelin Water Fraction and Calibrated T1w/T2w Image Ratio

PubMed Central

Arshad, Muzamil; Stanley, Jeffrey A.; Raz, Naftali

2016-01-01

In an age-heterogeneous sample of healthy adults, we examined test-retest reliability (with and without participant re-positioning) of two popular MRI methods of estimating myelin content: modeling the short spin-spin (T2) relaxation component of multi-echo imaging data and computing the ratio of T1-weighted and T2-weighted images (T1w/T2w). Taking the myelin water fraction (MWF) index of myelin content derived from the multi-component T2 relaxation data as a standard, we evaluate the concurrent and differential validity of T1w/T2w ratio images. The results revealed high reliability of MWF and T1w/T2w ratio. However, we found significant correlations of low to moderate magnitude between MWF and the T1w/T2w ratio in only two of six examined regions of the cerebral white matter. Notably, significant correlations of the same or greater magnitude were observed for T1w/T2w ratio and the intermediate T2 relaxation time constant, which is believed to reflect differences in the mobility of water between the intracellular and extracellular compartments. We conclude that although both methods are highly reliable and thus well-suited for longitudinal studies, T1w/T2w ratio has low criterion validity and may be not an optimal index of subcortical myelin content. PMID:28009069

An initial reliability and validity study of the Interaction, Communication, and Literacy Skills Audit.

PubMed

El-Choueifati, Nisrine; Purcell, Alison; McCabe, Patricia; Heard, Robert; Munro, Natalie

2014-06-01

Early childhood educators (ECEs) have an important role in promoting positive outcomes for children's language and literacy development. This paper reports the development of a new tool, The Interaction Communication and Literacy (ICL) Skills Audit, and pilots its reliability and validity. Intra- and inter-rater reliability was examined by three speech-language pathologists (SLPs). Five skill areas relating to ECE language and literacy practice were rated. The face and content validity of the ICL Skills Audit was examined by expert SLPs (n = 8) and expert ECEs (n = 4) via questionnaire. The overall intra-rater reliability for the ICL Skills Audit was excellent with percentage close agreement (PCA) of 91-94. Inter-rater agreement was PCA 68-80. Expert SLPs and ECEs agreed that the content was comprehensive and practical. Based on this preliminary study, the ICL Skills Audit appears to be a promising tool that can be used by SLPs and ECEs in collaboration to measure the skills of ECEs in the areas of language and literacy support. Future psychometric and outcome research on the revised ICL Skills Audit is warranted.

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Development and study of self-efficacy scale in medication adherence among Iranian patients with hypertension

PubMed Central

Najimi, Arash; Mostafavi, Firoozeh; Sharifirad, Gholamreza; Golshiri, Parastoo

2017-01-01

BACKGROUND: This study was aimed at developing and studying the scale of self-efficacy in adherence to treatment in Iranian patients with hypertension. METHODS: A mix-method study was conducted on the two stages: in the first phase, a qualitative study was done using content analysis through deep and semi-structured interviews. After data analysis, the draft of tool was prepared. Items in the draft were selected based on the extracted concepts. In the second phase, validity and reliability of the instrument were implemented using a quantitative study. The prepared instrument in the first phase was studied among 612 participants. To test the construct validity and internal consistency, exploratory factor analysis and Cronbach's alpha were used, respectively. To study the validity of the final scale, the average score of self-efficacy in patients with controlled hypertension were compared with patients with uncontrolled hypertension. RESULTS: In overall, 16 patients were interviewed. Twenty-six items were developed to assess different concepts of self-efficacy. Concept-related items were extracted from interviews to study the face validity of the tool from patient's point of view. Four items were deleted because scored 0.79 in content validity. The mean of questionnaire content validity was 0.85. Items were collected in two factors with an eigenvalue >1. Four items were deleted with load factor <0.4. Reliability was 0.84 for the entire instrument. CONCLUSION: Self-efficacy scale in patients with hypertension is a valid and reliable instrument that can effectively evaluate the self-efficacy in medication adherence in the management of hypertension. PMID:29114551

Complementary and Alternative Medicine: Italian Validation of a Questionnaire on Nurses' Personal and Professional Use, Knowledge, and Attitudes.

PubMed

Belletti, Giada; Shorofi, Seyed Afshin; Arbon, Paul; Dal Molin, Alberto

2017-08-01

Patients are showing an increasing interest in the use of complementary and alternative medicine (CAM). Most nurses are open to the adoption of CAM into clinical nursing practice, but they may experience a lack of knowledge about the safe and effective use of these therapies. Several studies concerning nurses' knowledge and attitudes toward CAM have been published, but only in one, the authors (Shorofi and Arbon) used a validated questionnaire. In Italy, there are no validated questionnaires to investigate this aspect of nursing practice. To test the psychometric properties of the Italian Shorofi and Arbon questionnaire for use with Italian nurses. A forward-backward translation method was used to translate the questionnaire from English to Italian. Content validity, face validity and reliability were established. This study examined the potential usefulness of the Shorofi and Arbon questionnaire for the evaluation of CAM knowledge of Italian speaking nurses, which showed good content validity and good reliability.

A systematic review of the reliability and validity of discrete choice experiments in valuing non-market environmental goods.

PubMed

Rakotonarivo, O Sarobidy; Schaafsma, Marije; Hockley, Neal

2016-12-01

While discrete choice experiments (DCEs) are increasingly used in the field of environmental valuation, they remain controversial because of their hypothetical nature and the contested reliability and validity of their results. We systematically reviewed evidence on the validity and reliability of environmental DCEs from the past thirteen years (Jan 2003-February 2016). 107 articles met our inclusion criteria. These studies provide limited and mixed evidence of the reliability and validity of DCE. Valuation results were susceptible to small changes in survey design in 45% of outcomes reporting reliability measures. DCE results were generally consistent with those of other stated preference techniques (convergent validity), but hypothetical bias was common. Evidence supporting theoretical validity (consistency with assumptions of rational choice theory) was limited. In content validity tests, 2-90% of respondents protested against a feature of the survey, and a considerable proportion found DCEs to be incomprehensible or inconsequential (17-40% and 10-62% respectively). DCE remains useful for non-market valuation, but its results should be used with caution. Given the sparse and inconclusive evidence base, we recommend that tests of reliability and validity are more routinely integrated into DCE studies and suggest how this might be achieved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Evacuation performance evaluation tool.

PubMed

Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

2016-01-01

Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish.

PubMed

Ulusoy, Hatice; Güler, Güngör; Yıldırım, Gülay; Demir, Ecem

2018-02-01

Developing professional values among nursing students is important because values are a significant predictor of the quality care that will be provided, the clients' recognition, and consequently the nurses' job satisfaction. The literature analysis showed that there is only one validated tool available in Turkish that examines both the personal and the professional values of nursing students. The aim of this study was to assess the reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish. This study was a Turkish linguistic and cultural adaptation of a research tool. Participants and research context: The sample of this study consisted of 627 undergraduate nursing students from different geographical areas of Turkey. Two questionnaires were used for data collection: a socio-demographic form and the Salford-Scott Nursing Values Questionnaire. For the Salford-Scott Nursing Values Questionnaire, construct validity was examined using factor analyses. Ethical considerations: The study was approved by the Cumhuriyet University Faculty of Medicine Research Ethics Board. Students were informed that participation in the study was entirely voluntary and anonymous. Item content validity index ranged from 0.66 to 1.0, and the total content validity index was 0.94. The Kaiser-Meyer-Olkin measure of sampling was 0.870, and Bartlett's test of sphericity was statistically significant (x 2 = 3108.714, p < 0.001). Construct validity was examined using factor analyses and the six factors were identified. Cronbach's alpha was used to assess the internal consistency reliability and the value of 0.834 was obtained. Our analyses showed that the Turkish version of Salford-Scott Nursing Values Questionnaire has high validity and reliability.

[Development of skill scale for communication skill measurement of pharmacist].

PubMed

Teramachi, Hitomi; Komada, Natsuki; Tanizawa, Katsuya; Kuzuya, Yumi; Tsuchiya, Teruo

2011-04-01

To purpose of this study was to develop a pharmacist communication skill scale. A 38 items scale was made and 283 pharmacists responded. The original questionnaire consisted of 38 items, with 1-5 graded Likert scale. Completed responses of 228 pharmacists data were used for testing the reliability and the validity of this scale. The first group of items from the original questionnaire were 38, and finally 38 original items were chosen for investigation of content validity, correlation coefficient and commonality. From factor analysis, four factors were chosen among the 31 items as follows: patient respect reception skill, problem discovery and solution skill, positive approach skill, feelings processing skill. The correlation coefficient between this original scale and the KiSS-18 (Social Skill) received high score (r=0.694). The reliability of this scale showed high internal consistency (Cronbach α coefficient=0.951), so the result of test for the validity of this scale supports high content validity. Thus we propose adoption of pharmacist communication skill scale to carry a brief eponymous name as TePSS-31. The above findings indicate that this developed scale possess adequate validity and reliability for practical use.

Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL): reliability and validity.

PubMed

Devoogdt, Nele; De Groef, An; Hendrickx, Ad; Damstra, Robert; Christiaansen, Anke; Geraerts, Inge; Vervloesem, Nele; Vergote, Ignace; Van Kampen, Marijke

2014-05-01

Patients may develop primary (congenital) or secondary (acquired) lymphedema, causing significant physical and psychosocial problems. To plan treatment for lymphedema and monitor a patient's progress, swelling, and problems in functioning associated with lymphedema development should be assessed at baseline and follow-up. The purpose of this study was to investigate the reliability (test-retest, internal consistency, and measurement variability) and validity (content and construct) of data obtained with the Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL). This was a multicenter, cross-sectional study. The Lymph-ICF-LL is a descriptive, evaluative tool containing 28 questions about impairments in function, activity limitations, and participation restrictions in patients with lower limb lymphedema. The questionnaire has 5 domains: physical function, mental function, general tasks/household activities, mobility activities, and life domains/social life. The reliability and validity of the Lymph-ICF-LL were examined in 30 participants with objective lower limb lymphedema. Intraclass correlation coefficients for test-retest reliability ranged from .69 to .94, and Cronbach alpha coefficients for internal consistency ranged from .82 to .97. Measurement variability was acceptable (standard error of measurement=5.9-12.6). Content validity was good because all questions were understandable for 93% of participants, the scoring system (visual analog scale) was clear, and the questionnaire was comprehensive for 90% of participants. Construct validity was good. All hypotheses for assessing convergent validity and divergent validity were accepted. The known-groups validity and responsiveness of the Dutch Lymph-ICF-LL and the cross-cultural validity of the English version of the Lymph-ICF-LL were not investigated. The Lymph-ICF-LL is a Dutch questionnaire with evidence of reliability and validity for assessing impairments in function, activity limitations, and participation restrictions in people with primary or secondary lower limb lymphedema.

Reliability and validity of the Turkish version of the situational self-efficacy scale for fruit and vegetable consumption in adolescents.

PubMed

Kadioglu, Hasibe; Erol, Saime; Ergun, Ayse

2015-01-01

The purpose of this research was to examine the psychometric properties of the Turkish version of the situational self-efficacy scale for vegetable and fruit consumption in adolescents. This was a methodological study. The study was conducted in four public secondary schools in Istanbul, Turkey. Subjects were 1586 adolescents. Content and construct validity were assessed to test the validity of the scale. The reliability was assessed in terms of internal consistency and test-retest reliability. For confirmatory factor analysis, χ(2) statistics plus other fit indices were used, including the goodness-of-fit index, the adjusted goodness-of-fit index, the nonnormed fit index, the comparative fit index, the standardized root mean residual, and the root mean square error of approximation. Pearson's correlation was used for test-retest reliability and item total correlation. The internal consistency was assessed by using Cronbach α. Confirmatory factor analysis strongly supported the three-component structure representing positive social situations (α = .81), negative effect situations (α = .93), and difficult situations (α = .78). Psychometric analyses of the Turkish version of the situational self-efficacy scale indicate high reliability and good content and construct validity. Researchers and health professionals will find it useful to employ the Turkish situational self-efficacy scale in evaluating situational self-efficacy for fruit and vegetable consumption in Turkish adolescents.

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

The Statin-Associated Muscle Symptom Clinical Index (SAMS-CI): Revision for Clinical Use, Content Validation, and Inter-rater Reliability.

PubMed

Rosenson, Robert S; Miller, Kate; Bayliss, Martha; Sanchez, Robert J; Baccara-Dinet, Marie T; Chibedi-De-Roche, Daniela; Taylor, Beth; Khan, Irfan; Manvelian, Garen; White, Michelle; Jacobson, Terry A

2017-04-01

The Statin-Associated Muscle Symptom Clinical Index (SAMS-CI) is a method for assessing the likelihood that a patient's muscle symptoms (e.g., myalgia or myopathy) were caused or worsened by statin use. The objectives of this study were to prepare the SAMS-CI for clinical use, estimate its inter-rater reliability, and collect feedback from physicians on its practical application. For content validity, we conducted structured in-depth interviews with its original authors as well as with a panel of independent physicians. Estimation of inter-rater reliability involved an analysis of 30 written clinical cases which were scored by a sample of physicians. A separate group of physicians provided feedback on the clinical use of the SAMS-CI and its potential utility in practice. Qualitative interviews with providers supported the content validity of the SAMS-CI. Feedback on the clinical use of the SAMS-CI included several perceived benefits (such as brevity, clear wording, and simple scoring process) and some possible concerns (workflow issues and applicability in primary care). The inter-rater reliability of the SAMS-CI was estimated to be 0.77 (confidence interval 0.66-0.85), indicating high concordance between raters. With additional provider feedback, a revised SAMS-CI instrument was created suitable for further testing, both in the clinical setting and in prospective validation studies. With standardized questions, vetted language, easily interpreted scores, and demonstrated reliability, the SAMS aims to estimate the likelihood that a patient's muscle symptoms were attributable to statins. The SAMS-CI may support better detection of statin-associated muscle symptoms in clinical practice, optimize treatment for patients experiencing muscle symptoms, and provide a useful tool for further clinical research.

myTREEHOUSE Self-Concept Assessment: preliminary psychometric analysis of a new self-concept assessment for children with cerebral palsy.

PubMed

Cheong, Sau Kuan; Lang, Cathryne P; Hemphill, Sheryl A; Johnston, Leanne M

2017-06-01

To evaluate the preliminary validity and reliability of the myTREEHOUSE Self-Concept Assessment for children with cerebral palsy (CP) aged 8 to 12 years. The myTREEHOUSE Self-Concept Assessment includes 26 items divided into eight domains, assessed across three Performance Perspectives (Personal, Social, and Perceived) and an additional Importance Rating. Face and content validity was assessed by semi-structured interviews with seven expert professionals regarding the assessment construct, content, and clinical utility. Reliability was assessed with 50 children aged 8 to 12 years with CP (29 males, 21 females; mean age 10y 2mo; Gross Motor Function Classification System [GMFCS] level I=35, II=8, III=5, IV=1; mean Wechsler Intelligence Scale for Children - Fourth Edition [WISC-IV]=104), whose data was used to calculate internal consistency of the scale, and a subset of 35 children (20 males, 15 females; mean age 10y 5mo; GMFCS level I=26, II=4, III=4, IV=1; mean WISC-IV=103) who participated in test-retest reliability within 14 to 28 days. Face and content validity was supported by positive expert feedback, with only minor adjustments suggested to clarify the wording of some items. After these amendments, strong internal consistency (Cronbach's α 0.84-0.91) and moderate to good test-retest reliability (intraclass correlation coefficient 0.64-0.75) was found for each component. The myTREEHOUSE Self-Concept Assessment is a valid and reliable assessment of self-concept for children with CP aged 8 to 12 years. © 2017 Mac Keith Press.

Non-Technical Skills for Surgeons (NOTSS): Critical appraisal of its measurement properties.

PubMed

Jung, James J; Borkhoff, Cornelia M; Jüni, Peter; Grantcharov, Teodor P

2018-02-17

To critically appraise the development and measurement properties, including sensibility, reliability, and validity of the Non-Technical Skills of Surgeons (NOTSS) system. Articles that described development process of the NOTSS system were identified. Relevant primary studies that presented evidence of reliability and validity were identified through a comprehensive literature review. NOTSS was developed through robust item generation and reduction strategies. It was shown to have good content validity, acceptability, and feasibility. Inter-rater reliability increased with greater expertise and number of assessors. Studies demonstrated evidence of cross-sectional construct validity, in that the tool was able to differentiate known groups of varied non-technical skill levels. Evidence of longitudinal construct validity also existed to demonstrate that NOTSS detected changes in non-technical skills before and after targeted training. In populations and settings presented in our critical appraisal, NOTSS provided reliable and valid measurements of intraoperative non-technical skills of surgeons. Copyright © 2018 Elsevier Inc. All rights reserved.

Mixed methods evaluation of a quality improvement and audit tool for nurse-to-nurse bedside clinical handover in ward settings.

PubMed

Redley, Bernice; Waugh, Rachael

2018-04-01

Nurse bedside handover quality is influenced by complex interactions related to the content, processes used and the work environment. Audit tools are seldom tested in 'real' settings. Examine the reliability, validity and usability of a quality improvement tool for audit of nurse bedside handover. Naturalistic, descriptive, mixed-methods. Six inpatient wards at a single large not-for-profit private health service in Victoria, Australia. Five nurse experts and 104 nurses involved in 199 change-of-shift bedside handovers. A focus group with experts and pilot test were used to examine content and face validity, and usability of the handover audit tool. The tool was examined for inter-rater reliability and usability using observation audits of handovers across six wards. Data were collected in 2013-2014. Two independent observers for 72 audits demonstrated acceptable inter-observer agreement for 27 (77%) items. Reliability was weak for items examining the handover environment. Seventeen items were not observed reflecting gaps in practices. Across 199 observation audits, gaps in nurse bedside handover practice most often related to process and environment, rather than content items. Usability was impacted by high observer burden, familiarity and non-specific illustrative behaviours. The reliability and validity of most items to audit handover content was acceptable. Gaps in practices for process and environment items were identified. Context specific exemplars and reducing the items used at each handover audit can enhance usability. Further research is needed to develop context specific exemplars and undertake additional reliability testing using a wide range of handover settings. CONTRIBUTION OF THE PAPER. Copyright © 2017 Elsevier Inc. All rights reserved.

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to include more long-term care facilities and individual participants. Future studies can utilize diverse measures of social activity for comparison and validation of the SSAI.

Psychometric Evaluation of a Turkish Version of the Diabetes Fear of Self-injecting and Self-testing Questionnaire (D-FISQ).

PubMed

Celik, Selda; Pinar, Rukiye

2016-09-01

To examine the psychometric properties of a Turkish version of the Diabetes Fear of Injecting and Self-testing Questionnaire (D-FISQ). Forward-backward translation of the D-FISQ from English into Turkish was conducted. Original English and translated forms were examined by a panel group. Validity was investigated using content, confirmatory factor analysis, and divergent validity. Reliability was assessed using Cronbach α values, item-total correlations, and intraclass correlations. The sample comprised 350 patients with diabetes. Data were analyzed using SPSS 15.0 for Windows and LISREL 8. The content validity index for the panel members was .90, which indicated perfect content validity; items in D-FISQ were clear, concise, readable, and distinct. Confirmatory factor analysis confirmed the original construct of the D-FISQ. All items had factor loadings higher than the recommended level of .40. The D-FISQ scores were discriminated by the level of anxiety. Reliability results were also satisfactory. Cronbach α values were within ideal limits. Item-total correlation coefficient ranged from .72 to .86. In terms of test-retest reliability, intraclass correlation coefficient was found to be over .90. D-FISQ is a valid and reliable questionnaire in assessing needle-prick fear among Turkish patients with diabetes. We recommend performing the Turkish D-FISQ in determining and screening patients with diabetes who have fear related to self-insulin injection and finger-prick test. Thus, health care professionals should be aware of the potential consequences of injection fear such as insulin misuse and poor self-monitoring of blood glucose, which may have unfavorable effects on optimal diabetes management. Copyright © 2016. Published by Elsevier B.V.

Construction and Validation of a Scale to Measure Maslow's Concept of Self-Actualization

ERIC Educational Resources Information Center

Jones, Kenneth Melvin; Randolph, Daniel Lee

1978-01-01

Designed to measure self-actualization as defined by Abraham Maslow, the Jones Self Actualizing Scale, as assessed in this study, possesses content validity, reliability, and a number of other positive characteristics. (JC)

The Trojan Lifetime Champions Health Survey: development, validity, and reliability.

PubMed

Sorenson, Shawn C; Romano, Russell; Scholefield, Robin M; Schroeder, E Todd; Azen, Stanley P; Salem, George J

2015-04-01

Self-report questionnaires are an important method of evaluating lifespan health, exercise, and health-related quality of life (HRQL) outcomes among elite, competitive athletes. Few instruments, however, have undergone formal characterization of their psychometric properties within this population. To evaluate the validity and reliability of a novel health and exercise questionnaire, the Trojan Lifetime Champions (TLC) Health Survey. Descriptive laboratory study. A large National Collegiate Athletic Association Division I university. A total of 63 university alumni (age range, 24 to 84 years), including former varsity collegiate athletes and a control group of nonathletes. Participants completed the TLC Health Survey twice at a mean interval of 23 days with randomization to the paper or electronic version of the instrument. Content validity, feasibility of administration, test-retest reliability, parallel-form reliability between paper and electronic forms, and estimates of systematic and typical error versus differences of clinical interest were assessed across a broad range of health, exercise, and HRQL measures. Correlation coefficients, including intraclass correlation coefficients (ICCs) for continuous variables and κ agreement statistics for ordinal variables, for test-retest reliability averaged 0.86, 0.90, 0.80, and 0.74 for HRQL, lifetime health, recent health, and exercise variables, respectively. Correlation coefficients, again ICCs and κ, for parallel-form reliability (ie, equivalence) between paper and electronic versions averaged 0.90, 0.85, 0.85, and 0.81 for HRQL, lifetime health, recent health, and exercise variables, respectively. Typical measurement error was less than the a priori thresholds of clinical interest, and we found minimal evidence of systematic test-retest error. We found strong evidence of content validity, convergent construct validity with the Short-Form 12 Version 2 HRQL instrument, and feasibility of administration in an elite, competitive athletic population. These data suggest that the TLC Health Survey is a valid and reliable instrument for assessing lifetime and recent health, exercise, and HRQL, among elite competitive athletes. Generalizability of the instrument may be enhanced by additional, larger-scale studies in diverse populations.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS).

PubMed

Poon, Vickie Wan-kei; Lam, Linda Chiu-wa; Wong, Samuel Yeung-shan

2008-09-01

With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha=0.89 and alpha=0.94 respectively). High value of Cronbach's alpha (alpha=0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r=0.58 to r=0.78, p<0.01). The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation.

Portuguese community pharmacists' attitudes to and knowledge of antibiotic misuse: questionnaire development and reliability.

PubMed

Roque, Fátima; Soares, Sara; Breitenfeld, Luiza; Gonzalez-Gonzalez, Cristian; Figueiras, Adolfo; Herdeiro, Maria Teresa

2014-01-01

To develop and evaluate the reliability of a self-administered questionnaire designed to assess the attitudes and knowledge of community pharmacists in Portugal about microbial resistance and the antibiotic dispensing process. This study was divided into the following three stages: (1) design of the questionnaire, which included a literature review and a qualitative study with focus-group sessions; (2) assessment of face and content validity, using a panel of experts and a pre-test of community pharmacists; and, (3) pilot study and reliability analysis, which included a test-retest study covering fifty practising pharmacists based at community pharmacies in five districts situated in Northern Portugal. Questionnaire reproducibility was quantified using the intraclass correlation coefficient (ICC; 95% confidence interval) computed by means of one-way analysis of variance (ANOVA). Internal consistency was evaluated using Cronbach's alpha. The correlation coefficients were fair to good (ICC>0.4) for all statements (scale-items) regarding knowledge of and attitudes to antibiotic resistance, and ranged from fair to good to excellent for statements about situations in which pharmacists acknowledged that antibiotics were sometimes dispensed without a medical prescription (ICC>0.8). Cronbach's alpha for this section was 0.716. The questionnaire designed in this study is valid and reliable in terms of content validity, face validity and reproducibility.

Validation of an instrument to measure quality of life in British children with inflammatory bowel disease.

PubMed

Ogden, C A; Akobeng, A K; Abbott, J; Aggett, P; Sood, M R; Thomas, A G

2011-09-01

To validate IMPACT-III (UK), a health-related quality of life (HRQoL) instrument, in British children with inflammatory bowel disease (IBD). One hundred six children and parents were invited to participate. IMPACT-III (UK) was validated by inspection by health professionals and children to assess face and content validity, factor analysis to determine optimum domain structure, use of Cronbach alpha coefficients to test internal reliability, ANOVA to assess discriminant validity, correlation with the Child Health Questionnaire to assess concurrent validity, and use of intraclass correlation coefficients to assess test-retest reliability. The independent samples t test was used to measure differences between sexes and age groups, and between paper and computerised versions of IMPACT-III (UK). IMPACT-III (UK) had good face and content validity. The most robust factor solution was a 5-domain structure: body image, embarrassment, energy, IBD symptoms, and worries/concerns about IBD, all of which demonstrated good internal reliability (α = 0.74-0.88). Discriminant validity was demonstrated by significant (P  < 0.05, P < 0.01) differences in HRQoL scores between the severe, moderate, and inactive/mild symptom severity groups for the embarrassment scale (63.7 vs 81.0 vs 81.2), IBD symptom scale (45.0 vs 64.2 vs 80.6), and the energy scale (46.4 vs 62.1 vs 77.7). Concurrent validity of IMPACT-III (UK) with comparable domains of the Child Health Questionnaire was confirmed. Test-retest reliability was confirmed with good intraclass correlation coefficients of 0.66 to 0.84. Paper and computer versions of IMPACT-III (UK) collected comparable scores, and there were no differences between the sexes and age groups. IMPACT-III (UK) appears to be a useful tool to measure HRQoL in British children with IBD.

Cross-cultural adaptation, content validation, and reliability of the Nigerian Composite Lifestyle CVD Risk Factors Questionnaire for adolescents among Yoruba rural adolescents in Nigeria.

PubMed

Odunaiya, Nse A; Louw, Quinette A; Grimmer, Karen

2017-06-01

Assessment of lifestyle risk factors must be culturally- and contextually relevant and available in local languages. This paper reports on a study which aimed to cross culturally adapt a composite lifestyle cardiovascular disease (CVD) risk factors questionnaire into an African language (Yoruba) and testing some of its psychometric properties such as content validity and test retest reliability in comparison to the original English version. This study utilized a cross sectional design. Translation of the English version of the questionnaire into Yoruba was undertaken using the guideline by Beaton et al. The translated instrument was presented to 21 rural adolescents to assess comprehensibility and clarity using a sample of convenience. A test retest reliability was conducted among 150 rural adolescents using a purposive sampling. Data was analyzed using intraclass correlation (ICC ) model 3, Cohen kappa statistics and prevalence rates. ICC ranged between 0.4-0.8. The Yoruba version was completed 15-20 minutes and was reported to be culturally appropriate and acceptable for rural Nigerian adolescents. The Yoruba translation of the Nigerian composite lifestyle risk factors questionnaire performs at least as well as the original English version in terms of content validity and reliability. It took a shorter time to complete therefore may be more relevant to rural adolescents.

An international measure of awareness and beliefs about cancer: development and testing of the ABC

PubMed Central

Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J

2012-01-01

Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874

What Counts as Validity Evidence? Examples and Prevalence in a Systematic Review of Simulation-Based Assessment

ERIC Educational Resources Information Center

Cook, David A.; Zendejas, Benjamin; Hamstra, Stanley J.; Hatala, Rose; Brydges, Ryan

2014-01-01

Ongoing transformations in health professions education underscore the need for valid and reliable assessment. The current standard for assessment validation requires evidence from five sources: content, response process, internal structure, relations with other variables, and consequences. However, researchers remain uncertain regarding the types…

A Chinese version of the Psychotic Symptom Rating Scales: psychometric properties in recent-onset and chronic psychosis.

PubMed

Chien, Wai-Tong; Lee, Isabella Yuet-Ming; Wang, Li-Qun

2017-01-01

The purpose of this study was to test the reliability, validity, and factor structure of a Chinese version of the Psychotic Symptom Rating Scale (PSYRATS) in 198 and 202 adult patients with recent-onset and chronic psychosis, respectively. The PSYRATS has been translated into different language versions and has been validated for clinical and research use mainly in chronic psychotic patients but not in recent-onset psychosis patients or in Chinese populations. The psychometric analysis of the translated Chinese version included assessment of its content validity, semantic equivalence, interrater and test-retest reliability, reproducibility, sensitivity to changes in psychotic symptoms, internal consistency, concurrent validity (compared to a valid psychotic symptom scale), and factor structure. The Chinese version demonstrated very satisfactory content validity as rated by an expert panel, good semantic equivalence with the original version, and high interrater and test-retest (at 2-week interval) reliability. It also indicated very good reproducibility of and sensitivity to changes in psychotic symptoms in line with the symptom severity measured with the Positive and Negative Syndrome Scale (PANSS). The scale consisted of four factors for the hallucination subscale and two factors for the delusion subscale, explaining about 80% of the total variance of the construct, indicating satisfactory correlations between the hallucination and delusion factors themselves, between items, factors, subscales, and overall scale, and between factors and relevant item and subscale scores of the PANSS. The Chinese version of the PSYRATS is a reliable and valid instrument to measure symptom severity in Chinese psychotic patients complementary to other existing measures mainly in English language.

Psychometric Evaluation of a Persian Version of the Cardiac Depression Scale in Iranian Patients With Acute Myocardial Infarction.

PubMed

Nia, Hamid Sharif; Sharif, Saeed Pahlevan; Froelicher, Erika Sivarajan; Boyle, Christopher; Goudarzian, Amir Hossein; Yaghoobzadeh, Ameneh; Oskouie, Fatemeh

2018-04-01

The aim of this study was to validate a Persian version of the Cardiac Depression Scale (CDS) in Iranian patients with acute myocardial infarction (AMI). The CDS was forward translated from English into Persian and back-translated to English. Validity was assessed using face, content, and construct validity. Also Cronbach's alpha (α), theta (), and McDonald's omega coefficient were used to evaluate the reliability. Construct validity of the scale showed two factors with eigenvalues greater than one. The Cronbach's α, , McDonald's omega, and construct reliability were greater than .70. The Persian version of the CDS has a two-factor structure (i.e., death anxiety and life satisfaction) and has acceptable reliability and validity. Therefore, the validated instrument can be used in future studies to assess depression in patients with AMI in Iranians.

Development of self and peer performance assessment on iodometric titration experiment

NASA Astrophysics Data System (ADS)

Nahadi; Siswaningsih, W.; Kusumaningtyas, H.

2018-05-01

This study aims to describe the process in developing of reliable and valid assessment to measure students’ performance on iodometric titration and the effect of the self and peer assessment on students’ performance. The self and peer-instrument provides valuable feedback for the student performance improvement. The developed assessment contains rubric and task for facilitating self and peer assessment. The participants are 24 students at the second-grade student in certain vocational high school in Bandung. The participants divided into two groups. The first 12 students involved in the validity test of the developed assessment, while the remain 12 students participated for the reliability test. The content validity was evaluated based on the judgment experts. Test result of content validity based on judgment expert show that the developed performance assessment instrument categorized as valid on each task with the realibity classified as very good. Analysis of the impact of the self and peer assessment implementation showed that the peer instrument supported the self assessment.

A comprehensive scoring system to measure healthy community design in land use plans and regulations.

PubMed

Maiden, Kristin M; Kaplan, Marina; Walling, Lee Ann; Miller, Patricia P; Crist, Gina

2017-02-01

Comprehensive land use plans and their corresponding regulations play a role in determining the nature of the built environment and community design, which are factors that influence population health and health disparities. To determine the level in which a plan addresses healthy living and active design, there is a need for a systematic, reliable and valid method of analyzing and scoring health-related content in plans and regulations. This paper describes the development and validation of a scoring tool designed to measure the strength and comprehensiveness of health-related content found in land use plans and the corresponding regulations. The measures are scored based on the presence of a specific item and the specificity and action-orientation of language. To establish reliability and validity, 42 land use plans and regulations from across the United States were scored January-April 2016. Results of the psychometric analysis indicate the scorecard is a reliable scoring tool for land use plans and regulations related to healthy living and active design. Intraclass correlation coefficients (ICC) scores showed strong inter-rater reliability for total strength and comprehensiveness. ICC scores for total implementation scores showed acceptable consistency among scorers. Cronbach's alpha values for all focus areas were acceptable. Strong content validity was measured through a committee vetting process. The development of this tool has far-reaching implications, bringing standardization of measurement to the field of land use plan assessment, and paving the way for systematic inclusion of health-related design principles, policies, and requirements in land use plans and their corresponding regulations. Copyright © 2016 Elsevier Inc. All rights reserved.

Inventory of Determinants of Obesity-Related Behaviors in Adolescents: Development and Psychometric Characteristics.

PubMed

Amiri, Parisa; Ghofranipour, Fazlollah; Jalali-Farahani, Sara; Ahmadi, Fazlollah; Hosseinpanah, Farhad; Hooman, Haidar Ali; Parvin, Parnian; Ghasemi, Mohammadreza

2015-07-01

The rising prevalence of childhood obesity is a major health problem worldwide. Hence, there is a growing need for health professionals to become capable of assessing the factors that determine lifestyle in a culturally relevant manner. This study aimed to develop and assess a questionnaire for measuring determinants of obesity-related behaviors in Tehranian adolescents. Based on the results of a qualitative study and an extensive literature review, the 44-item "Inventory of determinants of obesity-related behaviors in adolescents (IDOBA)" with eight subscales was developed: 1) unhealthy nutrition and physical inactivity; 2) stress-related eating; 3) perceived inability; 4) perceived lack of threat; 5) perceived priority of educational achievement; 6) perceived acceptability; 7) motivation loss; and 8) lack of support. Validity of IDOBA was assessed, utilizing face, content, and construct validity methods. To confirm face validity, ten overweight/obese adolescents completed the questionnaire. To calculate content validity ratio (CVR) and content validity index (CVI), a different panel of ten experts commented independently on the necessity, relevance, clarity, and simplicity of each item. To assess construct validity using exploratory factor analysis (EFA), a total of 478 adolescents (57.7% male) aged 13 to 18 years, who were recruited from schools, participated in the study. Confirmatory factor analysis (CFA) was used to test whether the data fit the hypothesized measurement model that was derived from EFA. Test-retest and internal consistency methods were used to assess reliability of the IDOBA scale. All items were perceived as relevant and comprehendible by adolescents. Content validity was confirmed by the panel of experts. The internal consistency, as measured by Cronbach's alpha coefficients, exceeded the minimum reliability standard of 0.60 for eight subscales. No ceiling effects were observed. Detected floor effects ranged from 0.2% for perceived acceptability subscale score to 18.8% for lack of threat subscale score. The EFA suggested an eight-factor construct and the results of the CFA indicated acceptable fit indices for the proposed model. All subscales demonstrated satisfactory test-retest reliability (intra-class correlation coefficient, 0.42 - 0.91) over one month. Results provided initial evidence that the IDOBA is a valid and reliable instrument for measuring determinants of obesity-related behaviors in Iranian adolescents, indicating that the questionnaire can be used in future weight management programs for Tehranian adolescents.

Media ratings for movies, music, video games, and television: a review of the research and recommendations for improvements.

PubMed

Gentile, Douglas A; Humphrey, Jeremy; Walsh, David A

2005-06-01

This article review is organized by studies that are relevant for testing the reliability and validity of ratings systems. Specifically, the interrater reliability, consistency, temporal stability, content validity, construct validity, and criterion validity of media ratings systems are reviewed. Data that are related to testing the "forbidden fruit" and "tainted fruit" hypotheses also are reviewed. Several changes are recommended to improve the ratings systems, including the creation of a universal ratings system that could be applied equally to all media. The research reviewed here can provide a guide for how to construct a reliable, valid, and more useful ratings system. This is important because the decisions that parents make regarding their children's media use can be only as good as the information to which the parents have access.

Test-retest reliability and concurrent validity of in vivo myelin content indices: Myelin water fraction and calibrated T1 w/T2 w image ratio.

PubMed

Arshad, Muzamil; Stanley, Jeffrey A; Raz, Naftali

2017-04-01

In an age-heterogeneous sample of healthy adults, we examined test-retest reliability (with and without participant repositioning) of two popular MRI methods of estimating myelin content: modeling the short spin-spin (T 2 ) relaxation component of multi-echo imaging data and computing the ratio of T 1 -weighted and T 2 -weighted images (T 1 w/T 2 w). Taking the myelin water fraction (MWF) index of myelin content derived from the multi-component T 2 relaxation data as a standard, we evaluate the concurrent and differential validity of T 1 w/T 2 w ratio images. The results revealed high reliability of MWF and T 1 w/T 2 w ratio. However, we found significant correlations of low to moderate magnitude between MWF and the T 1 w/T 2 w ratio in only two of six examined regions of the cerebral white matter. Notably, significant correlations of the same or greater magnitude were observed for T 1 w/T 2 w ratio and the intermediate T 2 relaxation time constant, which is believed to reflect differences in the mobility of water between the intracellular and extracellular compartments. We conclude that although both methods are highly reliable and thus well-suited for longitudinal studies, T 1 w/T 2 w ratio has low criterion validity and may be not an optimal index of subcortical myelin content. Hum Brain Mapp 38:1780-1790, 2017. © 2017 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

The development and validation of a test of science critical thinking for fifth graders.

PubMed

Mapeala, Ruslan; Siew, Nyet Moi

2015-01-01

The paper described the development and validation of the Test of Science Critical Thinking (TSCT) to measure the three critical thinking skill constructs: comparing and contrasting, sequencing, and identifying cause and effect. The initial TSCT consisted of 55 multiple choice test items, each of which required participants to select a correct response and a correct choice of critical thinking used for their response. Data were obtained from a purposive sampling of 30 fifth graders in a pilot study carried out in a primary school in Sabah, Malaysia. Students underwent the sessions of teaching and learning activities for 9 weeks using the Thinking Maps-aided Problem-Based Learning Module before they answered the TSCT test. Analyses were conducted to check on difficulty index (p) and discrimination index (d), internal consistency reliability, content validity, and face validity. Analysis of the test-retest reliability data was conducted separately for a group of fifth graders with similar ability. Findings of the pilot study showed that out of initial 55 administered items, only 30 items with relatively good difficulty index (p) ranged from 0.40 to 0.60 and with good discrimination index (d) ranged within 0.20-1.00 were selected. The Kuder-Richardson reliability value was found to be appropriate and relatively high with 0.70, 0.73 and 0.92 for identifying cause and effect, sequencing, and comparing and contrasting respectively. The content validity index obtained from three expert judgments equalled or exceeded 0.95. In addition, test-retest reliability showed good, statistically significant correlations ([Formula: see text]). From the above results, the selected 30-item TSCT was found to have sufficient reliability and validity and would therefore represent a useful tool for measuring critical thinking ability among fifth graders in primary science.

Validation of a diabetes numeracy test in Arabic.

PubMed

Alghodaier, Hussah; Jradi, Hoda; Mohammad, Najwa Samantha; Bawazir, Amen

2017-01-01

The prevalence of diabetes Mellitus in Saudi Arabia is 24%, ranking it among the top ten Worldwide. Diabetes education focuses on self-management and relies on numeracy skills. Poor numeracy may go unrecognized and it is important to have an assessment tool in Arabic to measure such a skill in diabetes care. To validate a 15-item Diabetes Numeracy Test (DNT-15) in the Arabic Language as a tool to assess the numeracy skills of patients with diabetes and to test its properties among Saudi patients with diabetes. A 15-question Arabic-language test to assess diabetes numeracy among patients with diabetes on the basis of the diabetes numeracy test (DNT-15) was validated among a sample Arabic speaking Saudi patients with diabetes. Data collection included patients' demographics, long-term glycemic control, diabetes type, duration, co-morbidities, and diabetes related knowledge questions. Internal reliability was assessed using Kuder-Richardson Formula 20 (KR-20). The average score of Arabic DNT-15 was 53.3% and took an average of 30 minutes to complete. The scores significantly correlated with education, income, HbA1c, and diabetes knowledge (p<0.05). Content Validity Ratio (CVR) of 0.75 and Content Validity Index (CVI) of 0.89 supported good content validity. The Arabic DNT-15 also had good internal reliability (KR20 = 0.90). Patients with diabetes need numeracy skills to manage their disease. Level of education does not reflect level of numeracy, and low numeracy skills might be unnoticed by health care providers. The Arabic DNT-15 is a valid and reliable scale to identify Arabic speaking patients with difficulties in certain diabetes-related numeracy skills.

The best interest of the child-questionnaire, reliability and validity: preliminary data on the question 'where to live after detention or secure treatment?'.

PubMed

Kalverboer, Margrite; Ten Brummelaar, Mijntje; Post, Wendy; Zijlstra, Elianne; Harder, Annemiek; Knorth, Erik

2012-02-01

The Best Interest of the Child-Questionnaire (BIC-Q) has been designed as an instrument for screening the quality of the rearing situation of children with behavioural problems or delinquency. It is intended to aid legal decisions in juvenile and family law. The aim of the study was to establish the reliability and validation of the BIC-Q. Records of 83 children in detention or secure treatment centres and 58 children with no delinquent behaviours were rated by trained researchers. Interrater reliability was tested with a sub-sample of 31 of the former. Content validity was evaluated across the whole group, using Cronbach's alpha to check internal consistency, Spearman's rho to examine correlations and explorative principal component analysis (PCA) to test the extent to which variance in the 14 underlying conditions could be accounted for by a single factor 'quality of rearing'. Interrater reliability was good (r = 0.89). The PCA lent support to the content validity of the questionnaire with four factors, which together explained 66% of the variance in child rearing: (1) attachment and bonding; (2) rules and provisions; (3) health care and physical care in the family context; and (4) care and models provided for in the societal environment. The BIC-Q is a reliable and valid measure of the overall quality of child rearing. Preliminary results indicate that the BIC-Q may be applied to support court decisions on where the child should live after detention or secure treatment. Copyright © 2011 John Wiley & Sons, Ltd.

Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

PubMed

Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

2016-06-01

To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

Cross-Cultural Adaptation, Reliability and Validity Study of the Persian Version of the Clinical COPD Questionnaire.

PubMed

Hasanpour, Neda; Attarbashi Moghadam, Behrouz; Sami, Ramin; Tavakol, Kamran

2016-08-01

The clinical COPD questionnaire (CCQ) has been developed to measure the health status of COPD patients. The aim of this study was to translate CCQ into the Persian language and assess the validity and reliability of the translated version. We used a forward-backward procedure to translate the questionnaire. In a cross-sectional study 100 COPD patients and 50 healthy subjects over 40 years old were selected to assess the reliability and construct validity of the instrument. The face and content validity were used for the questionnaire validity. Validity was examined in a population of patients with COPD, using the Persian validated version of the St George's Respiratory Questionnaire (PSGRQ). In order to assess the questionnaire's reliability, the Intraclass correlation coefficient (ICC) and Cronbach's alpha were calculated. Test-retest reliability was tested by re-administering the Persian version of the CCQ (PCCQ) after 1 week. Test-retest carry out of data demonstrates that the PCCQ has excellent reliability (ICC for all 3 domains were higher than 0.9). Internal consistency was found by Cronbach's alpha to be 0.96, 0.94, 0.97, and 0.98 for the symptom, mental state, functional state and total scores respectively. In addition, the correlation between the components of PCCQ and PSGRQ showed satisfactory construct validity. Analyzing the data from healthy subjects and patients divulged that the PCCQ has acceptable discriminant validity. In general, the PCCQ had satisfactory reliability and validity for assessing health-related quality of life status of Iranian COPD patients.

Translation, validity, and reliability of a persian version of the iowa tinnitus handicap questionnaire.

PubMed

Arian Nahad, Homa; Rouzbahani, Masomeh; Jarollahi, Farnoush; Jalaie, Shohreh; Pourbakht, Akram; Mokrian, Helnaz; Mahdi, Parvane; Amali, Amin; Nodin Zadeh, Abdolmajid

2014-04-01

Tinnitus is a common otologic symptom that can seriously affect a patient's quality of life. The purpose of the present study was to translate and validate the Iowa Tinnitus Handicap Questionnaire (THQ) into the Persian language, and to make it applicable as a tool for determining the effects of tinnitus on a patient's life. The main version of the THQ was translated into the Persian language. The agreed Persian version was administered to 150 tinnitus patients. The validity of the Persian THQ was evaluated and internal reliability was confirmed using Cronbach's α-coefficient. Finally, the effect of independent variables such as age, mean patient threshold, gender, and duration of tinnitus were considered in order to determine the psychometric properties of tinnitus. After an exact translation process, the Persian THQ was found to exhibit face validity. In terms of content validity, content validity index in total questionnaire was 0.93. Further, in structural validity measurements, intermediate correlation with annoyance from tinnitus (r=0.49), low correlation with duration of tinnitus (r=0.34) and high correlation with the Tinnitus Handicap Inventory (THI) questionnaire (r=0.84) were demonstrated. Additionally, a negligible effect of gender and age was noted on degree of tinnitus handicap (P= 0.754, P= 0.573, respectively). In the internal reliability assessment for Factors 1, 2, 3, and the whole questionnaire, Cronbach`s α-coefficient was 0.95, 0.92, 0.25 and 0.88, respectively. The Persian version of the Iowa THQ demonstrates high validity and reliability and can be used for the determination of tinnitus handicap and for following-up in the intervention process in Persian tinnitus patients.

Statistical methodology: II. Reliability and validity assessment in study design, Part B.

PubMed

Karras, D J

1997-02-01

Validity measures the correspondence between a test and other purported measures of the same or similar qualities. When a reference standard exists, a criterion-based validity coefficient can be calculated. If no such standard is available, the concepts of content and construct validity may be used, but quantitative analysis may not be possible. The Pearson and Spearman tests of correlation are often used to assess the correspondence between tests, but do not account for measurement biases and may yield misleading results. Techniques that measure interest differences may be more meaningful in validity assessment, and the kappa statistic is useful for analyzing categorical variables. Questionnaires often can be designed to allow quantitative assessment of reliability and validity, although this may be difficult. Inclusion of homogeneous questions is necessary to assess reliability. Analysis is enhanced by using Likert scales or similar techniques that yield ordinal data. Validity assessment of questionnaires requires careful definition of the scope of the test and comparison with previously validated tools.

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale

PubMed Central

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-01-01

Introduction Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. Objective To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. Method The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. Results The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Conclusion Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results. PMID:29736104

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale.

PubMed

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-04-01

Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results.

Development, linguistic and clinimetric validation of the WOMAC VA3.01 Bangla for Bangladesh Index.

PubMed

Rabbani, M G; Haq, S A; Bellamy, N; Islam, M N; Choudhury, M R; Naheed, A; Ahmed, S; Shahin, A

2015-06-01

The aim of this study was to develop and to validate a Bengali version of the Western Ontario and McMaster Osteoarthritis (WOMAC) index in Bangladesh. The WOMAC was translated into the local language of Bangladesh (Bengali) and adapted in the local sociocultural context, following the standard guidelines by Beaton et al. Content validity of the preliminary Bengali version was assessed by using the index of content validity (ICV) and floor and ceiling effects. Patients were assessed at the Department of Rheumatology of Bangabandhu Sheikh Mujib Medical University and were diagnosed to have knee OA by American College of Rheumatology criteria and recruited according to the requirements of the validation study. Convergent and divergent validity were measured by comparing with Health Assessment Questionnaire (HAQ) and the Short Form-36 (SF-36), and internal consistency was assessed using Cronbach's alpha coefficient. The questionnaire was readministered to 40 patients within a week for assessing reliability by using intra-class correlation coefficient (ICC) and Spearman's rank correlation coefficient. In addition, factor analysis of Bengali WOMAC questionnaire was performed to examine the number of factors influencing a common set of items. A Bengali version was developed with changes in three items to suit local practices. The ICV of the content validity was 1 for all items. The Bengali WOMAC had similar construct validity when compared to the HAQ (ρ 0.74, n = 70) and SF-36 bodily pain and physical functioning. It had dissimilar construct validity to SF-36 mental health domain except WOMAC pain. Factor analysis revealed five factors with eigenvalues of more than 1.0. Cronbach's alpha and ICC exceeded 0.7 in all domains. In the test-retest reliability testing, Spearman's ρ for all items exceeded 0.4 (n = 40). This study has demonstrated that the Bengali version of WOMAC is a valid tool for assessing quality of life of patients with knee osteoarthritis in Bangladesh and is reliable.

Measuring first-line nurse manager work: instrument: development and testing.

PubMed

Cadmus, Edna; Wisniewska, Edyta K

2013-12-01

The objective of this study was to develop and test a 1st-line nurse manager (FLNM) work instrument to measure categories of work and frequency of activities. First-line nurse managers have been demonstrated to be key contributors in meeting organizational outcomes and patient and nurse satisfaction. Identifying the work of FLNMs is essential to help in the development of prioritization and sequence. The need for an instrument that can measure and categorize the work of FLNMs is indicated. The author-developed instrument was administered as a pilot study to 173 FLNMs in New Jersey. Descriptive statistics were analyzed, and validity and reliability were measured. Content validity was established through 2 focus groups using 10 FLNMs and conducting a survey of 5 chief nursing officers. Reliability was assessed by 13 of 16 FLNM participants using the test/retest method and quantified using percent agreement within a 10-day period. Those items with 70% agreement or more were identified as reliable and retained on the instrument. The content validity of the instrument is strong; further refinement and testing of the tool are indicated to improve the reliability and generalizability across multiple populations of leaders and settings.

Instrument development and validation of a quality scale for historical research papers (QSHRP): a pilot study.

PubMed

Kelly, Jacinta; Watson, Roger

2014-12-01

To report a pilot study for the development and validation of an instrument to measure quality in historical research papers. There are no set criteria to assess historical papers published in nursing journals. A three phase mixed method sequential confirmatory design. In 2012, we used a three-phase approach to item generation and content evaluation. In phase 1, we consulted nursing historians using an online survey comprising three open-ended questions and revised the items. In phase 2, we evaluated the revised items for relevance with expert historians using a 4-point Likert scale and Content Validity Index calculation. In phase 3, we conducted reliability testing of the instrument using a 3-point Likert scale. In phase 1, 121 responses were generated via the online survey and revised to 40 interrogatively phrased items. In phase 2, five items with an Item Content Validity Index score of ≥0·7 remained. In phase 3, responses from historians resulted in 100% agreement to questions 1, 2 and 4 and 89% and 78%, respectively, to questions 3 and 5. Items for the QSHRP have been identified, content validated and reliability tested. This scale improves on previous scales, which over-emphasized source criticism. However, a full-scale study is needed with nursing historians to increase its robustness. © 2014 John Wiley & Sons Ltd.

Validation and cross cultural adaptation of the Italian version of the Harris Hip Score.

PubMed

Dettoni, Federico; Pellegrino, Pietro; La Russa, Massimo R; Bonasia, Davide E; Blonna, Davide; Bruzzone, Matteo; Castoldi, Filippo; Rossi, Roberto

2015-01-01

The Harris Hip Score (HHS) is one of the most widely used health related quality of life (HRQOL) measures for the assessment of hip pathology: in spite of this, a validation study, and an official Italian version have not been provided yet. The aim of this study was to create an Italian valid and reliable version of the HHS. The score was translated and modified in Italian; then 103 patients with different hip pathologies were evaluated using this HHS version and also with the WOMAC and the SF-12 questionnaires. Content, construct and criterion validities were tested, such as interobserver reliability, test-retest reliability and internal consistency. Cross-cultural adaptation was easy, and only minor adaptation was required in the translation process. Construct and criterion validity of the HHS Italian Version were confirmed by satisfactory values of Spearman's Rho for correlation between specific domains of HHS and Womac and SF12 scores. Interobserver and test-retest reliabilities obtained values of 0.996 and 0.975 respectively; Cronbach's alpha for internal consistency was 0.816. Statistical and clinical analysis showed that HHS is highly valid and reliable in this new Italian version.

Development of a self-report questionnaire designed for population-based surveillance of gingivitis in adolescents: assessment of content validity and reliability.

PubMed

Quiroz, Viviana; Reinero, Daniela; Hernández, Patricia; Contreras, Johanna; Vernal, Rolando; Carvajal, Paola

2017-01-01

This study aimed to develop and assess the content validity and reliability of a cognitively adapted self-report questionnaire designed for surveillance of gingivitis in adolescents. Ten predetermined self-report questions evaluating early signs and symptoms of gingivitis were preliminary assessed by a panel of clinical experts. Eight questions were selected and cognitively tested in 20 adolescents aged 12 to 18 years from Santiago de Chile. The questionnaire was then conducted and answered by 178 Chilean adolescents. Internal consistency was measured using the Cronbach's alpha and temporal stability was calculated using the Kappa-index. A reliable final self-report questionnaire consisting of 5 questions was obtained, with a total Cronbach's alpha of 0.73 and a Kappa-index ranging from 0.41 to 0.77 between the different questions. The proposed questionnaire is reliable, with an acceptable internal consistency and a temporal stability from moderate to substantial, and it is promising for estimating the prevalence of gingivitis in adolescents.

Psychometric evaluation of the Work Readiness Questionnaire in schizophrenia.

PubMed

Potkin, Steven G; Bugarski-Kirola, Dragana; Edgar, Chris J; Soliman, Sherif; Le Scouiller, Stephanie; Kunovac, Jelena; Miguel Velasco, Eugenio; Garibaldi, George M

2016-04-01

Unemployment can negatively impact quality of life among patients with schizophrenia. Employment status depends on ability, opportunity, education, and cultural influences. A clinician-rated scale of work readiness, independent of current work status, can be a valuable assessment tool. A series of studies were conducted to create and validate a Work Readiness Questionnaire (WoRQ) for clinicians to assess patient ability to engage in socially useful activity, independent of work availability. Content validity, test-retest and inter-rater reliability, and construct validity were evaluated in three separate studies. Content validity was supported. Cronbach's α was 0.91, in the excellent range. Clinicians endorsed WoRQ concepts, including treatment adherence, physical appearance, social competence, and symptom control. The final readiness decision showed good test-retest reliability and moderate inter-rater reliability. Work readiness was associated with higher function and lower levels of negative symptoms. Low positive and high negative predictive values confirmed the concept validity. The WoRQ has suitable psychometric properties for use in a clinical trial for patients with a broad range of symptom severity. The scale may be applicable to assess therapeutic interventions. It is not intended to assess eligibility for supported work interventions. The WoRQ is suitable for use in schizophrenia clinical trials to assess patient work functional potential.

Development of a radiology faculty appraisal instrument by using critical incident interviewing.

PubMed

Collins, J; Albanese, M A; Thakor, S K; Propeck, P A; Scanlan, K A

1997-12-01

To develop a valid and reliable radiology faculty appraisal instrument based on scientific methods. Fifteen radiology residents participated in critical incident interviewing. During a 1-hour interview, a resident was asked to describe five incidents each of effective and ineffective faculty behavior. Two investigators independently listened to the tape-recorded interviews, and two different investigators sorted the incidents into broad categories. A faculty appraisal instrument was developed by listing similar incidents under broad categories. A five-point rating scale was applied to each item. Content validity was assessed by resident and faculty critique of the appraisal instrument. A total of 168 incidents of faculty behavior were generated. The frequency with which similar incidents were reported was recorded. The most common behaviors reported were related to staff expertise and teaching. Interjudge reliability was good, as determined by computing K indices of agreement (overall K = 0.59). There was good agreement regarding instrument content validity among residents but not among faculty. Residents supported the use of the new appraisal instrument, but further tests of validity and reliability and faculty acceptance of the instrument will determine its usefulness as a tool for monitoring faculty teaching performance and making decisions regarding faculty promotion.

Cross-cultural differences in the conceptualisation of patients' satisfaction with psychiatric services--content validity of the English version of the Verona Service Satisfaction Scale.

PubMed

Henderson, Claire; Hales, Heidi; Ruggeri, Mirella

2003-03-01

The VSSS is a multi-dimensional questionnaire developed to address methodological concerns about measurement of satisfaction with services on the part of psychiatric patients. The acceptability, sensitivity, content validity and test-retest reliability of the original version of the VSSS, in Italian, have already been demonstrated [1, 2]. The internal consistency [3] and test-retest reliability [4] of the English translation have been shown to be within acceptable ranges. The content validity of the original 82-item and the 54-item English version has not yet been assessed. The aims of this study were to assess the content validity of the English translation of the VSSS and to compare it with that of the original version in Italian. We used data collected as part of the first wave (T1) of the PRiSM Psychosis Study [5] and repeated the methods used to assess the content validity of the original Italian version of the VSSS [1, 2]. Content elements derived from answers to four open questions were rated independently by CH and HH in terms of their equivalence to VSSS items or dimensions. were compared to those from the content validity study of the Italian version. Results Inter-rater agreement was very high. The largest proportion of the content elements of the answers were rated as equivalent or related to a questionnaire item or a dimension of the VSSS. The dimension 'Professionals' Skills and Behaviour' appears the most significant contributor to satisfaction, as it was most often related to content elements in answers to all four key questions (39.1 %). The second most frequently mentioned dimension was that of 'Types of Intervention' for three out of four open questions, while 'Access' was second most frequent for the fourth. Of the content elements, 17.2 % did not include items or dimensions covered by the VSSS; the three most frequently mentioned were other patients, food and security. The 82-item English version of the VSSS captures sharply most contents relevant to patients' satisfaction. Consideration of contributors to satisfaction so far neglected may refine the conceptualisation of satisfaction.

Development and empirical validation of symmetric component measures of multidimensional constructs: customer and competitor orientation.

PubMed

Sørensen, Hans Eibe; Slater, Stanley F

2008-08-01

Atheoretical measure purification may lead to construct deficient measures. The purpose of this paper is to provide a theoretically driven procedure for the development and empirical validation of symmetric component measures of multidimensional constructs. Particular emphasis is placed on establishing a formalized three-step procedure for achieving a posteriori content validity. Then the procedure is applied to development and empirical validation of two symmetrical component measures of market orientation, customer orientation and competitor orientation. Analysis suggests that average variance extracted is particularly critical to reliability in the respecification of multi-indicator measures. In relation to this, the results also identify possible deficiencies in using Cronbach alpha for establishing reliable and valid measures.

The Development of an Instrument for Measuring Healing

PubMed Central

Meza, James Peter; Fahoome, Gail F.

2008-01-01

PURPOSE Our lack of ability to measure healing attributes impairs our ability to research the topic. The specific aim of this project is to describe the psychological and social construct of healing and to create a valid and reliable measurement scale for attributes of healing. METHODS A content expert conducted a domain analysis examining the existing literature of midrange theories of healing. Theme saturation of content sampling was ensured by brainstorming more than 220 potential items. Selection of items was sequential: pile sorting and data reduction, with factor analysis of a mailed 54-item questionnaire. Criterion validity (convergent and divergent) and temporal reliability were established using a second mailing of the development version of the instrument. Construct validity was judged with structural equation modeling for goodness of fit. RESULTS Cronbach’s α of the original questionnaire was .869 and the final scale was .862. The test-retest reliability was .849. Eigenvalues for the 2 factors were 8 and 4, respectively. Divergent and convergent validity using the Spann-Fischer Codependency Scale and SF-36 mental health and emotional subscales were consistent with predictions. The root mean square error of approximation was 0.066 and Bentler’s Comparative Fit Index was 0.871. Root mean square residual was 0.102. CONCLUSIONS We developed a valid and reliable measurement scale for attributes of healing, which we named the Self-Integration Scale v 2.1. By creating a new variable, new areas of research in humanistic health care are possible. PMID:18626036

Translation and validation of the Malay version of the Stroke Knowledge Test.

PubMed

Sowtali, Siti Noorkhairina; Yusoff, Dariah Mohd; Harith, Sakinah; Mohamed, Monniaty

2016-04-01

To date, there is a lack of published studies on assessment tools to evaluate the effectiveness of stroke education programs. This study developed and validated the Malay language version of the Stroke Knowledge Test research instrument. This study involved translation, validity, and reliability phases. The instrument underwent backward and forward translation of the English version into the Malay language. Nine experts reviewed the content for consistency, clarity, difficulty, and suitability for inclusion. Perceived usefulness and utilization were obtained from experts' opinions. Later, face validity assessment was conducted with 10 stroke patients to determine appropriateness of sentences and grammar used. A pilot study was conducted with 41 stroke patients to determine the item analysis and reliability of the translated instrument using the Kuder Richardson 20 or Cronbach's alpha. The final Malay version Stroke Knowledge Test included 20 items with good content coverage, acceptable item properties, and positive expert review ratings. Psychometric investigations suggest that Malay version Stroke Knowledge Test had moderate reliability with Kuder Richardson 20 or Cronbach's alpha of 0.58. Improvement is required for Stroke Knowledge Test items with unacceptable difficulty indices. Overall, the average rating of perceived usefulness and perceived utility of the instruments were both 72.7%, suggesting that reviewers were likely to use the instruments in their facilities. Malay version Stroke Knowledge Test was a valid and reliable tool to assess educational needs and to evaluate stroke knowledge among participants of group-based stroke education programs in Malaysia.

Cross-cultural adaptation of the Portuguese version of the Patient-Generated Subjective Global Assessment.

PubMed

Duarte Bonini Campos, J A; Dias do Prado, C

2012-01-01

The cross-cultural adaptation of the Patient-Generated Subjective Global Assessment is important so it can be used with confidence in Portuguese language. To perform a cross-cultural adaptation of the Portuguese version of the Patient-Generated Subjective Global Assessment and to estimate its intrarater reliability. This is a validation study. Face Validity was classified by 17 health professionals and 10 Portuguese language specialists. Idiomatic, semantic, cultural and conceptual equivalences were analyzed. The questionnaire was completed by 20 patients of the Amaral Carvalho Hospital (Jaú, São Paulo, Brazil) in order to verify the Comprehension Index of each item. Therefore, 27 committee members classified each item into "essential", "useful, but not essential" and "not necessary", in order to calculate the Content Validity Ratio. After, this version of the questionnaire was applied twice to 62 patients of the hospital cited above. The intrarater reliability of the nutritional status analyzed by Patient-Generated Subjective Global Assessment was estimated by Kappa statistics. The Portuguese version of the Patient-Generated Subjective Global Assessment presented 10 incomprehensible expressions. The items "a year ago weight" and "dry mouth symptom" presented the lowest Content Validity Ratio. Substantial intrarater reliability (k = 0.78, p = 0.001) was observed. The cross-cultural adaptation of the Portuguese version of the Patient-Generated Subjective Global Assessment became simple and understandable for Brazilian patients. Thus, this version of the Patient-Generated Subjective Global Assessment was considered a valid and a reliable method.

Assessing the overuse of antibiotics in children in Saudi Arabia: validation of the parental perception on antibiotics scale (PAPA scale)

PubMed Central

2013-01-01

Background Antibiotics overuse is a global public health issue influenced by several factors, of which some are parent-related psychosocial factors that can only be measured using valid and reliable psychosocial measurement instruments. The PAPA scale was developed to measure these factors and the content validity of this instrument was assessed. Aim This study further validated the recently developed instrument in terms of (1) face validity and (2) construct validity including: deciding the number and nature of factors, and item selection. Methods Questionnaires were self-administered to parents of children between the ages of 0 and 12 years old. Parents were conveniently recruited from schools’ parental meetings in the Eastern Province, Saudi Arabia. Face validity was assessed with regards to questionnaire clarity and unambiguity. Construct validity and item selection processes were conducted using Exploratory factor analysis. Results Parallel analysis and Exploratory factor analysis using principal axis factoring produced six factors in the developed instrument: knowledge and beliefs, behaviours, sources of information, adherence, awareness about antibiotics resistance, and parents’ perception regarding doctors’ prescribing behaviours. Reliability was assessed (Cronbach’s alpha = 0.78) which demonstrates the instrument as being reliable. Conclusion The ‘factors’ produced in this study coincide with the constructs contextually identified in the development phase of other instruments used to study antibiotic use. However, no other study considering perceptions of antibiotic use had gone beyond content validation of such instruments. This study is the first to constructively validate the factors underlying perceptions regarding antibiotic use in any population and in parents in particular. PMID:23497151

Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information

PubMed Central

Shoemaker, Sarah J.; Wolf, Michael S.; Brach, Cindy

2016-01-01

Objective To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. Methods We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. Results The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K = 0.57) and strong agreement per Gwet’s AC1 (Average = 0.74). Internal consistency was strong (α = 0.71; Average Item-Total Correlation = 0.62). For construct validation with consumers (n = 47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p < 0.05) and ratings (8.9 vs. 7.7, p < 0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. Conclusions The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. Practice implications The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). PMID:24973195

Psychometric Properties of the Persian Translation of the Sexual Quality of Life–Male Questionnaire

PubMed Central

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2016-01-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life–Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward–backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test–retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M (p < .001). Reliability evaluation indicated a high internal consistency and test–retest reliability. The Cronbach’s alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men. PMID:26856758

Psychometric Properties of the Persian Translation of the Sexual Quality of Life-Male Questionnaire.

PubMed

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2017-05-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life-Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward-backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test-retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M ( p < .001). Reliability evaluation indicated a high internal consistency and test-retest reliability. The Cronbach's alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men.

Preliminary psychometric properties of the chinese version of the work-related quality of life scale-2 in the nursing profession.

PubMed

Lin, Shike; Chaiear, Naesinee; Khiewyoo, Jiraporn; Wu, Bin; Johns, Nutjaree Pratheepawanit

2013-03-01

As quality of work-life (QWL) among nurses affects both patient care and institutional standards, assessment regarding QWL for the profession is important. Work-related Quality of Life Scale (WRQOLS) is a reliable QWL assessment tool for the nursing profession. To develop a Chinese version of the WRQOLS-2 and to examine its psychometric properties as an instrument to assess QWL for the nursing profession in China. Forward and back translating procedures were used to develop the Chinese version of WRQOLS-2. Six nursing experts participated in content validity evaluation and 352 registered nurses (RNs) participated in the tests. After a two-week interval, 70 of the RNs were retested. Structural validity was examined by principal components analysis and the Cronbach's alphas calculated. The respective independent sample t-test and intra-class correlation coefficient were used to analyze known-group validity and test-retest reliability. One item was rephrased for adaptation to Chinese organizational cultures. The content validity index of the scale was 0.98. Principal components analysis resulted in a seven-factor model, accounting for 62% of total variance, with Cronbach's alphas for subscales ranging from 0.71 to 0.88. Known-group validity was established in the assessment results of the participants in permanent employment vs. contract employment (t = 2.895, p < 0.01). Good test-retest reliability was observed (r = 0.88, p < 0.01). The translated Chinese version of the WRQOLS-2 has sufficient validity and reliability so that it can be used to evaluate the QWL among nurses in mainland China.

Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information.

PubMed

Shoemaker, Sarah J; Wolf, Michael S; Brach, Cindy

2014-09-01

To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K=0.57) and strong agreement per Gwet's AC1 (Average=0.74). Internal consistency was strong (α=0.71; Average Item-Total Correlation=0.62). For construct validation with consumers (n=47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p<0.05) and ratings (8.9 vs. 7.7, p<0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Development of a job stressor scale for nurses caring for patients with intractable neurological diseases.

PubMed

Ando, Yukako; Kataoka, Tsuyoshi; Okamura, Hitoshi; Tanaka, Katsutoshi; Kobayashi, Toshio

2013-12-01

The purpose of this research is to verify the reliability and validity of a job stressor scale for nurses caring for patients with intractable neurological diseases. A mail survey was conducted using a self-report questionnaire. The subjects were 263 nurses and assistant nurses working in wards specializing in intractable neurological diseases. The response rate was 71.9% (valid response rate, 66.2%). With regard to reliability, internal consistency and stability were assessed. Internal consistency was examined via Cronbach's alpha. For stability, the test-retest method was performed and stability was examined via intraclass correlation coefficients. With regard to validity, factor validity, criterion-related validity, and content validity were assessed. Exploratory factor analysis was used for factor validity. For criterion-related validity, an existing scale was used as an external criterion; concurrent validity was examined via Spearman's rank correlation coefficients. As a result of analysis, there were 26 items in the scale created with an eight factor structure. Cronbach's a for the 26 items was 0.90; with the exception of two factors, alpha for all of the individual sub-factors was high at 0.7 or higher. The intraclass correlation coefficient for the 26 items was 0.89 (p < 0.001). With regard to criterion-related validity, concurrent validity was confirmed and the correlation coefficient with an external criterion was 0.73 (p < 0.001). For content validity, subjects who responded that "The questionnaire represents a stressor well or to a degree" accounted for 81% of the total responses. Reliability and validity were confirmed, so the scale created in the current research is a usable scale.

[Validation of a scale to assess the labour quality of life in public hospitals from Tlaxcala].

PubMed

Hernández-Vicente, Irma Alejandra; Lumbreras-Guzmán, Marivel; Méndez-Hernández, Pablo; Rojas-Lima, Elodia; Cervantes-Rodríguez, Margarita; Juárez-Flores, Clara Arlina

2017-01-01

To validate a scale for assessing the labour quality of life in public hospitals (LQL-PH) from Tlaxcala, Mexico. The instrument was validated among 669 health workers from six hospitals from the Ministry of Health of Tlaxcala, Mexico. Content validity was by inquiry to experts, construct validity by factor analysis, criterion validity by comparing with other scales, and reliability with Cronbach's Alpha. The factor analysis uncovered four dimensions: "individual welfare", "conditions and labour environment", "organization", and "well-being accomplished by the work"; reliability was 0.921. Workers who perceibed better LQL-PH were: under 50 years old, with temporary contract, with less seniority in job, with work schedule at daytime of weekends, and those with academic degree. LQL-PH showed to be an instrument phsycometrically valid and reliable. It's recommendable to prove this scale in other public and private health institutions, as well as its relationship with key health care indicators of labour performance and management.

Evaluation of the psychometric properties of the main meal quality index when applied in the UK population.

PubMed

Gorgulho, B M; Pot, G K; Marchioni, D M

2017-05-01

The aim of this study was to evaluate the validity and reliability of the Main Meal Quality Index when applied on the UK population. The indicator was developed to assess meal quality in different populations, and is composed of 10 components: fruit, vegetables (excluding potatoes), ratio of animal protein to total protein, fiber, carbohydrate, total fat, saturated fat, processed meat, sugary beverages and desserts, and energy density, resulting in a score range of 0-100 points. The performance of the indicator was measured using strategies for assessing content validity, construct validity, discriminant validity and reliability, including principal component analysis, linear regression models and Cronbach's alpha. The indicator presented good reliability. The Main Meal Quality Index has been shown to be valid for use as an instrument to evaluate, monitor and compare the quality of meals consumed by adults in the United Kingdom.

Turkish Version of the Student Nurse Stress Index: Validity and Reliability.

PubMed

Sarikoc, Gamze; Bayram Demiralp, Meral; Oksuz, Emine; Pazar, Berrin

2017-06-01

This study aimed to adapt the Student Nurse Stress Index (SNSI) for the Turkish nursing students and investigate its psychometric properties. Research was conducted with 152 volunteer female students who attended a university college in Ankara, Turkey. Test-retest reliability was investigated for the scale internal consistency (Cronbach α) and stability. Also, content validity and construct validity of the SNSI were assessed. In order to determine the construct validity of SNSI, Uygulamalı Çok Değişkenli İstatistiksel Yöntemler and confirmatory factor analysis was conducted. The Turkish version of SNSI with 15 items comprised four factors (academic load, clinical concerns, personal problems, interface worries). The content validity index (CVI) score was .97. Factor loadings of Turkish version of SNSI varied between .532 and .868. The "personal problems" subscale explained 19.01% of the variance; "clinical concerns" explained 18.51%; "interface worries" explained 15.32%; "academic load" explained 14.14%. The total variance explained was 66.99%. CFA results (χ 2 /SD, GFI, CFI, TLI, IFI, RMSEA and SRMR) were acceptable and in good agreement. The internal consistency coefficient of the SNSI was .86. Results showed that the SNSI had a satisfactory level of reliability and validity in nursing students in Turkey. Multicenter studies including nursing students from different nursing schools are recommended for the SNSI to be generalized. Copyright © 2017. Published by Elsevier B.V.

Validating the Farsi version of the Pregnancy Worries and Stress Questionnaire (PWSQ): An exploratory factor analysis.

PubMed

Navidpour, Fariba; Dolatian, Mahrokh; Shishehgar, Sara; Yaghmaei, Farideh; Majd, Hamid Alavi; Hashemi, Seyed Saeed

2016-10-01

Biological, environmental, inter- and intrapersonal changes during the antenatal period can result in anxiety and stress in pregnant women. It is pivotal to identify potential stressors and prevent their foetal and maternal consequences. The present study was conducted to validate and examine the factor structure of the Farsi version of the Pregnancy Worries and Stress Questionnaire (PWSQ). In 2015, 502 Iranian healthy pregnant women, referred to selected hospitals in Tehran for prenatal care at 8-39 weeks of pregnancy, were recruited through a randomized cluster sampling. The PWSQ was translated into Farsi, and its validity and reliability were examined using exploratory factor analysis by SPSS version 21. The content validity of items on the PWSQ was between 0.63-1. The content validity index for relevance, clarity and simplicity were 0.92, 0.98, and 0.98, respectively, with a mean of 0.94. The Kaiser-Meyer-Olkin measure of sampling adequacy was 0.863. Test-retest reliability showed high internal consistency (α=0.89; p<0.0001). The psychometric evaluation and exploratory factor analysis showed that the translated questionnaire is a valid and reliable tool to identify stress in Iranian pregnant women. Application of the questionnaire can facilitate the diagnosis of stress in pregnant women and assist health care providers in providing timely support and minimizing negative outcomes of stress and anxiety in pregnant women and their infants.

Translation and Validation of the Dutch Western Ontario Meniscal Evaluation Tool.

PubMed

van der Wal, Robert J P; Heemskerk, Bastiaan T J; van Arkel, Ewoud R A; Mokkink, Lidwine B; Thomassen, Bregje J W

2017-05-01

The aim of this study was to translate the Western Ontario Meniscal Evaluation Tool (WOMET) into Dutch, to evaluate the content validity, construct validity, reliability, and responsiveness, and to determine the minimal important change (MIC) of the Dutch version. The WOMET was translated into Dutch according to a standardized forward-backward translation protocol. A total of 86 patients (51 males, 35 females, median age 52 years [interquartile range, 43-60 years]) with isolated meniscal pathology were included. The WOMET was completed three times; at baseline, around 2 weeks, and after 3 months from the baseline. Knee injury and osteoarthritis outcome score, International Knee Documentation Committee subjective knee form, short-form 36, and an anchor question were also answered. There were good results for content validity (floor and ceiling effects [< 15%]), construct validity (79% of the predefined hypotheses were confirmed), internal consistency (Cronbach α = 0.87, 0.79, and 0.86 for each subscale score), test-retest reliability (intraclass correlation coefficient = 0.78 for total WOMET score), and responsiveness (79% of the predefined hypotheses were confirmed). The smallest detectable change and MIC for the Dutch WOMET are 20.5 and 14.7, respectively. The Dutch version of the WOMET is valid and reliable for assessing health-related quality of life in patients with meniscal pathology. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

A Chinese Mandarin translation and validation of the Myocardial Infarction Dimensional Assessment Scale (MIDAS).

PubMed

Wang, W; Lopez, V; Thompson, D R

2006-09-01

To evaluate the validity, reliability, and cultural relevance of the Chinese Mandarin version of Myocardial Infarction Dimensional Assessment Scale (MIDAS) as a disease-specific quality of life measure. The cultural relevance and content validity of the Chinese Mandarin version of the MIDAS (CM-MIDAS) was evaluated by an expert panel. Measurement performance was tested on 180 randomly selected Chinese MI patents. Thirty participants from the primary group completed the CM-MIDAS for test-retest reliability after 2 weeks. Reliability, validity and discriminatory power of the CM-MIDAS were calculated. Two items were modified as suggested by the expert panel. The overall CM-MIDAS had acceptable internal consistency with Cronbach's alpha coefficient 0.93 for the scale and 0.71-0.94 for the seven domains. Test-retest reliability by intraclass correlations was 0.85 for the overall scale and 0.74-0.94 for the seven domains. There was acceptable concurrent validity with significant (p < 0.05) correlations between the CM-MDAS and the Chinese Version of the Short Form 36. The principal components analysis extracted seven factors that explained 67.18% of the variance with high factor loading indicating good construct validity. Empirical data support CM-MIDAS as a valid and reliable disease-specific quality of life measure for Chinese Mandarin speaking patients with myocardial infarction.

Validity and reliability of Chinese version of Adult Carer Quality of Life questionnaire (AC-QoL) in family caregivers of stroke survivors

PubMed Central

Li, Yingshuang; Ding, Chunge

2017-01-01

The Adult Carer Quality of Life questionnaire (AC-QoL) is a reliable and valid instrument used to assess the quality of life (QoL) of adult family caregivers. We explored the psychometric properties and tested the reliability and validity of a Chinese version of the AC-QoL with reliability and validity testing in 409 Chinese stroke caregivers. We used item-total correlation and extreme group comparison to do item analysis. To evaluate its reliability, we used a test-retest reliability approach, intraclass correlation coefficient (ICC), together with Cronbach’s alpha and model-based internal consistency index; to evaluate its validity, we used scale content validity, confirmatory factor analysis (CFA) and exploratory factor analysis (EFA) via principal component analysis with varimax rotation. We found that the CFA did not in fact confirm the original factor model and our EFA yielded a 31-item measure with a five-factor model. In conclusions, although some items performed differently in our analysis of the original English language version and our Chinese language version, our translated AC-QoL is a reliable and valid tool which can be used to assess the quality of life of stroke caregivers in mainland China. Chinese version AC-QoL is a comprehensive and good measurement to understand caregivers and has the potential to be a screening tool to assess QoL of caregiver. PMID:29131845

Assessing Student Understanding of the "New Biology": Development and Evaluation of a Criterion-Referenced Genomics and Bioinformatics Assessment

NASA Astrophysics Data System (ADS)

Campbell, Chad Edward

Over the past decade, hundreds of studies have introduced genomics and bioinformatics (GB) curricula and laboratory activities at the undergraduate level. While these publications have facilitated the teaching and learning of cutting-edge content, there has yet to be an evaluation of these assessment tools to determine if they are meeting the quality control benchmarks set forth by the educational research community. An analysis of these assessment tools indicated that <10% referenced any quality control criteria and that none of the assessments met more than one of the quality control benchmarks. In the absence of evidence that these benchmarks had been met, it is unclear whether these assessment tools are capable of generating valid and reliable inferences about student learning. To remedy this situation the development of a robust GB assessment aligned with the quality control benchmarks was undertaken in order to ensure evidence-based evaluation of student learning outcomes. Content validity is a central piece of construct validity, and it must be used to guide instrument and item development. This study reports on: (1) the correspondence of content validity evidence gathered from independent sources; (2) the process of item development using this evidence; (3) the results from a pilot administration of the assessment; (4) the subsequent modification of the assessment based on the pilot administration results and; (5) the results from the second administration of the assessment. Twenty-nine different subtopics within GB (Appendix B: Genomics and Bioinformatics Expert Survey) were developed based on preliminary GB textbook analyses. These subtopics were analyzed using two methods designed to gather content validity evidence: (1) a survey of GB experts (n=61) and (2) a detailed content analyses of GB textbooks (n=6). By including only the subtopics that were shown to have robust support across these sources, 22 GB subtopics were established for inclusion in the assessment. An expert panel subsequently developed, evaluated, and revised two multiple-choice items to align with each of the 22 subtopics, producing a final item pool of 44 items. These items were piloted with student samples of varying content exposure levels. Both Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies were used to evaluate the assessment's validity, reliability and ability inferences, and its ability to differentiate students with different magnitudes of content exposure. A total of 18 items were subsequently modified and reevaluated by an expert panel. The 26 original and 18 modified items were once again piloted with student samples of varying content exposure levels. Both CTT and IRT methodologies were once again used to evaluate student responses in order to evaluate the assessment's validity and reliability inferences as well as its ability to differentiate students with different magnitudes of content exposure. Interviews with students from different content exposure levels were also performed in order to gather convergent validity evidence (external validity evidence) as well as substantive validity evidence. Also included are the limitations of the assessment and a set of guidelines on how the assessment can best be used.

Methodology for Developing a New EFNEP Food and Physical Activity Behaviors Questionnaire.

PubMed

Murray, Erin K; Auld, Garry; Baker, Susan S; Barale, Karen; Franck, Karen; Khan, Tarana; Palmer-Keenan, Debra; Walsh, Jennifer

2017-10-01

Research methods are described for developing a food and physical activity behaviors questionnaire for the Expanded Food and Nutrition Education Program (EFNEP), a US Department of Agriculture nutrition education program serving low-income families. Mixed-methods observational study. The questionnaire will include 5 domains: (1) diet quality, (2) physical activity, (3) food safety, (4) food security, and (5) food resource management. A 5-stage process will be used to assess the questionnaire's test-retest reliability and content, face, and construct validity. Research teams across the US will coordinate questionnaire development and testing nationally. Convenience samples of low-income EFNEP, or EFNEP-eligible, adult participants across the US. A 5-stage process: (1) prioritize domain concepts to evaluate (2) question generation and content analysis panel, (3) question pretesting using cognitive interviews, (4) test-retest reliability assessment, and (5) construct validity testing. A nationally tested valid and reliable food and physical activity behaviors questionnaire for low-income adults to evaluate EFNEP's effectiveness. Cognitive interviews will be summarized to identify themes and dominant trends. Paired t tests (P ≤ .05) and Spearman and intra-class correlation coefficients (r > .5) will be conducted to assess reliability. Construct validity will be assessed using Wilcoxon t test (P ≤ .05), Spearman correlations, and Bland-Altman plots. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Development and validation of a toddler silhouette scale.

PubMed

Hager, Erin R; McGill, Adrienne E; Black, Maureen M

2010-02-01

The purpose of this study is to develop and validate a toddler silhouette scale. A seven-point scale was developed by an artist based on photographs of 15 toddlers (6 males, 9 females) varying in race/ethnicity and body size, and a list of phenotypic descriptions of toddlers of varying body sizes. Content validity, age-appropriateness, and gender and race/ethnicity neutrality were assessed among 180 pediatric health professionals and 129 parents of toddlers. Inter- and intrarater reliability and concurrent validity were assessed by having 138 pediatric health professionals match the silhouettes with photographs of toddlers. Assessments of content validity revealed that most health professionals (74.6%) and parents of toddlers (63.6%) ordered all seven silhouettes correctly, and interobserver agreement for weight status classification was high (kappa = 0.710, r = 0.827, P < 0.001). Most respondents reported that the scale represented toddlers aged 12-36 months (89%) and was gender (68.5%) and race/ethnicity (77.3%) neutral. The inter-rater reliability, based on matching silhouettes with photographs, was 0.787 (Cronbach's alpha) and the intrarater reliability was 0.855 (P < 0.001). The concurrent validity, based on the correlation between silhouette choice and the weight-for-length percentile of each toddler's photograph, was 0.633 (P < 0.001). In conclusion, a valid and reliable toddler silhouette scale that may be used for male or female toddlers, aged 12-36 months, of varying race/ethnicity was developed and evaluated. This scale may be used clinically or in research settings to assess parents' perception of and satisfaction with their toddler's body size. Interventions can be targeted toward parents who have inaccurate perceptions of or are dissatisfied with their toddler's body size.

A content validated questionnaire for assessment of self reported venous blood sampling practices

PubMed Central

2012-01-01

Background Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. Findings We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. Conclusions The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward. PMID:22260505

A content validated questionnaire for assessment of self reported venous blood sampling practices.

PubMed

Bölenius, Karin; Brulin, Christine; Grankvist, Kjell; Lindkvist, Marie; Söderberg, Johan

2012-01-19

Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward.

Organizational member involvement in physical activity coalitions across the United States: development and testing of a novel survey instrument for assessing coalition functioning.

PubMed

Bornstein, Daniel B; Pate, Russell R; Beets, Michael W; Saunders, Ruth P; Blair, Steven N

2015-06-01

Coalitions are often composed of member organizations. Member involvement is thought to be associated with coalition success. No instrument currently exists for evaluating organizational member involvement in physical activity coalitions. This study aimed to develop a survey instrument for evaluating organizational member involvement in physical activity coalitions. The study was carried out in three phases: (a) developing a draft survey, (b) assessing the content validity of the draft survey, and (c) assessing the underlying factor structure, reliability, and validity of the survey. A cross-sectional design was employed. In Phase 1, a team of experts in survey development produced a draft survey. In Phase 2, the content validity of the draft survey was evaluated by a panel of individuals with expertise in physical activity coalitions. In Phase 3, the survey was administered to 120 individuals on local-, state-, and national-level physical activity coalitions. Responses were subjected to an exploratory factor analysis in order to determine the survey's underlying factor structure, reliability, and validity. Phases 1 and 2yielded a survey instrument with demonstrated content validity. Phase 3 yielded a three-factor model with three subscales: Strategic Alignment, Organizational Alignment, and Providing Input. Each subscale demonstrated high internal consistency reliability and construct validity. The survey instrument developed here demonstrated sound psychometric properties and provides new insight into organizational member involvement in physical activity coalitions. This instrument may be an important tool in developing a more complete picture of coalition functioning in physical activity coalitions specifically and health-based coalitions overall. © 2014 Society for Public Health Education.

from the Adolescents’ Perspective in Malaysia

PubMed

Mohd Zin, Faridah; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-05-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. Creative Commons Attribution License

[Development and validity of workplace bullying in nursing-type inventory (WPBN-TI)].

PubMed

Lee, Younju; Lee, Mihyoung

2014-04-01

The purpose of this study was to develop an instrument to assess bullying of nurses, and test the validity and reliability of the instrument. The initial thirty items of WPBN-TI were identified through a review of the literature on types bullying related to nursing and in-depth interviews with 14 nurses who experienced bullying at work. Sixteen items were developed through 2 content validity tests by 9 experts and 10 nurses. The final WPBN-TI instrument was evaluated by 458 nurses from five general hospitals in the Incheon metropolitan area. SPSS 18.0 program was used to assess the instrument based on internal consistency reliability, construct validity, and criterion validity. WPBN-TI consisted of 16 items with three distinct factors (verbal and nonverbal bullying, work-related bullying, and external threats), which explained 60.3% of the total variance. The convergent validity and determinant validity for WPBN-TI were 100.0%, 89.7%, respectively. Known-groups validity of WPBN-TI was proven through the mean difference between subjective perception of bullying. The satisfied criterion validity for WPBN-TI was more than .70. The reliability of WPBN-TI was Cronbach's α of .91. WPBN-TI with high validity and reliability is suitable to determine types of bullying in nursing workplace.

[Evaluation on the validity and reliability of the Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale (DSKAB)].

PubMed

Liu, Xiaoli; Dai, Long; Chen, Bo; Feng, Nongping; Wu, Qianhui; Lin, Yonghai; Zhang, Lan; Tan, Dong; Zhang, Jinhua; Tu, Huijuan; Li, Changfeng; Wang, Wenjuan

2016-01-01

To evaluate the validity and reliability of Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale (DSKAB). We selected 460 patients with diabetes in the community, used the scale which was after two rounds of the Delphi method and pilot study. Investigators surveyed the patients by the way of face to face. by draw lots, we selected 25 community diabetes randomly for repeating investigations after one week. The validity analyses included face validity, content validity, construct validity and discriminant validity. The reliability analyses included Cronbach's α coefficient, θ coefficient, Ω coefficient, split-half reliability and test-retest reliability. This study distributed a total of 460 questionnaires, reclaimed 442, qualified 432. The score of the scale was 254.59 ± 28.90, the scores of the knowledge, attitude, behavior sub-scales were 82.44 ± 11.24, 63.53 ± 5.77 and 108.61 ± 17.55, respectively. It had excellent face validity and content validity. The correlation coefficient was from 0.71 to 0.91 among three sub-scales and the scale, P<0.001. The common factor cumulative variance contribution rate of the scale and three sub-scales was from 57.28% to 67.19%, which achieved more than 50% of the approved standard, there was 25 common factors, 91 items of the total 98 items held factor loading ≥0.40 in its relevant common factor, it had good construct validity. The scores of high group and low group in three sub-scales were: knowledge (91.12 ± 3.62) and (69.96 ± 11.20), attitude (68.75 ± 4.51) and (58.79 ± 4.87), behavior (129.38 ± 8.53) and (89.65 ± 11.34),mean scores of three sub-scales were apparently different, which compared between high score group and low score group, the t value were - 19.45, -16.24 and -30.29, respectively, P<0.001, and it had good discriminant validity. The Cronbach's α coefficient of the scale and three sub-scales was from 0.79 to 0.93, the θ coefficient was from 0.86 to 0.95, the Ω coefficient was from 0.90 to 0.98, split-half reliability was from 0.89 to 0.95.Test-retest reliability of the scale was 0.51;the three sub-scales was from 0.46 to 0.52, P<0.05. The validity and reliability of the Diabetes Self-management Knowledge, Attitude, and Behavior Assessment Scale are excellent, which is a suitable instrument to evaluate the self-management for patients with diabetes.

The development of the Athens Emotional States Inventory (AESI): collection, validation and automatic processing of emotionally loaded sentences.

PubMed

Chaspari, Theodora; Soldatos, Constantin; Maragos, Petros

2015-01-01

The development of ecologically valid procedures for collecting reliable and unbiased emotional data towards computer interfaces with social and affective intelligence targeting patients with mental disorders. Following its development, presented with, the Athens Emotional States Inventory (AESI) proposes the design, recording and validation of an audiovisual database for five emotional states: anger, fear, joy, sadness and neutral. The items of the AESI consist of sentences each having content indicative of the corresponding emotion. Emotional content was assessed through a survey of 40 young participants with a questionnaire following the Latin square design. The emotional sentences that were correctly identified by 85% of the participants were recorded in a soundproof room with microphones and cameras. A preliminary validation of AESI is performed through automatic emotion recognition experiments from speech. The resulting database contains 696 recorded utterances in Greek language by 20 native speakers and has a total duration of approximately 28 min. Speech classification results yield accuracy up to 75.15% for automatically recognizing the emotions in AESI. These results indicate the usefulness of our approach for collecting emotional data with reliable content, balanced across classes and with reduced environmental variability.

The development and validation of the Self-Efficacy Beliefs about Equitable Science Teaching and learning instrument for prospective elementary teachers

NASA Astrophysics Data System (ADS)

Ritter, Jennifer M.

1999-12-01

The purpose of this study was to develop, validate and establish the reliability of an instrument to assess the self-efficacy beliefs of prospective elementary teachers with regards to science teaching and learning for diverse learners. The study used Bandura's theoretical framework, in that the instrument would use the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to science teaching and learning to diverse learners: specifically the two dimensions of self-efficacy beliefs defined by Bandura (1977): personal self-efficacy and outcome expectancy. A seven step plan was designed and followed in the process of developing the instrument, which was titled the Self-Efficacy Beliefs about Equitable Science Teaching or SEBEST. Diverse learners as recognized by Science for All Americans (1989) are "those who in the past who have largely been bypassed in science and mathematics education: ethnic and language minorities and girls" (p. xviii). That definition was extended by this researcher to include children from low socioeconomic backgrounds based on the research by Gomez and Tabachnick (1992). The SEBEST was administered to 226 prospective elementary teachers at The Pennsylvania State University. Using the results from factor analyses, Coefficient Alpha, and Chi-Square a 34 item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the content matrix. The 34 item SEBEST was found to load purely on four factors across the content matrix thus providing evidence construct validity. The Coefficient Alpha reliability for the 34 item SEBEST was .90 and .82 for the PSE sub-scale and .78 for the OE sub-scale. A Chi-Square test (X2 = 2.7 1, df = 7, p > .05) was used to confirm that the 34 items were balanced across the Personal Self-Efficacy/Outcome Expectancy and Ethnicity/LanguageMinority/Gender Socioeconomic Status/dimensions of the content matrix. Based on the standardized development procedures used and the associated evidence, the SEBEST appears to be a content and construct valid instrument, with high internal reliability and moderate test-retest reliability qualities, for use with prospective elementary teachers to assess self-efficacy beliefs for teaching and learning science for diverse learners.

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study

PubMed Central

Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

2013-01-01

Background Current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sport, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record monthly participation in all major sports relevant to our patient-group. Objective To assess the reliability, content validity, and concurrent validity of the survey, and evaluate if it provided more complete data on sports participation than a routine activity questionnaire. Methods One hundred and forty-five consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed two days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients were included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the twelfth postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. Results The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was substantial agreement between the two methods on return to preinjury main sport (κ = 0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. Conclusion The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire. PMID:23645830

Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study.

PubMed

Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

2014-05-01

The current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sports, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record the monthly participation in all major sports relevant to our patient-group. To assess the reliability, content validity and concurrent validity of the survey and to evaluate if it provided more complete data on sports participation than a routine activity questionnaire. 145 consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed 2 days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients was included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the 12th postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was a substantial agreement between the two methods on return to preinjury main sport (κ=0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire.

Validity and reliability of a novel immunosuppressive adverse effects scoring system in renal transplant recipients.

PubMed

Meaney, Calvin J; Arabi, Ziad; Venuto, Rocco C; Consiglio, Joseph D; Wilding, Gregory E; Tornatore, Kathleen M

2014-06-12

After renal transplantation, many patients experience adverse effects from maintenance immunosuppressive drugs. When these adverse effects occur, patient adherence with immunosuppression may be reduced and impact allograft survival. If these adverse effects could be prospectively monitored in an objective manner and possibly prevented, adherence to immunosuppressive regimens could be optimized and allograft survival improved. Prospective, standardized clinical approaches to assess immunosuppressive adverse effects by health care providers are limited. Therefore, we developed and evaluated the application, reliability and validity of a novel adverse effects scoring system in renal transplant recipients receiving calcineurin inhibitor (cyclosporine or tacrolimus) and mycophenolic acid based immunosuppressive therapy. The scoring system included 18 non-renal adverse effects organized into gastrointestinal, central nervous system and aesthetic domains developed by a multidisciplinary physician group. Nephrologists employed this standardized adverse effect evaluation in stable renal transplant patients using physical exam, review of systems, recent laboratory results, and medication adherence assessment during a clinic visit. Stable renal transplant recipients in two clinical studies were evaluated and received immunosuppressive regimens comprised of either cyclosporine or tacrolimus with mycophenolic acid. Face, content, and construct validity were assessed to document these adverse effect evaluations. Inter-rater reliability was determined using the Kappa statistic and intra-class correlation. A total of 58 renal transplant recipients were assessed using the adverse effects scoring system confirming face validity. Nephrologists (subject matter experts) rated the 18 adverse effects as: 3.1 ± 0.75 out of 4 (maximum) regarding clinical importance to verify content validity. The adverse effects scoring system distinguished 1.75-fold increased gastrointestinal adverse effects (p=0.008) in renal transplant recipients receiving tacrolimus and mycophenolic acid compared to the cyclosporine regimen. This finding demonstrated construct validity. Intra-class correlation was 0.81 (95% confidence interval: 0.65-0.90) and Kappa statistic of 0.68 ± 0.25 for all 18 adverse effects and verified substantial inter-rater reliability. This immunosuppressive adverse effects scoring system in stable renal transplant recipients was evaluated and substantiated face, content and construct validity with inter-rater reliability. The scoring system may facilitate prospective, standardized clinical monitoring of immunosuppressive adverse drug effects in stable renal transplant recipients and improve medication adherence.

The revised critical thinking skills scale for a life-and-death course: preliminary scale refinement.

PubMed

Hwang, Huei-Lih; Lin, Huey-Shyan; Wang, Hsiu-Hung

2010-12-01

Death education involves acquiring knowledge, changing behavior, and developing proper views of life in both the affective and the value domains. Critical thinking that is honed through reflecting on life-and-death issues represents a way to reach these goals. Designing assessments able to measure college student content and critical thinking skills related to life-and-death issues is thus important. The Test of Critical Thinking Skills for Life-And-Death content (TCTS-LD) instrument requires the administration of additional tests to assess reliability and validity for future use in the assessment of perceptions on life and death. The purpose of this study was to refine the TCTS-LD. A cross-sectional, descriptive design was used to recruit 715 college students in southern Taiwan. Three structured scales were administered in class to the participants. Data were collected in 2004 and 2006. Confirmatory factor analysis was applied to validate the structure of scales. Examination of the reliability of the three-factor and 15-item scale revealed a Kuder-Richardson coefficient of internal consistency of .54. The split-half reliability coefficients were .47 in the Spearman-Brown correlation and .40 in the intraclass correlation coefficient (ICC). The test-retest reliability coefficients (n = 22) were .58 in Pearson correlation and .56 in ICC. In addition to content validity verification by experts and face validity by students, the validity of this test was assessed using three methods, including (a) a comparable validity rating between this test and the TCTS-A (r = .34, p < .001; (b) a contrast-group technique with different responses to the instrument between those in education and nursing majors (t = 2.71, p < .01), with scores of 10.98 (SD = 2.42) and 9.82 (SD = 2.25), respectively; and (c) a confirmatory factor analysis confirming that TCTS-LD is related to the three dimensions of assumption, evaluation, and induction (χ = 81.800, p = .158, normed chi-square χ/df = 1.169, comparative fit index [CFI] = .976, Tucker-Lewis index = .984, root mean square error of approximation [RMSEA] = 0.015). Three factors explained 31.19% of total variance for the revised TCTS-LD. The revised TCTS-LD scale improved performance and effectiveness to a certain degree. However, reliability and construct validity must be further tested to permit its use as an evaluation tool.

Linguistic validation of stigmatisation degree, self-esteem and knowledge questionnaire among asthma patients using Rasch analysis.

PubMed

Ahmad, Sohail; Ismail, Ahmad Izuanuddin; Khan, Tahir Mehmood; Akram, Waqas; Mohd Zim, Mohd Arif; Ismail, Nahlah Elkudssiah

2017-04-01

The stigmatisation degree, self-esteem and knowledge either directly or indirectly influence the control and self-management of asthma. To date, there is no valid and reliable instrument that can assess these key issues collectively. The main aim of this study was to test the reliability and validity of the newly devised and translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" among adult asthma patients using the Rasch measurement model. This cross-sectional study recruited thirty adult asthma patients from two respiratory specialist clinics in Selangor, Malaysia. The newly devised self-administered questionnaire was adapted from relevant publications and translated into the Malay language using international standard translation guidelines. Content and face validation was done. The data were extracted and analysed for real item reliability and construct validation using the Rasch model. The translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" showed high real item reliability values of 0.90, 0.86 and 0.89 for stigmatisation degree, self-esteem, and knowledge of asthma, respectively. Furthermore, all values of point measure correlation (PTMEA Corr) analysis were within the acceptable specified range of the Rasch model. Infit/outfit mean square values and Z standard (ZSTD) values of each item verified the construct validity and suggested retaining all the items in the questionnaire. The reliability analyses and output tables of item measures for construct validation proved the translated Malaysian version of "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" as a valid and highly reliable questionnaire.

Assessing the efficacy of the Measure of Understanding of Macroevolution as a valid tool for undergraduate non-science majors

NASA Astrophysics Data System (ADS)

Romine, William Lee; Walter, Emily Marie

2014-11-01

Efficacy of the Measure of Understanding of Macroevolution (MUM) as a measurement tool has been a point of contention among scholars needing a valid measure for knowledge of macroevolution. We explored the structure and construct validity of the MUM using Rasch methodologies in the context of a general education biology course designed with an emphasis on macroevolution content. The Rasch model was utilized to quantify item- and test-level characteristics, including dimensionality, reliability, and fit with the Rasch model. Contrary to previous work, we found that the MUM provides a valid, reliable, and unidimensional scale for measuring knowledge of macroevolution in introductory non-science majors, and that its psychometric behavior does not exhibit large changes across time. While we found that all items provide productive measurement information, several depart substantially from ideal behavior, warranting a collective effort to improve these items. Suggestions for improving the measurement characteristics of the MUM at the item and test levels are put forward and discussed.

A Psychometric Study of the Bayley Scales of Infant and Toddler Development in Persian Language Children.

PubMed

Azari, Nadia; Soleimani, Farin; Vameghi, Roshanak; Sajedi, Firoozeh; Shahshahani, Soheila; Karimi, Hossein; Kraskian, Adis; Shahrokhi, Amin; Teymouri, Robab; Gharib, Masoud

2017-01-01

Bayley Scales of infant & toddler development is a well-known diagnostic developmental assessment tool for children aged 1-42 months. Our aim was investigating the validity & reliability of this scale in Persian speaking children. The method was descriptive-analytic. Translation- back translation and cultural adaptation was done. Content & face validity of translated scale was determined by experts' opinions. Overall, 403 children aged 1 to 42 months were recruited from health centers of Tehran, during years of 2013-2014 for developmental assessment in cognitive, communicative (receptive & expressive) and motor (fine & gross) domains. Reliability of scale was calculated through three methods; internal consistency using Cronbach's alpha coefficient, test-retest and interrater methods. Construct validity was calculated using factor analysis and comparison of the mean scores methods. Cultural and linguistic changes were made in items of all domains especially on communication subscale. Content and face validity of the test were approved by experts' opinions. Cronbach's alpha coefficient was above 0.74 in all domains. Pearson correlation coefficient in various domains, were ≥ 0.982 in test retest method, and ≥0.993 in inter-rater method. Construct validity of the test was approved by factor analysis. Moreover, the mean scores for the different age groups were compared and statistically significant differences were observed between mean scores of different age groups, that confirms validity of the test. The Bayley Scales of Infant and Toddler Development is a valid and reliable tool for child developmental assessment in Persian language children.

Developing a Psychometric Instrument to Measure Physical Education Teachers' Job Demands and Resources

ERIC Educational Resources Information Center

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands-resources model, the study developed and validated an instrument that measures physical education teachers' job demands-resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample (n = 397). Exploratory…

Reliability of Portfolio: A Closer Look at Findings from Recent Publications

ERIC Educational Resources Information Center

Oskay, Ozge Ozyalcin; Schallies, Michael; Morgil, Inci

2008-01-01

In this review article, conventional portfolio assessment and new developments in portfolio assessment are investigated. The concept of portfolio, portfolio building steps, contents of portfolio, evaluation of portfolio, advantages, disadvantages and concerns in using portfolio as well as validity and reliability of portfolio assessment are…

Development and Validation of a Scale for the Measurement of Adolescents' Developmental Assets in the Neighborhood

ERIC Educational Resources Information Center

Oliva, Alfredo; Antolin, Lucia; Lopez, Ana Maria

2012-01-01

The aim of this study was to develop a valid and reliable instrument to assess features of a neighborhood that are relevant to the development and adjustment of adolescents. First, a scale was created from a literature review. Second, the content validity of this scale was validated through expert opinion. Finally, the scale was administered to a…

Validation and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women.

PubMed

Abay, Halime; Kaplan, Sena

2016-04-01

There are a limited number of menopause-specific quality-of-life scales for the Turkish population. This study was conducted to evaluate the validity and reliability of the Turkish Utian Quality-of-Life Scale in postmenopausal women. The study group was comprised of 250 postmenopausal women who applied to a training and research hospital's menopause clinic in Turkey. A survey form and the Turkish Utian quality-of-Life Scale were used to collect data, and the Turkish version of Short Form-36 was used to evaluate reliability with an equivalent form. Language-validity, content-validity, and construct-validity methods were used to assess the validity of the scale, and Cronbach's α coefficient calculation and the equivalent-form reliability methods were used to assess the reliability of the scale. The Turkish Utian Quality-of-Life Scale was determined to be a valid and reliable instrument for measuring the quality of life of postmenopausal women. Confirmatory factor analysis demonstrates that the instrument fits well with 23 items and a four-factor model. The Cronbach's α coefficient for the quality-of-life domains were as follows: 0.88 overall, 0.79 health, 0.78 emotional, 0.76 sexual, and 0.75 occupational. Reliability of the instrument was confirmed through significant correlations between scores on the Turkish version of the Utian Quality-of-Life Scale and the Turkish version of the Short Form-36 (r = 0.745, P < 0.001). This research emphasizes that the Turkish Utian Quality-of-Life Scale is reliable and valid in postmenopausal women-it is a useful instrument for measuring quality of life during menopause.

The Trojan Lifetime Champions Health Survey: Development, Validity, and Reliability

PubMed Central

Sorenson, Shawn C.; Romano, Russell; Scholefield, Robin M.; Schroeder, E. Todd; Azen, Stanley P.; Salem, George J.

2015-01-01

Context Self-report questionnaires are an important method of evaluating lifespan health, exercise, and health-related quality of life (HRQL) outcomes among elite, competitive athletes. Few instruments, however, have undergone formal characterization of their psychometric properties within this population. Objective To evaluate the validity and reliability of a novel health and exercise questionnaire, the Trojan Lifetime Champions (TLC) Health Survey. Design Descriptive laboratory study. Setting A large National Collegiate Athletic Association Division I university. Patients or Other Participants A total of 63 university alumni (age range, 24 to 84 years), including former varsity collegiate athletes and a control group of nonathletes. Intervention(s) Participants completed the TLC Health Survey twice at a mean interval of 23 days with randomization to the paper or electronic version of the instrument. Main Outcome Measure(s) Content validity, feasibility of administration, test-retest reliability, parallel-form reliability between paper and electronic forms, and estimates of systematic and typical error versus differences of clinical interest were assessed across a broad range of health, exercise, and HRQL measures. Results Correlation coefficients, including intraclass correlation coefficients (ICCs) for continuous variables and κ agreement statistics for ordinal variables, for test-retest reliability averaged 0.86, 0.90, 0.80, and 0.74 for HRQL, lifetime health, recent health, and exercise variables, respectively. Correlation coefficients, again ICCs and κ, for parallel-form reliability (ie, equivalence) between paper and electronic versions averaged 0.90, 0.85, 0.85, and 0.81 for HRQL, lifetime health, recent health, and exercise variables, respectively. Typical measurement error was less than the a priori thresholds of clinical interest, and we found minimal evidence of systematic test-retest error. We found strong evidence of content validity, convergent construct validity with the Short-Form 12 Version 2 HRQL instrument, and feasibility of administration in an elite, competitive athletic population. Conclusions These data suggest that the TLC Health Survey is a valid and reliable instrument for assessing lifetime and recent health, exercise, and HRQL, among elite competitive athletes. Generalizability of the instrument may be enhanced by additional, larger-scale studies in diverse populations. PMID:25611315

The reliability, validity, sensitivity, specificity and predictive values of the Chinese version of the Rowland Universal Dementia Assessment Scale.

PubMed

Chen, Chia-Wei; Chu, Hsin; Tsai, Chia-Fen; Yang, Hui-Ling; Tsai, Jui-Chen; Chung, Min-Huey; Liao, Yuan-Mei; Chi, Mei-Ju; Chou, Kuei-Ru

2015-11-01

The purpose of this study was to translate the Rowland Universal Dementia Assessment Scale into Chinese and to evaluate the psychometric properties (reliability and validity) and the diagnostic properties (sensitivity, specificity and predictive values) of the Chinese version of the Rowland Universal Dementia Assessment Scale. The accurate detection of early dementia requires screening tools with favourable cross-cultural linguistic and appropriate sensitivity, specificity, and predictive values, particularly for Chinese-speaking populations. This was a cross-sectional, descriptive study. Overall, 130 participants suspected to have cognitive impairment were enrolled in the study. A test-retest for determining reliability was scheduled four weeks after the initial test. Content validity was determined by five experts, whereas construct validity was established by using contrasted group technique. The participants' clinical diagnoses were used as the standard in calculating the sensitivity, specificity, positive predictive value and negative predictive value. The study revealed that the Chinese version of the Rowland Universal Dementia Assessment Scale exhibited a test-retest reliability of 0.90, an internal consistency reliability of 0.71, an inter-rater reliability (kappa value) of 0.88 and a content validity index of 0.97. Both the patients and healthy contrast group exhibited significant differences in their cognitive ability. The optimal cut-off points for the Chinese version of the Rowland Universal Dementia Assessment Scale in the test for mild cognitive impairment and dementia were 24 and 22, respectively; moreover, for these two conditions, the sensitivities of the scale were 0.79 and 0.76, the specificities were 0.91 and 0.81, the areas under the curve were 0.85 and 0.78, the positive predictive values were 0.99 and 0.83 and the negative predictive values were 0.96 and 0.91 respectively. The Chinese version of the Rowland Universal Dementia Assessment Scale exhibited sound reliability, validity, sensitivity, specificity and predictive values. This scale can help clinical staff members to quickly and accurately diagnose cognitive impairment and provide appropriate treatment as early as possible. © 2015 John Wiley & Sons Ltd.

[Desing and validation of a scale to measure caregiving dedication in caregivers of dependent older people].

PubMed

Serrano-Ortega, Natalia; Frías-Osuna, Antonio; Recio-Gómez, Juan M; Del-Pino-Casado, Rafael

2015-11-01

To develop and validate a scale to measure caregiving dedication regarding activities of daily living in caregivers of dependent older people. Cross-sectional study. Primary Health Care (Andalusia, Spain). a probabilistic sample of 200 caregivers of older relatives from Córdoba, Spain. Content validation by experts, construct validity (by exploratory factor analysis), divergent validity and reliability (internal consistency, test-retest reliability and inter-observers reliability). Cronbach's alpha was 0.86. Intraclass Correlation Coefficient was 0.96 for test-retest reliability and 0.88 for inter-observers reliability. When the sample was divided in two groups according to perceived burden level (presence and absence), the perceived burden was significantly different in each group (P=.001). The factor analysis revealed one only factor that explained 64% of the variance. The scale allows a suitable measure of caregiving dedication regarding activities of daily living in caregivers of older people, because this scale allows a quickly, easy administration, is well accepted by caregivers, has acceptable psychometric results and includes the frequency of caregiving, the kind of attended need and the dependence level in each need. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Hypertension Knowledge-Level Scale (HK-LS): a study on development, validity and reliability.

PubMed

Erkoc, Sultan Baliz; Isikli, Burhanettin; Metintas, Selma; Kalyoncu, Cemalettin

2012-03-01

This study was conducted to develop a scale to measure knowledge about hypertension among Turkish adults. The Hypertension Knowledge-Level Scale (HK-LS) was generated based on content, face, and construct validity, internal consistency, test re-test reliability, and discriminative validity procedures. The final scale had 22 items with six sub-dimensions. The scale was applied to 457 individuals aged ≥ 18 years, and 414 of them were re-evaluated for test-retest reliability. The six sub-dimensions encompassed 60.3% of the total variance. Cronbach alpha coefficients were 0.82 for the entire scale and 0.92, 0.59, 0.67, 0.77, 0.72, and 0.76 for the sub-dimensions of definition, medical treatment, drug compliance, lifestyle, diet, and complications, respectively. The scale ensured internal consistency in reliability and construct validity, as well as stability over time. Significant relationships were found between knowledge score and age, gender, educational level, and history of hypertension of the participants. No correlation was found between knowledge score and working at an income-generating job. The present scale, developed to measure the knowledge level of hypertension among Turkish adults, was found to be valid and reliable.

Development and psychometric testing of the Mariani Nursing Career Satisfaction Scale.

PubMed

Mariani, Bette; Allen, Lois Ryan

2014-01-01

The Mariani Nursing Career Satisfaction Scale (MNCSS) was developed to explore the influence of mentoring on career satisfaction of registered nurses (RNs). A review of the literature revealed no contemporary valid and reliable measure of career satisfaction. The MNCSS is a semantic differential of 16 opposite adjective pairs on which participants rate feelings about their nursing career. The MNCSS was used in a pilot study and three major studies exploring career satisfaction of RNs. Validity, reliability, and exploratory factor analysis (FA) were computed to explore the internal structure of the instrument. The newly developed instrument had a content validity index (CVI) of .84 and Cronbach's alpha internal consistency reliabilities of .93-.96 across three major studies. Exploratory FA (N = 496) revealed a univocal instrument with one factor that explains 57.8% of the variance in career satisfaction scores. The MNCSS is a valid and reliable instrument for measuring career satisfaction. FA of the combined data from three studies yielded one factor that measures the concept of career satisfaction.

Translation, Cross-cultural Adaptation and Validation of the Farsi Version of NIH Task Force's Recommended Multidimensional Minimal Dataset for Research on Chronic Low Back Pain.

PubMed

Noormohammadpour, Pardis; Tavana, Bahareh; Mansournia, Mohammad Ali; Zeinalizadeh, Mehdi; Mirzashahi, Babak; Rostami, Mohsen; Kordi, Ramin

2018-05-01

Translation and cultural adaptation of the National Institutes of Health (NIH) Task Force's minimal dataset. The purpose of this study was to evaluate validity and reliability of the Farsi version of NIH Task Force's recommended multidimensional minimal dataset for research on chronic low back pain (CLBP). Considering the high treatment cost of CLBP and its increasing prevalence, NIH Pain Consortium developed research standards (including recommendations for definitions, a minimum dataset, and outcomes' report) for studies regarding CLBP. Application of these recommendations could standardize research and improve comparability of different studies in CLBP. This study has three phases: translation of dataset into Farsi and its cultural adaptation, assessment of pre-final version of dataset's comprehensibility via a pilot study, and investigation of the reliability and validity of final version of translated dataset. Subjects were 250 patients with CLBP. Test-retest reliability, content validity, and convergent validity (correlations among different dimensions of dataset and Farsi versions of Oswestry Disability Index, Roland Morris Disability Questionnaire, Fear-Avoidance Belief Questionnaire, and Beck Depression Inventory-II) were assessed. The Farsi version demonstrated good/excellent convergent validity (the correlation coefficient between impact dimension and ODI was r = 0.75 [P < 0.001], between impact dimension and Roland-Morris Disability Questionnaire was r = 0.80 [P < 0.001], and between psychological dimension and BDI was r = 0.62 [P < 0.001]). The test-retest reliability was also strong (intraclass correlation coefficient value ranged between 0.70 and 0.95) and the internal consistency was good/excellent (Chronbach's alpha coefficients' value for two main dimensions including impact dimension and psychological dimension were 0.91 and 0.82 [P < 0.001], respectively). In addition, its face validity and content validity were acceptable. The Farsi version of minimal dataset for research on CLBP is a reliable and valid instrument for data gathering in patients with CLBP. This minimum dataset can be a step toward standardization of research regarding CLBP. 3.

Reliability and Validity of the Turkish Version of the Gastrointestinal Symptom Rating Scale.

PubMed

Turan, Nuray; Aşt, Türkinaz Atabek; Kaya, Nurten

The purpose of this methodological study is to investigate the validity and reliability of the Turkish version of the Gastrointestinal Symptom Rating Scale (GSRS). The scale was adapted to the Turkish language via backward translation. Content validity was examined by referring to experts. Reliability was examined via test-retest reliability and internal consistency, and validity was examined with divergent and convergent validity. The Epworth Sleepiness Scale (ESS) and the Marlowe-Crowne Social Desirability Scale (MCSDS) were used for divergent validity. As for convergent validity, the Constipation Severity Instrument (CSI) and the Patient Assessment of Constipation Quality of Life Scale (PAC-QOLQ) were utilized. The relationship between the GSRS and the health-related quality of life (36-item short-form health survey [SF-36]) was also analyzed. The study population consisted of patients in orthopedic clinic who volunteered to participate. Test-retest reliability was examined with the participation of 30 patients; internal consistency and validity were examined with 150 patients. Test-retest reliability correlation coefficients of the GSRS varied from 0.39 to 0.87 for all items. For internal consistency, the GSRS's item total correlation was found to be 0.17-0.67, and Cronbach α was 0.82 for all items. There was a positive linear significant correlation between the GSRS, CSI, and PAC-QOLQ. There was no significant correlation between the GSRS, MCSDS, and ESS. Higher GSRS scores inversely correlated with general quality of life (SF-36). The Turkish version of the GSRS has been found to be a reliable and valid instrument for assessing patients' gastrointestinal symptoms. Therefore, this instrument can be confidently used with Turkish individuals.

A Chinese version of the revised Nurses Professional Values Scale: reliability and validity assessment.

PubMed

Lin, Yu-Hua; Wang, Liching Sung

2010-08-01

The purpose of this study was to assess the reliability and validity of a Chinese version of the revised nurses professional values scale (NPVS-R). The convenient sampling method, including senior undergraduate nursing students (n=110) and clinical nurses (n=223), was applied to recruit appropriate samples from southern Taiwan. The revised nurses professional values scale (NPVS-R) was used in this study. Content validity, construct validity, internal consistency, and reliability were assessed. The final sample consisted of 286 subjects. three factors were detected in the results, accounting for 60.12% of the explained variance. The first factor was titled professionalism, and included 13 items. The second factor was named caring, and consisted of seven items. Activism was the third factor, which included six items. Overall Cronbach's alpha coefficient was 0.90, taken from values for each of the three factors of 0.88, 0.90, and 0.81, respectively. The Chinese version of the NPVS-R can be considered a reliable and valid scale for assigning values that can mark professionalism in Taiwanese nurses. Copyright 2009 Elsevier Ltd. All rights reserved.

Development and testing of the questionnaire CEC-61: Knowledge about cervical cancer in Chilean adolescents.

PubMed

Urrutia, María Teresa; Gajardo, Macarena; Padilla, Oslando

2017-05-22

Despite a clear association between human papillomavirus and cervical cancer, knowledge in adolescent populations regarding the disease and methods for its detection and prevention is deficient. The aim of this study was to develop and test a new questionnaire concerning knowledge on cervical cancer. An instrument was developed and validated to measure knowledge in 226 Chilean adolescents between April and June 2011. Content validity, construct validity, and reliability analysis of the instrument were performed. The new, validated instrument, called CEC-61 (Conocimientos en Cancer Cérvicouterino-61 items/Knowledge in Cervical Cancer-61 items), contains nine factors and 61 items. The new questionnaire explained 81% of the variance with a reliability of 0.96. The assessment of knowledge with a valid and reliable instrument is the first step in creating interventions for a population and to encourage appropriate preventive behavior. CEC-61 is highly reliable and has a clear factorial structure to evaluate knowledge in nine domains related to cervical cancer disease, cervical cancer risk, papilloma virus infection, the Papanicolaou test, and the papilloma virus vaccine.

The Validity and reliability of the Comprehensive Home Environment Survey (CHES).

PubMed

Pinard, Courtney A; Yaroch, Amy L; Hart, Michael H; Serrano, Elena L; McFerren, Mary M; Estabrooks, Paul A

2014-01-01

Few comprehensive measures exist to assess contributors to childhood obesity within the home, specifically among low-income populations. The current study describes the modification and psychometric testing of the Comprehensive Home Environment Survey (CHES), an inclusive measure of the home food, physical activity, and media environment related to childhood obesity. The items were tested for content relevance by an expert panel and piloted in the priority population. The CHES was administered to low-income parents of children 5 to 17 years (N = 150), including a subsample of parents a second time and additional caregivers to establish test-retest and interrater reliabilities. Children older than 9 years (n = 95), as well as parents (N = 150) completed concurrent assessments of diet and physical activity behaviors (predictive validity). Analyses and item trimming resulted in 18 subscales and a total score, which displayed adequate internal consistency (α = .74-.92) and high test-retest reliability (r ≥ .73, ps < .01) and interrater reliability (r ≥ .42, ps < .01). The CHES score and a validated screener for the home environment were correlated (r = .37, p < .01; concurrent validity). CHES subscales were significantly correlated with behavioral measures (r = -.20-.55, p < .05; predictive validity). The CHES shows promise as a valid/reliable assessment of the home environment related to childhood obesity, including healthy diet and physical activity.

Translation and validation of the Cardiac Depression Scale to Arabic.

PubMed

Papasavvas, T; Al-Amin, H; Ghabrash, H F; Micklewright, D

2016-08-01

The Cardiac Depression Scale (CDS) has been designed to measure depressive symptoms in patients with heart disease. There is no Arabic version of the CDS. We translated and validated the CDS in an Arabic sample of patients with heart disease. Forward and back translation of the CDS was followed by assessment of cultural relevance and content validity. The Arabic version of the CDS (A-CDS) and the Arabic version of the Hospital Anxiety and Depression Scale (A-HADS) were then administered to 260 Arab in-patients with heart disease from 18 Arabic countries. Construct validity was assessed using exploratory factor analysis with polychoric correlations. Internal consistency was assessed using ordinal reliability alpha and item-to-factor polychoric correlations. Concurrent validity was assessed using Pearson's correlation coefficient between the A-CDS and the depression subscale of the A-HADS (A-HADS-D). Cultural relevance and content validity of the A-CDS were satisfactory. Exploratory factor analysis revealed three robust factors, without cross-loadings, that formed a single dimension. Internal consistency was high (ordinal reliability alpha for the total scale and the three factors were .94, .91, .86, and .87, respectively; item-to-factor correlations ranged from .77 to .91). Concurrent validity was high (r=.72). The A-CDS demonstrated a closer to normal distribution of scores than the A-HADS-D. Sensitivity and specificity of the A-CDS were not objectively assessed. The A-CDS appears to be a valid and reliable instrument to measure depressive symptoms in a representative sample of Arab in-patients with heart disease. Copyright © 2016 Elsevier B.V. All rights reserved.

Developing scale for colleague solidarity among nurses in Turkey.

PubMed

Uslusoy, Esin Cetinkaya; Alpar, Sule Ecevit

2013-02-01

There is a need for an appropriate instrument to measure colleague solidarity among nurses. This study was carried out to develop a Colleague Solidarity of Nurses' Scale (CSNS). This study was planned to be descriptive and methodological. The CSNS examined content validity, construct validity, test-retest reliability and internal consistency reliability. The trial form of the CSNS, which was composed of 44 items, was given to 200 nurses, followed by validity and reliability analyses. Following the analyses, 21 items were excluded from the scale, leaving an attitude scale made up of 23 items. Factor analysis of the data showed that the scale has a three sub-factor structure: emotional solidarity, academic solidarity and negative opinions about solidarity. The Cronbach's alpha reliability of the whole scale was 0.80. This study provides evidence that the CSNS possesses robust solidarity among nurses. © 2013 Wiley Publishing Asia Pty Ltd.

Assessment of Physical Self-Concept in Adolescents with Intellectual Disability: Content and Factor Validity of the Very Short Form of the Physical Self-Inventory

ERIC Educational Resources Information Center

Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Ninot, Gregory

2009-01-01

The purpose of this study was to test the factor validity and reliability of the Very Short Form of the Physical Self-Inventory- (PSI-VSF) within a sample of adolescents with mild to moderate Intellectual Disability (ID). A total of 362 ID adolescents were involved in two studies. In Study 1, the content and format scale response of the PSI-VSF…

Reliability and validity of a Chinese version of the Multidimensional Fatigue Symptom Inventory-Short Form (MFSI-SF-C).

PubMed

Pien, Li-Chung; Chu, Hsin; Chen, Wen-Chun; Chang, Yu-Shiun; Liao, Yuan-Mei; Chen, Chiung-Hua; Chou, Kuei-Ru

2011-08-01

To examine the psychometric properties of the Chinese version of the Multidimensional Fatigue Symptom Inventory-Short Form (MFSI-SF-C) for use in Chinese-speaking countries. The assessment of fatigue is a challenging task for most researchers because culture may influence perceptions of meaning of fatigue. The lack of examination of the psychometric properties of the fatigue measures across studies limits the scientific rigour for generating additional research on the concept of 'fatigue.' A cross-sectional study. The study recruited 107 cancer inpatients from two medical centres in Taiwan. The MFSI-SF-C was examined using a two step process: (1) Translation and back-translation of the instrument; and (2) Examination of internal consistency reliability, test-retest reliability, content validity and construct validity. The results showed that the Cronbach's α of MFSI-SF-C total scale and subscales ranged between 0·83-0·92. The content validity index was 0·93. The difference between the fatigue of cancer patients and the comparison group of healthy people in the community was significant. The results demonstrated good convergent validity when comparing fatigue with depression and quality of life. Factor analysis confirmed the four dimensions of fatigue: physical, emotional, mental and vigour. It showed moderate intercorrelation between subscales and high factor loadings also helped to clarify the psychometric meaning. The reliability and validity information presented in this article support the use of the Chinese version of the MFSI-SF as a research instrument for measuring fatigue in Chinese populations. This study also provides evidence that the MFSI-SF possesses robust psychometric properties. The MFSI-SF-C is an effective and comprehensive tool for measuring fatigue in Chinese patients with cancer. © 2011 Blackwell Publishing Ltd.

Measuring the reliability and validity of the Greek edition of the Diabetes Quality of Life Brief Clinical Inventory.

PubMed

Rekleiti, Maria; Souliotis, Kyriakos; Sarafis, Pavlos; Kyriazis, Ioannis; Tsironi, Maria

2018-06-01

The present study focuses on studying the validity and reliability of the Greek edition of DQOL-BCI. DQOL-BCI includes 15 questions-elements that are evaluated on a 5-grade scale like Likert and two general form-shapes. The translation process was conducted in conformity with the guidelines of EuroQol group. A non-random sample of 65 people-patients diagnosed with diabetes I and II was selected. The questionnaire that was used to collect the data was the translated version of DQOL-BCI, and included the demographic characteristics of the interviewees. The content validity of DQOL-BCI was re-examined from a team of five experts (expert panel) for qualitative and quantitative performance. The completion of the questionnaire was done via a personal interview. The sample consisted of 58 people (35 men and 23 women, 59.9 ± 10.9 years). The translation of the questionnaire was found appropriate in accordance to the peculiarities of the Greek language and culture. The largest deviation of values is observed in QOL1 (1.71) in comparison to QOL6 (2.98). The difference between the standard deviations is close to 0.6. The statistics results of the tests showed satisfactory content validity and high construct validity, while the high values for Cronbach alpha index (0.95) reveal high reliability and internal consistency. The Greek version of DQOL-BCI has acceptable psychometric properties and appears to demonstrate high internal reliability and satisfactory construct validity, which allows its use as an important tool in evaluating the quality of life of diabetic patients in relation to their health. Copyright © 2018. Published by Elsevier B.V.

Validation of the "Security Needs Assessment Profile" for measuring the profiles of security needs of Chinese forensic psychiatric inpatients.

PubMed

Siu, B W M; Au-Yeung, C C Y; Chan, A W L; Chan, L S Y; Yuen, K K; Leung, H W; Yan, C K; Ng, K K; Lai, A C H; Davies, S; Collins, M

Mapping forensic psychiatric services with the security needs of patients is a salient step in service planning, audit and review. A valid and reliable instrument for measuring the security needs of Chinese forensic psychiatric inpatients was not yet available. This study aimed to develop and validate the Chinese version of the Security Needs Assessment Profile for measuring the profiles of security needs of Chinese forensic psychiatric inpatients. The Security Needs Assessment Profile by Davis was translated into Chinese. Its face validity, content validity, construct validity and internal consistency reliability were assessed by measuring the security needs of 98 Chinese forensic psychiatric inpatients. Principal factor analysis for construct validity provided a six-factor security needs model explaining 68.7% of the variance. Based on the Cronbach's alpha coefficient, the internal consistency reliability was rated as acceptable for procedural security (0.73), and fair for both physical security (0.62) and relational security (0.58). A significant sex difference (p=0.002) in total security score was found. The Chinese version of the Security Needs Assessment Profile is a valid and reliable instrument for assessing the security needs of Chinese forensic psychiatric inpatients. Copyright © 2017 Elsevier Ltd. All rights reserved.

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire.

PubMed

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. A descriptive-analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser-Meyer-Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students.

Meta-Analysis of Armed service Vocational Aptitude Battery Subtest Validity Data

DTIC Science & Technology

1988-12-01

underprivelaged groups ( Gottfredson , 1986). Revisionist beliefs are similar, yet are more extreme. They contend that intelligence and educational...correlation with intelligence measures (.6) 18 ( Gottfredson , 1986). Attempts at social revisions with the dual goals of increasing both equality and... intelligence measures. The ASVAB will then be described in terms of its history, content, reliability, and validity. Lastly, validity generalization and

Assessment scale of risk for surgical positioning injuries 1

PubMed Central

Lopes, Camila Mendonça de Moraes; Haas, Vanderlei José; Dantas, Rosana Aparecida Spadoti; de Oliveira, Cheila Gonçalves; Galvão, Cristina Maria

2016-01-01

ABSTRACT Objective: to build and validate a scale to assess the risk of surgical positioning injuries in adult patients. Method: methodological research, conducted in two phases: construction and face and content validation of the scale and field research, involving 115 patients. Results: the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning contains seven items, each of which presents five subitems. The scale score ranges between seven and 35 points in which, the higher the score, the higher the patient's risk. The Content Validity Index of the scale corresponded to 0.88. The application of Student's t-test for equality of means revealed the concurrent criterion validity between the scores on the Braden scale and the constructed scale. To assess the predictive criterion validity, the association was tested between the presence of pain deriving from surgical positioning and the development of pressure ulcer, using the score on the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning (p<0.001). The interrater reliability was verified using the intraclass correlation coefficient, equal to 0.99 (p<0.001). Conclusion: the scale is a valid and reliable tool, but further research is needed to assess its use in clinical practice. PMID:27579925

IMatter: validation of the NHS Scotland Employee Engagement Index.

PubMed

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

Tests examining skill outcomes in sport: a systematic review of measurement properties and feasibility.

PubMed

Robertson, Samuel J; Burnett, Angus F; Cochrane, Jodie

2014-04-01

A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete's ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification. The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature. A search of both SPORTDiscus and MEDLINE databases was undertaken. Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria. A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review. A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95%) of the reviewed studies investigated test-retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68% of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18% of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14% investigating the predictive validity of the test. Test responsiveness was reported in only 9% of studies, whilst feasibility received varying levels of attention. In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally. Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test-retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

The PRECIS-2 tool has good interrater reliability and modest discriminant validity.

PubMed

Loudon, Kirsty; Zwarenstein, Merrick; Sullivan, Frank M; Donnan, Peter T; Gágyor, Ildikó; Hobbelen, Hans J S M; Althabe, Fernando; Krishnan, Jerry A; Treweek, Shaun

2017-08-01

PRagmatic Explanatory Continuum Indicator Summary (PRECIS)-2 is a tool that could improve design insight for trialists. Our aim was to validate the PRECIS-2 tool, unlike its predecessor, testing the discriminant validity and interrater reliability. Over 80 international trialists, methodologists, clinicians, and policymakers created PRECIS-2 helping to ensure face validity and content validity. The interrater reliability of PRECIS-2 was measured using 19 experienced trialists who used PRECIS-2 to score a diverse sample of 15 randomized controlled trial protocols. Discriminant validity was tested with two raters to independently determine if the trial protocols were more pragmatic or more explanatory, with scores from the 19 raters for the 15 trials as predictors of pragmatism. Interrater reliability was generally good, with seven of nine domains having an intraclass correlation coefficient over 0.65. Flexibility (adherence) and recruitment had wide confidence intervals, but raters found these difficult to rate and wanted more information. Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. We have assessed the validity and reliability of PRECIS-2. An elaboration study and web site provide guidance to help future users of the tool which is continuing to be tested by trial teams, systematic reviewers, and funders. Copyright © 2017 Elsevier Inc. All rights reserved.

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.

Translation and linguistic validation of the Persian version of the Bristol Female Lower Urinary Tract Symptoms instrument.

PubMed

Pourmomeny, Abbas Ali; Rezaeian, Zahra Sadat; Soltanmohamadi, Mahsa

2017-09-01

The aim of this study was to evaluate the psychometric properties of the Persian version of the International Consultation on Incontinence Modular Questionnaire for Female Lower Urinary Tract Symptoms (ICIQ-FLUTS) in patients with urinary tract dysfunction. After gaining permission from the International Consultation on Incontinence Modular Questionnaire (ICIQ) advisory board, the English Female Lower Urinary Tract Symptoms (FLUTS) questionnaire was translated into Persian and then translated back into English. One hundred fourteen women with pelvic floor dysfunction were asked to complete the Persian FLUTS and International Consultation on Incontinence Modular Questionnaire Overactive Bladder Questionnaire (ICIQ-OAB). The Persian FLUTS questionnaire was also readministered to 20 patients 2 weeks after their initial visit. Study data were analyzed using SPSS V16.0. To validate the translated questionnaire, we assayed content/face validity, internal consistency/reliability, and construct validity. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and the intraclass correlation coefficient (ICC) respectively. The mean age of the patients was 48.8 years old, 84% were married, and 59% had at least one Caesarean. Except for very few missing data, there is no any ambiguity in the Persian version of the FLUTS questionnaire. The Cronbach's alpha was 0.83, indicating a high internal consistency. Concerning criterion validity, correlation between the Persian FLUTS and the OAB was 0.77 (p < 0.001). The initial testing of the Persian version of the FLUTS questionnaire demonstrates good internal consistency, content validity, and reliability.

Reliability and Validation of the International Consultation on Incontinence Questionnaire in Over Active Bladder to Persian Language.

PubMed

Sari Motlagh, Reza; Hajebrahimi, Sakineh; Sadeghi-Bazargani, Homayoun; Joodi Tutunsaz, Javad

2015-05-01

Overactive bladder syndrome is a common syndrome in the world in both men and women. Correct diagnosis and accurate measurement of symptoms severity and also quality of life of patients is necessary to ensure proper treatment and to facilitate sound relationships among patients, researchers and doctors. The International Consultation on Incontinence Questionnaire in Over Active Bladder (ICIQ-OAB) questionnaire is a concise and strong tool to evaluate the symptoms of OAB and their effects on patients' quality of life and treatment results. The objective of this study was to translate and validate a simple and strong tool that could be used in clinics and research. First, the original British English questionnaire was translated into Persian by two bilingual and originally Persian-speaking translators. Then the Persian version was back translated to English and a native English speaker studied and compared the questionnaire with the original version. At the end, the translated and corrected Persian version was finalized by a research team. Content validity of the items and ensuring that the questions could convey the main concept to readers was assessed through Modified Content Validity Index (MCVI). Reliability was calculated by Cronbach's α coefficient. Internal Consistency of the questionnaire with the calculation of Kendall correlation coefficient were evaluated by performing test-retest in 50 participants. The modified content validity index was > 0.78 for all of the questions. Cronbach's α coefficient was calculated 0.76 for all of the participants. Kendall correlation coefficient was calculated for test-re-test assessment 0.66. Both of which indicates the reliability of this questionnaire. Persian version of ICIQ-OAB questionnaire is a simple and strong tool for research, treatment and screening purposes. © 2014 Wiley Publishing Asia Pty Ltd.

The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.

PubMed

Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan

2017-12-25

The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P < 0.05). Discriminative validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P < 0.001). The VCDQ was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Interrater reliability to assure valid content in peer review of CME-accredited presentations.

PubMed

Quigg, Mark; Lado, Fred A

2009-01-01

The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of peer-review audits for ACCME accreditation and designation of American Medical Association Category 1 Credit(TM) is unknown. Categories of presentation defects were constructed from discussions of the CME committee of the American Epilepsy Society: (1) insufficient citation, (2) poor formatting, (3) nonacknowledgment of non-FDA-approved use, (4) misapplied data, (5) 1-sided data, (6) self- or institutional promotion, (7) conflict of interest/commercial bias, (8) other, or (9) no defect. A PowerPoint lecture (n = 29 slides) suitable for presentation to general neurologists was purposefully created with the above defects. A multirater, multilevel kappa statistic was determined from the number and category of defects. Of 14 reviewers, 12 returned completed surveys (86%) identifying a mean +/- standard deviation 1.6 +/- 1.1 defects/slide. The interrater kappa equaled 0.115 (poor reliability) for number of defects/slides. No individual categories achieved kappa > 0.38. Interrater reliability on the rating of durable materials used in subspecialty CME was poor. Guidelines for CME appropriate content are too subjective to be applied reliably by raters knowledgeable in their specialty field but relatively untrained in the specifics of CME requirements. The process of peer review of CME materials would be aided by education of physicians on validation of materials appropriate for CME.

Evaluative frailty index for physical activity (EFIP): a reliable and valid instrument to measure changes in level of frailty.

PubMed

de Vries, Nienke M; Staal, J Bart; Olde Rikkert, Marcel G M; Nijhuis-van der Sanden, Maria W G

2013-04-01

Physical activity is assumed to be important in the prevention and treatment of frailty. It is unclear, however, to what extent frailty can be influenced because instruments designed to assess frailty have not been validated as evaluative outcome instruments in clinical practice. The aims of this study were: (1) to develop a frailty index (i.e., the evaluative frailty index for physical activity [EFIP]) based on the method of deficit accumulation and (2) to test the clinimetric properties of the EFIP. The content of the EFIP was determined using a written Delphi procedure. Intrarater reliability, interrater reliability, and construct validity were determined in an observational study (n=24). Intrarater reliability and interrater reliability were calculated using Cohen kappa and intraclass correlation coefficients (ICCs). Construct validity was determined by correlating the score on the EFIP with those on the timed "up & go" test (TUG), the performance-oriented mobility assessment (POMA), and the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Fifty items were included in the EFIP. Interrater reliability (Cohen kappa=0.72, ICC=.96) and intrarater reliability (Cohen kappa=0.77 and 0.80, ICC=.93 and .98) were good. As expected, a fair to moderate correlation with the TUG, POMA, and CIRS-G was found (.61, -.70, and .66, respectively). Reliability and validity of the EFIP have been tested in a small sample. These and other clinimetric properties, such as responsiveness, will be assessed or reassessed in a larger study population. The EFIP is a reliable and valid instrument to evaluate the effect of physical activity on frailty in research and in clinical practice.

[Spanish version of the Cancer Worry Scale (CWS). Cross cultural adaptation and validity and reliability analysis].

PubMed

Cabrera, Esther; Zabalegui, Adelaida; Blanco, Ignacio

2011-01-15

The worry for falling ill has been described as a key element in the change of preventive attitudes. Levels of cancer worry not well fitted have been associated with inadequate adherence to preventive strategies. There is not a Spanish validated scale to evaluate the degree of worry for the cancer in our population. The aim of the present study was to perform the cross cultural adaptation and validation of the Cancer Worry Scale described by Lerman. A translation, re-translation of the Cancer Worry Scale to Spanish was done. Validation of the Spanish scale was performed by means of the factorial analysis of principal components with the rotation varimax test in a sample of 200 healthy women with family history of breast cancer. The Escala de Preocupación por el Cáncer (EPC) is the Spanish version of the Cancer Worry Scale and it contains 6 items with a total value ranging from 6 (minimal worry) to 24 (maximum worry). The analysis of content validity demonstrated that the EPC is conceptually equivalent to the original scale. The factorial analysis showed a unique factor that explains 53.07% of the variance confirming the unique dimension. The EPC presented good reliability test - re-test with an Intraclass Correlation Coefficient of 0.777. The Cronbach's alpha was 0.835 for the complete of the scale. The EPC is a validated Spanish scale to measure the cancer worry in healthy individuals, which shows a correct content validity and reliability. Copyright © 2010 Elsevier España, S.L. All rights reserved.

A Psychometric Study of the Bayley Scales of Infant and Toddler Development in Persian Language Children

PubMed Central

AZARI, Nadia; SOLEIMANI, Farin; VAMEGHI, Roshanak; SAJEDI, Firoozeh; SHAHSHAHANI, Soheila; KARIMI, Hossein; KRASKIAN, Adis; SHAHROKHI, Amin; TEYMOURI, Robab; GHARIB, Masoud

2017-01-01

Objective Bayley Scales of infant & toddler development is a well-known diagnostic developmental assessment tool for children aged 1–42 months. Our aim was investigating the validity & reliability of this scale in Persian speaking children. Materials & Methods The method was descriptive-analytic. Translation- back translation and cultural adaptation was done. Content & face validity of translated scale was determined by experts’ opinions. Overall, 403 children aged 1 to 42 months were recruited from health centers of Tehran, during years of 2013-2014 for developmental assessment in cognitive, communicative (receptive & expressive) and motor (fine & gross) domains. Reliability of scale was calculated through three methods; internal consistency using Cronbach’s alpha coefficient, test-retest and interrater methods. Construct validity was calculated using factor analysis and comparison of the mean scores methods. Results Cultural and linguistic changes were made in items of all domains especially on communication subscale. Content and face validity of the test were approved by experts’ opinions. Cronbach’s alpha coefficient was above 0.74 in all domains. Pearson correlation coefficient in various domains, were ≥ 0.982 in test retest method, and ≥0.993 in inter-rater method. Construct validity of the test was approved by factor analysis. Moreover, the mean scores for the different age groups were compared and statistically significant differences were observed between mean scores of different age groups, that confirms validity of the test. Conclusion The Bayley Scales of Infant and Toddler Development is a valid and reliable tool for child developmental assessment in Persian language children. PMID:28277556

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men.

PubMed

Hussein, Ahmed A; Sexton, Kevin J; May, Paul R; Meng, Maxwell V; Hosseini, Abolfazl; Eun, Daniel D; Daneshmand, Siamak; Bochner, Bernard H; Peabody, James O; Abaza, Ronney; Skinner, Eila C; Hautmann, Richard E; Guru, Khurshid A

2018-04-13

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men. A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation. The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains. We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.

Development and Validation of the Biobanking Attitudes and Knowledge Survey (BANKS)

PubMed Central

Wells, Kristen J.; Arevalo, Mariana; Meade, Cathy D.; Gwede, Clement K.; Quinn, Gwendolyn P.; Luque, John S.; Miguel, Gloria San; Watson, Dale; Phillips, Rebecca; Reyes, Carmen; Romo, Margarita; West, Jim; Jacobsen, Paul B.

2014-01-01

Background No validated multi-scale instruments exist that measure community members’ views on biobanking and biospecimen donation. This study describes the development and psychometric properties of the English-language BANKS (Biobanking Attitudes aNd Knowledge Survey). Methods The BANKS was created by item generation through review of scientific literature, focus groups with community members, and input from a community advisory board. Items were refined through cognitive interviews. Content validity was assessed through an expert panel review. Psychometric properties of the BANKS were assessed in a sample of 85 community members. Results The final BANKS includes 3 scales: Attitudes, Knowledge, and Self-Efficacy; as well as 3 single items, which evaluated receptivity and intention to donate a biospecimen for research. Cronbach's alpha coefficients for two scales that use Likert response format indicated high internal consistency (Attitudes: α=.88; Self-Efficacy: α=.95). Content validity indices were moderate, ranging from 0.69 to 0.89. Intention to donate blood and intention to donate urine were positively correlated with attitudes, knowledge, self-efficacy, and receptivity to learning more about biobanking (p's range from .029 to <.001). Conclusions The final BANKS shows evidence of satisfactory reliability and validity, is easy to administer, and is a promising tool to inform biospecimen research. Additional studies should be conducted with larger samples considering biospecimen donation to further assess the instrument's reliability and validity. Impact A valid and reliable instrument measuring community members’ views about biobanking may help researchers evaluate relevant communication interventions to enhance understanding, intention, and actual biospecimen donation. A Spanish-language BANKS is under development. PMID:24609846

Validity, Reliability and Feasibility of the Eating Behavior Pattern Questionnaire (EBPQ) among Iranian Female Students

PubMed Central

Dehghan, Parvin; Asghari-Jafarabadi, Mohammad; Salekzamani, Shabnam

2015-01-01

Background: The aim of this study was to assess the validity, reliability and feasibility of eating behavior pattern questionnaire (EBPQ) in female university students. Methods: In this study, after forward-backward translation, the questionnaire was reviewed by a panel of nutritionists and a psychologist and further thirty participants for the content validity measurement. The translated and modified questionnaire was completed by 225 female students of Tabriz University in 2013. Principle axis factoring, confirmatory factor analysis and known group analysis were conducted for construct, convergent and discriminant validity. Internal consistency and test–retest reliability were assessed by Cronbach’s α coefficient and intra-class correlation coefficient (ICC). Ceiling and floor effects were also performed for evaluating the feasibility of the instrument. Results: By using exploratory factor analysis, nine factors were extracted. Confirmatory factor analysis confirmed the convergent validity. Cronbach ’s αand ICC were ranged between 0.55 to 0.78 and 0.67 to 0.89, respectively. The significant difference for some three subscales between diabetes and healthy subjects determined the discriminant validity. No ceiling and floor effects were found. Conclusion: Our findings demonstrate the initial validity, reliability and feasibility of the Iranian version of EBPQ as a useful tool for eating behavior studies in young females. PMID:26290828

Validity and reliability of the Persian version of the Brief Aging Perceptions Questionnaire in Iranian older adults

PubMed Central

Sadegh Moghadam, Leila; Foroughan, Mahshid; Mohammadi Shahboulaghi, Farahnaz; Ahmadi, Fazlollah; Sajjadi, Moosa; Farhadi, Akram

2016-01-01

Background Perceptions of aging refer to individuals’ understanding of aging within their sociocultural context. Proper measurement of this concept in various societies requires accurate tools. Objective The present study was conducted with the aim to translate and validate the Brief Aging Perceptions Questionnaire (B-APQ) and assess its psychometric features in Iranian older adults. Method In this study, the Persian version of B-APQ was validated for 400 older adults. This questionnaire was translated into Persian according to the Wild et al’s model. The Persian version was validated using content, face, and construct (using confirmatory factor analysis) validities, and then its internal consistency and test–retest reliability were measured. Data were analyzed using the statistical software programs SPSS 18 and EQS-6.1. Results The confirmatory factor analysis confirmed construct validity and five subscales of B-APQ. Test–retest reliability with 3-week interval produced r=0.94. Cronbach’s alpha was found to be 0.75 for the whole questionnaire, and from 0.53 to 0.77 for the five factors. Conclusion The Persian version of B-APQ showed favorable validity and reliability, and thus it can be used for measuring different dimensions of perceptions of aging in Iranian older adults. PMID:27194907

Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management.

PubMed

Paddock, L E; Veloski, J; Chatterton, M L; Gevirtz, F O; Nash, D B

2000-07-01

To develop a reliable and valid questionnaire to measure patient satisfaction with diabetes disease management programs. Questions related to structure, process, and outcomes were categorized into 14 domains defining the essential elements of diabetes disease management. Health professionals confirmed the content validity. Face validity was established by a patient focus group. The questionnaire was mailed to 711 patients with diabetes who participated in a disease management program. To reduce the number of questionnaire items, a principal components analysis was performed using a varimax rotation. The Scree test was used to select significant components. To further assess reliability and validity; Cronbach's alpha and product-moment correlations were calculated for components having > or =3 items with loadings >0.50. The validated 73-item mailed satisfaction survey had a 34.1% response rate. Principal components analysis yielded 13 components with eigenvalues > 1.0. The Scree test proposed a 6-component solution (39 items), which explained 59% of the total variation. Internal consistency reliabilities computed for the first 6 components (alpha = 0.79-0.95) were acceptable. The final questionnaire, the Diabetes Management Evaluation Tool (DMET), was designed to assess patient satisfaction with diabetes disease management programs. Although more extensive testing of the questionnaire is appropriate, preliminary reliability and validity of the DMET has been demonstrated.

Validation of a pregnancy planning measure for Arabic-speaking women.

PubMed

Almaghaslah, Eman; Rochat, Roger; Farhat, Ghada

2017-01-01

The prevalence of unplanned pregnancy in Saudi Arabia has not been thoroughly investigated. To conduct a psychometric evaluation study of the Arabic version of the London Measure of Unplanned Pregnancy (LMUP). To evaluate the psychometric properties of the LMUP, we conducted a self-administered online survey among 796 ever-married Saudi women aged 20-49 years, and a re-test survey among 24 women. The psychometric properties evaluated included content validity measured by content validity index (CVI), structural validity assessed by exploratory factor analysis (EFA), substantive validity assessed by hypothesis testing, contextual stability for the test-retest assessed by weighted Kappa, and internal consistency assessed by Cronbach's alpha. The psychometric analysis of the Arabic version of LMUP exhibited valid and reliable properties. The CVIs for individual items and at the scale level were >0.7. EFA confirmed a unidimensional extraction of the scale item. Hypothesis testing confirmed expected associations. The tool was stable with weighted kappa = 0.78 and Cronbach's alpha = 0.88. In this study, the validity and reliability of the Arabic version of the LMUP were confirmed according to well-known psychometric criteria. This LMUP version can be used in research studies among Arabic-speaking women to measure unplanned pregnancy and investigate correlates and outcomes related to unplanned pregnancy.

Development and Validation of an Instrument to Assess the Implementation of Family-Centred Care in Traditional Open Bay Neonatal Intensive Care Units

ERIC Educational Resources Information Center

Al-Motlaq, Mohammad A.; Abuidhail, Jamila; Salameh, Taghreed; Awwad, Wesam

2017-01-01

Objective: To develop an instrument to study family-centred care (FCC) in traditional open bay Neonatal Intensive Care Units (NICUs). Methods: The development process involved constructing instrument's items, establishing content validity by an expert panel and testing the instrument for validity and reliability with a convenience sample of 25…

Content validity of critical success factors for e-Government implementation in Indonesia

NASA Astrophysics Data System (ADS)

Napitupulu, D.; Syafrullah, M.; Rahim, R.; Amar, A.; Sucahyo, YG

2018-05-01

The purpose of this research is to validate the Critical Success Factors (CSFs) of e-Government implementation in Indonesia. The e-Government initiative conducted only to obey the regulation but ignoring the quality. Defining CSFs will help government agencies to avoid failure of e-Government projects. A survey with the questionnaire was used to validate the item of CSF based on expert judgment through two round of Delphi. The result showed from 67 subjects in instrument tested; there are 11 invalid items deleted and remain only 56 items that had good content validity and internal reliability. Therefore, all 56 CSFs should be adopted by government agencies in Indonesia to support e-Government implementation.

Psychometric properties of the Anxiety Inventory for Respiratory Disease in patients with COPD in China.

PubMed

Dong, Xiao-Yan; Wang, Lan; Tao, Yan-Xia; Suo, Xiu-Li; Li, Yue-Chuan; Liu, Fang; Zhao, Yue; Zhang, Qing

2017-01-01

Anxiety is a common comorbidity in patients with COPD in China, and it can significantly decrease patients' quality of life. Almost all anxiety measurements contain somatic items that can overlap with symptoms of COPD and side effects of medicines, which can lead to bias in measuring anxiety in patients with COPD. Therefore, a brief and disease-specific non-somatic anxiety measurement scale, the Anxiety Inventory for Respiratory Disease (AIR), which has been developed and validated in its English version, is needed for patients with COPD in China. A two-center study was conducted in two tertiary hospitals in Tianjin, China. A total of 181 outpatients with COPD (mean age 67.21±8.10 years, 32.6% women), who met the inclusion and exclusion criteria, were enrolled in the study. Test-retest reliability was examined using intraclass correlation coefficients. The internal consistency was calculated by Cronbach's α . Content validity was examined using the Content Validity Index (CVI), scale-level CVI/universal agreement, and scale-level CVI/average agreement (S-CVI/Ave). Besides, convergent validity and construct validity were also examined. The AIR-C (AIR-Chinese version) scale had high test-retest reliability (intraclass correlation coefficient =0.904) and internal consistency (Cronbach's α =0.914); the content validity of the AIR-C scale was calculated by CVI, scale-level CVI/universal agreement, and S-CVI/Ave at values of 0.89-1, 0.90, and 0.98, respectively. Meanwhile, the AIR-C scale had good convergent validity, correlating with the Hospital Anxiety and Depression Scale-Anxiety ( r =0.81, P <0.01), and there were significant correlations between the AIR-C and Clinical COPD Questionnaire (CCQ; r =0.44, P <0.01) and Activities of Daily Living Scale (ADLS; r =0.36, P <0.01). A two-factor model of general anxiety and panic symptoms in the AIR-C scale had the best fit according to Confirmatory Factor Analysis (CFA). The AIR-C scale had a good reliability and validity for patients with COPD and can be used as a user-friendly and valid tool for measuring anxiety symptoms among patients with COPD in China.

Validity and reliability of the Bahasa Melayu version of the Migraine Disability Assessment questionnaire.

PubMed

Shaik, Munvar Miya; Hassan, Norul Badriah; Tan, Huay Lin; Bhaskar, Shalini; Gan, Siew Hua

2014-01-01

The study was designed to determine the validity and reliability of the Bahasa Melayu version (MIDAS-M) of the Migraine Disability Assessment (MIDAS) questionnaire. Patients having migraine for more than six months attending the Neurology Clinic, Hospital Universiti Sains Malaysia, Kubang Kerian, Kelantan, Malaysia, were recruited. Standard forward and back translation procedures were used to translate and adapt the MIDAS questionnaire to produce the Bahasa Melayu version. The translated Malay version was tested for face and content validity. Validity and reliability testing were further conducted with 100 migraine patients (1st administration) followed by a retesting session 21 days later (2nd administration). A total of 100 patients between 15 and 60 years of age were recruited. The majority of the patients were single (66%) and students (46%). Cronbach's alpha values were 0.84 (1st administration) and 0.80 (2nd administration). The test-retest reliability for the total MIDAS score was 0.73, indicating that the MIDAS-M questionnaire is stable; for the five disability questions, the test-retest values ranged from 0.77 to 0.87. The MIDAS-M questionnaire is comparable with the original English version in terms of validity and reliability and may be used for the assessment of migraine in clinical settings.

Validity and Reliability of the Bahasa Melayu Version of the Migraine Disability Assessment Questionnaire

PubMed Central

Shaik, Munvar Miya; Hassan, Norul Badriah; Bhaskar, Shalini; Gan, Siew Hua

2014-01-01

Background. The study was designed to determine the validity and reliability of the Bahasa Melayu version (MIDAS-M) of the Migraine Disability Assessment (MIDAS) questionnaire. Methods. Patients having migraine for more than six months attending the Neurology Clinic, Hospital Universiti Sains Malaysia, Kubang Kerian, Kelantan, Malaysia, were recruited. Standard forward and back translation procedures were used to translate and adapt the MIDAS questionnaire to produce the Bahasa Melayu version. The translated Malay version was tested for face and content validity. Validity and reliability testing were further conducted with 100 migraine patients (1st administration) followed by a retesting session 21 days later (2nd administration). Results. A total of 100 patients between 15 and 60 years of age were recruited. The majority of the patients were single (66%) and students (46%). Cronbach's alpha values were 0.84 (1st administration) and 0.80 (2nd administration). The test-retest reliability for the total MIDAS score was 0.73, indicating that the MIDAS-M questionnaire is stable; for the five disability questions, the test-retest values ranged from 0.77 to 0.87. Conclusion. The MIDAS-M questionnaire is comparable with the original English version in terms of validity and reliability and may be used for the assessment of migraine in clinical settings. PMID:25121099

Development and Validation of the Caring Loneliness Scale.

PubMed

Karhe, Liisa; Kaunonen, Marja; Koivisto, Anna-Maija

2016-12-01

The Caring Loneliness Scale (CARLOS) includes 5 categories derived from earlier qualitative research. This article assesses the reliability and construct validity of a scale designed to measure patient experiences of loneliness in a professional caring relationship. Statistical analysis with 4 different sample sizes included Cronbach's alpha and exploratory factor analysis with principal axis factoring extraction. The sample size of 250 gave the most useful and comprehensible structure, but all 4 samples yielded underlying content of loneliness experiences. The initial 5 categories were reduced to 4 factors with 24 items and Cronbach's alpha ranging from .77 to .90. The findings support the reliability and validity of CARLOS for the assessment of Finnish breast cancer and heart surgery patients' experiences but as all instruments, further validation is needed.

Measuring children's self-reported sport participation, risk perception and injury history: development and validation of a survey instrument.

PubMed

Siesmaa, Emma J; Blitvich, Jennifer D; White, Peta E; Finch, Caroline F

2011-01-01

Despite the health benefits associated with children's sport participation, the occurrence of injury in this context is common. The extent to which sport injuries impact children's ongoing involvement in sport is largely unknown. Surveys have been shown to be useful for collecting children's injury and sport participation data; however, there are currently no published instruments which investigate the impact of injury on children's sport participation. This study describes the processes undertaken to assess the validity of two survey instruments for collecting self-reported information about child cricket and netball related participation, injury history and injury risk perceptions, as well as the reliability of the cricket-specific version. Face and content validity were assessed through expert feedback from primary and secondary level teachers and from representatives of peak sporting bodies for cricket and netball. Test-retest reliability was measured using a sample of 59 child cricketers who completed the survey on two occasions, 3-4 weeks apart. Based on expert feedback relating to face and content validity, modification and/or deletion of some survey items was undertaken. Survey items with low test-retest reliability (κ≤0.40) were modified or deleted, items with moderate reliability (κ=0.41-0.60) were modified slightly and items with higher reliability (κ≥0.61) were retained, with some undergoing minor modifications. This is the first survey of its kind which has been successfully administered to cricketers aged 10-16 years to collect information about injury risk perceptions and intentions for continued sport participation. Implications for its generalisation to other child sport participants are discussed. Copyright © 2010 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Development of the caregivers attitude scale on home care of schizophrenics (CASHS)

PubMed Central

Balasubramanian, N; Sathyanarayana Rao, T. S.; D’Sa, Juliana Linnette

2014-01-01

Background: Schizophrenia is a severe mental disorder that elicits feelings of strangeness and discomfort, which may create stigma and lead to the social exclusion of the mentally ill and of the people relating with them. In the past decade, there has been an increase in the number of research studies on attitudes toward mental disorders. Materials and Methods: An instrument was developed to assess the attitude of primary caregivers on home care of schizophrenics. This article describes the development of a Likert scale, the Caregivers Attitude Scale on Home Care of Schizophrenics CASHS, which is a 31-item self-reported instrument that quantifies three aspects of home care, that is, attitude towards patient, towards treatment, and towards social interaction. The steps involved in its development are the review of literature, development of items, content validation, translation and language validity, pretesting, and reliability. Results: After establishing the content validity, the CASHS was pretested with five subjects. To establish the reliability of the CASHS, 21 primary caregivers were recruited through purposive sampling technique. In order to measure the stability between scores obtained, a test-retest reliability was computed using Karl Pearson correlation coefficient and the r value was 0.78. The internal consistency was measured using Cronbach's alpha and item-total correlation and the r value was 0.789. The item discrimination analysis was also computed and the value was of above 0.35. These statistical measurements indicate that the CASHS was reliable. Conclusions: The CASHS is a valid and reliable tool that can be utilized for assessing the attitude of primary caregivers on home care of schizophrenics. PMID:24574561

Reliability and validity of the German version of the Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (D-OAR).

PubMed

Spiekermann, Christoph; Rudack, Claudia; Stenner, Markus

2017-11-01

The outcome of aesthetic rhinoplasty is determined by the patient's subjective satisfaction with the nasal appearance which is difficult to assess. The Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (OAR) is a brief and reliable instrument to assess the influence of the subjective nasal appearance on quality of life in patients undergoing aesthetic rhinoplasty. Preoperative application of this questionnaire reveals important aspects and possible disturbances of the body image which could be negative predictors concerning the result. On the other hand, it represents an appropriate tool to assess the postoperative outcome. The aim of this study was to determine the validity, reliability and responsiveness of the adapted German version of the OAR (D-OAR). The adaption of the OAR to German language was performed by a forward and backward translation process. Patients undergoing rhinoplasty were asked to complete the D-OAR preoperatively, 1, 3 and 12 months after procedure and healthy volunteers without any nasal complaints served as controls to test validity, reliability and responsiveness. An excellent internal consistency, a good test-retest reliability and good inter-item and item-total correlations demonstrated a good reliability of the D-OAR. The convincing validity of the adapted version was proven by an excellent discriminant and a sufficient content validity. Significant differences between pre- and postoperative D-OAR scores revealed a good responsiveness of the instrument. Hence, with a sufficient validity, reliability and sensitivity to changes, the D-OAR is a short and helpful instrument to assess the subjective perception of the nasal appearance in German patients.

Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study.

PubMed

González-Chordá, Víctor M; Mena-Tudela, Desirée; Salas-Medina, Pablo; Cervera-Gasch, Agueda; Orts-Cortés, Isabel; Maciá-Soler, Loreto

2016-02-01

Writing a bachelor thesis (BT) is the last step to obtain a nursing degree. In order to perform an effective assessment of a nursing BT, certain reliable and valid tools are required. To develop and validate a 3-rubric system (drafting process, dissertation, and viva) to assess final year nursing students' BT. A multi-disciplinary study of content validity and psychometric properties. The study was carried out between December 2014 and July 2015. Nursing Degree at Universitat Jaume I. Spain. Eleven experts (9 nursing professors and 2 education professors from 6 different universities) took part in the development and content validity stages. Fifty-two theses presented during the 2014-2015 academic year were included by consecutive sampling of cases in order to study the psychometric properties. First, a group of experts was created to validate the content of the assessment system based on three rubrics (drafting process, dissertation, and viva). Subsequently, a reliability and validity study of the rubrics was carried out on the 52 theses presented during the 2014-2015 academic year. The BT drafting process rubric has 8 criteria (S-CVI=0.93; α=0.837; ICC=0.614), the dissertation rubric has 7 criteria (S-CVI=0.9; α=0.893; ICC=0.74), and the viva rubric has 4 criteria (S-CVI=0.86; α=8.16; ICC=0.895). A nursing BT assessment system based on three rubrics (drafting process, dissertation, and viva) has been validated. This system may be transferred to other nursing degrees or degrees from other academic areas. It is necessary to continue with the validation process taking into account factors that may affect the results obtained. Copyright © 2015 Elsevier Ltd. All rights reserved.

Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.

PubMed

Zendejas, Benjamin; Ruparel, Raaj K; Cook, David A

2016-02-01

The Fundamentals of Laparoscopic Surgery (FLS) program uses five simulation stations (peg transfer, precision cutting, loop ligation, and suturing with extracorporeal and intracorporeal knot tying) to teach and assess laparoscopic surgery skills. We sought to summarize evidence regarding the validity of scores from the FLS assessment. We systematically searched for studies evaluating the FLS as an assessment tool (last search update February 26, 2013). We classified validity evidence using the currently standard validity framework (content, response process, internal structure, relations with other variables, and consequences). From a pool of 11,628 studies, we identified 23 studies reporting validity evidence for FLS scores. Studies involved residents (n = 19), practicing physicians (n = 17), and medical students (n = 8), in specialties of general (n = 17), gynecologic (n = 4), urologic (n = 1), and veterinary (n = 1) surgery. Evidence was most common in the form of relations with other variables (n = 22, most often expert-novice differences). Only three studies reported internal structure evidence (inter-rater or inter-station reliability), two studies reported content evidence (i.e., derivation of assessment elements), and three studies reported consequences evidence (definition of pass/fail thresholds). Evidence nearly always supported the validity of FLS total scores. However, the loop ligation task lacks discriminatory ability. Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.

Cross-cultural adaptation of the VISA-P questionnaire for Greek-speaking patients with patellar tendinopathy.

PubMed

Korakakis, Vasileios; Patsiaouras, Asterios; Malliaropoulos, Nikos

2014-12-01

To cross-culturally adapt the VISA-P questionnaire for Greek-speaking patients and evaluate its psychometric properties. The VISA-P was developed in the English language to evaluate patients with patellar tendinopathy. The validity and use of self-administered questionnaires in different language and cultural populations require a specific procedure in order to maintain their content validity. The VISA-P questionnaire was translated and cross-culturally adapted according to specific guidelines. The validity and reliability were tested in 61 healthy recreational athletes, 64 athletes at risk from different sports, 32 patellar tendinopathy patients and 30 patients with other knee injuries. Participants completed the questionnaire at baseline and after 15-17 days. The questionnaire's face and content validity were judged as good by the expert committee, and the participants. Concurrent validity was almost perfect (ρ=-0.839, p<0.001). Also, factorial validity testing revealed a two-factor solution, which explained 85.6% of the total variance. A one-factor solution explained 80.8% of the variance when the other knee injury group was excluded. Known group validity was demonstrated by significant differences between patients compared with the asymptomatic groups (p<0.001). The VISA-P-GR exhibited very good test-retest reliability (ICC=0.818, p<0.001; 95% CI 0.758 to 0.864) and internal consistency since Cronbach's α analysis ranged from α=0.785 to 0.784 following a 15-17 days interval. The translated VISA-P-GR is a valid and reliable questionnaire and its psychometric properties are comparable with the original and adapted versions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Reliability and Validity of a Spanish Version of the Posttraumatic Growth Inventory

ERIC Educational Resources Information Center

Weiss, Tzipi; Berger, Roni

2006-01-01

Objectives. This study was designed to adapt and validate a Spanish translation of the Posttraumatic Growth Inventory (PTGI) for the assessment of positive life changes following the stressful experiences of immigration. Method. A cross-cultural equivalence model was used to pursue semantic, content, conceptual, and technical equivalence.…

Measuring leader perceptions of school readiness for reforms: use of an iterative model combining classical and Rasch methods.

PubMed

Chatterji, Madhabi

2002-01-01

This study examines validity of data generated by the School Readiness for Reforms: Leader Questionnaire (SRR-LQ) using an iterative procedure that combines classical and Rasch rating scale analysis. Following content-validation and pilot-testing, principal axis factor extraction and promax rotation of factors yielded a five factor structure consistent with the content-validated subscales of the original instrument. Factors were identified based on inspection of pattern and structure coefficients. The rotated factor pattern, inter-factor correlations, convergent validity coefficients, and Cronbach's alpha reliability estimates supported the hypothesized construct properties. To further examine unidimensionality and efficacy of the rating scale structures, item-level data from each factor-defined subscale were subjected to analysis with the Rasch rating scale model. Data-to-model fit statistics and separation reliability for items and persons met acceptable criteria. Rating scale results suggested consistency of expected and observed step difficulties in rating categories, and correspondence of step calibrations with increases in the underlying variables. The combined approach yielded more comprehensive diagnostic information on the quality of the five SRR-LQ subscales; further research is continuing.

The Importance of Positive Discipline Approach in Making Students Gain Multimedia Course Content

ERIC Educational Resources Information Center

Özan, Mukadder Boydak

2015-01-01

In this study, the importance of multimedia contents for effective learning, effective classroom management and building behaviors within the framework of positive discipline approach was emphasized. A questionnaire consisting of 24 items, whose validity and reliability were established, was prepared. The questionnaire was administered to 1474…

Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

PubMed

Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

2014-05-01

In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method of assessing and reporting whether items assess the intended theoretical construct and only that construct. In three studies, DCV was applied to measures of illness perceptions, control cognitions, and theory of planned behaviour response formats. Appendix S1 gives content validity indices for each item of each questionnaire investigated. Discriminant content validity is ideally applied while the measure is being developed, before using to measure the construct(s), but can also be applied after using a measure. © 2014 The British Psychological Society.

[Spanish version of the Satisfaction With Decision scale: cross-cultural adaptation, validity and reliability].

PubMed

Chabrera, Carolina; Areal, Joan; Font, Albert; Caro, Mónica; Bonet, Marta; Zabalegui, Adelaida

2015-01-01

The aim of this study is to develop a Spanish version of the Satisfaction With Decision scale (SWDs) and analyse the psychometric properties of validity and reliability. An observational, descriptive study and validation of a tool to measure satisfaction with the decision. Urology, Radiation oncology, and Medical oncology Departments of the Hospital Universitari Germans Trias i Pujol, Institut Català d'Oncologia and the Institut Oncològic del Vallès - Hospital General de Catalunya. A total of 170 participants diagnosed with prostate cancer, and who could read and write in Spanish and gave their informed consent. A translation, back-translation and cross-cultural adaptation to Spanish was performed on the SWDs. The content validity, criterion validity, construct validity and reliability (internal consistency and stability) of the Spanish version were evaluated. The SWDs contains 6 items with 5-item Likert scales. A Spanish version (ESD) was obtained that was linguistically and conceptually equivalent to the original version. Criterion validity, the ESD correlated with "satisfaction with the decision" using a linear analogue scale, was significant (r=0.63, P<.01) for all items. The factorial analysis showed a unique dimension to explain 82.08% of the variance. The ESD showed excellent results in terms of internal consistency (Cronbach alpha=0.95) and good test-retest reliability with intraclass correlation coefficient of 0.711. The ESD is a validated Spanish scale to measure the satisfaction with the decisions taken in health, and demonstrates a correct validity and reliability. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

[Reliability and construct validity of an instrument to asses the Self-perception of Family Health Status].

PubMed

Lima Rodríguez, Joaquín Salvador; Lima Serrano, Marta; Jiménez Picón, Nerea; Domínguez Sánchez, Isabel

2012-10-01

Family health determines and it is determined by family´s capacity to function effectively as a biosocial unit in a given culture and society. The main of study has been to test reliability and construct validity of an instrument to asses the Self-perception of Family Health Status. We validated its content by an on-line Dephi panel with experts. We surveyed 258 families in them homes or in primary health centres from Seville, Spain. We administered the instrument that has five Likert scales: Family climate, Family integrity, Family functioning, and Family resistance. We tested reliability by Cronbach Alpha and construct validity by exploratory factor analysis. The five scales obtained values α between 0.73 for the Family Climate and 0.89 for Family Integrity. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The scales showed their reliability and validity. They could be employed to assess the self-perception of family health status.

Validation of the Adherence Determinants Questionnaire scale among women with breast and cervical cancer1

PubMed Central

Lessa, Paula Renata Amorim; Ribeiro, Samila Gomes; Aquino, Priscila de Souza; de Almeida, Paulo Cesar; Pinheiro, Ana Karina Bezerra

2015-01-01

Objectives: the aim was to translate and culturally adapt the Adherence Determinants Questionnaire scale for the Portuguese language in the Brazilian context, and to check its reliability and validity to analyze the elements of the adherence of patients to the clinical treatment for breast and cervical cancer. Method: this was a methodological study, carried out in two oncology reference centers. The sample consisted of 198 participants, with 152 being treated for breast cancer and 46 being treated for cervical cancer. The content validation was performed by a committee of experts. The construct validation was demonstrated through factor analysis and the reliability was analyzed using Cronbach's alpha. Results: the committee of experts made the necessary adjustments so that the scale was adapted to the Brazilian context. The factor analysis suggested a reduction from seven to five factors and the maintenance of 38 items similar to those of the original scale. The reliability, investigated through Cronbach's alpha, was .829, showing high internal consistency. Conclusion: it was concluded that the Brazilian version of the Adherence Determinants Questionnaire scale is a valid and reliable instrument that is able to measure the elements of adherence to the treatment for breast and cervical cancer. PMID:26487149

Development of the Teen Oral Health-Related Quality of Life Instrument.

PubMed

Wright, Wanda G; Spiro, Avron; Jones, Judith A; Rich, Sharron E; Garcia, Raul I

2017-03-01

The aim of this study was to develop the Teen Oral Health-Related Quality of Life instrument (TOQOL) and demonstrate its validity and reliability in a diverse sample of 13-18-year-old adolescents. A total of 363 adolescents aged 13-18 years participated in this cross sectional study. Oral screening examinations were conducted to collect oral health status data. Adolescents completed the TOQOL and a generic measure of health-related quality of life, the PedsQL. The psychometric properties of the TOQOL were evaluated in terms of face, content, convergent, concurrent and discriminant validity in addition to internal reliability. The 16-item TOQOL covers five domains: Physical functioning, Role functioning, Social functioning, Oral problems, and Emotional functioning. The total scale and subscales showed satisfactory reliability with Cronbach alpha ranging from 0.75 to 0.92. TOQOL scores showed significant associations with perceived oral health status and the PedsQL (convergent validity) and discriminated well between adolescents with caries and adolescents who were caries free (discriminate validity). The TOQOL is a valid and reliable oral health-related quality of life measurement that can be recommended for self-report in adolescents aged 13-18 years. © 2016 American Association of Public Health Dentistry.

Learning Style Scales: a valid and reliable questionnaire.

PubMed

Abdollahimohammad, Abdolghani; Ja'afar, Rogayah

2014-01-01

Learning-style instruments assist students in developing their own learning strategies and outcomes, in eliminating learning barriers, and in acknowledging peer diversity. Only a few psychometrically validated learning-style instruments are available. This study aimed to develop a valid and reliable learning-style instrument for nursing students. A cross-sectional survey study was conducted in two nursing schools in two countries. A purposive sample of 156 undergraduate nursing students participated in the study. Face and content validity was obtained from an expert panel. The LSS construct was established using principal axis factoring (PAF) with oblimin rotation, a scree plot test, and parallel analysis (PA). The reliability of LSS was tested using Cronbach's α, corrected item-total correlation, and test-retest. Factor analysis revealed five components, confirmed by PA and a relatively clear curve on the scree plot. Component strength and interpretability were also confirmed. The factors were labeled as perceptive, solitary, analytic, competitive, and imaginative learning styles. Cronbach's α was >0.70 for all subscales in both study populations. The corrected item-total correlations were >0.30 for the items in each component. The LSS is a valid and reliable inventory for evaluating learning style preferences in nursing students in various multicultural environments.

Disruptive behavior scale for adolescents (DISBA): development and psychometric properties.

PubMed

Karimy, Mahmood; Fakhri, Ahmad; Vali, Esmaeel; Vali, Farzaneh; Veiga, Feliciano H; Stein, L A R; Araban, Marzieh

2018-01-01

Growing evidence indicates that if disruptive behavior is left unidentified and untreated, a significant proportion of these problems will persist and may develop into problems linked with delinquency, substance abuse, and violence. Research is needed to develop valid and reliable measures of disruptive behavior to assist recognition and impact of treatments on disruptive behavior. The aim of this study was to develop and evaluate the psychometric properties of a scale for disruptive behavior in adolescents. Six hundred high school students (50% girls), ages ranged 15-18 years old, selected through multi stage random sampling. Psychometrics of the disruptive behavior scale for adolescents (DISBA) (Persian version) was assessed through content validity, explanatory factor analysis (EFA) using Varimax rotation and confirmatory factor analysis (CFA). The reliability of this scale was assessed via internal consistency and test-retest reliability. EFA revealed four factors accounting for 59% of observed variance. The final 29-item scale contained four factors: (1) aggressive school behavior, (2) classroom defiant behavior, (3) unimportance of school, and (4) defiance to school authorities. Furthermore, CFA produced a sufficient Goodness of Fit Index > 0.90. Test-retest and internal consistency reliabilities were acceptable at 0.85 and 0.89, respectively. The findings from this study suggest that the Iranian version of DISBA questionnaire has content validity. Further studies are needed to evaluate stronger psychometric properties for DISBA.

Psychometric properties of belief measures about osteoporosis and its control.

PubMed

Alexander, Lacey; Wajanatinapart, Piyaorn; Lauver, Diane

2017-12-01

Osteoporosis (OP) is a chronic health condition with potentially serious consequences. Although preventive behaviors are important to control OP, many people do not engage in such behaviors. Although beliefs about preventive behaviors for OP influence such behaviors, we could not find psychometrically strong measures of such beliefs for use in planned research. Our initial study was done to assess the content validity, clarity, and internal consistency of belief measures regarding behaviors to control OP: perceived competence, perceived susceptibility, and perceived severity, based on relevant theories. Using a descriptive design, we recruited five clinicians to rate proposed measures for content validity. We also recruited fifty-one older adults from five different counties in a Midwestern state to respond to proposed measures so we could assess clarity and internal consistency reliability. The content validity indices of items varied from 0.60-1.00. The content validity indices of scales varied from 0.73-1.00. For reliability, the final Cronbach's alphas were 0.79-0.96. Addressing a gap in research, we have documented good psychometric properties of belief measures regarding OP and its control. In describing our search for psychometrically sound measures, we have raised issues for future researchers to consider prior to adopting use of existing measures. Nurses can use these measures to assess and address the accuracy of patients' beliefs either individually or in groups. Researchers can use these measures to examine whether or not psycho-educational interventions influence beliefs about OP and its control. Published by Elsevier Inc.

Psychometric Properties of a Screening Instrument for Domestic Violence in a Sample of Iranian Women

PubMed Central

Azadarmaki, Taghi; Kassani, Aziz; Menati, Rostam; Hassanzadeh, Jafar; Menati, Walieh

2016-01-01

Background Domestic violence against women is regarded as an important health problem among women and a serious concern in issues related to human rights. To date, a few screening tools for domestic violence exist for Iranian married women, but they assess only some of the domestic violence components. Objectives The present study aimed to design and determine the validity and reliability of a screening instrument for domestic violence in a sample of Iranian women. Materials and Methods The present study was a cross-sectional psychometric evaluation conducted on 350 married women in Ilam, Iran, in 2014. The samples were selected through multistage sampling and the main method was cluster sampling. A 20-item, self-administered questionnaire was validated by exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). An Eigen value > 1 and a loading factor > 0.3 for each component were considered as indices for extracting domestic violence components. Reliability was calculated by test-retest and Cronbach’s alpha. Also, the content validity index (CVI) and content validity ratio (CVR) were used to measure content validity. The data were analyzed using SPSS-13 and LISREL 8.8 software programs. Results The self-administered instrument was completed by 334 women. The CFA and EFA methods confirmed embedding items and the three-factor structure of the instrument including psychological, physical, and sexual violence, which explained 66% of the total variance of the domestic violence. The ICC and Cronbach’s alpha coefficients were > 0.7 for the components of the questionnaire. The test-retest also revealed strong correlations for each of the domestic violence components (r > 0.6). Conclusions The used instrument for measuring domestic violence had desirable validity and reliability and can be used as a suitable instrument in health and social researches in the local population. PMID:27331052

Development and validation of the Geriatric In-hospital Nursing Care Questionnaire.

PubMed

Persoon, Anke; Bakker, Franka C; van der Wal-Huisman, Hanneke; Olde Rikkert, Marcel G M

2015-02-01

To develop a questionnaire, the Geriatric In-hospital Nursing Care Questionnaire (GerINCQ), to measure, in an integrated way, the care that older adults receive in the hospital and nurses' attitudes toward and perceptions about caring for older adults. Questionnaire development. Twelve university and teaching hospitals. Thirteen experienced geriatric nurses and three geriatricians from 12 hospitals evaluated an initial version of the questionnaire. Two hundred seventy-one nurses, primarily registered nurses from 11 geriatric, medical, and surgical departments in six hospitals, validated the final questionnaire. Items from two published instruments were extracted for use in the questionnaire. Content validity was confirmed using the Delphi technique with an expert panel. Internal consistency was measured by calculating Cronbach alpha; intrarater reliability was measured using test-retest correlations and intraclass correlation coefficients (ICCs); differences between hospital departments were analyzed using analysis of variance. Sensitivity to detect before-and-after changes with implementation of a geriatric care program was determined using the Student t-test. Consensus was reached after three Delphi rounds. The GerINCQ is a self-administered questionnaire to be filled out by hospital nurses that comprises five subscales with 67 items. It has good content validity (each item content validity index >0.9) and good internal consistency (Cronbach alpha = 0.86). Intrarater reliability revealed high test-retest results (ICC = 0.87). The questionnaire detected significant differences between nurses in three types of hospital departments (medical, surgical, and geriatric (P < .01). The GerINCQ was sensitive to changes after an educational program (P < .02) and had a large effect size (0.5). The GerINCQ is a reliable and valid tool and is sensitive to change over time. It is clinically relevant because it provides a quantitative measure of hospital nurses' geriatric practices, attitudes, and perceptions. Moreover, the GerINCQ is suitable for monitoring progress after implementation of geriatric improvement programs. © 2015, Copyright the Authors Journal compilation © 2015, The American Geriatrics Society.

Development and psychometric testing of the Carter Assessment of Critical Thinking in Midwifery (Preceptor/Mentor version).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-03-01

develop and test a tool designed for use by preceptors/mentors to assess undergraduate midwifery students׳ critical thinking in practice. a descriptive cohort design was used. participants worked in a range of maternity settings in Queensland, Australia. 106 midwifery clinicians who had acted in the role of preceptor for undergraduate midwifery students. this study followed a staged model for tool development recommended by DeVellis (2012). This included generation of items, content validity testing through mapping of draft items to critical thinking concepts and expert review, administration of items to a convenience sample of preceptors, and psychometric testing. A 24 item tool titled the XXXX Assessment of Critical Thinking in Midwifery (CACTiM) was completed by registered midwives in relation to students they had recently preceptored in the clinical environment. ratings by experts revealed a content validity index score of 0.97, representing good content validity. An evaluation of construct validity through factor analysis generated three factors: 'partnership in practice', 'reflection on practice' and 'practice improvements'. The scale demonstrated good internal reliability with a Cronbach alpha coefficient of 0.97. The mean total score for the CACTiM scale was 116.77 (SD=16.68) with a range of 60-144. Total and subscale scores correlated significantly. the CACTiM (Preceptor/Mentor version) was found to be a valid and reliable tool for use by preceptors to assess critical thinking in undergraduate midwifery students. given the importance of critical thinking skills for midwifery practice, mapping and assessing critical thinking development in students׳ practice across an undergraduate programme is vital. The CACTiM (Preceptor/Mentor version) has utility for clinical education, research and practice. The tool can inform and guide preceptors׳ assessment of students׳ critical thinking in practice. The availability of a reliable and valid tool can be used to research the development of critical thinking in practice. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

Examining the diagnostic criteria for Internet addiction: Expert validation.

PubMed

Hsu, Wen-Yu; Lin, Sunny S J; Chang, Shan-Mei; Tseng, Yin-Hsing; Chiu, Nan-Ying

2015-06-01

Internet addiction is the coming problem around the world. The diagnostic criteria for Internet addiction among adolescents (DC-IA-A) has become a widely used measure for assessing the presence of Internet addiction in Taiwan. This study examined the diagnosis criteria for Internet addiction in adolescents by expert evaluation. Twenty psychiatrists rated the adequacy of each criterion in DC-IA-A. The content validity and homogeneity reliability proposed by Aiken were calculated. The coefficients content validity and homogeneity reliability showed twenty psychiatrists agreed on each of DC-IA-A as relevant to the diagnosis of Internet addiction, though several criteria need improvements. Two criteria "excessive time spent on Internet activities and leaving the Internet" and "excessive effort spent on activities necessary to obtain access to the Internet" should be omitted, and the criteria of "tolerance" should be modified. The diagnostic criteria for Internet addiction among adolescents should be revised to meet the real condition of this population. Copyright © 2014. Published by Elsevier B.V.

Evaluation of the spoken knowledge in low literacy in diabetes scale for use with Mexican Americans.

PubMed

Garcia, Alexandra A; Zuniga, Julie; Reynolds, Raquel; Cairampoma, Laura; Sumlin, Lisa

2015-05-01

This article evaluates the Spoken Knowledge in Low Literacy in Diabetes (SKILLD) questionnaire, a measure of essential knowledge for type 2 diabetes self-management, after it was modified for English- and Spanish-speaking Mexican Americans. We collected surveys (SKILLD, demographic, acculturation) and blood for A1C analysis from 72 community-recruited participants to analyze the SKILLD's internal consistency, interrater reliability, item analysis, and construct validity. Clinical experts evaluated content validity. The SKILLD demonstrated low internal consistency but high interrater reliability and content and construct validity. There were significant correlations in expected directions between SKILLD scores and acculturation, education, and A1C and significant differences in SKILLD scores between and within groups after an educational intervention and between high- and low-acculturated participants. The SKILLD generates useful information about Mexican Americans' diabetes knowledge. Lower SKILLD scores suggest less diabetes knowledge, lower health literacy, and participants' difficulties understanding items. Further modifications should improve use with low-acculturated Mexican Americans. © The Author(s) 2014.

Development and psychometric evaluation of the Dialysis patient-perceived Exercise Benefits and Barriers Scale.

PubMed

Zheng, Jing; You, Li-Ming; Lou, Tan-Qi; Chen, Nian-Chang; Lai, De-Yuan; Liang, Yan-Yi; Li, Ying-Na; Gu, Ying-Ming; Lv, Shao-Fen; Zhai, Cui-Qiu

2010-02-01

Perceptions of exercise benefits and barriers affect exercise behavior. Because of the clinical course and treatment, dialysis patients differ from the general population in their perceptions of exercise benefits and barriers, especially the latter. At present, no valid instruments for assessing perceived exercise benefits and barriers in dialysis patients are available. Our goal was to develop and test the psychometric properties of the Dialysis patient-perceived Exercise Benefits and Barriers Scale (DPEBBS). A literature review and two focus groups were conducted to generate the initial item pool. An expert panel examined the content validity. Then, 269 Chinese hemodialysis patients were recruited by convenience sampling. Exploratory and confirmatory factor analyses were used to test construct validity. Finally, internal consistency and test-retest reliability were assessed. The expert panel determined that the content validity index was satisfactory. The final 24-item scale consisted of six factors explaining 57% of the total variance in the data. Confirmative factor analysis supported the six-factor structure and a higher-order model. Cronbach's alpha was 0.87 for the total scale, and 0.84 for test-retest reliability. The DPEBBS was a valid and reliable instrument for evaluating dialysis patients' perceived benefits and barriers to exercise. The application value of this scale remains to be investigated by increasing the sample size and evaluating patients undergoing different dialysis modalities and coming from different regions and cultural backgrounds. Copyright 2009 Elsevier Ltd. All rights reserved.

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire

PubMed Central

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

Background: This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. Materials and Methods: A descriptive–analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. Results: The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser–Meyer–Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. Conclusion: This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students. PMID:24741650

Body surface posture evaluation: construction, validation and protocol of the SPGAP system (Posture evaluation rotating platform system).

PubMed

Schwertner, Debora Soccal; Oliveira, Raul; Mazo, Giovana Zarpellon; Gioda, Fabiane Rosa; Kelber, Christian Roberto; Swarowsky, Alessandra

2016-05-04

Several posture evaluation devices have been used to detect deviations of the vertebral column. However it has been observed that the instruments present measurement errors related to the equipment, environment or measurement protocol. This study aimed to build, validate, analyze the reliability and describe a measurement protocol for the use of the Posture Evaluation Rotating Platform System (SPGAP, Brazilian abbreviation). The posture evaluation system comprises a Posture Evaluation Rotating Platform, video camera, calibration support and measurement software. Two pilot studies were carried out with 102 elderly individuals (average age 69 years old, SD = ±7.3) to establish a protocol for SPGAP, controlling the measurement errors related to the environment, equipment and the person under evaluation. Content validation was completed with input from judges with expertise in posture measurement. The variation coefficient method was used to validate the measurement by the instrument of an object with known dimensions. Finally, reliability was established using repeated measurements of the known object. Expert content judges gave the system excellent ratings for content validity (mean 9.4 out of 10; SD 1.13). The measurement of an object with known dimensions indicated excellent validity (all measurement errors <1 %) and test-retest reliability. A total of 26 images were needed to stabilize the system. Participants in the pilot studies indicated that they felt comfortable throughout the assessment. The use of only one image can offer measurements that underestimate or overestimate the reality. To verify the images of objects with known dimensions the values for the width and height were, respectively, CV 0.88 (width) and 2.33 (height), SD 0.22 (width) and 0.35 (height), minimum and maximum values 24.83-25.2 (width) and 14.56 - 15.75 (height). In the analysis of different images (similar) of an individual, greater discrepancies were observed in the values found. The cervical index, for example, presented minimum and maximum values of 15.38 and 37.5, a coefficient of variation of 0.29 and a standard deviation of 6.78. The SPGAP was shown to be a valid and reliable instrument for the quantitative analysis of body posture with applicability and clinical use, since it managed to reduce several measurement errors, amongst which parallax distortion.

[Design and validation of a questionnaire for psychosocial nursing diagnosis in Primary Care].

PubMed

Brito-Brito, Pedro Ruymán; Rodríguez-Álvarez, Cristobalina; Sierra-López, Antonio; Rodríguez-Gómez, José Ángel; Aguirre-Jaime, Armando

2012-01-01

To develop a valid, reliable and easy-to-use questionnaire for a psychosocial nursing diagnosis. The study was performed in two phases: first phase, questionnaire design and construction; second phase, validity and reliability tests. A bank of items was constructed using the NANDA classification as a theoretical framework. Each item was assigned a Likert scale or dichotomous response. The combination of responses to the items constituted the diagnostic rules to assign up to 28 labels. A group of experts carried out the validity test for content. Other validated scales were used as reference standards for the criterion validity tests. Forty-five nurses provided the questionnaire to the patients on three separate occasions over a period of three weeks, and the other validated scales only once to 188 randomly selected patients in Primary Care centres in Tenerife (Spain). Validity tests for construct confirmed the six dimensions of the questionnaire with 91% of total variance explained. Validity tests for criterion showed a specificity of 66%-100%, and showed high correlations with the reference scales when the questionnaire was assigning nursing diagnoses. Reliability tests showed agreement of 56%-91% (P<.001), and a 93% internal consistency. The Questionnaire for Psychosocial Nursing Diagnosis was called CdePS, and included 61 items. The CdePS is a valid, reliable and easy-to-use tool in Primary Care centres to improve the assigning of a psychosocial nursing diagnosis. Copyright © 2011 Elsevier España, S.L. All rights reserved.

[Development and validation of a questionnaire on knowledge and personal hygiene habits in childhood (HICORIN®)].

PubMed

Moreno-Martínez, Francisco José; Ruzafa-Martínez, María; Ramos-Morcillo, Antonio Jesús; Gómez García, Carmen Isabel; Hernández-Susarte, Ana María

2015-01-01

To develop and validate a questionnaire on the integral assessment of the habits and knowledge in personal hygiene in children between 7 to 12 years old in the educational, social and health environment. Cross-sectional study for the validation of a questionnaire. One primary and secondary school and one children's home in the Region of Murcia, Spain. A total of 86 children were included (80 from a primary and secondary school; 6 from a children's home), as well as 7 experts. Content validation by experts; qualitative assessment; identify difficulties related to some questions, item response analysis, and test-retest reliability. After the literature search, 20 tools that included items related to child body hygiene were obtained. The researchers selected 34 items and drafted 48 additional ones. After content validity by the experts, the questionnaire (HICORIN®) was reduced to 63 items, and consisted of 7 dimensions of child personal hygiene (skin, hair, hands, oral, feet, ears, and intimate hygiene). After with the children some terms were adapted to improve their understanding. Only two items had non-response rates that exceeded 10%. The test-retest showed that 84.1% of the items had between very good and moderate reliability. HICORIN® is a reliable and valid instrument that integrally assesses the habits and knowledge in personal hygiene in children between 7-12 years old. It is applicable in educative and social and health environments and in children from different socioeconomic levels. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Validation of the Chinese translation of the 6-item De Jong Gierveld Loneliness Scale in elderly Chinese.

PubMed

Leung, Grace Tak Yu; de Jong Gierveld, Jenny; Lam, Linda Chiu Wa

2008-12-01

This study aims to develop and validate a Chinese translation of the 6-item De Jong Gierveld Loneliness Scale - a widely used instrument to measure loneliness - specifically determining its psychometric properties in community-dwelling Chinese elders in Hong Kong. The relationships between loneliness and several clinical variables are also assessed. The English version was translated into Chinese. Content validity was established by group discussion and Delphi panel. The questionnaire was administered to 103 Hong Kong Chinese community-dwelling elders. Statistical analysis was performed to test the reliability and validity of the scale. The content validity was high as shown by the results of the Delphi panel. Cronbach's alpha of the 6-item scale was 0.76. For the inter-rater reliability of the six items, the intra-class correlation coefficients ranged from 0.98 to 1.00. The emotional loneliness subscale significantly correlated with the social loneliness subscale (rho = 0.37; p < 0.001). In using a direct question to measure loneliness, 21 participants (20%) reported that they were lonely. The overall loneliness scale score significantly correlated with the answers on the direct question of loneliness (rpb = 0.71; p < 0.001). The overall loneliness score showed significant correlation with Cornell Scale for Depression in Dementia (rho = 0.29; p = 0.003), current smoking status (rpb = 0.24; p = 0.014), and some objective social characteristics. The Chinese version of the 6-item De Jong Gierveld Loneliness Scale is a reliable and valid measure of loneliness in Chinese elders.

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Development of the insight scale for affective disorders (ISAD): modification from the scale to assess unawareness of mental disorder.

PubMed

Olaya, Beatriz; Marsà, Ferran; Ochoa, Susana; Balanzá-Martínez, Vicent; Barbeito, Sara; García-Portilla, Mari Paz; González-Pinto, Ana; Lobo, Antonio; López-Antón, Raúl; Usall, Judith; Arranz, Belén; Haro, Josep Maria

2012-12-15

Research on insight in patients with mood disorders has grown in recent years. Several instruments to assess insight have been used, but most of them have been specifically designed for psychosis and may not appear relevant to mood disorders. The aim of the present study is to develop a short, multidimensional, reliable and valid scale to measure insight in patients with mood disorders, based on the Amador's Scale to Assess Unawareness of Mental Disorders (SUMD). A Delphi method was used to facilitate expert participation and ensure face and content validity. The SUMD structure and items were used as a reference in the scale development. A new scale with 17 items was obtained. Internal consistency, test-retest and inter-rater reliability and validity were studied in a sample of 76 outpatients with a DSM-IV diagnosis of major depression or bipolar disorder (type I or II). Internal consistency of the general items was moderate, and high for the symptoms awareness subscale. Scores on ISAD correlated with other measures of insight and with some clinical measures, thus supporting its validity. The majority of the sample came from community services. Future studies should use inpatients or patients with severe symptoms to broaden the range of responses. Moreover, the rating of insight and other measures by the same clinician might introduce a methodological bias. The ISAD, with a multidimensional approach, appears as a short, reliable and valid measure of insight in mood disorders. Expert consensus ensures its face and content validity. Copyright © 2012 Elsevier B.V. All rights reserved.

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability.

PubMed

Maïano, Christophe; Bégarie, Jérôme; Morin, Alexandre J S; Garbarino, Jean-Marie; Ninot, Grégory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items' content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.

Cross-Cultural Adaptation and Psychometric Testing of the Brazilian Version of the Self-Care of Heart Failure Index Version 6.2

PubMed Central

Ávila, Christiane Wahast; Riegel, Barbara; Pokorski, Simoni Chiarelli; Camey, Suzi; Silveira, Luana Claudia Jacoby; Rabelo-Silva, Eneida Rejane

2013-01-01

Objective. To adapt and evaluate the psychometric properties of the Brazilian version of the SCHFI v 6.2. Methods. With the approval of the original author, we conducted a complete cross-cultural adaptation of the instrument (translation, synthesis, back translation, synthesis of back translation, expert committee review, and pretesting). The adapted version was named Brazilian version of the self-care of heart failure index v 6.2. The psychometric properties assessed were face validity and content validity (by expert committee review), construct validity (convergent validity and confirmatory factor analysis), and reliability. Results. Face validity and content validity were indicative of semantic, idiomatic, experimental, and conceptual equivalence. Convergent validity was demonstrated by a significant though moderate correlation (r = −0.51) on comparison with equivalent question scores of the previously validated Brazilian European heart failure self-care behavior scale. Confirmatory factor analysis supported the original three-factor model as having the best fit, although similar results were obtained for inadequate fit indices. The reliability of the instrument, as expressed by Cronbach's alpha, was 0.40, 0.82, and 0.93 for the self-care maintenance, self-care management, and self-care confidence scales, respectively. Conclusion. The SCHFI v 6.2 was successfully adapted for use in Brazil. Nevertheless, further studies should be carried out to improve its psychometric properties. PMID:24163765

Development and Psychometric Testing of a Novel Food Service Satisfaction Questionnaire for Food Service Staff of Aged Care Homes.

PubMed

Miller, M; Hamilton, J; Scupham, R; Matwiejczyk, L; Prichard, I; Farrer, O; Yaxley, A

2018-01-01

Food service staff are integral to delivery of quality food in aged care homes yet measurement of their satisfaction is unable to be performed due to an absence of a valid and reliable questionnaire. The aim of this study was to develop and perform psychometric testing for a new Food Service Satisfaction Questionnaire developed in Australia specifically for use by food service staff working in residential aged care homes (Flinders FSSQFSAC). A mixed methods design utilizing both a qualitative (in-depth interviews, focus groups) and a quantitative approach (cross sectional survey) was used. Content validity was determined from focus groups and interviews with food service staff currently working in aged care homes, related questionnaires from the literature and consultation with an expert panel. The questionnaire was tested for construct validity and internal consistency using data from food service staff currently working in aged care homes that responded to an electronic invitation circulated to Australian aged care homes using a national database of email addresses. Construct validity was tested via principle components analysis and internal consistency through Cronbach's alpha. Temporal stability of the questionnaire was determined from food service staff undertaking the Flinders FSSQFSAC on two occasions, two weeks apart, and analysed using Pearson's correlations. Content validity for the Flinders FSSQFSAC was established from a panel of experts and stakeholders. Principle components analysis revealed food service staff satisfaction was represented by 61-items divided into eight domains: job satisfaction (α=0.832), food quality (α=0.871), staff training (α=0.922), consultation (α=0.840), eating environment (α=0.777), reliability (α=0.695), family expectations (α=0.781) and resident relationships (α=0.429), establishing construct validity in all domains, and internal consistency in all (α>0.5) except for "resident relationships" (α=0.429). Test-retest reliability coefficients ranged from 0.276 to 0.826 dependent on domain, with test-retest reliability established in seven domains at r>0.4; an exception was "reliability" at r=0.276. The newly developed Flinders FSSQFSAC has acceptable validity and reliability and thereby the potential to measure satisfaction of food service staff working in residential aged care homes, identify areas for strategic change, measure improvements and in turn, improve the satisfaction and quality of life of both food service staff and residents of aged care homes.

Inter-Rater Reliability and Validity of the Australian Football League’s Kicking and Handball Tests

PubMed Central

Cripps, Ashley J.; Hopper, Luke S.; Joyce, Christopher

2015-01-01

Talent identification tests used at the Australian Football League’s National Draft Combine assess the capacities of athletes to compete at a professional level. Tests created for the National Draft Combine are also commonly used for talent identification and athlete development in development pathways. The skills tests created by the Australian Football League required players to either handball (striking the ball with the hand) or kick to a series of 6 randomly generated targets. Assessors subjectively rate each skill execution giving a 0-5 score for each disposal. This study aimed to investigate the inter-rater reliability and validity of the skills tests at an adolescent sub-elite level. Male Australian footballers were recruited from sub-elite adolescent teams (n = 121, age = 15.7 ± 0.3 years, height = 1.77 ± 0.07 m, mass = 69.17 ± 8.08 kg). The coaches (n = 7) of each team were also recruited. Inter-rater reliability was assessed using Inter-class correlations (ICC) and Limits of Agreement statistics. Both the kicking (ICC = 0.96, p < .01) and handball tests (ICC = 0.89, p < .01) demonstrated strong reliability and acceptable levels of absolute agreement. Content validity was determined by examining the test scores sensitivity to laterality and distance. Concurrent validity was assessed by comparing coaches’ perceptions of skill to actual test outcomes. Multivariate analysis of variance (MANOVA) examined the main effect of laterality, with scores on the dominant hand (p = .04) and foot (p < .01) significantly higher compared to the non-dominant side. Follow-up univariate analysis reported significant differences at every distance in the kicking test. A poor correlation was found between coaches’ perceptions of skill and testing outcomes. The results of this study demonstrate both skill tests demonstrate acceptable inter-rater reliable. Partial content validity was confirmed for the kicking test, however further research is required to confirm validity of the handball test. Key points The skill tests created by the AFL demonstrated acceptable levels of relative and absolute inter-rater reliability. Both the AFL’s skills tests are able to differentiate between athletes dominant and non-dominant limbs. However, only the kicking test could consistently differentiated between score outcomes over a range of Australian Football specific disposal distances. Both tests demonstrated poor concurrent validity, with no correlation found between coaches’ perceptions of technical skills and actual skill outcomes measured. PMID:26336356

Development of diagnostic test instruments to reveal level student conception in kinematic and dynamics

NASA Astrophysics Data System (ADS)

Handhika, J.; Cari, C.; Suparmi, A.; Sunarno, W.; Purwandari, P.

2018-03-01

The purpose of this research was to develop a diagnostic test instrument to reveal students' conceptions in kinematics and dynamics. The diagnostic test was developed based on the content indicator the concept of (1) displacement and distance, (2) instantaneous and average velocity, (3) zero and constant acceleration, (4) gravitational acceleration (5) Newton's first Law, (6) and Newton's third Law. The diagnostic test development model includes: Diagnostic test requirement analysis, formulating test-making objectives, developing tests, checking the validity of the content and the performance of reliability, and application of tests. The Content Validation Index (CVI) results in the category are highly relevant, with a value of 0.85. Three questions get negative Content Validation Ratio CVR) (-0.6), after revised distractors and clarify visual presentation; the CVR become 1 (highly relevant). This test was applied, obtained 16 valid test items, with Cronbach Alpha value of 0.80. It can conclude that diagnostic test can be used to reveal the level of students conception in kinematics and dynamics.

Development and validation of an instrument for evaluating inquiry-based tasks in science textbooks

NASA Astrophysics Data System (ADS)

Yang, Wenyuan; Liu, Enshan

2016-12-01

This article describes the development and validation of an instrument that can be used for content analysis of inquiry-based tasks. According to the theories of educational evaluation and qualities of inquiry, four essential functions that inquiry-based tasks should serve are defined: (1) assisting in the construction of understandings about scientific concepts, (2) providing students opportunities to use inquiry process skills, (3) being conducive to establishing understandings about scientific inquiry, and (4) giving students opportunities to develop higher order thinking skills. An instrument - the Inquiry-Based Tasks Analysis Inventory (ITAI) - was developed to judge whether inquiry-based tasks perform these functions well. To test the reliability and validity of the ITAI, 4 faculty members were invited to use the ITAI to collect data from 53 inquiry-based tasks in the 3 most widely adopted senior secondary biology textbooks in Mainland China. The results indicate that (1) the inter-rater reliability reached 87.7%, (2) the grading criteria have high discriminant validity, (3) the items possess high convergent validity, and (4) the Cronbach's alpha reliability coefficient reached 0.792. The study concludes that the ITAI is valid and reliable. Because of its solid foundations in theoretical and empirical argumentation, the ITAI is trustworthy.

Psychometric properties of the communication skills attitude scale (CSAS) measure in a sample of Iranian medical students

PubMed Central

YAKHFOROSHHA, AFSANEH; SHIRAZI, MANDANA; YOUSEFZADEH, NASER; GHANBARNEJAD, AMIN; CHERAGHI, MOHAMMADALI; MOJTAHEDZADEH, RITA; MAHMOODI-BAKHTIARI, BEHROOZ; EMAMI, SEYED AMIR HOSSEIN

2018-01-01

Introduction: Communication skill (CS) has been regarded as one of the fundamental competencies for medical and other health care professionals. Student's attitude toward learning CS is a key factor in designing educational interventions. The original CSAS, as positive and negative subscales, was developed in the UK; however, there is no scale to measure these attitudes in Iran. The aim of this study was to assess the psychometric characteristic of the Communication Skills Attitude Scale (CSAS), in an Iranian context and to understand if it is a valid tool to assess attitude toward learning communication skills among health care professionals. Methods: Psychometric characteristics of the CSAS were assessed by using a cross-sectional design. In the current study, 410 medical students were selected using stratified sampling framework. The face validity of the scale was estimated through students and experts’ opinion. Content validity of CSAS was assessed qualitatively and quantitatively. Reliability was examined through two methods including Chronbach’s alpha coefficient and Intraclass Correlation of Coefficient (ICC). Construct validity of CSAS was assessed using confirmatory factor analysis (CFA) and explanatory factor analysis (PCA) followed by varimax rotation. Convergent and discriminant validity of the scale was measured through Spearman correlation. Statistical analysis was performed using SPSS 19 and EQS, 6.1. Results: The internal consistency and reproducibility of the total CSAS score were 0.84 (Cronbach’s alpha) and 0.81, which demonstrates an acceptable reliability of the questionnaire. The item-level content validity index (I-CVI) and the scale-level content validity index (S-CVI/Ave) demonstrated appropriate results: 0.97 and 0.94, respectively. An exploratory factor analysis (EFA) on the 25 items of the CSAS revealed 4-factor structure that all together explained %55 of the variance. Results of the confirmatory factor analysis indicated an acceptable goodness-of-fit between the model and the observed data. [χ2/df = 2.36, Comparative Fit Index (CFI) = 0.95, the GFI=0.96, Root Mean Square Error of Approximation (RMSEA) = 0.05]. Conclusion: The Persian version of CSAS is a multidimensional, valid and reliable tool for assessing attitudes towards communication skill among medical students. PMID:29344525

Development of an instrument based on the protection motivation theory to measure factors influencing women's intention to first pap test practice.

PubMed

Hassani, Lale; Dehdari, Tahereh; Hajizadeh, Ebrahim; Shojaeizadeh, Davoud; Abedini, Mehrandokht; Nedjat, Saharnaz

2014-01-01

Given that there are many Iranian women who have never had a Pap smear, this study was designed to develop and validate a measurement tool based on the Protection Motivation Theory to assess factors influencing the Iranian women's intention to perform first Pap testing. In this psychometric research, to determine the Content Validity Index (CVI) and the Content Validity Ratio (CVR), a panel of experts (n=10) reviewed scale items. Reliability was estimated through the Intraclass Correlation Coefficient (n=30) and internal consistency (n=240). Also, factor analysis (exploratory and conformity) was performed on the data of the sample women who had never had a Pap smear test (n=240). A 26-item questionnaire was developed. The CVI and CVR scores of the scale were 0.89 and 0.90, respectively. Exploratory factor analysis loaded a 26-item with seven factors questionnaire (perceived vulnerability and severity, fear, response costs, response efficacy, self-efficacy, and protection motivation (or intention)) that jointly accounted for 72.76% of the observed variance. Confirmatory factor analysis indicated a good fit for the data. Internal consistency (range 0.70-0.93) and test-retest reliability (range 0.72-0.96) of sub-scales were acceptable. This study showed that the designed instrument was a valid and reliable tool for measuring the factors influencing the women's intention to perform their first Pap testing.

The validity and reliability of a Spanish version of the summary of diabetes self-care activities questionnaire.

PubMed

Vincent, Deborah; McEwen, Marylyn M; Pasvogel, Alice

2008-01-01

Translation of data collection instruments, paying careful attention to equivalency between the source and the target language, is important to obtain valid data collection instruments. To translate the Summary of Diabetes Self-Care Activities (SDSCA) questionnaire (English) into Spanish and to evaluate the reliability and validity of the Spanish version. Translation and back-translation were used to develop the Spanish version of the SDSCA. The Spanish version of the SDSCA was reviewed by an expert panel for conceptual and content equivalence to the English version. Psychometric properties were assessed further by combining data from three studies that used the Spanish version as a data collection instrument. Correlation of each item of the Spanish and English version of the SDSCA instrument ranged from .78 to 1.00, with no variability in the responses of 2 of the 12 items. Test-retest correlations for the SDSCA ranged from .51 to 1.00. Internal consistency (Cronbach's alpha) for the Spanish version was .68. Items loaded on three factors, with the factors accounting for 61% of the variance in SDSCA. The findings for the psychometric properties of the Spanish version of the SDSCA questionnaire suggest that it has conceptual and content equivalency with the original English version and is valid and reliable. However, further testing with larger samples is required.

[Validity, reliability, and acceptability of the scale of knowledge, attitude, and behavior of lifestyle intervention in a diabetes high-risk population].

PubMed

Wang, W J; Dong, J; Ren, Z P; Chen, B; He, W; Li, W D; Hao, Z W

2016-07-06

To evaluate the validity, reliability, and acceptability of the scale of knowledge, attitude, and behavior of lifestyle intervention in a diabetes high-risk population (HILKAB), and provide scientific evidence for its usage. By convenient sampling, we selected 406 individuals at high risk for diabetes for survey using the HILKAB. Pearson correlation coefficient, factor analysis, independent sampling, and t-test for high- and low-score groups were used to evaluate the content validity, construct validity, and discriminant validity of the scale. Reliability of the scale was evaluated by internal consistency, which included Cronbach's α coefficient, θ coefficient, Ω coefficient, and split-half reliability. Scale acceptability was evaluated by acceptance rate and completion time of the survey. In this study, 366 questionnaires (90.1%) was qnalified and the completion time was (8.62±2.79) minutes. Scores for knowledge, attitude, and behavior were 10.60±3.73, 26.56±3.58, 17.09±9.74, respectively. The scale had good face validity and content validity. The correlation coefficient of items and the dimension to which they belong was between 0.25 and 0.97, and the correlation coefficient of three dimensions and the entire scale was between 0.64 and 0.91, all with P<0.001. Factor analysis of the scale extracted eight common factors. The cumulative variance contribution rate was 65.23%, thereby reaching the 50% approved standard. Of 30 items there were 29 items with factor loadings ≥0.40, indicating the scale had good construct validity. For the high-score group, scores for knowledge, attitude, and behavior dimensions were 13.89±2.55, 29.56± 2.46, 28.05 ± 2.93, respectively, which were higher than those for the low-score group (7.67 ± 2.78, 23.89 ± 3.35, 6.25 ± 3.13); t-values were 55.14, 119.40, 95.29, respectively, with P<0.001. The scale consisted of three dimensions: knowledge, attitude, and behavior. The Cronbach's α coefficient was between 0.84 and 0.92, the θ coefficient was between 0.85 and 0.96, the Ω coefficient was between 0.90 and 0.94, and the split-half reliability was between 0.77 and 0.95, reaching the 0.70 standard letter. The validity, reliability, and acceptability of the HILKAB scale were satisfactory for use in a population at high risk of diabetes.

Center for Epidemiologic Studies Depression Scale for Children: psychometric testing of the Chinese version.

PubMed

Li, Ho Cheung William; Chung, Oi Kwan Joyce; Ho, Ka Yan

2010-11-01

This paper is a report of psychometric testing of the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children. The availability of a valid and reliable instrument that accurately detects depressive symptoms in children is crucial before any psychological intervention can be appropriately planned and evaluated. There is no such an instrument for Chinese children. A test-retest, within-subjects design was used. A total of 313 primary school students between the ages of 8 and 12 years were invited to participate in the study in 2009. Participants were asked to respond to the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children, short form of the State Anxiety Scale for Children and Rosenberg's Self-Esteem Scale. The internal consistency, content validity and construct validity and test-retest reliability of the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children were assessed. The newly-translated scale demonstrated adequate internal consistency, good content validity and appropriate convergent and discriminant validity. Confirmatory factor analysis added further evidence of the construct validity of the scale. Results suggest that the newly-translated scale can be used as a self-report assessment tool in detecting depressive symptoms of Chinese children aged between 8 and 12 years. © 2010 Blackwell Publishing Ltd.

Herth hope index: psychometric testing of the Chinese version.

PubMed

Chan, Keung Sum; Li, Ho Cheung William; Chan, Sally Wai-Chi; Lopez, Violeta

2012-09-01

This article is a report on psychometric testing of the Chinese version of the herth hope index. The availability of a valid and reliable instrument that accurately measures the level of hope in patients with heart failure is crucial before any hope-enhancing interventions can be appropriately planned and evaluated. There is no such instrument for Chinese people. A test-retest, within-subjects design was used. A purposive sample of 120 Hong Kong Chinese patients with heart failure between the ages of 60 and 80 years admitted to two medical wards was recruited during an 8-month period in 2009. Participants were asked to respond to the Chinese version of the herth hope index, Hamilton depression rating scale and Rosenberg's self-esteem scale. The internal consistency, content validity and construct validity and test-retest reliability of the Chinese version of the herth hope index were assessed. The newly translated scale demonstrated adequate internal consistency, good content validity and appropriate convergent and discriminant validity. Confirmatory factor analysis added further evidence of the construct validity of the scale. Results suggest that the newly translated scale can be used as a self-report assessment tool in assessing the level of hope in Hong Kong Chinese patients with heart failure. © 2011 Blackwell Publishing Ltd.

[Authorization, translation, back translation and language modification of the simplified Chinese adult comorbidity-27 index].

PubMed

Gao, L; Mao, C; Yu, G Y; Peng, X

2016-10-09

Objective: To translate the adult comorbidity evaluation-27(ACE-27) index authored by professor JF Piccirillo into Chinese and for the purpose of assessing the possible impact of comorbidity on survival of oral cancer patients and improving cancer staging. Methods: The translation included the following steps, obtaining permission from professor Piccirillo, translation, back translation, language modification, adjusted by the advice from the professors of oral and maxillofacial surgery. The test population included 154 patients who were admitted to Peking University of Stomatology during March 2011. Questionnaire survey was conducted on these patients. Retest of reliability, internal consistency reliability, content validity, and structure validity were performed. Results: The simplified Chinese ACE-27 index was established. The Cronbach's α was 0.821 in the internal consistency reliability test. The Kaiser-Meyer-Olkin (KMO) value of 8 items was 0.859 in the structure validity test. Conclusions: The simplified Chinese ACE-27 index has good feasibility and reliability. It is useful to assess the comorbidity of oral cancer patients.

Risk Management of New Microelectronics for NASA: Radiation Knowledge-base

NASA Technical Reports Server (NTRS)

LaBel, Kenneth A.

2004-01-01

Contents include the following: NASA Missions - implications to reliability and radiation constraints. Approach to Insertion of New Technologies Technology Knowledge-base development. Technology model/tool development and validation. Summary comments.

Development of the Autosomal Dominant Polycystic Kidney Disease Impact Scale: A New Health-Related Quality-of-Life Instrument.

PubMed

Oberdhan, Dorothee; Cole, Jason C; Krasa, Holly B; Cheng, Rebecca; Czerwiec, Frank S; Hays, Ron D; Chapman, Arlene B; Perrone, Ronald D

2018-02-01

The impact of autosomal dominant polycystic kidney disease (ADPKD) on health-related quality of life (HRQoL) is not well understood due to a lack of instruments specific to the condition. Content for a new self-administered patient-reported outcome (PRO) questionnaire to assess ADPKD-related HRQoL was developed through clinical expert and patient focus group discussions. The new PRO instrument was administered to study patients with ADPKD to evaluate its reliability and validity. 1,674 adult patients with ADPKD participated in this research: 285 patients in focus groups to generate questionnaire content, 15 patients in debriefing interviews to refine the PRO questionnaire, and 1,374 patients to assess the performance and measurement properties of the PRO questionnaire. A new PRO questionnaire. The ADPKD Impact Scale (ADPKD-IS), consisting of 14 items representing 3 conceptual domains (physical, emotional, and fatigue) plus 4 additional questions, was developed. The instrument's reliability (regarding internal consistency and test-retest consistency) and validity (content and construct) were supported. Need for more responsiveness testing when more data from clinical use become available over time. Complex concepts such as ADPKD-related pain and impact on a patient's HRQoL need further evaluation. The ADPKD-IS is a new patient-centric tool that reliably and validly provides a standardized method for assessing HRQoL and overall disease burden in patients with ADPKD. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Reliability and validity of the Chinese version of the autoimmune bullous disease quality of life (ABQOL) questionnaire.

PubMed

Yang, Baoqi; Chen, Guo; Yang, Qing; Yan, Xiaoxiao; Zhang, Zhaoxia; Murrell, Dédée F; Zhang, Furen

2017-02-02

The autoimmune bullous diseases quality of life (ABQOL) questionnaire was recently developed by an Australian group and has been validated in Australian and North American patient cohorts. It is a 17-item, multidimensional, self-administered English questionnaire. The study aimed to validate the Chinese version of the ABQOL questionnaire and evaluate the reliability in Chinese patients. The Chinese version of the ABQOL questionnaire was produced by forward-backward translation and cross-cultural adaptation of the original English version. The ABQOL questionnaire was then distributed to a total of 101 patients with autoimmune bullous diseases (AIBDs) together with the Dermatology Life Quality Index (DLQI) and the 36-item Short Form Health Survey (SF-36). Validity was analyzed across a range of indices and reliability was assessed using internal consistency and test-retest methods. The Chinese version of the ABQOL questionnaire has a high internal consistency (Cronbach's alpha coefficient, 0.88) and test-retest reliability (the intraclass correlation coefficient, 0.87). Face and content validity were satisfactory. Convergent validity testing showed that the correlation coefficients for the ABQOL and DLQI was 0.77 and for the ABQOL and SF-36 was -0.62. In terms of discriminant validity, there was no significant difference between the proportions of insensitive items in ABQOL and DLQI (p = 0.236). There was no significant difference between the proportions of insensitive items in ABQOL and SF-36 (p = 0.823). The Chinese version of the ABQOL questionnaire has adequate validity and reliability. It may constitute a useful instrument to measure disease burden in Chinese patients with AIBDs.

[Psychometric Characteristics of the Clinical Nursing Mentors' Behavior Scale].

PubMed

Zhao, Rong; Chen, Yan-Hua; Yu, Hui-Ting; Xiao, Lu; Wen, Jing; Yeh, Tzu-Pei

2017-08-01

The behavior of mentors impacts the quality and experience of nursing students who are studying in clinical placement. Accurately assessing the behavior of mentors is fundamental to training, regulating, guiding, and improving their behavior and quality of teaching. To test the validity and reliability of the Clinical Nursing Mentors' Behavior Scale (CNMBS) among mentors. This study included three stages. During the first stage, seven Chinese experts were invited to evaluate content validity. During the second stage, the test-retest reliability was examined with 63 mentors. During the third stage, a cross-sectional study was conducted. Seven hundred and sixty-six nursing mentors from five hospitals in Beijing, Shenzhen, and Sichuan completed the survey either online or in hard copy form. The data collected from the questionnaire were analyzed using item analysis, construct validity, internal consistency and discriminant validity, with the results used to determine the psychometric characteristics of the CNMBS. The content validity index for the CNMBS was .91. The intra-class correlation coefficient was .89; the range of the item discrimination critical ratio was 9.42-22.43 (p < .001), and the item-total correlation was .35- .70 (p < .001). The three factors of "guiding personal growth", "promoting professional development", and "providing psychosocial support" and a total of 23 items were identified, with item factor loadings ranging from .51 to .79. The three factors explained 50.99% of total variance. The internal consistency of the CNMBS earned a Cronbach's α coefficient of .92, while those of the three subscales were .89, .86 and .75, respectively. The Clinical Nursing Mentors' Behavior Scale demonstrated high validity and reliability, supporting the CNMBS as a valid tool for assessing the teaching behavior of mentors.

Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

PubMed

Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

2017-06-01

Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in electrocardiogram rhythm recognition.

Translation and validation of the Dutch new Knee Society Scoring System ©.

PubMed

Van Der Straeten, Catherine; Witvrouw, Erik; Willems, Tine; Bellemans, Johan; Victor, Jan

2013-11-01

A new version of The Knee Society Knee Scoring System(©) (KSS) has recently been developed. Before this scale can be used in non-English-speaking populations, it has to be translated and validated for a particular population. We evaluated the construct and content validity, the test-retest reliability, and the internal consistency of the Dutch version of the New Knee Society KSS. A Dutch translation was performed using a forward-backward translation protocol. We tested the construct validity of the Dutch New KSS by comparing it with the Dutch versions of the WOMAC, Knee Injury and Osteoarthritis Outcome Score (KOOS), and SF-12 scores in 137 patients undergoing total knee arthroplasty (TKA). Content validity was assessed by comparing pre- and postoperative scores and by checking floor and ceiling effects. To evaluate test-retest reliability and consistency, 47 patients completed the questionnaire a second time with a mean of 8 days interval (range, 2-20 days) between tests. Construct validity was demonstrated because the Dutch New KSS correlated well with the Dutch WOMAC (r = -0.751; p < 0.001), Dutch KOOS (r = -0.723; p < 0.001), and Dutch SF-12 (r = 0.569; p < 0.001). There was a significant difference between pre- and postoperative scores (p < 0.001) in line with the other scores. Test-retest reliability proved excellent with an intraclass correlation coefficient between 0.73 and 0.92 depending on the domain tested. Consistency as indicated by Cronbach's alpha ranging from 0.84 to 0.96 was good to excellent. As demonstrated by the validation procedure, the Dutch New KSS is an excellent instrument to evaluate TKA outcome in Dutch-speaking patients.

Factors affecting knowledge transfer from continuing professional education to clinical practice: Development and psychometric properties of a new instrument.

PubMed

Vasli, Parvaneh; Dehghan-Nayeri, Nahid; Khosravi, Laleh

2018-01-01

Despite the emphasis placed on the implementation of continuing professional education programs in Iran, researchers or practitioners have not developed an instrument for assessing the factors that affect the knowledge transfer from such programs to clinical practice. The aim of this study was to design and validate such instrument for the Iranian context. The research used a three-stage mix method. In the first stage, in-depth interviews with nurses and content analysis were conducted, after which themes were extracted from the data. In the second stage, the findings of the content analysis and literature review were examined, and preliminary instrument options were developed. In the third stage, qualitative content validity, face validity, content validity ratio, content validity index, and construct validity using exploratory factor analysis was conducted. The reliability of the instrument was measured before and after the determination of construct validity. Primary tool instrument initially comprised 53 items, and its content validity index was 0.86. In the multi-stage factor analysis, eight questions were excluded, thereby reducing 11 factors to five and finally, to four. The final instrument with 43 items consists of the following dimensions: structure and organizational climate, personal characteristics, nature and status of professionals, and nature of educational programs. Managers can use the Iranian instrument to identify factors affecting knowledge transfer of continuing professional education to clinical practice. Copyright © 2017. Published by Elsevier Ltd.

Development and Psychometric Properties of the Math and Me Survey: Measuring Third through Sixth Graders' Attitudes toward Mathematics

ERIC Educational Resources Information Center

Adelson, Jill L.; McCoach, D. Betsy

2011-01-01

The Math and Me Survey was designed to measure elementary students' attitudes toward mathematics. The authors conducted content validation, exploratory factor analysis, confirmatory factor analysis, item response theory, reliability, and external validity analyses to improve it and to test its psychometric properties. The final Math and Me Survey…

Development of a Self-Efficacy Scale toward Piano Lessons

ERIC Educational Resources Information Center

Kurtuldu, M. Kayhan; Bulut, Damla

2017-01-01

This study aimed to develop a valid and reliable scale to determine students' levels of self-efficacy toward piano lessons. The sample consisted of 456 university-level piano students enrolled in Music Education programs. Experts in language and the field of music were consulted to establish content validity of the items included in the scalar…

Effectiveness of ethics education as perceived by nursing students: development and testing of a novel assessment instrument.

PubMed

Vynckier, Tine; Gastmans, Chris; Cannaerts, Nancy; de Casterlé, Bernadette Dierckx

2015-05-01

The effectiveness of ethics education continues to be disputed. No studies exist on how nursing students perceive the effectiveness of nursing ethics education in Flanders, Belgium. To develop a valid and reliable instrument, named the 'Students' Perceived Effectiveness of Ethics Education Scale' (SPEEES), to measure students' perceptions of the effectiveness of ethics education, and to conduct a pilot study in Flemish nursing students to investigate the perceived efficacy of nursing ethics education in Flanders. Content validity, comprehensibility and usability of the SPEEES were assessed. Reliability was assessed by means of a quantitative descriptive non-experimental pilot study. 86 third-year baccalaureate nursing students of two purposefully selected university colleges answered the SPEEES. Formal approval was given by the ethics committee. Informed consent was obtained and anonymity was ensured for both colleges and their participating students. The scale content validity index/Ave scores for the subscales were 1.00, 1.00 and 0.86. The comprehensibility and user-friendliness were favourable. Cronbach's alpha was 0.94 for general effectiveness, 0.89 for teaching methods and 0.85 for ethical content. Students perceived 'case study', 'lecture' and 'instructional dialogue' to be effective teaching methods and 'general ethical concepts' to contain effective content. 'Reflecting critically on their own values' was mentioned as the only ethical competence that, was promoted by the ethics courses. The study revealed rather large differences between both schools in students' perceptions of the contribution of ethics education to other ethical competences. The study revealed that according to the students, ethics courses failed to meet some basic objectives of ethics education. Although the SPEEES proved to be a valid and reliable measure, the pilot study suggests that there is still space for improvement and a need for larger scale research. Additional insights will enable educators to improve current nursing ethics education. © The Author(s) 2014.

Validity of Criteria-Based Content Analysis (CBCA) at Trial in Free-Narrative Interviews

ERIC Educational Resources Information Center

Roma, Paolo; San Martini, Pietro; Sabatello, Ugo; Tatarelli, Roberto; Ferracuti, Stefano

2011-01-01

Objective: The reliability of child witness testimony in sexual abuse cases is often controversial, and few tools are available. Criteria-Based Content Analysis (CBCA) is a widely used instrument for evaluating psychological credibility in cases of suspected child sexual abuse. Only few studies have evaluated CBCA scores in children suspected of…

Methodological Choices in the Content Analysis of Textbooks for Measuring Alignment with Standards

ERIC Educational Resources Information Center

Polikoff, Morgan S.; Zhou, Nan; Campbell, Shauna E.

2015-01-01

With the recent adoption of the Common Core standards in many states, there is a need for quality information about textbook alignment to standards. While there are many existing content analysis procedures, these generally have little, if any, validity or reliability evidence. One exception is the Surveys of Enacted Curriculum (SEC), which has…

Initial Development and Validation of the BullyHARM: The Bullying, Harassment, and Aggression Receipt Measure.

PubMed

Hall, William J

2016-11-01

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and 6 subscales: physical bullying, verbal bullying, social/relational bullying, cyber-bullying, property bullying, and sexual bullying. First-order and second-order factor models were evaluated. Results demonstrate that the first-order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent-related validation and is a promising instrument for measuring bullying victimization in school.

The Reliability and Validity of Prostate Cancer Fatalism Inventory in Turkish Language.

PubMed

Aydoğdu, Nihal Gördes; Çapık, Cantürk; Ersin, Fatma; Kissal, Aygul; Bahar, Zuhal

2017-10-01

This study aimed to conduct the reliability and validity study of the Prostate Cancer Fatalism Inventory in Turkish language. The study carried out in methodological type and consisted of 171 men. The ages of the participants ranged between 40 and 82. The content validity index was determined to be 0.80, Kaiser-Meyer-Olkin value 0.825, Bartlett's test X 2  = 750.779 and p = 0.000. Then the principal component analysis was applied to the 15-item inventory. The inventory consisted of one dimension, and the load factors were over 0.30 for all items. The explained variance of the inventory was found 33.3 %. The Kuder-Richardson-20 coefficient was determined to be 0.849 and the item-total correlations ranged between 0.335 and 0.627. The Prostate Cancer Fatalism Inventory was a reliable and valid measurement tool in Turkish language. Integrating psychological strategies for prostate cancer screening may be required to strengthen the positive effects of nursing education.

Initial Development and Validation of the BullyHARM: The Bullying, Harassment, and Aggression Receipt Measure

PubMed Central

Hall, William J.

2017-01-01

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and 6 subscales: physical bullying, verbal bullying, social/relational bullying, cyber-bullying, property bullying, and sexual bullying. First-order and second-order factor models were evaluated. Results demonstrate that the first-order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent-related validation and is a promising instrument for measuring bullying victimization in school. PMID:28194041

Development and Testing of the Nurse Manager EBP Competency Scale.

PubMed

Shuman, Clayton J; Ploutz-Snyder, Robert J; Titler, Marita G

2018-02-01

The purpose of this study was to develop and evaluate the validity and reliability of an instrument to measure nurse manager competencies regarding evidence-based practice (EBP). The Nurse Manager EBP Competency Scale consists of 16 items for respondents to indicate their perceived level of competency on a 0 to 3 Likert-type scale. Content validity was demonstrated through expert panel review and pilot testing. Principal axis factoring and Cronbach's alpha evaluated construct validity and internal consistency reliability, respectively. Eighty-three nurse managers completed the scale. Exploratory factor analysis resulted in a 16-item scale with two subscales, EBP Knowledge ( n = 6 items, α = .90) and EBP Activity ( n = 10 items, α = .94). Cronbach's alpha for the entire scale was .95. The Nurse Manager EBP Competency Scale is a brief measure of nurse manager EBP competency with evidence of validity and reliability. The scale can enhance our understanding in future studies regarding how nurse manager EBP competency affects implementation.

Validation of a Survey Questionnaire on Organ Donation: An Arabic World Scenario

PubMed Central

Agarwal, Tulika Mehta; Al-Thani, Hassan; Al Maslamani, Yousuf

2018-01-01

Objective To validate a questionnaire for measuring factors influencing organ donation and transplant. Methods The constructed questionnaire was based on the theory of planned behavior by Ajzen Icek and had 45 questions including general inquiry and demographic information. Four experts on the topic, Arabic culture, and the Arabic and English languages established content validity through review. It was quantified by content validity index (CVI). Construct validity was established by principal component analysis (PCA), whereas internal consistency was checked by Cronbach's Alpha and intraclass correlation coefficient (ICC). Statistical analysis was performed by SPSS 22.0 statistical package. Results Content validity in the form of S-CVI/Average and S-CVI/UA was 0.95 and 0.82, respectively, suggesting adequate relevance content of the questionnaire. Factor analysis indicated that the construct validity for each domain (knowledge, attitudes, beliefs, and intention) was 65%, 71%, 77%, and 70%, respectively. Cronbach's Alpha and ICC coefficients were 0.90, 0.67, 0.75, and 0.74 and 0.82, 0.58, 0.61, and 0.74, respectively, for the domains. Conclusion The questionnaire consists of 39 items on knowledge, attitudes, beliefs, and intention domains which is valid and reliable tool to use for organ donation and transplant survey. PMID:29593894

Validity and Reliability of a General Nutrition Knowledge Questionnaire for Japanese Adults.

PubMed

Matsumoto, Mai; Tanaka, Rie; Ikemoto, Shinji

2017-01-01

Nutrition knowledge is necessary for individuals to adopt appropriate dietary habits, and needs to be evaluated before nutrition education is provided. However, there is no tool to assess general nutrition knowledge of adults in Japan. Our aims were to determine the validity and reliability of a general nutrition knowledge questionnaire for Japanese adults. We developed the pilot version of the Japanese general nutrition knowledge questionnaire (JGNKQ) and administered the pilot study to assess content validity and internal reliability to 1,182 Japanese adults aged 18-64 y. The JGNKQ was further modified based on the pilot study and the final version consisted of 5 sections and 147 items. The JGNKQ was administered to female undergraduate Japanese students in their senior year twice in 2015 to assess construct validity and test-retest reliability. Ninety-six students majoring in nutrition and 44 students in other majors who studied at the same university completed the first questionnaire. Seventy-five students completed the questionnaire twice. The responses from the first questionnaire and both questionnaires were used to assess construct validity and test-retest reliability, respectively. The students in nutrition major had significantly higher scores than the students in other majors on all sections of the questionnaire (p=0.000); therefore, the questionnaire had good construct validity. The test-retest reliability correlation coefficient value of overall and each section except "The use of dietary information to make dietary choices" were 0.75, 0.67, 0.67, 0.68 and 0.61, respectively. We suggest that the JGNKQ is an effective tool to assess the nutrition knowledge level of Japanese adults.

Validity and reliability of a modified english version of the physical activity questionnaire for adolescents.

PubMed

Aggio, Daniel; Fairclough, Stuart; Knowles, Zoe; Graves, Lee

2016-01-01

Adaptation of physical activity self-report questionnaires is sometimes required to reflect the activity behaviours of diverse populations. The processes used to modify self-report questionnaires though are typically underreported. This two-phased study used a formative approach to investigate the validity and reliability of the Physical Activity Questionnaire for Adolescents (PAQ-A) in English youth. Phase one examined test content and response process validity and subsequently informed a modified version of the PAQ-A. Phase two assessed the validity and reliability of the modified PAQ-A. In phase one, focus groups (n = 5) were conducted with adolescents (n = 20) to investigate test content and response processes of the original PAQ-A. Based on evidence gathered in phase one, a modified version of the questionnaire was administered to participants (n = 169, 14.5 ± 1.7 years) in phase two. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and intra-class correlations, respectively. Spearman correlations were used to assess associations between modified PAQ-A scores and accelerometer-derived physical activity, self-reported fitness and physical activity self-efficacy. Phase one revealed that the original PAQ-A was unrepresentative for English youth and that item comprehension varied. Contextual and population/cultural-specific modifications were made to the PAQ-A for use in the subsequent phase. In phase two, modified PAQ-A scores had acceptable internal consistency (α = 0.72) and test-retest reliability (ICC = 0.78). Modified PAQ-A scores were significantly associated with objectively assessed moderate-to-vigorous physical activity (r = 0.39), total physical activity (r = 0.42), self-reported fitness (r = 0.35), and physical activity self-efficacy (r = 0.32) (p ≤ 0.01). The modified PAQ-A had acceptable internal consistency and test-retest reliability. Modified PAQ-A scores displayed weak-to-moderate correlations with objectively measured physical activity, self-reported fitness, and self-efficacy providing evidence of satisfactory criterion and construct validity, respectively. Further testing with more diverse English samples is recommended to provide a more complete assessment of the tool.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Instruments to identify prescription medication misuse, abuse, and related events in clinical trials: an ACTTION systematic review

PubMed Central

Smith, Shannon M.; Paillard, Florence; McKeown, Andrew; Burke, Laurie B.; Edwards, Robert R.; Katz, Nathaniel P.; Papadopoulos, Elektra J.; Rappaport, Bob A.; Slagle, Ashley; Strain, Eric C.; Wasan, Ajay D.; Turk, Dennis C.; Dworkin, Robert H.

2017-01-01

Measurement of inappropriate medication use events (e.g., abuse, misuse) in clinical trials is important in characterizing a medication’s abuse potential. However, no “gold standard” assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (i.e., content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and non-opioid prescription medications to identify any that meet U.S. and European regulatory agencies’ rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the lifespan rather than current use, including items that did not directly assess inappropriate use (e.g., questions about anger), or failing to capture information pertinent to inappropriate use events (e.g., intention, route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, non-standardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. PMID:25660826

[Reliability and validity analysis of simplified Chinese version of QOL questionnaire of olfactory disorders].

PubMed

Jin, X F; Wang, J; Li, Y J; Liu, J F; Ni, D F

2016-09-20

Objective: To cross-culturally translate the questionnaire of olfactory disorders(QOD)into a simplified Chinese version, and evaluate its reliability and validity in clinical. Method: A simplified Chinese version of the QOD was evaluated in test-retest reliability, split-half reliability and internal consistency.Then it was evaluated in validity test including content validity, criterion-related validity, responsibility. Criterion-related validity was using the medical outcome study's 36-item short rorm health survey(SF-36) and the World Health Organization quality of life-brief (WHOQOL-BREF) for comparison. Result: A total of 239 patients with olfactory dysfunction were enrolled and tested, in which 195 patients completed all three surveys(QOD, SF-36, WHOQOL-BREF). The test-retest reliabilities of the QOD-parosmia statements(QOD-P), QOD-quality of life(QOD-QoL), and the QOD-visual simulation(QOD-VAS)sections were 0.799( P <0.01),0.781( P <0.01),0.488( P <0.01), respectively, and the Cronbach' s α coefficients reliability were 0.477,0.812,0.889,respectively.The split-half reliability of QOD-QoL was 0.89. There was no correlation between the QOD-P section and the SF-36, but there were statistically significant correlations between the QOD-QoL and QOD-VAS sections with the SF-36. There was no correlation between the QOD-P section and the WHOQOL-BREF, but there were statistically significant correlations between the QOD-QoL and QOD-VAS sections with the SF-36 in most sections. Conclusion: The simplified Chinese version of the QOD was testified to be a reliable and valid questionnaire for evaluating patients with olfactory dysfunction living in mainland of China.The QOD-P section needs further modifications to properly adapt patients with Chinese cultural and knowledge background. Copyright© by the Editorial Department of Journal of Clinical Otorhinolaryngology Head and Neck Surgery.

Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods.

PubMed

Hauge, Cindy Horst; Jacobs-Knight, Jacque; Jensen, Jamie L; Burgess, Katherine M; Puumala, Susan E; Wilton, Georgiana; Hanson, Jessica D

2015-06-01

The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population. © The Author(s) 2015.

Assessing institutional support for Hispanic nursing student retention: a study to evaluate the psychometric properties of two self-assessment inventories.

PubMed

Bond, Mary Lou; Cason, Carolyn L

2014-01-01

To assess the content validity and internal consistency reliability of the Healthcare Professions Education Program Self-Assessment (PSA) and the Institutional Self-Assessment for Factors Supporting Hispanic Student Retention (ISA). Health disparities among vulnerable populations are among the top priorities demanding attention in the United States. Efforts to recruit and retain Hispanic nursing students are essential. Based on a sample of provosts, deans/directors, and an author of the Model of Institutional Support, participants commented on the perceived validity and usefulness of each item of the PSA and ISA. Internal consistency reliability was calculated by Cronbach's alpha using responses from nursing schools in states with large Hispanic populations. The ISA and PSA were found to be reliable and valid tools for assessing institutional friendliness. The instruments highlight strengths and identify potential areas of improvement at institutional and program levels.

Preliminary Psychometric Analysis of the Modified Perceived Value of Certification Tool for the Nurse Educator.

PubMed

Barbe, Tammy

2015-01-01

The purpose of this study was to examine psychometric properties of the Perceived Value of Certification Tool© with a focus on nurse educator certification (PVCT-NE) in a sample of nurse educators. Greater understanding of faculty perceptions of certification is necessary to facilitate a strong cadre of nursing faculty; however, research around nurse educator certification is limited by a lack of reliable and valid instruments to measure such perceptions. Twenty-four nursing faculty from one university participated in the psychometric study, which involved completion of the PVCT-NE in a web-based survey format. Internal consistency reliability was excellent. Cronbach's alpha for the total PVCT-NE was .94 (.93 for the intrinsic subscale and .86 for the extrinsic subscale). A content validity index of .95 was obtained. There is preliminary evidence that the PVCT-NE is a reliable and valid instrument to measure perceived value of certification in nurse educators.

Assessing Households Preparedness for Earthquakes: An Exploratory Study in the Development of a Valid and Reliable Persian-version Tool.

PubMed

Ardalan, Ali; Sohrabizadeh, Sanaz

2016-02-25

Iran is placed among countries suffering from the highest number of earthquake casualties. Household preparedness, as one component of risk reduction efforts, is often supported in quake-prone areas. In Iran, lack of a valid and reliable household preparedness tool was reported by previous disaster studies. This study is aimed to fill this gap by developing a valid and reliable tool for assessing household preparedness in the event of an earthquake.  This survey was conducted through three phases including literature review and focus group discussions with the participation of eight key informants, validity measurements and reliability measurements. Field investigation was completed with the participation of 450 households within three provinces of Iran. Content validity, construct validity, the use of factor analysis; internal consistency using Cronbach's alpha coefficient, and test-retest reliability were carried out to develop the tool.  Based on the CVIs, ranging from 0.80 to 0.100, and exploratory factor analysis with factor loading of more than 0.5, all items were valid. The amount of Cronbach's alpha (0.7) and test-retest examination by Spearman correlations indicated that the scale was also reliable. The final instrument consisted of six categories and 18 questions including actions at the time of earthquakes, nonstructural safety, structural safety, hazard map, communications, drill, and safety skills.  Using a Persian-version tool that is adjusted to the socio-cultural determinants and native language may result in more trustful information on earthquake preparedness. It is suggested that disaster managers and researchers apply this tool in their future household preparedness projects. Further research is needed to make effective policies and plans for transforming preparedness knowledge into behavior.

Development of a reliable, valid measure to assess parents' and teachers' understanding of postural care for children with physical disabilities: the (UKC PostCarD) questionnaire.

PubMed

Hotham, S; Hutton, E; Hamilton-West, K E

2015-11-01

Previous research has highlighted lack of knowledge, understanding and confidence among parents and teachers responsible for the postural care of children with physical disability. Interventions designed to improve these qualities require a reliable and validated tool to assess pre- and post-intervention levels. Currently, however, no validated measure of postural care confidence (i.e. self-efficacy) exists. Hence, the aim of this research was to develop a reliable and valid questionnaire to assess parents' and teachers' confidence, alongside knowledge and understanding of postural care - the Understanding Knowledge and Confidence in providing POSTural CARe for children with Disabilities (UKC PostCarD) questionnaire. Items were developed by a multidisciplinary team and designed to map onto the content of 'An A-to-Z of Postural Care'. Parents, teachers and therapists assessed items for face validity. Scale reliability was then assessed using Cronbach's alpha and known-group validity was assessed by comparing scores of an 'expert' group (physiotherapists and occupational therapists) with those of a 'non-expert' group (with no formal training in postural care). The total scale and all three subscales (understanding and knowledge, confidence and concerns) demonstrated adequate reliability (α > 0.83) and subscale correlations formed a logical pattern (understanding and knowledge correlated positively with confidence and negatively with concerns). Experts' (n = 111) scores were higher than non-experts' (n = 79) for the total scale and all subscales (P < 0.001). Findings support the reliability and validity of the UKC PostCarD questionnaire as a measure of understanding, knowledge and confidence in providing postural care for children with disabilities. © 2015 John Wiley & Sons Ltd.

Validation of a short questionnaire to assess mothers' perception of workplace breastfeeding support.

PubMed

Bai, Yeon; Peng, C-Y Joanne; Fly, Alyce D

2008-07-01

The purpose of this study was to create and establish the validity of a short questionnaire to measure mothers' perceived support for breastfeeding from the workplace. The items in the workplace breastfeeding support scale (WBSS) were derived from a literature review. The scale was self-administered in central Indiana during the fall of 2005 to a convenience sample of 66 volunteers who were primiparous, 6 to 12 months postpartum, worked outside home, and had initiated breastfeeding prior to the survey. Internal consistency (alpha) and split-half reliability (r) tests and a factor analysis were done to establish reliability and construct validity of the scale. The WBSS showed acceptable reliability (alpha=.77, r=0.86). Content validity was established by review using a panel of experts. Four distinct constructs of the scale were identified that accounted for 62.1% of the total variability of the scale: technical, environmental, facility, and peer support, thus establishing construct validity of the scale. Lactation consultants and worksite lactation program planners can use the WBSS to help mothers returning to work and to assess the needs for improvement of support programs.

Psychometric testing on the NLN Student Satisfaction and Self-Confidence in Learning, Simulation Design Scale, and Educational Practices Questionnaire using a sample of pre-licensure novice nurses.

PubMed

Franklin, Ashley E; Burns, Paulette; Lee, Christopher S

2014-10-01

In 2006, the National League for Nursing published three measures related to novice nurses' beliefs about self-confidence, scenario design, and educational practices associated with simulation. Despite the extensive use of these measures, little is known about their reliability and validity. The psychometric properties of the Student Satisfaction and Self-Confidence in Learning Scale, Simulation Design Scale, and Educational Practices Questionnaire were studied among a sample of 2200 surveys completed by novice nurses from a liberal arts university in the southern United States. Psychometric tests included item analysis, confirmatory and exploratory factor analyses in randomly-split subsamples, concordant and discordant validity, and internal consistency. All three measures have sufficient reliability and validity to be used in education research. There is room for improvement in content validity with the Student Satisfaction and Self-Confidence in Learning and Simulation Design Scale. This work provides robust evidence to ensure that judgments made about self-confidence after simulation, simulation design and educational practices are valid and reliable. Copyright © 2014 Elsevier Ltd. All rights reserved.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

[Validity, reliability, and acceptability of the brief version of the self-management knowledge, attitude, and behavior assessment scale for diabetes patients].

PubMed

Wu, Y Z; Wang, W J; Feng, N P; Chen, B; Li, G C; Liu, J W; Liu, H L; Yang, Y Y

2016-07-06

To evaluate the validity, reliability, and acceptability of the brief version of the self-management knowledge, attitude, and behavior (KAB) assessment scale for diabetes patients. Diabetes patients who were managed at the Xinkaipu Community Health Service Center of Tianxin in Changsha, Hunan Province were selected for survey by cluster sampling. A total of 350 diabetes patients were surveyed using the brief scale to collect data on knowledge, attitudes, and behaviors of self-management. Content validity was evaluated by Pearson correlation coefficient between the brief scale and subscales of knowledge, attitude, and behavior. Structure validity was evaluated by factor analysis, and discrimination validity was evaluated by an independent sample t-test between the high-score and low-score groups. Reliability was tested by internal consistency reliability and split-half reliability. The evaluation indexes of internal consistency reliability were Cronbach's α coefficients, θ coefficient, and Ω coefficient. Acceptability was evaluated by valid response rate and completion time of the brief scale. A total of 346(98.9%) valid questionnaires were returned, with average survey time of (11.43±3.4) minutes. Average score of the brief scale was 78.85 ± 11.22; scores of the knowledge, attitude, and behavior subscales were 16.45 ± 4.42, 21.33 ± 2.03, and 41.07 ± 8.34, respectively. Pearson correlation coefficients between the brief scale and the knowledge, attitude, and behavior subscales were 0.92, 0.42, and 0.60, respectively; P-values were all less than 0.01, indicating that the face validity and content validity of the brief scale were achieved to a good level. The common factor cumulative variance contribution rate of the brief scale and three subscales was from 53.66% to 61.75%, which achieved more than 50% of the approved standard. There were 11 common factors; 41 of the total 42 items had factor loadings above 0.40 in their relevant common factor, indicating that the brief scale and three subscales had good construct validity. Patients were divided into a high-score group and a low-score group, then scores of the brief scale and three subscales were compared between the groups using a t-test. The results were all significant, indicating that the brief scale and three subscales had good discriminate validity. Mean scores of the brief scale and three subscales of the high-score group were 91.55±6.81, 19.51±2.17, 22.74±1.88, and 49.30±6.20, respectively; these were higher than the low-score group (65.89±5.79, 12.29±4.76, 20.22±1.88, and 33.39±6.17, respectively) with t-values 27.76, 13.31, 9.20, and 17.56 (P-values were less than 0.001). The Cronbach's α coefficient, θ coefficient, Ω coefficient, and split-half reliability of the brief scale were 0.83, 0.87, 0.96, and 0.84, respectively. These values for the three subscales were all above 0.70, except for the θ coefficient of the attitude subscale with 0.64, indicating that the brief scale and three subscales had acceptable internal consistency reliability. The brief version of the diabetes self-management knowledge, attitude, and behavior assessment scale showed good acceptability, validity, and reliability, to responsibly evaluate self-management KAB among patients with diabetes.

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Immunization knowledge and practice among Malaysian parents: a questionnaire development and pilot-testing.

PubMed

Awadh, Ammar Ihsan; Hassali, Mohamed Azmi; Al-lela, Omer Qutaiba; Bux, Siti Halimah; Elkalmi, Ramadan M; Hadi, Hazrina

2014-10-27

Parents are the main decision makers for their children vaccinations. This fact makes parents' immunization knowledge and practices as predictor factors for immunization uptake and timeliness. The aim of this pilot study was to develop a reliable and valid instrument in Malaysian language to measure immunization knowledge and practice (KP) of Malaysian parents. A cross-sectional prospective pilot survey was conducted among 88 Malaysian parents who attended public health facilities that provide vaccinations. Translated immunization KP questionnaires (Bahasa Melayu version) were used. Descriptive statistics were applied, face and content validity were assessed, and internal consistency, test-retest reliability, and construct validity were determined. The mean ± standard deviation (SD) of the knowledge scores was 7.36 ± 2.29 and for practice scores was 7.13 ± 2.20. Good internal consistency was found for knowledge and practice items (Cronbach's alpha = 0.757 and 0.743 respectively); the test-retest reliability value was 0.740 (p = 0.014). A panel of three specialist pharmacists who are experts in this field judged the face and content validity of the final questionnaire. Parents with up-to-date immunized children had significantly better knowledge and practice scores than parents who did not (p < 0.001 and p = 0.001 respectively), suggesting a good construct validity. A significant difference was found in knowledge and practice scores among parents' age (p = 0.006 and p = 0.029 respectively) and place of living (p = 0.037 and p = 0.043). The parents' knowledge level was positively associated with their practice toward immunization (Spearman's rank correlation coefficient 0.310, p = 0.003). The pilot study concluded that the Bahasa Melayu version of the immunization KP questionnaire has good reliability and validity for measuring the knowledge and practices of Malaysian parents and therefore this version can be used in future research.

Development of a quality-of-life instrument for autoimmune bullous disease: the Autoimmune Bullous Disease Quality of Life questionnaire.

PubMed

Sebaratnam, Deshan F; Hanna, Anna Marie; Chee, Shien-ning; Frew, John W; Venugopal, Supriya S; Daniel, Benjamin S; Martin, Linda K; Rhodes, Lesley M; Tan, Jeremy Choon Kai; Wang, Charles Qian; Welsh, Belinda; Nijsten, Tamar; Murrell, Dédée F

2013-10-01

Quality-of-life (QOL) evaluation is an increasingly important outcome measure in dermatology, with disease-specific QOL instruments being the most sensitive to changes in disease status. To develop a QOL instrument specific to autoimmune bullous disease (AIBD). A comprehensive item generation process was used to build a 45-item pilot Autoimmune Bullous Disease Quality of Life (ABQOL) questionnaire, distributed to 70 patients with AIBD. Experts in bullous disease refined the pilot ABQOL before factor analysis was performed to yield the final ABQOL questionnaire of 17 questions. We evaluated validity and reliability across a range of indices. Australian dermatology outpatient clinics and private dermatology practices. PATIENTS AND EXPOSURE: Patients with a histological diagnosis of AIBD. The development of an AIBD-specific QOL instrument. Face and content validity were established through the comprehensive patient interview process and expert review. In terms of convergent validity, the ABQOL was found to have a moderate correlation with scores on the Dermatology Life Quality Index (R = 0.63) and the General Health subscale of the 36-Item Short Form Health Survey (R = 0.69; P = .009) and low correlation with the Pemphigus Disease Area Index (R = 0.42) and Autoimmune Bullous Disease Skin Disorder Intensity Score (R = 0.48). In terms of discriminant validity, the ABQOL was found to be more sensitive than the Dermatology Life Quality Index (P = .02). The ABQOL was also found to be a reliable instrument evaluated by internal consistency (Cronbach α coefficient, 0.84) and test-retest reliability (mean percentage variation, 0.92). The ABQOL has been shown to be a valid and reliable instrument that may serve as an end point in clinical trials. Future work should include incorporating patient weighting on questions to further increase content validity and translation of the measure to other languages. anzctr.org.au Identifier: ACTRN12612000750886.

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Clinical validity of a relocation stress scale for the families of patients transferred from intensive care units.

PubMed

Oh, HyunSoo; Lee, Seul; Kim, JiSun; Lee, EunJu; Min, HyoNam; Cho, OkJa; Seo, WhaSook

2015-07-01

This study was conducted to develop a family relocation stress scale by modifying the Son's Relocation Stress Syndrome Scale, to examine its clinical validity and reliability and to confirm its suitability for measuring family relocation stress. The transfer of ICU patients to general wards is a significant anxiety-producing event for family members. However, no relocation stress scale has been developed specifically for families. A nonexperimental, correlation design was adopted. The study subjects were 95 family members of 95 ICU patients at a university hospital located in Incheon, South Korea. Face and construct validities of the devised family relocation stress scale were examined. Construct validity was examined using factor analysis and by using a nomological validity test. Reliability was also examined. Face and content validity of the scale were verified by confirming that its items adequately measured family relocation stress. Factor analysis yielded four components, and the total variance explained by these four components was 63·0%, which is acceptable. Nomological validity was well supported by significant relationships between relocation stress and degree of preparation for relocation, patient self-care ability, family burden and satisfaction with the relocation process. The devised scale was also found to have good reliability. The family relocation stress scale devised in this study was found to have good validity and reliability, and thus, is believed to offer a means of assessing family relocation stress. The findings of this study provide a reliable and valid assessment tool when nurses prepare families for patient transfer from an ICU to a ward setting, and may also provide useful information to those developing an intervention programme for family relocation stress management. © 2015 John Wiley & Sons Ltd.

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

Puzzling with online games (BAM-COG): reliability, validity, and feasibility of an online self-monitor for cognitive performance in aging adults.

PubMed

Aalbers, Teun; Baars, Maria A E; Olde Rikkert, Marcel G M; Kessels, Roy P C

2013-12-03

Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible. This study examines a new instrument called the Brain Aging Monitor-Cognitive Assessment Battery (BAM-COG) for its alternate forms reliability, face and content validity, and convergent and divergent validity. Also, reference values are provided. The BAM-COG consists of four easily accessible, short, yet challenging puzzle games that have been developed to measure working memory ("Conveyer Belt"), visuospatial short-term memory ("Sunshine"), episodic recognition memory ("Viewpoint"), and planning ("Papyrinth"). A total of 641 participants were recruited for this study. Of these, 397 adults, 40 years and older (mean 54.9, SD 9.6), were eligible for analysis. Study participants played all games three times with 14 days in between sets. Face and content validity were based on expert opinion. Alternate forms reliability (AFR) was measured by comparing scores on different versions of the BAM-COG and expressed with an intraclass correlation (ICC: two-way mixed; consistency at 95%). Convergent validity (CV) was provided by comparing BAM-COG scores to gold-standard paper-and-pencil and computer-assisted cognitive assessment. Divergent validity (DV) was measured by comparing BAM-COG scores to the National Adult Reading Test IQ (NART-IQ) estimate. Both CV and DV are expressed as Spearman rho correlation coefficients. Three out of four games showed adequate results on AFR, CV, and DV measures. The games Conveyer Belt, Sunshine, and Papyrinth have AFR ICCs of .420, .426, and .645 respectively. Also, these games had good to very good CV correlations: rho=.577 (P=.001), rho=.669 (P<.001), and rho=.400 (P=.04), respectively. Last, as expected, DV correlations were low: rho=-.029 (P=.44), rho=-.029 (P=.45), and rho=-.134 (P=.28) respectively. The game Viewpoint provided less desirable results with an AFR ICC of .167, CV rho=.202 (P=.15), and DV rho=-.162 (P=.21). This study provides evidence for the use of the BAM-COG test battery as a feasible, reliable, and valid tool to monitor cognitive performance in healthy adults in an online setting. Three out of four games have good psychometric characteristics to measure working memory, visuospatial short-term memory, and planning capacity.

Cross-cultural adaptation and validation of Persian Achilles tendon Total Rupture Score.

PubMed

Ansari, Noureddin Nakhostin; Naghdi, Soofia; Hasanvand, Sahar; Fakhari, Zahra; Kordi, Ramin; Nilsson-Helander, Katarina

2016-04-01

To cross-culturally adapt the Achilles tendon Total Rupture Score (ATRS) to Persian language and to preliminary evaluate the reliability and validity of a Persian ATRS. A cross-sectional and prospective cohort study was conducted to translate and cross-culturally adapt the ATRS to Persian language (ATRS-Persian) following steps described in guidelines. Thirty patients with total Achilles tendon rupture and 30 healthy subjects participated in this study. Psychometric properties of floor/ceiling effects (responsiveness), internal consistency reliability, test-retest reliability, standard error of measurement (SEM), smallest detectable change (SDC), construct validity, and discriminant validity were tested. Factor analysis was performed to determine the ATRS-Persian structure. There were no floor or ceiling effects that indicate the content and responsiveness of ATRS-Persian. Internal consistency was high (Cronbach's α 0.95). Item-total correlations exceeded acceptable standard of 0.3 for the all items (0.58-0.95). The test-retest reliability was excellent [(ICC)agreement 0.98]. SEM and SDC were 3.57 and 9.9, respectively. Construct validity was supported by a significant correlation between the ATRS-Persian total score and the Persian Foot and Ankle Outcome Score (PFAOS) total score and PFAOS subscales (r = 0.55-0.83). The ATRS-Persian significantly discriminated between patients and healthy subjects. Explanatory factor analysis revealed 1 component. The ATRS was cross-culturally adapted to Persian and demonstrated to be a reliable and valid instrument to measure functional outcomes in Persian patients with Achilles tendon rupture. II.

Reliability of a rating procedure to monitor industry self-regulation codes governing alcohol advertising content.

PubMed

Babor, Thomas F; Xuan, Ziming; Proctor, Dwayne

2008-03-01

The purposes of this study were to develop reliable procedures to monitor the content of alcohol advertisements broadcast on television and in other media, and to detect violations of the content guidelines of the alcohol industry's self-regulation codes. A set of rating-scale items was developed to measure the content guidelines of the 1997 version of the U.S. Beer Institute Code. Six focus groups were conducted with 60 college students to evaluate the face validity of the items and the feasibility of the procedure. A test-retest reliability study was then conducted with 74 participants, who rated five alcohol advertisements on two occasions separated by 1 week. Average correlations across all advertisements using three reliability statistics (r, rho, and kappa) were almost all statistically significant and the kappas were good for most items, which indicated high test-retest agreement. We also found high interrater reliabilities (intraclass correlations) among raters for item-level and guideline-level violations, indicating that regardless of the specific item, raters were consistent in their general evaluations of the advertisements. Naïve (untrained) raters can provide consistent (reliable) ratings of the main content guidelines proposed in the U.S. Beer Institute Code. The rating procedure may have future applications for monitoring compliance with industry self-regulation codes and for conducting research on the ways in which alcohol advertisements are perceived by young adults and other vulnerable populations.

Validity and Reliability of Malay Version of the Job Content Questionnaire among Public Hospital Female Nurses in Malaysia.

PubMed

Amin, N A; Quek, K F; Oxley, J A; Noah, R M; Nordin, R

2015-10-01

The Job Content Questionnaire (M-JCQ) is an established self-reported instrument used across the world to measure the work dimensions based on the Karasek's demand-control-support model. To evaluate the psychometrics properties of the Malay version of M-JCQ among nurses in Malaysia. This cross-sectional study was carried out on nurses working in 4 public hospitals in Klang Valley area, Malaysia. M-JCQ was used to assess the perceived psychosocial stressors and physical demands of nurses at their workplaces. Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Cronbach's α values were used to estimate the reliability (internal consistency) of the M-JCQ. EFA showed that 34 selected items were loaded in 4 factors. Except for psychological job demand (Cronbach's α 0.51), the remaining 3 α values for 3 subscales (job control, social support, and physical demand) were greater than 0.70, indicating acceptable internal consistency. However, an item was excluded due to poor item-total correlation (r<0.3). The final M-JCQ was consisted of 33 items. The M-JCQ is a reliable and valid instrument to measure psychosocial and physical stressors in the workplace of public hospital nurses in Malaysia.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.

Systematic review of methods for quantifying teamwork in the operating theatre

PubMed Central

Marshall, D.; Sykes, M.; McCulloch, P.; Shalhoub, J.; Maruthappu, M.

2018-01-01

Background Teamwork in the operating theatre is becoming increasingly recognized as a major factor in clinical outcomes. Many tools have been developed to measure teamwork. Most fall into two categories: self‐assessment by theatre staff and assessment by observers. A critical and comparative analysis of the validity and reliability of these tools is lacking. Methods MEDLINE and Embase databases were searched following PRISMA guidelines. Content validity was assessed using measurements of inter‐rater agreement, predictive validity and multisite reliability, and interobserver reliability using statistical measures of inter‐rater agreement and reliability. Quantitative meta‐analysis was deemed unsuitable. Results Forty‐eight articles were selected for final inclusion; self‐assessment tools were used in 18 and observational tools in 28, and there were two qualitative studies. Self‐assessment of teamwork by profession varied with the profession of the assessor. The most robust self‐assessment tool was the Safety Attitudes Questionnaire (SAQ), although this failed to demonstrate multisite reliability. The most robust observational tool was the Non‐Technical Skills (NOTECHS) system, which demonstrated both test–retest reliability (P > 0·09) and interobserver reliability (Rwg = 0·96). Conclusion Self‐assessment of teamwork by the theatre team was influenced by professional differences. Observational tools, when used by trained observers, circumvented this.

Measuring professional satisfaction in Greek nurses: combination of qualitative and quantitative investigation to evaluate the validity and reliability of the Index of Work Satisfaction.

PubMed

Karanikola, Maria N K; Papathanassoglou, Elizabeth D E

2015-02-01

The Index of Work Satisfaction (IWS) is a comprehensive scale assessing nurses' professional satisfaction. The aim of the present study was to explore: a) the applicability, reliability and validity of the Greek version of the IWS and b) contrasts among the factors addressed by IWS against the main themes emerging from a qualitative phenomenological investigation of nurses' professional experiences. A descriptive correlational design was applied using a sample of 246 emergency and critical care nurses. Internal consistency and test-retest reliability were tested. Construct and content validity were assessed by factor analysis, and through qualitative phenomenological analysis with a purposive sample of 12 nurses. Scale factors were contrasted to qualitative themes to assure that IWS embraces all aspects of Greek nurses' professional satisfaction. The internal consistency (α = 0.81) and test-retest (tau = 1, p < 0.0001) reliability were adequate. Following appropriate modifications, factor analysis confirmed the construct validity of the scale and subscales. The qualitative data partially clarified the low reliability of one subscale. The Greek version of the IWS scale is supported for use in acute care. The mixed methods approach constitutes a powerful tool for transferring scales to different cultures and healthcare systems. Copyright © 2014 Elsevier Inc. All rights reserved.

Reliability and Validity of a Turkish version of the Prenatal Breastfeeding Self-Efficacy Scale.

PubMed

Aydin, Ayse; Pasinlioglu, Turkan

2018-05-18

This study aims to conduct reliability and validity study of the Turkish version of the "Prenatal Breastfeeding Self-Efficacy Scale", which determines pregnant women's perception of breastfeeding self-efficacy in the prenatal period. This methodological research was carried out between December 2014 and May 2016 in maternity clinics of the Erzurum Nene Hatun Maternity Hospital and Atatürk University Research Hospital. The study population consisted of pregnant women, admitted to the specified clinics for prenatal controls. The study was carried out with 326 pregnant women, who met the inclusion criteria and agreed to participate in the research without any sample selection. "Personal Information Form" and "Prenatal Breastfeeding Self-Efficacy Scale - Turkish Form" were used for data collection. The data were collected by the face-to-face interview method, and analyzed by SPSS 18 software. In the validity-reliability analysis of the scale, language and content validity, explanatory factor analysis, Cronbach's Alpha coefficient, item-total score correlation, and testretest methods were used. Linguistic validity was verified by the translation-backtranslation of the Prenatal Breastfeeding Self-Efficacy Scale, then the necessary corrections were made according to the recommendations of the expert opinions, to ensure the content validity. As a result of the explanatory factor analysis, performed to determine the construct validity of the scale, a single factor structure was found, having factor loadings in the appropriate range (0.30-0.76). In the internal consistency analysis of the scale, Cronbach's Alpha was 0.86, and the item-total score correlations were between 0.23 and 0.65, and no item was removed from the scale. In order to test the time-invariance of the scale, the test-retest correlation value was found to be 0.94. The relationship between the two applications were determined to be statistically significant (p < 0.001). Turkish version of the Prenatal Breastfeeding Self-Efficacy Scale was evaluated in Turkish women and found to be a valid and reliable measurement instrument. Copyright © 2018 Elsevier Ltd. All rights reserved.

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief disease management encounters. MISHCE also evaluates quality of the patient-provider therapeutic alliance, i.e., the "flow" of the interaction. Copyright © 2015 Elsevier Inc. All rights reserved.

The Utrecht questionnaire (U-CEP) measuring knowledge on clinical epidemiology proved to be valid.

PubMed

Kortekaas, Marlous F; Bartelink, Marie-Louise E L; de Groot, Esther; Korving, Helen; de Wit, Niek J; Grobbee, Diederick E; Hoes, Arno W

2017-02-01

Knowledge on clinical epidemiology is crucial to practice evidence-based medicine. We describe the development and validation of the Utrecht questionnaire on knowledge on Clinical epidemiology for Evidence-based Practice (U-CEP); an assessment tool to be used in the training of clinicians. The U-CEP was developed in two formats: two sets of 25 questions and a combined set of 50. The validation was performed among postgraduate general practice (GP) trainees, hospital trainees, GP supervisors, and experts. Internal consistency, internal reliability (item-total correlation), item discrimination index, item difficulty, content validity, construct validity, responsiveness, test-retest reliability, and feasibility were assessed. The questionnaire was externally validated. Internal consistency was good with a Cronbach alpha of 0.8. The median item-total correlation and mean item discrimination index were satisfactory. Both sets were perceived as relevant to clinical practice. Construct validity was good. Both sets were responsive but failed on test-retest reliability. One set took 24 minutes and the other 33 minutes to complete, on average. External GP trainees had comparable results. The U-CEP is a valid questionnaire to assess knowledge on clinical epidemiology, which is a prerequisite for practicing evidence-based medicine in daily clinical practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Development and validation of the coping with terror scale.

PubMed

Stein, Nathan R; Schorr, Yonit; Litz, Brett T; King, Lynda A; King, Daniel W; Solomon, Zahava; Horesh, Danny

2013-10-01

Terrorism creates lingering anxiety about future attacks. In prior terror research, the conceptualization and measurement of coping behaviors were constrained by the use of existing coping scales that index reactions to daily hassles and demands. The authors created and validated the Coping with Terror Scale to fill the measurement gap. The authors emphasized content validity, leveraging the knowledge of terror experts and groups of Israelis. A multistep approach involved construct definition and item generation, trimming and refining the measure, exploring the factor structure underlying item responses, and garnering evidence for reliability and validity. The final scale comprised six factors that were generally consistent with the authors' original construct specifications. Scores on items linked to these factors demonstrate good reliability and validity. Future studies using the Coping with Terror Scale with other populations facing terrorist threats are needed to test its ability to predict resilience, functional impairment, and psychological distress.

Maternal sensitivity and attachment security in Thailand: cross-cultural validation of Western measures.

PubMed

Chaimongkol, Nujjaree N; Flick, Louise H

2006-01-01

The purpose of this study was to examine the psychometric properties of Thai versions of the Maternal Behavior Q-Sort (MBQS), Caldwell's HOME, and the Attachment Q-set (AQS). A sample of 110 Thai mother-infant dyads were studied. The Content Validity Index (CVIs) of the Thai MBQS, HOME and AQS were between 91% and 99%. Internal consistency of the HOME was .71. Interobserver reliability of the MBQS, HOME, and AQS were .95, .87, and .87, respectively. Convergent validity was supported by finding a positive correlation between the MBQS and the HOME (r = .29, p < .001). A positive correlation of .45 (p < .001) between the scores of the MBQS and the AQS indicated concurrent validity of these scales. Study findings indicate the Thai MBQS, HOME, and AQS are reliable and valid in this Thai sample and suggest that the Thai versions reflect concepts similar to those in the original English versions.

Development and psychometric testing of the Nurse Practitioner Primary Care Organizational Climate Questionnaire.

PubMed

Poghosyan, Lusine; Nannini, Angela; Finkelstein, Stacey R; Mason, Emanuel; Shaffer, Jonathan A

2013-01-01

Policy makers and healthcare organizations are calling for expansion of the nurse practitioner (NP) workforce in primary care settings to assure timely access and high-quality care for the American public. However, many barriers, including those at the organizational level, exist that may undermine NP workforce expansion and their optimal utilization in primary care. This study developed a new NP-specific survey instrument, Nurse Practitioner Primary Care Organizational Climate Questionnaire (NP-PCOCQ), to measure organizational climate in primary care settings and conducted its psychometric testing. Using instrument development design, the organizational climate domain pertinent for primary care NPs was identified. Items were generated from the evidence and qualitative data. Face and content validity were established through two expert meetings. Content validity index was computed. The 86-item pool was reduced to 55 items, which was pilot tested with 81 NPs using mailed surveys and then field-tested with 278 NPs in New York State. SPSS 18 and Mplus software were used for item analysis, reliability testing, and maximum likelihood exploratory factor analysis. Nurse Practitioner Primary Care Organizational Climate Questionnaire had face and content validity. The content validity index was .90. Twenty-nine items loaded on four subscale factors: professional visibility, NP-administration relations, NP-physician relations, and independent practice and support. The subscales had high internal consistency reliability. Cronbach's alphas ranged from.87 to .95. Having a strong instrument is important to promote future research. Also, administrators can use it to assess organizational climate in their clinics and propose interventions to improve it, thus promoting NP practice and the expansion of NP workforce.

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.

Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus.

PubMed

McElhone, Kathleen; Abbott, Janice; Shelmerdine, Joanna; Bruce, Ian N; Ahmad, Yasmeen; Gordon, Caroline; Peers, Kate; Isenberg, David; Ferenkeh-Koroma, Ada; Griffiths, Bridget; Akil, Mohamed; Maddison, Peter; Teh, Lee-Suan

2007-08-15

To develop and validate a disease-specific health-related quality of life (HRQOL) instrument for adults with systemic lupus erythematosus (SLE). The work consisted of 6 stages. Stage 1 included item generation for questionnaire content from semistructured interviews with SLE patients. In stage 2 item selection for the draft questionnaire was performed by thematic analysis of the patient interview transcripts and expert panel agreement. In stage 3 the content validity of the draft questionnaire was assessed by patients completing the questionnaire and providing critical feedback. In stages 4 and 5 construct validity and internal reliability of the 3 versions of the LupusQoL were evaluated using principal component analysis with varimax rotation and Cronbach's alpha coefficients, respectively. In stage 6 discriminatory validity, concurrent validity, and test-retest reliability were evaluated. Stages 1, 2, and 3 resulted in a preliminary instrument containing 63 items. In stage 4, 8 domains were identified. This factor structure, accounting for 82% of the variance, was confirmed in stage 5. The domains and Cronbach's alpha coefficients were physical health (0.94), emotional health (0.94), body image (0.89), pain (0.92), planning (0.93), fatigue (0.88), intimate relationships (0.96), and burden to others (0.94). Discriminant validity was demonstrated for different levels of disease activity (British Isles Lupus Assessment Group Index) and damage (Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index). High correlations (r = 0.71-0.79) between comparable domains of the Short Form 36 and the LupusQoL assured acceptable concurrent validity. Good test-retest reliability (r = 0.72-0.93) was demonstrated. The LupusQoL is a validated SLE-specific HRQOL instrument with 34 items across 8 domains defined by patients as being important.

Cross-cultural adaptation and validation of the neonatal/infant Braden Q risk assessment scale.

PubMed

de Lima, Edson Luiz; de Brito, Maria José Azevedo; de Souza, Diba Maria Sebba Tosta; Salomé, Geraldo Magela; Ferreira, Lydia Masako

2016-02-01

To translate into Brazilian Portuguese and cross-culturally adapt the Neonatal/Infant Braden Q Risk Assessment Scale (Neonatal/Infant Braden Q Scale), and test the psychometric properties, reproducibility and validity of the instrument. There is a lack of studies on the development of pressure ulcers in children, especially in neonates. Thirty professionals participated in the cross-cultural adaptation of the Brazilian-Portuguese version of the scale. Fifty neonates of both sexes were assessed between July 2013 and June 2014. Reliability and reproducibility were tested in 20 neonates and construct validity was measured by correlating the Neonatal/Infant Braden Q Scale with the Braden Q Risk Assessment Scale (Braden Q Scale). Discriminant validity was assessed by comparing the scores of neonates with and without ulcers. The scale showed inter-rater reliability (ICC = 0.98; P < 0.001) and intra-rater reliability (ICC = 0.79; P < 0.001). A strong correlation was found between the Neonatal/Infant Braden Q Scale and Braden Q Scale (r = 0.96; P < 0.001). The cross-culturally adapted Brazilian version of the Neonatal/Infant Braden Q Scale is a reliable instrument, showing face, content and construct validity. Copyright © 2015 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

[New questionnaire to assess self-efficacy toward physical activity in children].

PubMed

Aedo, Angeles; Avila, Héctor

2009-10-01

To design a questionnaire for assessment of self-efficacy toward physical activity in school children, as well as to measure its construct validity, test-retest reliability, and internal consistency. A four-stage multimethod approach was used: (1) bibliographic research followed by exploratory study and the formulation of questions and responses based on a dichotomous scale of 14 items; (2) validation of the content by a panel of experts; (3) application of the preliminary version of the questionnaire to a sample of 900 school-aged children in Mexico City; and (4) determination of the construct validity, test-retest reliability, and internal consistency (Cronbach's alpha). Three factors were identified that explain 64.15% of the variance: the search for positive alternatives to physical activity, ability to deal with possible barriers to exercising, and expectations of skill or competence. The model was validated using the goodness of fit, and the result of 65% less than 0.05 indicated that the estimated factor model fit the data. Cronbach's consistency alpha was 0.733; test-retest reliability was 0.867. The scale designed has adequate reliability and validity. These results are a good indicator of self-efficacy toward physical activity in school children, which is important when developing programs intended to promote such behavior in this age group.

Six Years of Comprehensive, Clinical, Performance-Based Assessment Using Standardized Patients at the Southern Illinois University School of Medicine.

ERIC Educational Resources Information Center

Vu, Nu Viet; And Others

1992-01-01

The use of a performance-based assessment of senior medical students' clinical skills utilizing standardized patients was evaluated, with 6,804 student-patient encounters involving 405 students over 6 years. Results provide evidence for test security, content validity, construct validity, reliability, and test ability to discriminate a wide range…

The Development and Validation of an Alternative Assessment to Measure Changes in Understanding of the Longleaf Pine Ecosystem

ERIC Educational Resources Information Center

Dentzau, Michael W.; Martínez, Alejandro José Gallard

2016-01-01

A drawing assessment to gauge changes in fourth grade students' understanding of the essential components of the longleaf pine ecosystem was developed to support an out-of-school environmental education program. Pre- and post-attendance drawings were scored with a rubric that was determined to have content validity and reliability among users. In…

Validity and reliability of a nutrition knowledge survey for assessment in elementary school children.

PubMed

Gower, Jared R; Moyer-Mileur, Laurie J; Wilkinson, Robert D; Slater, Hillarie; Jordan, Kristine C

2010-03-01

Limited surveys are available to assess the nutrition knowledge of children. The goals of this study were to test the validity and reliability of a computer nutrition knowledge survey for elementary school students and to evaluate the impact of the "Fit Kids 'r' Healthy Kids" nutrition intervention via the knowledge survey. During survey development, a sample (n=12) of health educators, elementary school teachers, and registered dietitians assessed the survey. The target population consisted of first- through fourth-grade students from Salt Lake City, UT, metropolitan area schools. Participants were divided into reliability (n=68), intervention (n=74), and control groups (n=59). The reliability group took the survey twice (2 weeks apart); the intervention and control groups also took the survey twice, but at pre- and post-intervention (4 weeks later). Only students from the intervention group participated in four weekly nutrition classes. Reliability was assessed by Pearson's correlation coefficients for knowledge scores. Results demonstrated appropriate content validity, as indicated by expert peer ratings. Test-retest reliability correlations were found to be significant for the overall survey (r=0.54; P<0.001) and for all subscales: food groups, healthful foods, and food functions (r=0.51, 0.65, and 0.49, respectively; P<0.001). Nutrition knowledge was assessed upon program completion with paired samples t tests. Students from the intervention group demonstrated improvement in nutrition knowledge (12.2+/-1.9 to 13.5+/-1.6; P<0.001), while scores for the control group remained unchanged. The difference in total scores from pre- to post-intervention between the two groups was significant (P<0.001). These results suggest that the computerized nutrition survey demonstrated content validity and test-retest reliability for first- through fourth-grade elementary school children. Also, the study results imply that the Fit Kids 'r' Healthy Kids intervention promoted gains in nutrition knowledge. Overall, the computer survey shows promise as an appealing medium for assessing nutrition knowledge in children. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

PubMed

Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

2015-08-01

This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. © 2015 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

Validity and reliability of the Cohen 10-item Perceived Stress Scale in patients with chronic headache: Persian version.

PubMed

Khalili, Robabe; Sirati Nir, Masoud; Ebadi, Abbas; Tavallai, Abbas; Habibi, Mehdi

2017-04-01

The Cohen Perceived Stress Scale is being used widely in various countries. The present study evaluated the validity and reliability of the Cohen 10-item Perceived Stress Scale (PSS-10) in assessing tension headache, migraine, and stress-related diseases in Iran. This study is a methodological and cross-sectional descriptive investigation of 100 patients with chronic headache admitted to the pain clinic of Baqiyatallah Educational and Therapeutic Center. Convenience sampling was used for subject selection. PSS psychometric properties were evaluated in two stages. First, the standard scale was translated. Then, the face validity, content, and construct of the translated version were determined. The average age of participants was 38 years with a standard deviation (SD) of 13.2. As for stress levels, 12% were within the normal range, 36% had an intermediate level, and 52% had a high level of stress. The face validity and scale content were remarkable, and the KMO coefficient was 0.82. Bartlett's test yielded 0.327 which was statistically significant (p<0.0001) representing the quality of the sample. In factor analysis of the scale, the two elements of "coping" and "distress" were determined. A Cronbach's Alpha coefficient of 0.72 was obtained. This confirmed the remarkable internal consistency and stability of the scale through repeated measure tests (0.93). The Persian PSS-10 has good internal consistency and reliability. The availability of a validated Persian PSS-10 would indicate a link between stress and chronic headache. Copyright © 2017 Elsevier B.V. All rights reserved.

Evidence on the validity and reliability of the German, French and Italian nursing home version of the Basel Extent of Rationing of Nursing Care instrument.

PubMed

Zúñiga, Franziska; Schubert, Maria; Hamers, Jan P H; Simon, Michael; Schwendimann, René; Engberg, Sandra; Ausserhofer, Dietmar

2016-08-01

To develop and test psychometrically the Basel Extent of Rationing of Nursing Care for Nursing Homes instrument, providing initial evidence on the validity and reliability of the German, French and Italian-language versions. In the hospital setting, implicit rationing of nursing care is defined as the withholding of nursing activities due to lack of resources, such as staffing or time. No instrument existed to measure this concept in nursing homes. Cross-sectional study. We developed the instrument in three phases: (1) adaption and translation; (2) content validity testing; and (3) initial validity and reliability testing. For phase 3, we analysed survey data from 4748 care workers collected between May 2012-April 2013 from a randomly selected sample of 162 nursing homes in the German-, French- and Italian-speaking regions of Switzerland to provide evidence from response processes (e.g. missing), internal structure (exploratory factor analysis), inter-item inconsistencies (e.g. Cronbach's alpha) and interscorer differences (e.g. within-group agreement). Exploratory factor analysis revealed a four-factor structure with good fit statistics. Rationing of nursing care was structured in four domains: (1) activities of daily living; (2) caring, rehabilitation and monitoring; (3) documentation; and (4) social care. Items of the social care subscale showed lower content validity and more missing values than items of other subscales. First evidence indicates that the new instrument can be recommended for research and practice to measure implicit rationing of nursing care in nursing homes. Further refinements of single items are needed. © 2016 John Wiley & Sons Ltd.

Developing and investigating the use of single-item measures in organizational research.

PubMed

Fisher, Gwenith G; Matthews, Russell A; Gibbons, Alyssa Mitchell

2016-01-01

The validity of organizational research relies on strong research methods, which include effective measurement of psychological constructs. The general consensus is that multiple item measures have better psychometric properties than single-item measures. However, due to practical constraints (e.g., survey length, respondent burden) there are situations in which certain single items may be useful for capturing information about constructs that might otherwise go unmeasured. We evaluated 37 items, including 18 newly developed items as well as 19 single items selected from existing multiple-item scales based on psychometric characteristics, to assess 18 constructs frequently measured in organizational and occupational health psychology research. We examined evidence of reliability; convergent, discriminant, and content validity assessments; and test-retest reliabilities at 1- and 3-month time lags for single-item measures using a multistage and multisource validation strategy across 3 studies, including data from N = 17 occupational health subject matter experts and N = 1,634 survey respondents across 2 samples. Items selected from existing scales generally demonstrated better internal consistency reliability and convergent validity, whereas these particular new items generally had higher levels of content validity. We offer recommendations regarding when use of single items may be more or less appropriate, as well as 11 items that seem acceptable, 14 items with mixed results that might be used with caution due to mixed results, and 12 items we do not recommend using as single-item measures. Although multiple-item measures are preferable from a psychometric standpoint, in some circumstances single-item measures can provide useful information. (c) 2016 APA, all rights reserved).

Validity and reliability of a short questionnaire for assessing the impact of cooking skills interventions.

PubMed

Barton, K L; Wrieden, W L; Anderson, A S

2011-12-01

Food skills programmes are widely used as a means to improve confidence in food preparation, the use of basic food skills and food selections amongst low income communities. However, the impact of such interventions are rarely evaluated as a result of a lack of validated assessment tools appropriate for use within this target group. A two-page questionnaire utilising a closed-question format was designed based on key domains known to be influenced by cooking skills programmes. Content validity was assessed by a panel of public health experts and face validity by individuals, typical of those who may attend cooking skills classes. Internal and repeat reliability were assessed with groups of adults attending community-based classes. The feasibility of using the tool in community settings was also assessed. The draft questionnaire was amended as appropriate subsequent to content and face validity testing. Cronbach's alpha for confidence and knowledge sections was 0.86 and 0.84, respectively, indicating good internal consistency. Spearman correlation coefficients for repeat reliability testing between time 1 and time 2 for each item were in the range 0.46-0.91 (all significant at P < 0.001), indicating that the questionnaire elicited stable responses for repeated use. Feasibility testing highlighted the need for detailed instructions for course tutors on how to distribute and check questionnaires for completion. This tool provides a standardised method of evaluating cooking skills interventions that could be utilised in the development and evaluation of multicentre cooking skills interventions. © 2011 The Authors. Journal of Human Nutrition and Dietetics © 2011 The British Dietetic Association Ltd.

Development and validation of a self-efficacy questionnaire (SE-12) measuring the clinical communication skills of health care professionals.

PubMed

Axboe, Mette K; Christensen, Kaj S; Kofoed, Poul-Erik; Ammentorp, Jette

2016-10-18

The outcome of communication training is widely measured by self-efficacy ratings, and different questionnaires have been used. Nevertheless, none of these questionnaires have been formally validated through systematic measurement of assessment properties. Consequently, we decided to further develop a self-efficacy questionnaire which has been used in previous studies. This study aims to examine the content, internal structure, and relations with other variables of the new version of the self-efficacy questionnaire (SE-12). The questionnaire was developed on the basis of the theoretical approach applied in the communication course, statements from former course participants, teachers, and experts in the field. The questionnaire was initially validated through face-to-face interviews with 9 staff members following a test-retest including 195 participants. After minor adjustments, the SE-12 questionnaire demonstrated evidence of content validity. An explorative factor analysis indicated unidimensionality with highly correlated items. A Cronbach's α of 0.95 and a Loevinger's H coefficient of 0.71 provided evidence of statistical reliability and scalability. The test-retest reliability had a value of 0.71 when evaluated using intra-class correlation. Expected relations with other variables were partially confirmed in two of three hypotheses, but a ceiling effect was present in 9 of 12 items. The SE-12 scale should be regarded a reliable and partially valid instrument. We consider the questionnaire useful for self-evaluation of clinical communication skills; the SE-12 is user-friendly and can be administered as an electronic questionnaire. However, future research should explore potential needs for adjustments to reduce the identified ceiling effect.

The Chelsea critical care physical assessment tool (CPAx): validation of an innovative new tool to measure physical morbidity in the general adult critical care population; an observational proof-of-concept pilot study.

PubMed

Corner, E J; Wood, H; Englebretsen, C; Thomas, A; Grant, R L; Nikoletou, D; Soni, N

2013-03-01

To develop a scoring system to measure physical morbidity in critical care - the Chelsea Critical Care Physical Assessment Tool (CPAx). The development process was iterative involving content validity indices (CVI), a focus group and an observational study of 33 patients to test construct validity against the Medical Research Council score for muscle strength, peak cough flow, Australian Therapy Outcome Measures score, Glasgow Coma Scale score, Bloomsbury sedation score, Sequential Organ Failure Assessment score, Short Form 36 (SF-36) score, days of mechanical ventilation and inter-rater reliability. Trauma and general critical care patients from two London teaching hospitals. Users of the CPAx felt that it possessed content validity, giving a final CVI of 1.00 (P<0.05). Construct validation data showed moderate to strong significant correlations between the CPAx score and all secondary measures, apart from the mental component of the SF-36 which demonstrated weak correlation with the CPAx score (r=0.024, P=0.720). Reliability testing showed internal consistency of α=0.798 and inter-rater reliability of κ=0.988 (95% confidence interval 0.791 to 1.000) between five raters. This pilot work supports proof of concept of the CPAx as a measure of physical morbidity in the critical care population, and is a cogent argument for further investigation of the scoring system. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

The Multimedia Activity Recall for Children and Adolescents (MARCA): development and evaluation.

PubMed

Ridley, Kate; Olds, Tim S; Hill, Alison

2006-05-26

Self-report recall questionnaires are commonly used to measure physical activity, energy expenditure and time use in children and adolescents. However, self-report questionnaires show low to moderate validity, mainly due to inaccuracies in recalling activity in terms of duration and intensity. Aside from recall errors, inaccuracies in estimating energy expenditure from self-report questionnaires are compounded by a lack of data on the energy cost of everyday activities in children and adolescents. This article describes the development of the Multimedia Activity Recall for Children and Adolescents (MARCA), a computer-delivered use-of-time instrument designed to address both the limitations of self-report recall questionnaires in children, and the lack of energy cost data in children. The test-retest reliability of the MARCA was assessed using a sample of 32 children (aged 11.8 +/- 0.7 y) who undertook the MARCA twice within 24-h. Criterion validity was assessed by comparing self-reports with accelerometer counts collected on a sample of 66 children (aged 11.6 +/- 0.8 y). Content and construct validity were assessed by establishing whether data collected using the MARCA on 1429 children (aged 11.9 +/- 0.8 y) exhibited relationships and trends in children's physical activity consistent with established findings from a number of previous research studies. Test-retest reliability was high with intra-class coefficients ranging from 0.88 to 0.94. The MARCA demonstrated criterion validity comparable to other self-report instruments with Spearman coefficients ranging from rho = 0.36 to 0.45, and provided evidence of good content and construct validity. The MARCA is a valid and reliable self-report questionnaire, capable of a wide variety of flexible use-of-time analyses related to both physical activity and sedentary behaviour, and offers advantages over existing pen-and-paper questionnaires.

Critical thinking skills in midwifery practice: Development of a self-assessment tool for students.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-07-01

Develop and test a tool designed for use by pre-registration midwifery students to self-appraise their critical thinking in practice. A descriptive cohort design was used. All students (n=164) enrolled in a three-year Bachelor of Midwifery program in Queensland, Australia. The staged model for tool development involved item generation, mapping draft items to critical thinking concepts and expert review to test content validity, pilot testing of the tool to a convenience sample of students, and psychometric testing. Students (n=126, 76.8% response rate) provided demographic details, completed the new tool, and five questions from the Motivated Strategies for Learning Questionnaire (MSLQ) via an online platform or paper version. A high content validity index score of 0.97 was achieved through expert review. Construct validity via factor analysis revealed four factors: seeks information, reflects on practice, facilitates shared decision making, and evaluates practice. The mean total score for the tool was 124.98 (SD=12.58). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of 0.92. Concurrent validity with the MSLQ subscale was 0.35 (p<0.001). This study established the reliability and validity of the CACTiM - student version for use by pre-registration midwifery students to self-assess critical thinking in practice. Critical thinking skills are vital for safe and effective midwifery practice. Students' assessment of their critical thinking development throughout their pre-registration programme makes these skills explicit, and could guide teaching innovation to address identified deficits. The availability of a reliable and valid tool assists research into the development of critical thinking in education and practice. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

A community-based validation study of the short-form 36 version 2 Philippines (Tagalog) in two cities in the Philippines.

PubMed

Castillo-Carandang, Nina T; Sison, Olivia T; Grefal, Mary Lenore; Sy, Rody G; Alix, Oliver C; Llanes, Elmer Jasper B; Reganit, Paul Ferdinand M; Gumatay, Allan Wilbert G; Punzalan, Felix Eduardo R; Velandria, Felicidad V; Tai, E Shyong; Wee, Hwee-Lin

2013-01-01

To evaluate the validity and reliability of the Philippines (Tagalog) Short Form 36 Health Survey version 2 (SF-36v2(®)) standard questionnaire among Filipinos residing in two cities. The official Philippines (Tagalog) SF-36v2 standard (4-week recall) version was pretested on 30 participants followed by formal and informal cognitive debriefing. To obtain the feedback on translation by bilingual respondents, each SF-36v2 question was stated first in English followed by Tagalog. No revisions to the original questionnaire were needed except that participants thought it was appropriate to incorporate "po" in the instructions to make it more polite. Face-to-face interviews of 562 participants aged 20-50 years living in two barangays (villages) in the highly urbanized city of Makati City (Metro Manila) and in urban and rural barangays in Tanauan City (province of Batangas) were subsequently conducted. Content validity, item level validity, reliability and factor structure of the SF-36v2 (Tagalog) were examined. Content validity of the SF-36v2 was assessed to be adequate for assessing health status among Filipinos. Item means of Philippines (Tagalog) SF-36v2 were similar with comparable scales in the US English, Singapore (English and Chinese) and Thai SF-36 version 1. Item-scale correlation exceeded 0.4 for all items except the bathing item in PF (correlation: 0.31). In exploratory factor analysis, the US two-component model was supported. However, in confirmatory factor analysis, the Japanese three-component model fit the Tagalog data better than the US two-component model. The Philippines (Tagalog) SF-36v2 is a valid and reliable instrument for measuring health status among residents of Makati City (Metro Manila) and Tanauan City (Province of Batangas).

Validation of the Brazilian version of the Burn Specific Health Scale-Brief (BSHS-B-Br).

PubMed

Piccolo, Monica Sarto; Gragnani, Alfredo; Daher, Ricardo Piccolo; Scanavino, Marco de Tubino; de Brito, Maria José; Ferreira, Lydia Masako

2015-11-01

Progressive increases in survival rates from burn trauma have shifted attention to patient rehabilitation and posttraumatic quality of life. The assessment of quality of life is strongly dependent on reliable instruments for its measurement. A literature review has revealed that the Burn Specific Health Scale-Brief (BSHS-B) questionnaire is the most commonly used instrument worldwide. The aim of this study was to translate the BSHS-B into the Portuguese language, adapt it culturally to the Brazilian population, and test its psychometric properties. The questionnaire was translated into Portuguese; culturally adapted; and tested for reproducibility, face validity, content validity, and construct validity. The translated version was tested on 92 patients with burns. Internal consistency was tested by means of Cronbach's alpha. Construct validity was performed by correlating the BSHS-B questionnaire with the Burn Specific Health Scale-Revised (BSHS-R), BurnSexQ-Escola Paulista de Medicina (EPM)/Universidade Federal De São Paulo (UNIFESP), the Rosenberg Self-Esteem Scale (RSES), and the Beck Depression Inventory (BDI). Cronbach's alpha was 0.85. The Pearson correlation coefficients were significant at three time points of the reliability analysis. A significant correlation was observed between BSHS-B domains and BSHS-R, and between RSES and BDI domains. A significant correlation was also observed between BSHS-B and the BurnSexQ-EPM/UNIFESP social comfort and body image domains. The BSHS-B questionnaire was translated into Portuguese. It is a reliable tool in this language, showing face, content, and construct validity. The modified instrument has been named BSHS-B-Br. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.

Development of the Consumer Refrigerator Safety Questionnaire: A Measure of Consumer Perceptions and Practices.

PubMed

Cairnduff, Victoria; Dean, Moira; Koidis, Anastasios

2016-09-01

Food preparation and storage behaviors in the home deviating from the "best practice" food safety recommendations may result in foodborne illnesses. Currently, there are limited tools available to fully evaluate the consumer knowledge, perceptions, and behavior in the area of refrigerator safety. The current study aimed to develop a valid and reliable tool in the form of a questionnaire, the Consumer Refrigerator Safety Questionnaire (CRSQ), for assessing systematically all these aspects. Items relating to refrigerator safety knowledge (n =17), perceptions (n =46), and reported behavior (n =30) were developed and pilot tested by an expert reference group and various consumer groups to assess face and content validity (n =20), item difficulty and consistency (n =55), and construct validity (n =23). The findings showed that the CRSQ has acceptable face and content validity with acceptable levels of item difficulty. Item consistency was observed for 12 of 15 in refrigerator safety knowledge. Further, all 5 of the subscales of consumer perceptions of refrigerator safety practices relating to risk of developing foodborne disease showed acceptable internal consistency (Cronbach's α value > 0.8). Construct validity of the CRSQ was shown to be very good (P = 0.022). The CRSQ exhibited acceptable test-retest reliability at 14 days with the majority of knowledge items (93.3%) and reported behavior items (96.4%) having correlation coefficients of greater than 0.70. Overall, the CRSQ was deemed valid and reliable in assessing refrigerator safety knowledge and behavior; therefore, it has the potential for future use in identifying groups of individuals at increased risk of deviating from recommended refrigerator safety practices, as well as the assessment of refrigerator safety knowledge and behavior for use before and after an intervention.

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM).

PubMed

Strand, Pia; Sjöborg, Karolina; Stalmeijer, Renée; Wichmann-Hansen, Gitte; Jakobsson, Ulf; Edgren, Gudrun

2013-12-01

There is a paucity of instruments designed to evaluate the multiple dimensions of the workplace as an educational environment for undergraduate medical students. The aim was to develop and psychometrically evaluate an instrument to measure how undergraduate medical students perceive the clinical workplace environment, based on workplace learning theories and empirical findings. Development of the instrument relied on established standards including theoretical and empirical grounding, systematic item development and expert review at various stages to ensure content validity. Qualitative and quantitative methods were employed using a series of steps from conceptualization through psychometric analysis of scores in a Swedish medical student population. The final result was a 25-item instrument with two overarching dimensions, experiential learning and social participation, and four subscales that coincided well with theory and empirical findings: Opportunities to learn in and through work & quality of supervision; Preparedness for student entry; Workplace interaction patterns & student inclusion; and Equal treatment. Evidence from various sources supported content validity, construct validity and reliability of the instrument. The Undergraduate Clinical Education Environment Measure represents a valid, reliable and feasible multidimensional instrument for evaluation of the clinical workplace as a learning environment for undergraduate medical students. Further validation in different populations using various psychometric methods is needed.

Development and psychometric testing of the Cancer Knowledge Scale for Elders.

PubMed

Su, Ching-Ching; Chen, Yuh-Min; Kuo, Bo-Jein

2009-03-01

To develop the Cancer Knowledge Scale for Elders and test its validity and reliability. The number of elders suffering from cancer is increasing. To facilitate cancer prevention behaviours among elders, they shall be educated about cancer-related knowledge. Prior to designing a programme that would respond to the special needs of elders, understanding the cancer-related knowledge within this population was necessary. However, extensive review of the literature revealed a lack of appropriate instruments for measuring cancer-related knowledge. A valid and reliable cancer knowledge scale for elders is necessary. A non-experimental methodological design was used to test the psychometric properties of the Cancer Knowledge Scale for Elders. Item analysis was first performed to screen out items that had low corrected item-total correlation coefficients. Construct validity was examined with a principle component method of exploratory factor analysis. Cancer-related health behaviour was used as the criterion variable to evaluate criterion-related validity. Internal consistency reliability was assessed by the KR-20. Stability was determined by two-week test-retest reliability. The factor analysis yielded a four-factor solution accounting for 49.5% of the variance. For criterion-related validity, cancer knowledge was positively correlated with cancer-related health behaviour (r = 0.78, p < 0.001). The KR-20 coefficients of each factor were 0.85, 0.76, 0.79 and 0.67 and 0.87 for the total scale. Test-retest reliability over a two-week period was 0.83 (p < 0.001). This study provides evidence for content validity, construct validity, criterion-related validity, internal consistency and stability of the Cancer Knowledge Scale for Elders. The results show that this scale is an easy-to-use instrument for elders and has adequate validity and reliability. The scale can be used as an assessment instrument when implementing cancer education programmes for elders. It can also be used to evaluate the effects of education programmes.

Curriculum-Based Measurement in the Content Areas: Vocabulary Matching as an Indicator of Progress in Social Studies Learning

ERIC Educational Resources Information Center

Espin, Christine A.; Shin, Jongho; Busch, Todd W.

2005-01-01

The purpose of this study was to examine the reliability and validity of curriculum-based measures as indicator of growth in content-area learning. Participants were 58 students in 2 seventh-grade social studies classes. CBM measures were student- and administrator-read vocabulary-matching probes. Criterion measures were performance on a knowledge…

[Psychometric evaluation of the Coach Orientation Questionnaire with a Spanish sample of handball coaches].

PubMed

Feu, Sebastián; Ibáñez, Sergio José; Graça, Amândio; Sampaio, Jaime

2007-11-01

The purpose of this study was to develop a questionnaire to investigate volleyball coaches' orientations toward the coaching process. The study was preceded by four developmental stages in order to improve user understanding, validate the content, and refine the psychometric properties of the instrument. Participants for the reliability and validity study were 334 Spanish volleyball team coaches, 86.5% men and 13.2% women. The following 6 factors emerged from the exploratory factor analysis: team-work orientation, technological orientation, innovative orientation, dialogue orientation, directive orientation, and social climate orientation. Statistical results indicated that the instrument produced reliable and valid scores in all the obtained factors (a> .70), showing that this questionnaire is a useful tool to examine coaches' orientations towards coaching.

Translation, cultural adaptation and validation of the Diabetes Attitudes Scale - third version into Brazilian Portuguese 1

PubMed Central

Vieira, Gisele de Lacerda Chaves; Pagano, Adriana Silvino; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Torres, Heloísa de Carvalho

2018-01-01

ABSTRACT Objective: to perform the translation, adaptation and validation of the Diabetes Attitudes Scale - third version instrument into Brazilian Portuguese. Methods: methodological study carried out in six stages: initial translation, synthesis of the initial translation, back-translation, evaluation of the translated version by the Committee of Judges (27 Linguists and 29 health professionals), pre-test and validation. The pre-test and validation (test-retest) steps included 22 and 120 health professionals, respectively. The Content Validity Index, the analyses of internal consistency and reproducibility were performed using the R statistical program. Results: in the content validation, the instrument presented good acceptance among the Judges with a mean Content Validity Index of 0.94. The scale presented acceptable internal consistency (Cronbach’s alpha = 0.60), while the correlation of the total score at the test and retest moments was considered high (Polychoric Correlation Coefficient = 0.86). The Intra-class Correlation Coefficient, for the total score, presented a value of 0.65. Conclusion: the Brazilian version of the instrument (Escala de Atitudes dos Profissionais em relação ao Diabetes Mellitus) was considered valid and reliable for application by health professionals in Brazil. PMID:29319739

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

PubMed

Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J

2013-11-01

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

PubMed

Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

2016-12-11

The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability.

PubMed

Vermeulen, Margit I; Tromp, Fred; Zuithoff, Nicolaas P A; Pieters, Ron H M; Damoiseaux, Roger A M J; Kuyvenhoven, Marijke M

2014-12-01

Abstract Background: Historically, semi-structured interviews (SSI) have been the core of the Dutch selection for postgraduate general practice (GP) training. This paper describes a pilot study on a newly designed competency-based selection procedure that assesses whether candidates have the competencies that are required to complete GP training. The objective was to explore reliability and validity aspects of the instruments developed. The new selection procedure comprising the National GP Knowledge Test (LHK), a situational judgement tests (SJT), a patterned behaviour descriptive interview (PBDI) and a simulated encounter (SIM) was piloted alongside the current procedure. Forty-seven candidates volunteered in both procedures. Admission decision was based on the results of the current procedure. Study participants did hardly differ from the other candidates. The mean scores of the candidates on the LHK and SJT were 21.9 % (SD 8.7) and 83.8% (SD 3.1), respectively. The mean self-reported competency scores (PBDI) were higher than the observed competencies (SIM): 3.7(SD 0.5) and 2.9(SD 0.6), respectively. Content-related competencies showed low correlations with one another when measured with different instruments, whereas more diverse competencies measured by a single instrument showed strong to moderate correlations. Moreover, a moderate correlation between LHK and SJT was found. The internal consistencies (intraclass correlation, ICC) of LHK and SJT were poor while the ICC of PBDI and SIM showed acceptable levels of reliability. Findings on content validity and reliability of these new instruments are promising to realize a competency based procedure. Further development of the instruments and research on predictive validity should be pursued.

Development and Preliminary Validation of a Comprehensive Questionnaire to Assess Women’s Knowledge and Perception of the Current Weight Gain Guidelines during Pregnancy

PubMed Central

Ockenden, Holly; Gunnell, Katie; Giles, Audrey; Nerenberg, Kara; Goldfield, Gary; Manyanga, Taru; Adamo, Kristi

2016-01-01

The aim of this study was to develop and validate an electronic questionnaire, the Electronic Maternal Health Survey (EMat Health Survey), related to women’s knowledge and perceptions of the current gestational weight gain guidelines (GWG), as well as pregnancy-related health behaviours. Constructs addressed within the questionnaire include self-efficacy, locus of control, perceived barriers, and facilitators of physical activity and diet, outcome expectations, social environment and health practices. Content validity was examined using an expert panel (n = 7) and pilot testing items in a small sample (n = 5) of pregnant women and recent mothers (target population). Test re-test reliability was assessed among a sample (n = 71) of the target population. Reliability scores were calculated for all constructs (r and intra-class correlation coefficients (ICC)), those with a score of >0.5 were considered acceptable. The content validity of the questionnaire reflects the degree to which all relevant components of excessive GWG risk in women are included. Strong test-retest reliability was found in the current study, indicating that responses to the questionnaire were reliable in this population. The EMat Health Survey adds to the growing body of literature on maternal health and gestational weight gain by providing the first comprehensive questionnaire that can be self-administered and remotely accessed. The questionnaire can be completed in 15–25 min and collects useful data on various social determinants of health and GWG as well as associated health behaviours. This online tool may assist researchers by providing them with a platform to collect useful information in developing and tailoring interventions to better support women in achieving recommended weight gain targets in pregnancy. PMID:27916921

[Multicenter validation of an evaluation tool for clinical training activities (SVAT) of the nursing students].

PubMed

Finotto, Sergio; Gradellini, Cinzia; Bandini, Stefania; Burrai, Francesco; Lucchi Casadei, Sandra; Villani, Carolina; Vincenzi, Simone; Mecugni, Daniela

2017-01-01

To evaluate the psychometric characteristics of the Scheda di Valutazione delle Attività di Tirocinio (SVAT). The degree courses in Nursing of the University of Modena and Reggio Emilia, site of Reggio Emilia, the University of Bologna Formative Section BO1, Imola and training center of Cesena, the University of Ferrara training centers of Ferrara and Codigoro were all enrolled in the research. For the content validation the reactive Delphi method was chosen. The panel of experts expressed a qualitative-intuitive judgment on the adequacy of language and on the stimulus material (SVAT). For internal consistency Cronbach's alpha was calculated the. The test-retest method was used for the reliability of stability. all indicators of the SVAT have achieved a degree of consensus not less than 80% demonstrating its content validity. The face validity is demonstrated by an average score equal to or greater than 7 obtained by all indicators. The reliability of internal consistency of the SVAT was appraised by Cronbach's alpha that was 0.987 for the entire instrument. The reliability of the stability has been calculated through the correlation's coefficient expressed by Pearson's r that was 0.983 (p = 1.3E-198). in Italy there is no a "gold standard" tool to evaluate the clinical performance of nursing students during and at the end of their clinical training. The SVAT proves to be a valuable and reliable tool it furthermore could stimulate the discussion and the debate among educators and nurses, so that also in our country, it may be possible develop and refine tools that support the evaluation of clinical skills of nursing students.

Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score.

PubMed

Ramnarayan, Padmanabhan; Kapoor, Ritika R; Coren, Michael; Nanduri, Vasantha; Tomlinson, Amanda L; Taylor, Paul M; Wyatt, Jeremy C; Britto, Joseph F

2003-01-01

Few previous studies evaluating the benefits of diagnostic decision support systems have simultaneously measured changes in diagnostic quality and clinical management prompted by use of the system. This report describes a reliable and valid scoring technique to measure the quality of clinical decision plans in an acute medical setting, where diagnostic decision support tools might prove most useful. Sets of differential diagnoses and clinical management plans generated by 71 clinicians for six simulated cases, before and after decision support from a Web-based pediatric differential diagnostic tool (ISABEL), were used. A composite quality score was calculated separately for each diagnostic and management plan by considering the appropriateness value of each component diagnostic or management suggestion, a weighted sum of individual suggestion ratings, relevance of the entire plan, and its comprehensiveness. The reliability and validity (face, concurrent, construct, and content) of these two final scores were examined. Two hundred fifty-two diagnostic and 350 management suggestions were included in the interrater reliability analysis. There was good agreement between raters (intraclass correlation coefficient, 0.79 for diagnoses, and 0.72 for management). No counterintuitive scores were demonstrated on visual inspection of the sets. Content validity was verified by a consultation process with pediatricians. Both scores discriminated adequately between the plans of consultants and medical students and correlated well with clinicians' subjective opinions of overall plan quality (Spearman rho 0.65, p < 0.01). The diagnostic and management scores for each episode showed moderate correlation (r = 0.51). The scores described can be used as key outcome measures in a larger study to fully assess the value of diagnostic decision aids, such as the ISABEL system.

Development and initial psychometric evaluation of patient-reported outcome questionnaires to evaluate the symptoms and impact of hidradenitis suppurativa.

PubMed

Kimball, Alexa B; Sundaram, Murali; Banderas, Benjamin; Foley, Catherine; Shields, Alan L

2018-03-01

Two patient-reported outcome (PRO) questionnaires, the Hidradenitis Suppurativa Symptom Assessment (HSSA) and Hidradenitis Suppurativa Impact Assessment (HSIA), were developed to measure signs, symptoms and impacts of HS in treatment efficacy studies. In accordance with FDA guidelines and published best practices, four stages of research were conducted to create the questionnaires: concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Subjects (N = 20) who participated in the concept elicitation stage reported 15 unique HS-related signs and symptoms and 51 impacts. Following this, eight sign and symptom concepts and 21 impacts were selected for construction of the HSSA and HSIA, respectively. During content evaluation, cognitive debriefing interviews with HS subjects (N = 20) confirmed subjects could read, comprehend and meaningfully respond to both questionnaires. Modifications made after this stage of work resulted in a nine-item HSSA and a 17-item HSIA. The HSSA and HSIA were subsequently entered into a US-based observational study (N = 40), and the scores produced by each were found to be reliable, construct valid, and able to distinguish among clinically distinct groups. The HSSA and HSIA are content-valid, HS-specific, PRO questionnaires with demonstrated ability to generate reliable, valid scores when administered to patients with HS in a research setting.

The development and validation of an instrument to measure preservice teachers' self-efficacy in regard to the teaching of science as inquiry

NASA Astrophysics Data System (ADS)

Dira-Smolleck, Lori

The purpose of this study was to develop, validate and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument (TSI) is based upon the work of Bandura, Riggs, and Enochs & Riggs (1990). The study used Bandura's theoretical framework in that the instrument uses the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to the teaching of science through inquiry: specifically, the two dimensions of self-efficacy beliefs defined by Bandura: personal self-efficacy and outcome expectancy. Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert scale instrument designed by the author of the study. A 13-step plan was designed and followed in the process of developing the instrument. Using the results from Chronbach Alpha and Analysis of Variance, a 69-item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the Essential Elements of Classroom Inquiry content matrix. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument, with high internal reliability for use with prospective elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry. Implications for research, policy and practice are also discussed.

Measuring the quality of Hospital Food Services: Development and reliability of a Meal Quality Audit Tool.

PubMed

Banks, Merrilyn; Hannan-Jones, Mary; Ross, Lynda; Buckley, Ann; Ellick, Jennifer; Young, Adrienne

2017-04-01

To develop and test the reliability of a Meal Quality Audit Tool (MQAT) to audit the quality of hospital meals to assist food service managers and dietitians in identifying areas for improvement. The MQAT was developed using expert opinion and was modified over time with extensive use and feedback. A phased approach was used to assess content validity and test reliability: (i) trial with 60 dietetic students, (ii) trial with 12 food service dietitians in practice and (iii) interrater reliability study. Phases 1 and 2 confirmed content validity and informed minor revision of scoring, language and formatting of the MQAT. To assess reliability of the final MQAT, eight separate meal quality audits of five identical meals were conducted over several weeks in the hospital setting. Each audit comprised an 'expert' team and four 'test' teams (dietitians, food services and ward staff). Interrater reliability was determined using intra-class correlation analysis. There was statistically significant interrater reliability for dimensions of Temperature and Accuracy (P < 0.001) but not for Appearance or Sensory. Composition of the 'test' team appeared to influence results for Appearance and Sensory, with food service-led teams scoring higher on these dimensions. 'Test' teams reported that MQAT was clear and easy to use. MQAT was found to be reliable for Temperature and Accuracy domains, with further work required to improve the reliability of the Appearance and Sensory dimensions. The systematic use of the tool, used in conjunction with patient satisfaction, could provide pertinent and useful information regarding the quality of food services and areas for improvement. © 2017 Dietitians Association of Australia.

Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

PubMed

Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

2015-01-01

Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection.

PubMed

Jaffer, U; Singh, P; Pandey, V A; Aslam, M; Standfield, N J

2014-01-01

Duplex ultrasound facilitates bedside diagnosis and hence timely patient care. Its uptake has been hampered by training and accreditation issues. We have developed an assessment tool for Duplex arterial stenosis measurement for both simulator and patient based training. A novel assessment tool: duplex ultrasound assessment of technical skills was developed. A modified duplex ultrasound assessment of technical skills was used for simulator training. Novice, intermediate experience and expert users of duplex ultrasound were invited to participate. Participants viewed an instructional video and were allowed ample time to familiarize with the equipment. Participants' attempts were recorded and independently assessed by four experts using the modified duplex ultrasound assessment of technical skills. 'Global' assessment was also done on a four point Likert scale. Content, construct and concurrent validity as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. The simulator had good satisfaction rating from participants: median 4; range 3-5. Receiver operator characteristic analysis has established a cut point of 22/ 34 and 25/ 40 were most appropriate for simulator and patient based assessment respectively. We have validated a novel assessment tool for duplex arterial stenosis detection. Further work is underway to establish transference validity of simulator training to improved skill in scanning patients. We have developed and validated duplex ultrasound assessment of technical skills for simulator training.

Development, reliability, and validity testing of Toddler NutriSTEP: a nutrition risk screening questionnaire for children 18-35 months of age.

PubMed

Randall Simpson, Janis; Gumbley, Jillian; Whyte, Kylie; Lac, Jane; Morra, Crystal; Rysdale, Lee; Turfryer, Mary; McGibbon, Kim; Beyers, Joanne; Keller, Heather

2015-09-01

Nutrition is vital for optimal growth and development of young children. Nutrition risk screening can facilitate early intervention when followed by nutritional assessment and treatment. NutriSTEP (Nutrition Screening Tool for Every Preschooler) is a valid and reliable nutrition risk screening questionnaire for preschoolers (aged 3-5 years). A need was identified for a similar questionnaire for toddlers (aged 18-35 months). The purpose was to develop a reliable and valid Toddler NutriSTEP. Toddler NutriSTEP was developed in 4 phases. Content and face validity were determined with a literature review, parent focus groups (n = 6; 48 participants), and experts (n = 13) (phase A). A draft questionnaire was refined with key intercept interviews of 107 parents/caregivers (phase B). Test-retest reliability (phase C), based on intra-class correlations (ICC), Kappa (κ) statistics, and Wilcoxon tests was assessed with 133 parents/caregivers. Criterion validity (phase D) was assessed using Receiver Operating Characteristic (ROC) curves by comparing scores on the Toddler NutriSTEP to a comprehensive nutritional assessment of 200 toddlers with a registered dietitian (RD). The Toddler NutriSTEP was reliable between 2 administrations (ICC = 0.951, F = 20.53, p < 0.001); most questions had moderate (κ ≥ 0.6) or excellent (κ ≥ 0.8) agreement. Scores on the RD nutrition risk rating and the Toddler NutriSTEP were correlated (r = 0.67, p < 0.000). The area under the ROC curve for moderate and high RD risk ratings were 84.6% and 82.7%, respectively. Cut-points of ≥21 (sensitivity 86%; specificity 61%) (moderate risk) and ≥26 (sensitivity 95%; specificity 63%) (high risk) were determined. The Toddler NutriSTEP questionnaire is both reliable and valid for screening for nutritional risk in toddlers.

A Chinese version of the City of Hope Quality of Life-Ostomy Questionnaire: validity and reliability assessment.

PubMed

Gao, Wenjun; Yuan, Changrong; Wang, Jichuan; Du, Jiarui; Wu, Huiqiao; Qian, Xiaojie; Hinds, Pamela S

2013-01-01

The City of Hope Quality of Life-Ostomy Questionnaire is a widely accepted scale to assess quality of life in ostomy patients. However, the validity and reliability of the Chinese version (C-COH) have not been studied. The objective of the study was to assess the validity and reliability of the C-COH among ostomy patients sampled from Shanghai from August 2010 to June 2011. Content validity was examined based on the reviews of a panel of 10 experts; test-retest was conducted to assess the item reliabilities of the scale; a pilot sample (n = 274) was selected to explore the factorial structure of the C-COH using exploratory factor analysis; a validation sample (n = 370) was selected to confirm the findings from the exploratory study using confirmatory factor analysis (CFA). Statistical package SPSS version 16.0 was used for the exploratory factor analysis, and Amos 17.0 was used for the CFA. The C-COH was developed by modifying 1 item and excluding 11 items from the original scale. Four factors/subscales (physical well-being, psychological well-being, social well-being, and spiritual well-being) were identified and confirmed in the C-COH The scale reliabilities estimated from the CFA results for the 4 subscales were 0.860, 0.885, 0.864, and 0.686, respectively. Findings support the reliability and validity of the C-COH. The C-COH could be a useful measure of the level of quality of life among Chinese patients with a stoma and may provide important intervention implications for healthcare providers to help improve the life quality of patients with a stoma.

The Cambridge Otology Quality of Life Questionnaire: an otology-specific patient-recorded outcome measure. A paper describing the instrument design and a report of preliminary reliability and validity.

PubMed

Martin, T P C; Moualed, D; Paul, A; Ronan, N; Tysome, J R; Donnelly, N P; Cook, R; Axon, P R

2015-04-01

The Cambridge Otology Quality of Life Questionnaire (COQOL) is a patient-recorded outcome measurement (PROM) designed to quantify the quality of life of patients attending otology clinics. Item-reduction model. A systematically designed long-form version (74 items) was tested with patient focus groups before being presented to adult otology patients (n. 137). Preliminary item analysis tested reliability, reducing the COQOL to 24 questions. This was then presented in conjunction with the SF-36 (V1) questionnaire to a total of 203 patients. Subsequently, these were re-presented at T + 3 months, and patients recorded whether they felt their condition had improved, deteriorated or remained the same. Non-responders were contacted by post. A correlation between COQOL scores and patient perception of change was examined to analyse content validity. Teaching hospital and university psychology department. Adult patients attending otology clinics with a wide range of otological conditions. Item reliability measured by item–total correlation, internal consistency and test– retest reliability. Validity measured by correlation between COQOL scores and patient-reported symptom change. Reliability: the COQOL showed excellent internal consistency at both initial presentation (a = 0.90) and 3 months later (a = 0.93). Validity: One-way analysis of variance showed a significant difference between groups reporting change and those reporting no change in quality of life (F(2, 80) = 5.866, P < 0.01). The COQOL is the first otology-specific PROM. Initial studies demonstrate excellent reliability and encouraging preliminary criterion validity: further studies will allow a deeper validation of the instrument.

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Developing a model for hospital inherent safety assessment: Conceptualization and validation.

PubMed

Yari, Saeed; Akbari, Hesam; Gholami Fesharaki, Mohammad; Khosravizadeh, Omid; Ghasemi, Mohammad; Barsam, Yalda; Akbari, Hamed

2018-01-01

Paying attention to the safety of hospitals, as the most crucial institute for providing medical and health services wherein a bundle of facilities, equipment, and human resource exist, is of significant importance. The present research aims at developing a model for assessing hospitals' safety based on principles of inherent safety design. Face validity (30 experts), content validity (20 experts), construct validity (268 examples), convergent validity, and divergent validity have been employed to validate the prepared questionnaire; and the items analysis, the Cronbach's alpha test, ICC test (to measure reliability of the test), composite reliability coefficient have been used to measure primary reliability. The relationship between variables and factors has been confirmed at 0.05 significance level by conducting confirmatory factor analysis (CFA) and structural equations modeling (SEM) technique with the use of Smart-PLS. R-square and load factors values, which were higher than 0.67 and 0.300 respectively, indicated the strong fit. Moderation (0.970), simplification (0.959), substitution (0.943), and minimization (0.5008) have had the most weights in determining the inherent safety of hospital respectively. Moderation, simplification, and substitution, among the other dimensions, have more weight on the inherent safety, while minimization has the less weight, which could be due do its definition as to minimize the risk.

Development and psychometric testing of a new instrument to measure factors influencing women's breast cancer prevention behaviors (ASSISTS).

PubMed

Khazaee-Pool, Maryam; Majlessi, Fereshteh; Montazeri, Ali; Pashaei, Tahereh; Gholami, Ali; Ponnet, Koen

2016-07-22

Breast cancer preventive behaviors have an extreme effect on women's health. Despite the benefits of preventive behaviors regarding breast cancer, they have not been implemented as routine care for healthy women. To assess this health issue, a reliable and valid scale is needed. The aim of the present study is to develop and examine the psychometric properties of a new scale, called the ASSISTS, in order to identify factors that affect women's breast cancer prevention behaviors. A multi-phase instrument development method was performed to develop the questionnaire from February 2012 to September 2014. The item pool was generated based on secondary analyses of previous qualitative data. Then, content and face validity were applied to provide a pre-final version of the scale. The scale validation was conducted with a sample of women recruited from health centers affiliated with Tehran University of Medical Sciences. The construct validity (both exploratory and confirmatory), convergent validity, discriminate validity, internal consistency reliability and test-retest analysis of the questionnaire were tested. Fifty-eight items were initially extracted from the secondary analysis of previous qualitative data. After content validity, this was reduced to 49 items. The exploratory factor analysis revealed seven factors (Attitude, supportive systems, self-efficacy, information seeking, stress management, stimulant and self-care) containing 33 items that jointly accounted for 60.62 % of the observed variance. The confirmatory factor analysis showed a model with appropriate fitness for the data. The Cronbach's alpha coefficient for the subscales ranged from 0.68 to 0.85, and the Intraclass Correlation Coefficient (ICC) ranged from 0.71 to 0.98; which is well above the acceptable thresholds. The findings showed that the designed questionnaire was a valid and reliable instrument for assessing factors affecting women's breast cancer prevention behaviors that can be used both in practice and in future studies.

Reliability and validity assessment of gastrointestinal dystemperaments questionnaire: a novel scale in Persian traditional medicine

PubMed Central

Hoseinzadeh, Hamidreza; Taghipour, Ali; Yousefi, Mahdi

2018-01-01

Background Development of a questionnaire based on the resources of Persian traditional medicine seems necessary. One of the problems faced by practitioners of traditional medicine is the different opinions regarding the diagnosis of general temperament or temperament of member. One of the reasons is the lack of validity tools, and it has led to difficulties in training the student of traditional medicine and the treatment of patients. The differences in the detection methods, have given rise to several treatment methods. Objective The present study aimed to develop a questionnaire and standard software for diagnosis of gastrointestinal dystemperaments. Methods The present research is a tool developing study which included 8 stages of developing the items, determining the statements based on items, assessing the face validity, assessing the content validity, assessing the reliability, rating the items, developing a software for calculation of the total score of the questionnaire named GDS v.1.1, and evaluating the concurrent validity using statistical tests including Cronbach’s alpha coefficient, Cohen’s kappa coefficient. Results Based on the results, 112 notes including 62 symptoms were extracted from resources, and 58 items were obtained from in-person interview sessions with a panel of experts. A statement was selected for each item and, after merging a number of statements, a total of 49 statements were finally obtained. By calculating the score of statement impact and determining the content validity, respectively, 6 and 10 other items were removed from the list of statements. Standardized Cronbach’s alpha for this questionnaire was obtained 0.795 and its concurrent validity was equal to 0.8. Conclusion A quantitative tool was developed for diagnosis and examination of gastrointestinal dystemperaments. The developed questionnaire is adequately reliable and valid for this purpose. In addition, the software can be used for clinical diagnosis. PMID:29629060

Cross Cultural Adaptation, Validity, and Reliability of the Farsi Breastfeeding Attrition Prediction Tools in Iranian Pregnant Women

PubMed Central

Mortazavi, Forough; Mousavi, Seyed Abbas; Chaman, Reza; Khosravi, Ahmad; Janke, Jill R.

2015-01-01

Background: The rate of exclusive breastfeeding in Iran is decreasing. The breastfeeding attrition prediction tools (BAPT) have been validated and used in predicting premature weaning. Objectives: We aimed to translate the BAPT into Farsi, assess its content validity, and examine its reliability and validity to identify exclusive breastfeeding discontinuation in Iran. Materials and Methods: The BAPT was translated into Farsi and the content validity of the Farsi version of the BAPT was assessed. It was administered to 356 pregnant women in the third trimester of pregnancy, who were residents of a city in northeast of Iran. The structural integrity of the four-factor model was assessed in confirmatory factor analysis (CFA) and exploratory factor analysis (EFA). Reliability was assessed using Cronbach’s alpha coefficient and item-subscale correlations. Validity was assessed using the known-group comparison (128 with vs. 228 without breastfeeding experience) and predictive validity (80 successes vs. 265 failures in exclusive breastfeeding). Results: The internal consistency of the whole instrument (49 items) was 0.775. CFA provided an acceptable fit to the a priori four-factor model (Chi-square/df = 1.8, Root Mean Square Error of Approximation (RMSEA) = 0.049, Standardized Root Mean Square Residual (SRMR) = 0.064, Comparative Fit Index (CFI) = 0.911). The difference in means of breastfeeding control (BFC) between the participants with and without breastfeeding experience was significant (P < 0.001). In addition, the total score of BAPT and the score of Breast Feeding Control (BFC) subscale were higher in women who were on exclusive breastfeeding than women who were not, at four months postpartum (P < 0.05). Conclusions: This study validated the Farsi version of BAPT. It is useful for researchers who want to use it in Iran to identify women at higher risks of Exclusive Breast Feeding (EBF) discontinuation. PMID:26019910

The Communication Function Classification System: cultural adaptation, validity, and reliability of the Farsi version for patients with cerebral palsy.

PubMed

Soleymani, Zahra; Joveini, Ghodsiye; Baghestani, Ahmad Reza

2015-03-01

This study developed a Farsi language Communication Function Classification System and then tested its reliability and validity. Communication Function Classification System is designed to classify the communication functions of individuals with cerebral palsy. Up until now, there has been no instrument for assessment of this communication function in Iran. The English Communication Function Classification System was translated into Farsi and cross-culturally modified by a panel of experts. Professionals and parents then assessed the content validity of the modified version. A backtranslation of the Farsi version was confirmed by the developer of the English Communication Function Classification System. Face validity was assessed by therapists and parents of 10 patients. The Farsi Communication Function Classification System was administered to 152 individuals with cerebral palsy (age, 2 to 18 years; median age, 10 years; mean age, 9.9 years; standard deviation, 4.3 years). Inter-rater reliability was analyzed between parents, occupational therapists, and speech and language pathologists. The test-retest reliability was assessed for 75 patients with a 14 day interval between tests. The inter-rater reliability of the Communication Function Classification System was 0.81 between speech and language pathologists and occupational therapists, 0.74 between parents and occupational therapists, and 0.88 between parents and speech and language pathologists. The test-retest reliability was 0.96 for occupational therapists, 0.98 for speech and language pathologists, and 0.94 for parents. The findings suggest that the Farsi version of Communication Function Classification System is a reliable and valid measure that can be used in clinical settings to assess communication function in patients with cerebral palsy. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric Properties of the Persian Version of Spiritual Well-Being Scale in Patients with Acute Myocardial Infarction.

PubMed

Soleimani, Mohammad Ali; Pahlevan Sharif, Saeed; Allen, Kelly A; Yaghoobzadeh, Ameneh; Sharif Nia, Hamid; Gorgulu, Ozkan

2017-12-01

The purpose of this study was to assess the psychometric properties of the Persian version of Spiritual Well-Being Scale (SWBS) in patients with acute myocardial infarction. A multisite, cross-sectional survey was employed to determine the instrument's reliability (Cronbach's α and construct reliability) and validity (face, content, and construct). Using systematic sampling of adult outpatients at primary care clinic sites in the Qazvin City, Iran (N = 300), it was found that the Cronbach's alpha and construct reliability of both factors associated with the SWBS were above 0.7. The construct validity of the scale was determined using exploratory factor analysis. The findings supported two factors: relation with God and relation with life. Further investigation through confirmatory factor analysis (eigenvalues of greater than one) confirmed a third factor construct associated with the SWBS. A total of 50.65 % of the variance were explained by these three factors. The overall findings of the study demonstrated that the SWBS is a valid and reliable instrument that has potential utility in future research and clinical practice settings.

Development and validation of a questionnaire to evaluate infection control in oral radiology.

PubMed

da Costa, Eliana D; Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-04-01

To create and validate a questionnaire to evaluate infection control in oral radiology. The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test-retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722-1.000) and good to great for the yes/no questions (kappa = 0.662-0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology.

Instruments to Identify Prescription Medication Misuse, Abuse, and Related Events in Clinical Trials: An ACTTION Systematic Review.

PubMed

Smith, Shannon M; Paillard, Florence; McKeown, Andrew; Burke, Laurie B; Edwards, Robert R; Katz, Nathaniel P; Papadopoulos, Elektra J; Rappaport, Bob A; Slagle, Ashley; Strain, Eric C; Wasan, Ajay D; Turk, Dennis C; Dworkin, Robert H

2015-05-01

Measurement of inappropriate medication use events (eg, abuse or misuse) in clinical trials is important in characterizing a medication's abuse potential. However, no gold standard assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (ie, content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and nonopioid prescription medications to identify any that meet U.S. and European regulatory agencies' rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the life span rather than current use, including items that did not directly assess inappropriate use (eg, questions about anger), or failing to capture information pertinent to inappropriate use events (eg, intention and route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, nonstandardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. This systematic review evaluates the measurement properties of inappropriate medication use (eg, abuse or misuse) instruments to determine whether any meet regulatory standards for clinical trial outcome measures to assess abuse potential. Copyright © 2015 American Pain Society. All rights reserved.

Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS).

PubMed

Jalil, Rozh; Soukup, Tayana; Akhter, Waseem; Sevdalis, Nick; Green, James S A

2018-03-03

High-quality leadership and chairing skills are vital for good performance in multidisciplinary tumor boards (MTBs), but no instruments currently exist for assessing and improving these skills. To construct and validate a robust instrument for assessment of MTB leading and chairing skills. We developed an observational MTB leadership assessment instrument (ATLAS). ATLAS includes 12 domains that assess the leadership and chairing skills of the MTB chairperson. ATLAS has gone through a rigorous process of refinement and content validation prior to use to assess the MTB lead by two urological surgeons (blinded to each other) in 7 real-live (n = 286 cases) and 10 video-recorded (n = 131 cases) MTBs. ATLAS domains were analyzed via descriptive statistics. Instrument content was evaluated for validity using the content validation index (CVI). Intraclass correlation coefficients (ICCs) were used to assess inter-observer reliability. Instrument refining resulted in ATLAS including the following 12 domains: time management, communication, encouraging contribution, ability to summarize, ensuring all patients have treatment plan, case prioritization, keeping meeting focused, facilitate discussion, conflict management, leadership, creating good working atmosphere, and recruitment for clinical trials. CVI was acceptable and inter-rater agreement adequate to high for all domains. Agreement was somewhat higher in real-time MTBs compared to video ratings. Concurrent validation evidence was derived via positive and significant correlations between ATLAS and an established validated brief MTB leadership assessment scale. ATLAS is an observational assessment instrument that can be reliably used for assessing leadership and chairing skills in cancer MTBs (both live and video-recorded). The ability to assess and feedback on team leader performance provides the ground for promotion of good practice and continuing professional development of tumor board leaders.

A unified approach to validation, reliability, and education study design for surgical technical skills training.

PubMed

Sweet, Robert M; Hananel, David; Lawrenz, Frances

2010-02-01

To present modern educational psychology theory and apply these concepts to validity and reliability of surgical skills training and assessment. In a series of cross-disciplinary meetings, we applied a unified approach of behavioral science principles and theory to medical technical skills education given the recent advances in the theories in the field of behavioral psychology and statistics. While validation of the individual simulation tools is important, it is only one piece of a multimodal curriculum that in and of itself deserves examination and study. We propose concurrent validation throughout the design of simulation-based curriculum rather than once it is complete. We embrace the concept that validity and curriculum development are interdependent, ongoing processes that are never truly complete. Individual predictive, construct, content, and face validity aspects should not be considered separately but as interdependent and complementary toward an end application. Such an approach could help guide our acceptance and appropriate application of these exciting new training and assessment tools for technical skills training in medicine.

[Validation and reliability of Turkish Singing Voice Handicap index].

PubMed

Denizoğlu, İsmail İlter; Şahin, Mustafa; Kazancıoğlu, Alper; Dağdelen, Zibelhan; Akdeniz, Serap; Oğuz, Haldun; Kılıç, Mehmet Akif; Yücedağ, Aslı; Öğüt, Mehmet Fatih

2016-01-01

This study aims to constitute a valid and reliable Turkish version of the original Singing Voice Handicap Index. An authorized committee assessed the reliability and validity of the content, scope, and language of the original Singing Voice Handicap Index which underwent a back translation process. The Turkish version of the questionnaire was answered twice with a 7 to 10-day interval by two singing voice groups with or without singing voice problems. The reliability and validity analyses were performed based on these answers. Of a total of 123 individuals (64 females, 59 males; mean age 26.2±7.3 years), 81 were without a voice pathology and 42 were with a voice pathology. The total Cronbach's alpha coefficient was 0.917. The item-total correlations ranged between 0.51 and 0.89. The weighted kappa values of test-retest correlation values of the items were 0.82-0.91. The Cronbach's alpha values of two part of the questionnaire based on the split-half method were 0.89 and 0.84. The mean total scale scores were 21.8±18.5 and 53.6±28.9 in normal and pathology groups, respectively and there was a statistically significant difference in scores between these two groups (p=0.000). The Turkish version of the Singing Voice Handicap Index is a valid and reliable scale which can be used in the evaluation of voice problems of Turkish-speaking singing voice users.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Development and validation of a nutrition knowledge questionnaire for a Canadian population.

PubMed

Bradette-Laplante, Maude; Carbonneau, Élise; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-05-01

The present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines. A thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test-retest reliability were evaluated through a validation study. Online survey. Six nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated. Content validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RD v. non-RD (21·5 (sd 2·1) v. 15·7 (sd 3·0) out of 24, P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach's α=0·73). Assessment of test-retest reliability resulted in significant associations for the total knowledge score (r=0·59, P<0·001). This nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Validity and reliability of the Turkish version of the Optimality Index-US (OI-US) to assess maternity care outcomes.

PubMed

Yucel, Cigdem; Taskin, Lale; Low, Lisa Kane

2015-12-01

Although obstetrical interventions are used commonly in Turkey, there is no standardized evidence-based assessment tool to evaluate maternity care outcomes. The Optimality Index-US (OI-US) is an evidence-based tool that was developed for the purpose of measuring aggregate perinatal care processes and outcomes against an optimal or best possible standard. This index has been validated and used in Netherlands, USA and UK until now. The objective of this study was to adapt the OI-US to assess maternity care outcomes in Turkey. Translation and back translation were used to develop the Optimality Index-Turkey (OI-TR) version. To evaluate the content validity of the OI-TR, an expert panel group (n=10) reviewed the items and evidence-based quality of the OI-TR for application in Turkey. Following the content validity process, the OI-TR was used to assess 150 healthy and 150 high-risk pregnant women who gave birth at a high volume, urban maternity hospital in Turkey. The scores between the two groups were compared to assess the discriminant validity of the OI-TR. The percentage of agreement between two raters and the Kappa statistic were calculated to evaluate the reliability. Content validity was established for the OI-TR by an expert group. Discriminant validity was confirmed by comparing the OI scores of healthy pregnant women (mean OI score=77.65%) and those of high-risk pregnant women (mean OI score=78.60%). The percentage of agreement between the two raters was 96.19, and inter-rater agreement was provided for each item in the OI-TR. OI-TR is a valid and reliable tool that can be used to assess maternity care outcomes in Turkey. The results of this study indicate that although the risk statuses of the women differed, the type of care they received was essentially the same, as measured by the OI-TR. Care was not individualised based on risk and for a majority of items was inconsistent with evidence based practice, which is not optimal. Use of the OI-TR will help to provide a standardized way to assess maternity care process and outcomes of maternity care in Turkey which can inform future research aimed at improving maternity care outcomes. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and validation of the Multidimensional Home Environment Scale (MHES) for adolescents and their mothers.

PubMed

Tabbakh, Tamara; Freeland-Graves, Jeanne

2016-08-01

The home environment is an important setting for the development of weight status in adolescence. At present a limited number of valid and reliable tools are available to evaluate the weight-related comprehensive home environment of this population. The goal of this research was to develop the Multidimensional Home Environment Scale which measures multiple components of the home. It includes psychological, social, and environmental domains from the perspective of an adolescent and the mother. Items were generated based on a literature review and then assessed for content validity by an expert panel and focus group in the target population. Internal consistency reliability was determined using Cronbach's α. Principal components analysis with varimax rotation was employed for assessment of construct validity. Temporal stability was evaluated using paired sample t-tests and bivariate correlations between responses at two different times, 1-2weeks apart. Associations between adolescent and mother responses were utilized for convergent validity. The final versions contained 32-items for adolescents and 36-items for mothers; these were administered to 218 adolescents and mothers. The subscales on the questionnaires exhibited high construct validity, internal consistency reliability (adolescent: α=0.82, mother: α=0.83) and test-retest reliability (adolescent: r=0.90, p<0.01; mother: r=0.91, p<0.01). Total home environment scores were computed, with greater scores reflecting a better health environment. These results verify the utility of the MHES as a valid and reliable instrument. This promising tool can be utilized to capture the comprehensive home environment of young adolescents (11-14years old). Copyright © 2016 Elsevier Ltd. All rights reserved.

[Translation and Development of the Chinese-Version Patient Privacy Scale].

PubMed

Chen, Li; Feng, Xian-Qiong; Yang, Xiao-Li; Li, Luo-Hong

2017-06-01

The unauthorized releasing of confidential patient information is a serious problem worldwide. Nurses, the healthcare professionals who are in most frequent contact with patients, have access to a significant amount of confidential patient information and play a key role in protecting patient privacy. However, currently, there is no proper tool to measure the level to which clinical nurses protect the privacy of their patients in China. To translate the patient privacy scale (PPS) into Chinese and to test the reliability and validity of this Chinese version. The original scale was developed by Özturk, Bahcecik, and Özçelik (2014) to identify whether nurses protect or violate patient privacy in the workplace. This study used the "back translation" method to translate the scale. A total of 616 nurses in two tertiary hospitals in the Western region of China were enrolled to test the internal consistency, test-retest reliability, and construct validity of the translated scale. The Cronbach's coefficients of the total scale and its 5 factors ranged from .84 to .94; the split half reliability was .91; the test-retest reliability was .82; and the content validity index was .95. Explanatory factor analysis revealed that the 5 factors explained 64.98% of the total variance. The Chinese version of the PPS is reliable and valid, and may be used to reliably assess the behaviors of nurses with regard to protecting the privacy of their patients. The scale may also be used to evaluate the effects of training on patient privacy protection.

Social Skills Questionnaire for Argentinean College Students (SSQ-U) Development and Validation.

PubMed

Morán, Valeria E; Olaz, Fabián O; Del Prette, Zilda A P

2015-11-27

In this paper we present a new instrument called Social Skills Questionnaire for Argentinean College Students (SSQ-U). Based on the adapted version of the Social Skills Inventory - Del Prette (SSI-Del Prette) (Olaz, Medrano, Greco, & Del Prette, 2009), we wrote new items for the scale, and carried out psychometric analysis to assess the validity and reliability of the instrument. In the first study, we collected evidence based on test content through expert judges who evaluated the quality and the relevance of the items. In the second and third studies, we provided validity evidence based on the internal structure of the instrument using exploratory (n = 1067) and confirmatory (n = 661) factor analysis. Results suggested a five-factor structure consistent with the dimensions of social skills, as proposed by Kelly (2002). The fit indexes corresponding to the obtained model were adequate, and composite reliability coefficients of each factor were excellent (above .75). Finally, in the fourth study, we provided evidence of convergent and discriminant validity. The obtained results allow us to conclude that the SSQ-U is the first valid and reliable instrument for measuring social skills in Argentinean college students.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions.

PubMed

Damschroder, Laura J; Goodrich, David E; Kim, Hyungjin Myra; Holleman, Robert; Gillon, Leah; Kirsh, Susan; Richardson, Caroline R; Lutes, Lesley D

2016-09-01

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Psychometric Properties of the Persian Version of Death Depression Scale-Revised in Iranian Patients with Acute Myocardial Infarction.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Lehto, Rebecca H; Allen, Kelly A; Goudarzian, Amir Hossein; Yaghoobzadeh, Ameneh; Soleimani, Mohammad Ali

2017-07-01

Objective: Limited research has examined the psychometric properties of death depression scales in Persian populations with cardiac disease despite the need for valid assessment tools for evaluating depressive symptoms in patients with life-limiting chronic conditions. The present study aimed at evaluating the reliability and validity of the Persian Version of Death Depression Scale - Revised (DDS-R) in Iranian patients who had recent acute myocardial infarction (AMI). Method: This psychometric study was conducted with a convenience sample of 407 patients with AMI diagnosis who completed the Persian version of the DDS-R. The face, content, and construct validity of the scale were ascertained. Internal consistency, test-retest, and construct reliability (CR) were used to assess reliability of the Persian Version of DDS-R. Results: Based on maximum likelihood exploratory factor analysis and consideration of conceptual meaning, a 4-factor solution was identified, explaining 75.89% of the total variance. Goodness-of-fit indices (GFI), Comparative Fit Index (CFI), Normed Fit Index (NFI), Incremental Fit Index (IFI), and Root Mean Square Error of Approximation (RMSEA) in the final DDS-R structure demonstrated the adequacy of the 4-domain structure. The internal consistency, construct reliability, and Intra-class Correlation Coefficients (ICC) were greater than .70. Conclusion: The DDS-R was found to be a valid and reliable assessment tool for evaluating death depression symptoms in Iranian patients with AMI.

Developing an index to measure the voluntariness of consent to research.

PubMed

Dugosh, Karen L; Festinger, David S; Marlowe, Douglas B; Clements, Nicolle T

2014-10-01

The goals of the current study were to expand the content domain and further validate the Coercion Assessment Scale (CAS), a measure of perceived coercion for criminally involved substance abusers being recruited into research. Unlike the few existing measures of this construct, the CAS identifies specific external sources of pressure that may influence one's decision to participate. In Phase 1, we conducted focus groups with criminal justice clients and stakeholders to expand the instrument by identifying additional sources of pressure. In Phase 2, we evaluated the expanded measure (i.e., endorsement rates, reliability, validity) in an ongoing research trial. Results identified new sources of pressure and provided evidence supporting the CAS's utility and reliability over time as well as convergent and discriminative validity. © The Author(s) 2014.

Development of a Home Food Safety Questionnaire Based on the PRECEDE Model: Targeting Iranian Women.

PubMed

Esfarjani, Fatemeh; Hosseini, Hedayat; Mohammadi-Nasrabadi, Fatemeh; Abadi, Alireza; Roustaee, Roshanak; Alikhanian, Haleh; Khalafi, Marjan; Kiaee, Mohammad Farhad; Khaksar, Ramin

2016-12-01

Food safety is an essential public health issue for all countries. This study was the first attempt to design and develop a home food safety questionnaire (HFSQ), in the conceptual framework of the PRECEDE (predisposing, reinforcing, and enabling constructs in educational diagnosis and evaluation) model, and to assess its validity and reliability. The HFSQ was developed by reviewing electronic databases and 12 focus group discussions with 96 women volunteers. Ten panel members reviewed the questionnaire, and the content validity ratio and content validity index were computed. Twenty women completed the HFSQ, and face validity was assessed. Women who were responsible for food handling in their households (n =320) were selected randomly from 10 health centers and completed the HFSQ based on the PRECEDE model. To examine the construct validity, a principal components factor analysis with varimax rotation was used. Internal consistency was determined with Cronbach's α. Reproducibility was checked by Kendall's τ after 4 weeks with 30 women. The developed HSFQ was considered acceptable with a content validity index of 0.88. Face validity revealed that 95% of the participants understood the questions and found them easy to answer, and 90% confirmed the appearance of the HFSQ and declared the layout acceptable. Principal component factor analysis revealed that the HFSQ could explain 33.7, 55.3, 34.8, and 60.0% of the total variance of the predisposing, reinforcing, practice, and enabling components, respectively. Cronbach's α was acceptable at 0.73. For Kendall's τ c , r = 0.89, with a 95% confidence interval of 0.85 to 0.93. The HFSQ developed based on the PRECEDE model met the standards of acceptable reliability and validity, which can be generalized to a wider population. These results can provide information for the development of effective communication strategies to promote home food safety.

Promoting the Quality of Health Research-based News: Introduction of a Tool

PubMed Central

Ashoorkhani, Mahnaz; Majdzadeh, Reza; Nedjat, Saharnaz; Gholami, Jaleh

2017-01-01

Introduction: While disseminating health research findings to the public, it is very important to present appropriate and accurate information to give the target audience a correct understanding of the subject matter. The objective of this study was to design and psychometrically evaluate a checklist for health journalists to help them prepare news of appropriate accuracy and authenticity. Methods: The study consisted of two phases, checklist design and psychometrics. Literature review and expert opinion were used to extract the items of the checklist in the first phase. In the second phase, to assess content and face validity, the judgment of 38 persons (epidemiologists with a tool production history, editors-in-chief, and health journalists) was used to check the items’ understandability, nonambiguity, relevancy, and clarity. Reliability was assessed by the test–retest method using intra-cluster correlation (ICC) indices in the two phases. Cronbach's alpha was used to assess internal validity of the checklist. Results: Based on the participants’ opinions, the items were reduced from 20 to 14 in number. The items were categorized into the following three domains: (a) items assessing the source of news and its validity, (b) items addressing the presentation of complete and accurate information on research findings, and (c) items which if adhered to lead to the target audiences’ better understanding. The checklist was approved for content and face validity. The reliability of the checklist was assessed in the last stage; the ICC was 1 for 12 items and above 0.8 for the other two. Internal consistency (Cronbach's alpha) was 0.98. Discussion and Conclusions: The resultant indices of the study indicate that the checklist has appropriate validity and reliability. Hence, it can be used by health journalists to develop health research-based news. PMID:29184638

Spanish translation and validation of the Scale for Contraversive Pushing to measure pusher behaviour.

PubMed

Martín-Nieto, A; Atín-Arratibel, M Á; Bravo-Llatas, C; Moreno-Bermejo, M I; Martín-Casas, P

2018-06-08

The aim of this study was to develop and validate a Spanish-language version of the Scale for Contraversive Pushing, used to diagnose and measure pusher behaviour in stroke patients. Translation-back translation was used to create the Spanish-language Scale for Contraversive Pushing; we subsequently evaluated its validity and reliability by administering it to a sample of patients. We also analysed its sensitivity to change in patients identified as pushers who received neurological physiotherapy. Experts indicated that the content of the scale was valid. Internal consistency was very good (Cronbach's alpha of 0.94). The intraclass correlation coefficient showed high intra- and interobserver reliability (0.999 and 0.994, respectively). The Kappa and weighted Kappa coefficients were used to measure the reliability of each item; the majority obtained values above 0.9. Lastly, the differences between baseline and final evaluations of pushers were significant (paired sample t test), showing that the scale is sensitive to changes obtained through physical therapy. The Spanish-language version of the Scale for Contraversive Pushing is valid and reliable for measuring pusher behaviour in stroke patients. In addition, it is able to evaluate the ongoing changes in patients who have received physical therapy. Copyright © 2018 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

Reliability and Validity Study of the Chamorro Assisted Gait Scale for People with Sprained Ankles, Walking with Forearm Crutches

PubMed Central

Ridao-Fernández, Carmen; Ojeda, Joaquín; Benítez-Lugo, Marisa; Sevillano, José Luis

2016-01-01

Objective The aim of this study was to design and validate a functional assessment scale for assisted gait with forearm crutches (Chamorro Assisted Gait Scale—CHAGS) and to assess its reliability in people with sprained ankles. Design Thirty subjects who suffered from sprained ankle (anterior talofibular ligament first and second degree) were included in the study. A modified Delphi technique was used to obtain the content validity. The selected items were: pelvic and scapular girdle dissociation(1), deviation of Center of Gravity(2), crutch inclination(3), steps rhythm(4), symmetry of step length(5), cross support(6), simultaneous support of foot and crutch(7), forearm off(8), facing forward(9) and fluency(10). Two raters twice visualized the gait of the sample subjects which were recorded. The criterion-related validity was determined by correlation between CHAGS and Coding of eight criteria of qualitative gait analysis (Viel Coding). Internal consistency and inter and intra-rater reliability were also tested. Results CHAGS obtained a high and negative correlation with Viel Coding. We obtained a good internal consistency and the intra-class correlation coefficients oscillated between 0.97 and 0.99, while the minimal detectable changes were acceptable. Conclusion CHAGS scale is a valid and reliable tool for assessing assisted gait with crutches in people with sprained ankles to perform partial relief of lower limbs. PMID:27168236

Application of a framework to assess the usefulness of alternative sepsis criteria

PubMed Central

Seymour, Christopher W.; Coopersmith, Craig M.; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S.; Osborn, Tiffany M.; Rhee, Chanu; Warren, David; Watson, R. Scott; Angus, Derek C.

2016-01-01

The current definition for sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by 6 domains of usefulness (reliability; content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these 6 domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement (QI) and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed 4-fold and mortality 3-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the highest case identification with lowest mortality. QI /audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work. PMID:26901560

The merits and problems of Neuropsychiatric Inventory as an assessment tool in people with dementia and other neurological disorders.

PubMed

Lai, Claudia K Y

2014-01-01

The Neuropsychiatric Inventory (NPI) is one of the most commonly used assessment scales for assessing symptoms in people with dementia and other neurological disorders. This paper analyzes its conceptual framework, measurement mode, psychometric properties, and merits and problems. All articles discussing the psychometric properties and factor structure of the NPI were searched for in Medline via Ovid. The abstracts of these papers were read to determine their relevance to the purpose of this paper. If deemed appropriate, a full paper was then obtained and read. The NPI has reasonably good content validity and internal consistency, and good test-retest and interrater reliability. There is limited information about its sensitivity, specificity, positive and negative predictive values, and, in particular, responsiveness. Merits of the NPI include being comprehensive, avoiding symptom overlap, ease of use, and flexibility. It has problems in scoring (no multiples of 5, 7, and 11) and, therefore, analysis using parametric tests may not be appropriate. The use of individual subscales also warrants further investigation. In terms of its content and concurrent validity, intra- and interrater reliability, test-retest reliability, and internal consistency, the NPI can be considered as valid and reliable, and can be used across different ethnic groups. The tool is most likely unable to deliver as good a performance in terms of discriminating between different disorders. More studies are required to further evaluate its psychometric properties, particularly in the areas of factor structure and responsiveness. The clinical utility of the NPI also needs to be further explored.

Application of a Framework to Assess the Usefulness of Alternative Sepsis Criteria.

PubMed

Seymour, Christopher W; Coopersmith, Craig M; Deutschman, Clifford S; Gesten, Foster; Klompas, Michael; Levy, Mitchell; Martin, Gregory S; Osborn, Tiffany M; Rhee, Chanu; Warren, David K; Watson, R Scott; Angus, Derek C

2016-03-01

The current definition of sepsis is life-threatening, acute organ dysfunction secondary to a dysregulated host response to infection. Criteria to operationalize this definition can be judged by six domains of usefulness (reliability, content, construct and criterion validity, measurement burden, and timeliness). The relative importance of these six domains depends on the intended purpose for the criteria (clinical care, basic and clinical research, surveillance, or quality improvement [QI] and audit). For example, criteria for clinical care should have high content and construct validity, timeliness, and low measurement burden to facilitate prompt care. Criteria for surveillance or QI/audit place greater emphasis on reliability across individuals and sites and lower emphasis on timeliness. Criteria for clinical trials require timeliness to ensure prompt enrollment and reasonable reliability but can tolerate high measurement burden. Basic research also tolerates high measurement burden and may not need stability over time. In an illustrative case study, we compared examples of criteria designed for clinical care, surveillance and QI/audit among 396,241 patients admitted to 12 academic and community hospitals in an integrated health system. Case rates differed four-fold and mortality three-fold. Predictably, clinical care criteria, which emphasized timeliness and low burden and therefore used vital signs and routine laboratory tests, had the greater case identification with lowest mortality. QI/audit criteria, which emphasized reliability and criterion validity, used discharge information and had the lowest case identification with highest mortality. Using this framework to identify the purpose and apply domains of usefulness can help with the evaluation of existing sepsis diagnostic criteria and provide a roadmap for future work.

Psychometric properties of the Affordances in the Home Environment for Motor Development inventory for use with Iranian children aged 18-42 months.

PubMed

Valadi, Saeed; Gabbard, Carl; Arabameri, Elahe; Kashi, Ali; Ghasemi, Abdollah

2018-02-01

The aim of this study was to translate the original English language version of the Affordances in the Home Environment for Motor Development (AHEMD) inventory and test its psychometric properties for use with Iranian children aged 18-42 months. For this purpose, the tool was translated into Farsi (a Persian language) using the forward-backward translation method and some of its psychometric properties were examined. Multistage stratified-cluster sampling was used to study 1019 families having children aged 18-42 months from among the regional divisions of Tehran urban community health centers. The questionnaire evaluated five factors: outside space, inside space, variety of stimulation, fine motor toys and gross motor toys. Expert opinion was used for content-related validity evaluation and confirmatory factor analysis was used to determine construct validity. For test-retest reliability, parents completed identical questionnaires two weeks apart. Internal consistency was evaluated using inter-examiner reliability, Cronbach's alpha and construct reliability. Linear regression analysis was used to explain and predict the effects of toys on AHEMD total score. Results showed that content-related validity was 0.92. Data confirmatory factor analysis showed an acceptable fit to the original five factors. Reliability over time was 0.91 and internal consistency was 0.93. It was also found that fine- and gross-motor toys showed a significant 55% predictability of affordance provision in the home. The Farsi translation of the AHEMD is acceptable for use with Iranian children aged 18-42 month. Copyright © 2017 Elsevier Inc. All rights reserved.

Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults

PubMed Central

Baars, Maria A E; Olde Rikkert, Marcel G M; Kessels, Roy P C

2013-01-01

Background Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible. Objective This study examines a new instrument called the Brain Aging Monitor–Cognitive Assessment Battery (BAM-COG) for its alternate forms reliability, face and content validity, and convergent and divergent validity. Also, reference values are provided. Methods The BAM-COG consists of four easily accessible, short, yet challenging puzzle games that have been developed to measure working memory (“Conveyer Belt”), visuospatial short-term memory (“Sunshine”), episodic recognition memory (“Viewpoint”), and planning (“Papyrinth”). A total of 641 participants were recruited for this study. Of these, 397 adults, 40 years and older (mean 54.9, SD 9.6), were eligible for analysis. Study participants played all games three times with 14 days in between sets. Face and content validity were based on expert opinion. Alternate forms reliability (AFR) was measured by comparing scores on different versions of the BAM-COG and expressed with an intraclass correlation (ICC: two-way mixed; consistency at 95%). Convergent validity (CV) was provided by comparing BAM-COG scores to gold-standard paper-and-pencil and computer-assisted cognitive assessment. Divergent validity (DV) was measured by comparing BAM-COG scores to the National Adult Reading Test IQ (NART-IQ) estimate. Both CV and DV are expressed as Spearman rho correlation coefficients. Results Three out of four games showed adequate results on AFR, CV, and DV measures. The games Conveyer Belt, Sunshine, and Papyrinth have AFR ICCs of .420, .426, and .645 respectively. Also, these games had good to very good CV correlations: rho=.577 (P=.001), rho=.669 (P<.001), and rho=.400 (P=.04), respectively. Last, as expected, DV correlations were low: rho=−.029 (P=.44), rho=−.029 (P=.45), and rho=−.134 (P=.28) respectively. The game Viewpoint provided less desirable results with an AFR ICC of .167, CV rho=.202 (P=.15), and DV rho=−.162 (P=.21). Conclusions This study provides evidence for the use of the BAM-COG test battery as a feasible, reliable, and valid tool to monitor cognitive performance in healthy adults in an online setting. Three out of four games have good psychometric characteristics to measure working memory, visuospatial short-term memory, and planning capacity. PMID:24300212

Development and validation of a Malawian version of the primary care assessment tool.

PubMed

Dullie, Luckson; Meland, Eivind; Hetlevik, Øystein; Mildestvedt, Thomas; Gjesdal, Sturla

2018-05-16

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.

The Imperial Paediatric Emergency Training Toolkit (IPETT) for use in paediatric emergency training: development and evaluation of feasibility and validity.

PubMed

Lambden, Simon; DeMunter, Claudine; Dowson, Anne; Cooper, Mehrengise; Gautama, Sanjay; Sevdalis, Nick

2013-06-01

To develop and test the feasibility, reliability, and validity of a practical toolkit for the assessment and feedback of skills required to manage paediatric emergencies in critical care settings. The Imperial Paediatric Emergency Training Toolkit (IPETT) was developed based on current evidence-base and expert input. IPETT assesses both technical and non-technical skills. The technical component covers skills in the areas of clinical assessment, airway and breathing, cardiovascular, and drugs. The non-technical component is based on the validated NOTECHS tool and covers communication and interaction, cooperation and team skills, leadership and managerial skills, and decision-making. The reliability (internal consistency), content validity (inter-correlations between different skills) and concurrent validity (correlations between global technical and non-technical scores) of IPETT were prospectively evaluated in 45 simulated paediatric crises carried out in a PICU with anaesthetic and paediatric trainees (N=52). Non-parametric analyses were carried out. Significance was set at P<0.05. Cronbach alpha reliability coefficients were overall acceptable for the technical (alpha range=0.638-0.810) and good for the non-technical (alpha range=0.701-0.899) component of IPETT. The median inter-skill correlation was rho=0.564 and rho=0.549 for the technical and non-technical components, respectively. These indicate good content validity, as the skills were inter-related but not redundant. We also demonstrate a correlation between the global technical and non-technical scores (rho=0.471) - all Ps<0.05 during the assessments. IPETT offers a psychometrically viable and feasible to use tool in the context of paediatric emergencies training. This study shows that assessment of technical and non-technical skills in combination may offer a more clinically relevant model for training in paediatric emergencies. Further validation should aim to demonstrate skill retention over time and skill transfer from simulation-based training to real emergencies. Copyright © 2013. Published by Elsevier Ireland Ltd.

Validation of the Mandarin Chinese version of the Leicester Cough Questionnaire in bronchiectasis.

PubMed

Gao, Y-H; Guan, W-J; Xu, G; Gao, Y; Lin, Z-Y; Tang, Y; Lin, Z-M; Li, H-M; Luo, Q; Zhong, N-S; Birring, S S; Chen, R-C

2014-12-01

The Leicester Cough Questionnaire (LCQ) has been validated for assessing cough-specific health status in bronchiectasis. We translated the LCQ into Mandarin Chinese and investigated its validity, reliability and responsiveness. The LCQ was translated into Mandarin Chinese using the forward-backward translation procedure. A total of 144 out-patients completed the Mandarin Chinese version of the LCQ (LCQ-MC), the Hospital Anxiety and Depression Scale (HADS) and the St George's Respiratory Questionnaire. Reassessments were performed during exacerbations and at 6 months. Concurrent validation, internal consistency, repeatability and responsiveness were determined. Minor cultural adaptations were made to the wording of LCQ-MC. No other difficulties were found during the translation process, with all items easily adapted to acceptable Mandarin Chinese. The questionnaire was not changed in terms of content layout and the order of the questions. In cognitive debriefing interviews, participants reported that the questionnaire was acceptable, relevant, comprehensive and easy to complete. The LCQ-MC showed good concurrent validity, internal consistency and test-retest reliability. Responsiveness was shown by significant changes in LCQ-MC scores between steady state, the first exacerbation and following 2-week antibiotic treatment (both interval changes, P < 0.01) CONCLUSION: The LCQ-MC is a valid, reliable and responsive instrument for determining cough-specific health status in Chinese bronchiectasis patients.

European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30: factorial models to Brazilian cancer patients

PubMed Central

Campos, Juliana Alvares Duarte Bonini; Spexoto, Maria Cláudia Bernardes; da Silva, Wanderson Roberto; Serrano, Sergio Vicente; Marôco, João

2018-01-01

ABSTRACT Objective To evaluate the psychometric properties of the seven theoretical models proposed in the literature for European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30 (EORTC QLQ-C30), when applied to a sample of Brazilian cancer patients. Methods Content and construct validity (factorial, convergent, discriminant) were estimated. Confirmatory factor analysis was performed. Convergent validity was analyzed using the average variance extracted. Discriminant validity was analyzed using correlational analysis. Internal consistency and composite reliability were used to assess the reliability of instrument. Results A total of 1,020 cancer patients participated. The mean age was 53.3±13.0 years, and 62% were female. All models showed adequate factorial validity for the study sample. Convergent and discriminant validities and the reliability were compromised in all of the models for all of the single items referring to symptoms, as well as for the “physical function” and “cognitive function” factors. Conclusion All theoretical models assessed in this study presented adequate factorial validity when applied to Brazilian cancer patients. The choice of the best model for use in research and/or clinical protocols should be centered on the purpose and underlying theory of each model. PMID:29694609

Transcultural adaptation and initial validation of Brazilian-Portuguese version of the Basel assessment of adherence to immunosuppressive medications scale (BAASIS) in kidney transplants

PubMed Central

2013-01-01

Background Transplant recipients are expected to adhere to a lifelong immunosuppressant therapeutic regimen. However, nonadherence to treatment is an underestimated problem for which no properly validated measurement tool is available for Portuguese-speaking patients. We aimed to initially validate the Basel Assessment of Adherence to Immunosuppressive Medications Scale (BAASIS®) to accurately estimate immunosuppressant nonadherence in Brazilian transplant patients. Methods The BAASIS® (English version) was transculturally adapted and its psychometric properties were assessed. The transcultural adaptation was performed using the Guillemin protocol. Psychometric testing included reliability (intraobserver and interobserver reproducibility, agreement, Kappa coefficient, and the Cronbach’s alpha) and validity (content, criterion, and construct validities). Results The final version of the transculturally adapted BAASIS® was pretested, and no difficulties in understanding its content were found. The intraobserver and interobserver reproducibility variances (0.007 and 0.003, respectively), the Cronbach’s alpha (0.7), Kappa coefficient (0.88) and the agreement (95.2%) suggest accuracy, preciseness and reliability. For construct validity, exploratory factorial analysis demonstrated unidimensionality of the first three questions (r = 0.76, r = 0.80, and r = 0.68). For criterion validity, the adapted BAASIS® was correlated with another self-report instrument, the Measure of Adherence to Treatment, and showed good congruence (r = 0.65). Conclusions The BAASIS® has adequate psychometric properties and may be employed in advance to measure adherence to posttransplant immunosuppressant treatments. This instrument will be the first one validated to use in this specific transplant population and in the Portuguese language. PMID:23692889

Is the Bayley Scales of Infant and Toddler Developmental Screening Test, Valid and Reliable for Persian Speaking Children?

PubMed

Soleimani, Farin; Azari, Nadia; Vameghi, Roshanak; Sajedi, Firoozeh; Shahshahani, Soheila; Karimi, Hossein; Kraskian, Adis; Shahrokhi, Amin; Teymouri, Robab; Gharib, Masoud

2016-10-01

Advances in perinatal and neonatal care have substantially improved the survival of at-risk infants over the past two decades. The purpose of this study was to assess the reliability and validity of the Bayley Scales of infant and toddler developmental Screening test in Persian-speaking children. This was a cross-sectional prospective study of 403 children aged 1 - 42-months. The Bayley scales screening instrument, which consists of five domains (cognitive, receptive, and expressive communication and fine and gross motor items), was used to measure infants' and toddlers' development. The psychometric properties examined included the face and content validity of the scale, in addition to cultural and linguistic modifications to the scale and its test-retest and inter-rater reliability. An expert team changed some of the test items relating to cultural and linguistic issues. In almost all the age groups, cultural or linguistic changes were made to items in the communication domains. According to Cronbach's alpha for internal consistency, the reliability of the cognitive scale was r = 0.79, and the reliability of the receptive scale was r = 0.76. The reliability for expressive communication, fine motor, and gross motor scales was r = 0.81, r = 0.80, and r = 0.81, respectively. The construct validity of the tests was confirmed using a factor analysis and comparison of the mean scores of the age groups. The intra- and inter-rater reliabilities of the Bayley Scales were good-to-excellent. The results indicated that the Bayley Scales had a high level of reliability in the present study. Thus, the scale can be used in a Persian population.

Cross-cultural adaptation and validation of the Injury-Psychological Readiness to Return to Sport scale to Persian language.

PubMed

Naghdi, Soofia; Nakhostin Ansari, Noureddin; Farhadi, Yasaman; Ebadi, Safoora; Entezary, Ebrahim; Glazer, Douglas

2016-10-01

The aim of the present study was to develop and provide validation statistics for the Persian Injury-Psychological Readiness to Return to Sport scale (I-PRRS) following a cross-sectional and prospective cohort study design. The I-PRRS was forward/back-translated and culturally adapted into Persian language. The Persian I-PRRS was administered to 100 injured athletes (93 male; age 26.0 ± 5.6 years; time since injury 4.84 ± 6.4 months) and 50 healthy athletes (36 male; mean age 25.7 ± 6.0 years). The Persian I-PRRS was re-administered to 50 injured athletes at 1 week to examine test-retest reliability. There were no floor or ceiling effects confirming the content validity of Persian I-PRRS. The internal consistency reliability was good. Excellent test-retest reliability and agreement were demonstrated. The statistically significant difference in Persian I-PRRS total scores between the injured athletes and healthy athletes provides an evidence of discriminative validity. The Persian I-PRRS total scores were positively correlated with the Farsi Mood Scale (FARMS) total scores, showing construct validity. The principal component analysis indicated a two-factor solution consisting of "Confidence to play" and "Confidence in the injured body part and skill level". The Persian I-PRRS showed excellent reliability and validity and can be used to assess injured athletes' psychological readiness to return to sport among Persian-speaking populations.

Cross-cultural adaptation of Kerlan-Jobe Orthopaedic Clinic shoulder and elbow score: Reliability and validity in Turkish-speaking overhead athletes.

PubMed

Turgut, Elif; Tunay, Volga Bayrakci

2018-03-09

Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow Score (KJOC-SES) is a subjective assessment tool to measure functional status of the upper extremities in overhead athletes. The aim was to translate and culturally adapt the KJOC-SES and to evaluate the psychometric properties of the Turkish version (KJOC-SES-Tr) in overhead athletes. The forward and back-translation method was followed. One hundred and twenty-three overhead athletes completed the KJOC-SES-Tr, the Disabilities of the Arm, Shoulder, and Hand (DASH), and the American Shoulder and Elbow Surgeons Evaluation Form (ASES). Participants were assigned to one of the following subgroups: asymptomatic (playing without pain) or symptomatic (playing with pain, or not playing due to pain). Internal consistency, reliability, construct validity, discriminant validity, and content validity of the KJOC-SES-Tr were tested. The test-retest reliability of the KJOC-SES-Tr was excellent with an interclass coefficient of 0.93. There was a strong correlation between the KJOC-SES-Tr and the DASH and the ASES, indicating that the construct validity was good for all participants. Results of the KJOC-SES-Tr significantly differed between different subgroups and categories of athletes. The floor and ceiling effects were acceptable for symptomatic athletes. The KJOC-SES-Tr was shown to be valid, reliable tool to monitor the return to sports following injuries in athletes. Copyright © 2018 Turkish Association of Orthopaedics and Traumatology. Production and hosting by Elsevier B.V. All rights reserved.

Validity and reliability of parental report of frequency, severity and risk factors of urinary tract infection and urinary incontinence in children.

PubMed

Sureshkumar, Premala; Cumming, Robert G; Craig, Jonathan C

2006-06-01

We describe the validity and reliability of a questionnaire designed to determine frequency, severity and risk factors of urinary tract infection and daytime urinary incontinence in primary school-age children. Based on published validated questionnaires and advice from content experts, a questionnaire was developed and piloted in children attending outpatient clinics. Construct validity for parent report of frequency and severity of daytime urinary incontinence was tested by comparison with a daily accident diary in 52 primary school children, and criterion validity of parent report for UTI was verified by comparison with the reference standard (urine culture) in 100 primary school children. Test-retest reliability of the questionnaire was assessed in 106 children from primary schools. There was excellent agreement between the questionnaire and accident diary in severity (weighted kappa 0.94, 95% confidence intervals 0.85 to 1.03) and frequency of daytime urinary incontinence (0.88, 0.7 to 1.0). Parents reported urinary tract infection in 15% of children, compared to a positive urine culture in 8% (sensitivity 100% and specificity 68.5%). Test-retest reliability of the questionnaire was excellent (mean k 0.78, range 0.61 to 1.00). Parents overreport UTI by about 2-fold but can recall frequency and severity of daytime urinary incontinence well during a 3-month period. The developed questionnaire is a valid tool to estimate frequency, severity and risk factors of daytime urinary incontinence and UTI in primary school children.

Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©).

PubMed

Davies, Kylie; Bulsara, Max K; Ramelet, Anne-Sylvie; Monterosso, Leanne

2018-05-01

To establish criterion-related construct validity and test-retest reliability for the Endotracheal Suction Assessment Tool© (ESAT©). Endotracheal tube suction performed in children can significantly affect clinical stability. Previously identified clinical indicators for endotracheal tube suction were used as criteria when designing the ESAT©. Content validity was reported previously. The final stages of psychometric testing are presented. Observational testing was used to measure construct validity and determine whether the ESAT© could guide "inexperienced" paediatric intensive care nurses' decision-making regarding endotracheal tube suction. Test-retest reliability of the ESAT© was performed at two time points. The researchers and paediatric intensive care nurse "experts" developed 10 hypothetical clinical scenarios with predetermined endotracheal tube suction outcomes. "Experienced" (n = 12) and "inexperienced" (n = 14) paediatric intensive care nurses were presented with the scenarios and the ESAT© guiding decision-making about whether to perform endotracheal tube suction for each scenario. Outcomes were compared with those predetermined by the "experts" (n = 9). Test-retest reliability of the ESAT© was measured at two consecutive time points (4 weeks apart) with "experienced" and "inexperienced" paediatric intensive care nurses using the same scenarios and tool to guide decision-making. No differences were observed between endotracheal tube suction decisions made by "experts" (n = 9), "inexperienced" (n = 14) and "experienced" (n = 12) nurses confirming the tool's construct validity. No differences were observed between groups for endotracheal tube suction decisions at T1 and T2. Criterion-related construct validity and test-retest reliability of the ESAT© were demonstrated. Further testing is recommended to confirm reliability in the clinical setting with the "inexperienced" nurse to guide decision-making related to endotracheal tube suction. The ESAT© is the first validated tool to systematically guide endotracheal nursing practice for the "inexperienced" nurse. © 2018 John Wiley & Sons Ltd.

Psychometric Properties of the Adolescent Health Concern Inventory: The Persian Version

PubMed Central

Baheiraei, Azam; Ahmadi, Fazlollah; Foroushani, Abbas Rahimi; Ghofranipour, Fazlollah; Weiler, Robert M

2013-01-01

Objective It is important to consider the health concerns of adolescents before developing and implementing public health promotion or health education curriculum programs aimed at ameliorating priority health problems experienced by adolescents. The aim of this study was to test the psychometric properties of the original Adolescent Health Concern Inventory (AHCI) for use with an Iranian population. Methods This was a methodological study in which 50 adolescents with age range of 14-18 years were selected using convenience sampling. The translation and cultural adaptation process of The AHCI followed recognized and established guidelines. The face and content validity was established by analyzing feedback solicited from teenagers and professionals with expertise in health, sociology and psychology. Reliability was examined using test-retest and Cronbach's alpha for internal consistency reliability. Kappa and McNemar tests were used to examine test-retest reliability for each item. Results Minor cultural differences were identified and resolved during the translation process and determining the validity of the checklist. Results from Kappa and McNemar tests indicate a high degree of test-retest reliability. Internal consistency reliability as measured by Cronbach's alpha for the subscales were between 0.68 and 0.87 with total instrument reliability of 0.96 indicating considerable overall reliability. Conclusion The Persian version of the AHCI appears valid and reliable. Hence, it can be used for filling a gap in identifying the adolescents’ health concerns in the research and community settings and school health education programs in Iran to design appropriate interventions. PMID:23682249

Assessing Assessment Texts: Where Is Planning?

ERIC Educational Resources Information Center

Fives, Helenrose; Barnes, Nicole; Dacey, Charity; Gillis, Anna

2016-01-01

We conducted a content analysis of 27 assessment textbooks to determine how assessment planning was framed in texts for preservice teachers. We identified eight assessment planning themes: alignment, assessment purpose and types, reliability and validity, writing goals and objectives, planning specific assessments, unpacking, overall assessment…

Person-centred ward climate as experienced by mentally lucid residents in long-term care facilities.

PubMed

Bergland, Ådel; Hofoss, Dag; Kirkevold, Marit; Vassbø, Tove; Edvardsson, David

2015-02-01

To assess the content validity and reliability of the Person-centred Climate Questionnaire-Patient version in long-term care facilities, to describe residents' perceptions of the extent to which their ward climate was person-centred and to explore whether person-centredness was associated with facility and resident characteristics, such as facility and ward size, having a sensory garden and having a primary caregiver. The importance of the physical environment to persons with dementia has been investigated. However, research is lacking regarding the extent to which mentally lucid residents experience their physical and psycho-social ward climate as person-centred and the factors influencing their experience. Cross-sectional survey design. The Person-centred Climate Questionnaire-Patient version was translated into Norwegian with forward and backward translation. The content validity index for scales was assessed. The Person-centred Climate Questionnaire -Patient version was completed by 145 mentally lucid residents in 17 Norwegian long-term care facilities. Reliability was assessed by Cronbach's α and item-total correlations. Test-retest reliability was assessed by paired samples t-test and Spearman's correlation. To explore differences based on facility and resident characteristics, independent-samples t-test and one-way anova were used. The content validity index for scales was satisfactory. The Person-centred Climate Questionnaire-Patient version was internally consistent and had satisfactory test-retest reliability. The climate was experienced as highly person-centred. No significant differences were found, except that residents in larger facilities experienced the climate as more person-centred in relation to everyday activities (subscale 2) than residents in smaller facilities. The Norwegian version of the Person-centred Climate Questionnaire-Patient version can be regarded as reliable in a long-term care facility context. Perceived degree of person-centredness was not associated with facility or resident characteristics, such as the number of residents, having a sensory garden or knowing that one has a primary caregiver. A person-centred climate can be attained in different kinds of long-term care facilities. © 2014 John Wiley & Sons Ltd.

Evaluation of a Nutrition Care Process-based audit instrument, the Diet-NCP-Audit, for documentation of dietetic care in medical records.

PubMed

Lövestam, Elin; Orrevall, Ylva; Koochek, Afsaneh; Karlström, Brita; Andersson, Agneta

2014-06-01

Adequate documentation in medical records is important for high-quality health care. Documentation quality is widely studied within nursing, but studies are lacking within dietetic care. The aim of this study was to translate, elaborate and evaluate an audit instrument, based on the four-step Nutrition Care Process model, for documentation of dietetic care in medical records. The audit instrument includes 14 items focused on essential parts of dietetic care and the documentation's clarity and structure. Each item is to be rated 0-1 or 0-2 points, with a maximum total instrument score of 26. A detailed manual was added to facilitate the interpretation and increase the reliability of the instrument. The instrument is based on a similar tool initiated 9 years ago in the United States, which in this study was translated to Swedish and further elaborated. The translated and further elaborated instrument was named Diet-NCP-Audit. Firstly, the content validity of the Diet-NCP-Audit instrument was tested by five experienced dietitians. They rated the relevance and clarity of the included items. After a first rating, minor improvements were made. After the second rating, the Content Validity Indexes were 1.0, and the Clarity Index was 0.98. Secondly, to test the reliability, four dietitians reviewed 20 systematically collected dietetic notes independently using the audit instrument. Before the review, a calibration process was performed. A comparison of the reviews was performed, which resulted in a moderate inter-rater agreement with Krippendorff's α = 0.65-0.67. Grouping the audit results in three levels: lower, medium or higher range, a Krippendorff's α of 0.74 was considered high reliability. Also, an intra-rater reliability test-retest with a 9 weeks interval, performed by one dietitian, showed strong agreement. To conclude, the evaluated audit instrument had high content validity and moderate to high reliability and can be used in auditing documentation of dietetic care. © 2013 Nordic College of Caring Science.

Organizational readiness for implementing change: a psychometric assessment of a new measure.

PubMed

Shea, Christopher M; Jacobs, Sara R; Esserman, Denise A; Bruce, Kerry; Weiner, Bryan J

2014-01-10

Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change. We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.

Organizational readiness for implementing change: a psychometric assessment of a new measure

PubMed Central

2014-01-01

Background Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner’s theory of organizational readiness for change. Methods We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure’s factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Results Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. Conclusions This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity. PMID:24410955

Development and evaluation of the Korean Health Literacy Instrument.

PubMed

Kang, Soo Jin; Lee, Tae Wha; Paasche-Orlow, Michael K; Kim, Gwang Suk; Won, Hee Kwan

2014-01-01

The purpose of this study is to develop and validate the Korean Health Literacy Instrument, which measures the capacity to understand and use health-related information and make informed health decisions in Korean adults. In Phase 1, 33 initial items were generated to measure functional, interactive, and critical health literacy with prose, document, and numeracy tasks. These items included content from health promotion, disease management, and health navigation contexts. Content validity assessment was conducted by an expert panel, and 11 items were excluded. In Phase 2, the 22 remaining items were administered to a convenience sample of 292 adults from community and clinical settings. Exploratory factor and item difficulty and discrimination analyses were conducted and four items with low discrimination were deleted. In Phase 3, the remaining 18 items were administered to a convenience sample of 315 adults 40-64 years of age from community and clinical settings. A confirmatory factor analysis was performed to test the construct validity of the instrument. The Korean Health Literacy Instrument has a range of 0 to 18. The mean score in our validation study was 11.98. The instrument exhibited an internal consistency reliability coefficient of 0.82, and a test-retest reliability of 0.89. The instrument is suitable for screening individuals who have limited health literacy skills. Future studies are needed to further define the psychometric properties and predictive validity of the Korean Health Literacy Instrument.

Translation and Validation of the Korean Version of the International Knee Documentation Committee Subjective Knee Form

PubMed Central

Kim, Jin Goo; Lee, Joong Yub; Seo, Seung Suk; Choi, Choong Hyeok; Lee, Myung Chul

2013-01-01

Purpose To perform a cross-cultural adaptation and to test the measurement properties of the Korean version of International Knee Documentation Committee (K-IKDC) Subjective Knee Form. Materials and Methods According to the guidelines for cross-cultural adaptation, translation and backward translation of the English version of the IKDC Subjective Knee Form were performed. After translation into the Korean version, 150 patients who had knee-related problems were asked to complete the K-IKDC, Lysholm score, and Short Form-36 (SF-36). Of these patients, 126 were retested 2 weeks later to evaluate test-retest reliability, and 104 were recruited 3 months later to evaluate responsiveness. Construct validity was analyzed by investigating the correlation with Lysholm score and SF-36; content validity was also evaluated. Standardized mean response was calculated for evaluating responsiveness. Results The test-retest reliability proved excellent with a high value for the intraclass correlation coefficient (r=0.94). The internal consistency was strong (Cronbach's α=0.91). Good content validity with absence of floor not ceiling effects and good convergent and divergent validity were observed. Moderate responsiveness was shown (standardized mean response=0.689). Conclusions The K-IKDC demonstrated good measurement properties. We suggest that this instrument is an excellent evaluation instrument that can be used for Korean patients with knee-related injuries. PMID:24032098

The Persian version of auditory word discrimination test (P-AWDT) for children: Development, validity, and reliability.

PubMed

Hashemi, Nassim; Ghorbani, Ali; Soleymani, Zahra; Kamali, Mohmmad; Ahmadi, Zohreh Ziatabar; Mahmoudian, Saeid

2018-07-01

Auditory discrimination of speech sounds is an important perceptual ability and a precursor to the acquisition of language. Auditory information is at least partially necessary for the acquisition and organization of phonological rules. There are few standardized behavioral tests to evaluate phonemic distinctive features in children with or without speech and language disorders. The main objective of the present study was the development, validity, and reliability of the Persian version of auditory word discrimination test (P-AWDT) for 4-8-year-old children. A total of 120 typical children and 40 children with speech sound disorder (SSD) participated in the present study. The test comprised of 160 monosyllabic paired-words distributed in the Forms A-1 and the Form A-2 for the initial consonants (80 words) and the Forms B-1 and the Form B-2 for the final consonants (80 words). Moreover, the discrimination of vowels was randomly included in all forms. Content validity was calculated and 50 children repeated the test twice with two weeks of interval (test-retest reliability). Further analysis was also implemented including validity, intraclass correlation coefficient (ICC), Cronbach's alpha (internal consistency), age groups, and gender. The content validity index (CVI) and the test-retest reliability of the P-AWDT were achieved 63%-86% and 81%-96%, respectively. Moreover, the total Cronbach's alpha for the internal consistency was estimated relatively high (0.93). Comparison of the mean scores of the P-AWDT in the typical children and the children with SSD revealed a significant difference. The results revealed that the group with SSD had greater severity of deficit than the typical group in auditory word discrimination. In addition, the difference between the age groups was statistically significant, especially in 4-4.11-year-old children. The performance of the two gender groups was relatively same. The comparison of the P-AWDT scores between the typical children and the children with SSD demonstrated differences in the capabilities of auditory phonological discrimination in both initial and final positions. It supposed that the P-AWDT meets the appropriate validity and reliability criteria. The P-AWDT test can be utilized to measure the distinctive features of phonemes, the auditory discrimination of initial and final consonants and middle vowels of words in 4-8-year-old typical children and children with SSD. Copyright © 2018. Published by Elsevier B.V.

Development of a measure of knowledge use by stakeholders in rehabilitation technology

PubMed Central

Nobrega, Amanda R; Lane, Joseph P; Tomita, Machiko R; Usiak, Douglas J; Lockett, Michelle M

2014-01-01

Objectives: Uptake of new knowledge by diverse and diffuse stakeholders of health-care technology innovations has been a persistent challenge, as has been measurement of this uptake. This article describes the development of the Level of Knowledge Use Survey instrument, a web-based measure of self-reported knowledge use. Methods: The Level of Knowledge Use Survey instrument was developed in the context of assessing effectiveness of knowledge communication strategies in rehabilitation technology. It was validated on samples representing five stakeholder types: researchers, manufacturers, clinician–practitioners, knowledge brokers, and consumers. Its structure is broadly based on Rogers’ stages of innovation adoption. Its item generation was initially guided by Hall et al’s Levels of Use framework. Item selection was based on content validity indices computed from expert ratings (n 1 = 4; n 2 = 3). Five representative stakeholders established usability of the web version. The version included 47 items (content validity index for individual items >0.78; content validity index for a scale or set of items >0.90) in self-reporting format. Psychometrics were then established for the version. Results: Analyses of data from small (n = 69) and large (n = 215) samples using the Level of Knowledge Use Survey instrument suggested a conceptual model of four levels of knowledge use—Non-awareness, Awareness, Interest, and Use. The levels covered eight dimensions and six user action categories. The sequential nature of levels was inconclusive due to low cell frequencies. The Level of Knowledge Use Survey instrument showed adequate content validity (≈ 0.88; n = 3) and excellent test–retest reliability (1.0; n = 69). It also demonstrated good construct validity (n = 215) for differentiating among new knowledge outputs (p < 0.001) and among stakeholder types (0.001 < p ≤ 0.013). It showed strong responsiveness to change between baseline and follow-up testing (0.001 < p ≤ 0.002; n = 215). Conclusion: The Level of Knowledge Use Survey instrument is valid and reliable for measuring uptake of innovations across diffuse stakeholders of rehabilitation technologies and therefore also for tracking changes in knowledge use. PMID:26770743

Use of the Rasch measurement model to explore the relationship between content knowledge and topic-specific pedagogical content knowledge for organic chemistry

NASA Astrophysics Data System (ADS)

Davidowitz, Bette; Potgieter, Marietjie

2016-06-01

Research has shown that a high level of content knowledge (CK) is necessary but not sufficient to develop the special knowledge base of expert teachers known as pedagogical content knowledge (PCK). This study contributes towards research to quantify the relationship between CK and PCK in science. In order to determine the proportion of the variance in PCK accounted for by the variance in CK, instruments are required which are valid and reliable as well as being unidimensional to measure person abilities for CK and PCK. An instrument consisting of two paper-and-pencil tests was designed to assess Grade 12 teachers CK and PCK in organic chemistry. We used the Rasch measurement model to convert raw score data into interval measures and to provide empirical evidence for the validity, reliability and unidimensionality of the tests. The correlation between CK and PCK was estimated as r = .66 (p < .001). We found evidence to suggest that while topic-specific PCK (TSPCK) develops with increasing teaching experience, high levels of CK can be acquired with limited teaching experience. These findings support the hypothesis that CK is a requirement for the development of TSPCK; proficiency in CK is, however, not necessarily associated with high levels of TSPCK.

Adaptation and evaluation of the Family Involvement and Alienation Questionnaire for use in the care of older people, psychiatric care, palliative care and diabetes care.

PubMed

Ewertzon, Mats; Alvariza, Anette; Winnberg, Elisabeth; Leksell, Janeth; Andershed, Birgitta; Goliath, Ida; Momeni, Pardis; Kneck, Åsa; Skott, Maria; Årestedt, Kristofer

2018-03-31

To adapt the Family Involvement and Alienation Questionnaire (FIAQ) for use in the care of older people, psychiatric care, palliative care and diabetes care and to evaluate its validity and reliability. Involvement in the professional care has proven to be important for family members. However, they have described feelings of alienation in relation to how they experienced the professionals' approach. To explore this issue, a broad instrument that can be used in different care contexts is needed. A psychometric evaluation study, with a cross-sectional design. The content validity of the FIAQ was evaluated during 2014 by cognitive interviews with 15 family members to adults in different care contexts. Psychometric evaluation was then conducted (2015-2016). A sample of 325 family members participated, 103 of whom in a test-retest evaluation. Both parametric and non-parametric methods were used. The content validity revealed that the questionnaire was generally understood and considered to be relevant and retrievable by family members in the contexts of the care of older people, psychiatric care, palliative care and diabetes care. Furthermore, the FIAQ (Revised), demonstrated satisfactory psychometric properties in terms of data quality, homogeneity, unidimensionality (factor structure), internal consistency and test-retest reliability. The study provides evidence that the FIAQ (Revised) is reliable and valid for use in further research and in quality assessment in the contexts of the care of older people, psychiatric care, palliative care and diabetes care. © 2018 John Wiley & Sons Ltd.

Measuring the Nursing Work Environment in Mainland China: Further Development of the Chinese Nursing Work Environment Scale.

PubMed

Shao, Jing; Tang, Leiwen; Ye, Zhihong

For the stabilization of the nursing profession in mainland China, a valid and reliable nursing work environment instrument, grounded in China's context, should be developed to better provide rigorous evidence for policy makers. The purpose of the current research was to further develop a scale that could capture the characteristics of the nursing work environment in mainland China. A convenience sample of 542 nurses employed in a tertiary hospital of mainland China completed the 108-item Chinese Nursing Work Environment (C-NWE) Scale (1st ed.). Items that did not differentiate between respondents with the highest and lowest 27% of total scores and those that did not meet criteria for factor loadings were set aside. Exploratory factor analysis based on the maximum likelihood method was used to identify the structure of the scale. The chi-square test was used to evaluate model fit, and expert review was conducted to test content validity. Reliability was estimated using Cronbach's alpha coefficient. The revised C-NWE Scale, which consists of nine subscales and 47 items, is a simplified version of the C-NWE (1st ed.). Using exploratory maximum likelihood factor analysis, the normed chi-square fit index for a nine-factor solution was 1.97. The content validity index for the total scale was 0.93; Cronbach's alpha was .94. Initial evidence of the psychometric properties of C-NWE scores was presented. Further studies could be conducted in various settings to identify the C-NWE Scale's validity and reliability.

The Piper Fatigue Scale-12 (PFS-12): psychometric findings and item reduction in a cohort of breast cancer survivors.

PubMed

Reeve, Bryce B; Stover, Angela M; Alfano, Catherine M; Smith, Ashley Wilder; Ballard-Barbash, Rachel; Bernstein, Leslie; McTiernan, Anne; Baumgartner, Kathy B; Piper, Barbara F

2012-11-01

Brief, valid measures of fatigue, a prevalent and distressing cancer symptom, are needed for use in research. This study's primary aim was to create a shortened version of the revised Piper Fatigue Scale (PFS-R) based on data from a diverse cohort of breast cancer survivors. A secondary aim was to determine whether the PFS captured multiple distinct aspects of fatigue (a multidimensional model) or a single overall fatigue factor (a unidimensional model). Breast cancer survivors (n = 799; stages in situ through IIIa; ages 29-86 years) were recruited through three SEER registries (New Mexico, Western Washington, and Los Angeles, CA) as part of the Health, Eating, Activity, and Lifestyle (HEAL) study. Fatigue was measured approximately 3 years post-diagnosis using the 22-item PFS-R that has four subscales (Behavior, Affect, Sensory, and Cognition). Confirmatory factor analysis was used to compare unidimensional and multidimensional models. Six criteria were used to make item selections to shorten the PFS-R: scale's content validity, items' relationship with fatigue, content redundancy, differential item functioning by race and/or education, scale reliability, and literacy demand. Factor analyses supported the original 4-factor structure. There was also evidence from the bi-factor model for a dominant underlying fatigue factor. Six items tested positive for differential item functioning between African-American and Caucasian survivors. Four additional items either showed poor association, local dependence, or content validity concerns. After removing these 10 items, the reliability of the PFS-12 subscales ranged from 0.87 to 0.89, compared to 0.90-0.94 prior to item removal. The newly developed PFS-12 can be used to assess fatigue in African-American and Caucasian breast cancer survivors and reduces response burden without compromising reliability or validity. This is the first study to determine PFS literacy demand and to compare PFS-R responses in African-Americans and Caucasian breast cancer survivors. Further testing in diverse populations is warranted.

An online spaced-education game to teach and assess residents: a multi-institutional prospective trial.

PubMed

Kerfoot, B Price; Baker, Harley

2012-03-01

While games are frequently used in resident education, there is little evidence supporting their efficacy. We investigated whether a spaced-education (SE) game can be both a reliable and valid method of assessing residents' knowledge and an effective means of teaching core content. The SE game consisted of 100 validated multiple-choice questions and explanations on core urology content. Residents were sent 2 questions each day via email. Adaptive game mechanics re-sent the questions in 2 or 6 weeks if answered incorrectly and correctly, respectively. Questions expired if not answered on time (appointment dynamic). Residents retired questions by answering each correctly twice in a row (progression dynamic). Competition was fostered by posting relative performance among residents. Main outcomes measures were baseline scores (percentage of questions answered correctly on initial presentation) and completion scores (percentage of questions retired). Nine hundred thirty-one US and Canadian residents enrolled in the 45-week trial. Cronbach alpha reliability for the SE baseline scores was 0.87. Baseline scores (median 62%, interquartile range [IQR] 17%) correlated with scores on the 2008 American Urological Association in-service examination (ISE08), 2009 American Board of Urology qualifying examination (QE09), and ISE09 (r = 0.76, 0.46, and 0.64, respectively; all p < 0.001). Baseline scores varied by sex, country, medical degree, and year of training (all p ≤ 0.001). Completion scores (median 100%, IQR 2%) correlated with ISE08 and ISE09 scores (r = 0.35, p < 0.001 for both). Seventy-two percent of enrollees (667 of 931) requested to participate in future SE games. An SE game is a reliable and valid means to assess residents' knowledge and is a well-accepted method by which residents can master core content. Published by Elsevier Inc.

Chinese version of the treatment of autoimmune bullous disease quality of life questionnaire: Reliability and validity.

PubMed

Chen, Guo; Yang, Baoqi; Zhang, Zhaoxia; Yang, Qing; Yan, Xiaoxiao; Murrell, Dédée F; Zhang, Furen

2018-01-01

Treatments for autoimmune blistering disease carry significant risks of medical complications and can affect the patient's quality of life. Recently, the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire was developed in Australia. The objective of this study was to evaluate the reliability and validity of the Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire in Chinese patients with autoimmune blistering diseases. The Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire was produced by forward-backward translation and cross-cultural adaptation of the original English version. Autoimmune blistering disease patients recruited in the study self-administered the Chinese Treatment of Autoimmune Bullous Disease Quality of Life questionnaire, the Dermatology Life Quality Index and the 36-item Short-Form Health Survey. Reliability of the Chinese Treatment of Autoimmune Bullous Disease Quality of Life was evaluated using internal consistency and test-retest (days 0 and 7) methods. Validity was analyzed by face, content, construct, convergent and discriminant validity measures. A total of 86 autoimmune blistering disease patients were recruited for the study. Cronbach's alpha coefficient was 0.883 and the intraclass correlation coefficient was 0.871. Face and content validities were satisfactory. Convergent validity testing revealed correlation coefficients of 0.664 for the Treatment of Autoimmune Bullous Disease Quality of Life and Dermatology Life Quality Index and -0.577 for the Treatment of Autoimmune Bullous Disease Quality of Life and 36-item Short-Form Health Survey. With respect to discriminant validity, no significant differences were observed in the Treatment of Autoimmune Bullous Disease Quality of Life scores of men and women (t = 0.251, P = 0.802), inpatients and outpatients (t = 0.447, P = 0.656), patients on steroids and steroid-sparing medications (t = 0.672, P = 0.503) and patients with different autoimmune blistering disease subtypes (F = 0.030, P = 0.971). Illiterate patients were excluded from the study. The patients were from a single hospital and most of their conditions were in a relatively stable status. The Chinese version of the Treatment of Autoimmune Bullous Disease Quality of Life questionnaire is a reliable and valid instrument to measure treatment burden and to serve as an end point in clinical trials in Chinese autoimmune blistering disease patients.

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

[Validation and reliability study of the parent concerns about surgery questionnaire: What worries parents?

PubMed

Gironés Muriel, Alberto; Campos Segovia, Ana; Ríos Gómez, Patricia

2018-01-01

The study of mediating variables and psychological responses to child surgery involves the evaluation of both the patient and the parents as regards different stressors. To have a reliable and reproducible valid evaluation tool that assesses the level of paternal involvement in relation to different stressors in the setting of surgery. A self-report questionnaire study was completed by 123 subjects of both sexes, subdivided into 2populations, due to their relationship with the hospital setting. The items were determined by a group of experts and analysed using the Lawshe validity index to determine a first validity of content. Subsequently, the reliability of the tool was determined by an item-re-item analysis of the 2sub-populations. A factorial analysis was performed to analyse the construct validity with the maximum likelihood and rotation of varimax type factors. A questionnaire of paternal concern was offered, consisting of 21 items with a Cronbach coefficient of 0.97, giving good precision and stability. The posterior factor analysis gives an adequate validity to the questionnaire, with the determination of 10 common stressors that cover 74.08% of the common and non-common variance of the questionnaire. The proposed questionnaire is reliable, valid and easy-to-apply and is developed to assess the level of paternal concern about the surgery of a child and to be able to apply measures and programs through the prior assessment of these elements. Copyright © 2016 Asociación Española de Pediatría. Publicado por Elsevier España, S.L.U. All rights reserved.

Developing a Psychometric Instrument to Measure Physical Education Teachers' Job Demands and Resources.

PubMed

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands-resources model, the study developed and validated an instrument that measures physical education teachers' job demands-resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample ( n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from -.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers' perception of their working environment.

Developing a Psychometric Instrument to Measure Physical Education Teachers’ Job Demands and Resources

PubMed Central

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands–resources model, the study developed and validated an instrument that measures physical education teachers’ job demands–resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample (n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from −.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers’ perception of their working environment. PMID:29200808

Development and validation of a new instrument for testing functional health literacy in Japanese adults.

PubMed

Nakagami, Katsuyuki; Yamauchi, Toyoaki; Noguchi, Hiroyuki; Maeda, Tohru; Nakagami, Tomoko

2014-06-01

This study aimed to develop a reliable and valid measure of functional health literacy in a Japanese clinical setting. Test development consisted of three phases: generation of an item pool, consultation with experts to assess content validity, and comparison with external criteria (the Japanese Health Knowledge Test) to assess criterion validity. A trial version of the test was administered to 535 Japanese outpatients. Internal consistency reliability, calculated by Cronbach's alpha, was 0.81, and concurrent validity was moderate. Receiver Operating Characteristics and Item Response Theory were used to classify patients as having adequate, marginal, or inadequate functional health literacy. Both inadequate and marginal functional health literacy were associated with older age, lower income, lower educational attainment, and poor health knowledge. The time required to complete the test was 10-15 min. This test should enable health workers to better identify patients with inadequate health literacy. © 2013 Wiley Publishing Asia Pty Ltd.

The Development and Validation of a Generic Instrument, QoDoS, for Assessing the Quality of Decision Making.

PubMed

Donelan, Ronan; Walker, Stuart; Salek, Sam

2016-01-01

The impact of decision-making during the development and the regulatory review of medicines greatly influences the delivery of new medicinal products. Currently, there is no generic instrument that can be used to assess the quality of decision-making. This study describes the development of the Quality of Decision-Making Orientation Scheme QoDoS(©) instrument for appraising the quality of decision-making. Semi-structured interviews about decision-making were carried out with 29 senior decision makers from the pharmaceutical industry (10), regulatory authorities (9) and contract research organizations (10). The interviews offered a qualified understanding of the subjective decision-making approach, influences, behaviors and other factors that impact such processes for individuals and organizations involved in the delivery of new medicines. Thematic analysis of the transcribed interviews was carried out using NVivo8® software. Content validity was carried out using qualitative and quantitative data by an expert panel, which led to the developmental version of the QoDoS. Further psychometric evaluations were performed, including factor analysis, item reduction, reliability testing and construct validation. The thematic analysis of the interviews yielded a 94-item initial version of the QoDoS(©) with a 5-point Likert scale. The instrument was tested for content validity using a panel of experts for language clarity, completeness, relevance and scaling, resulting in a favorable agreement by panel members with an intra-class correlation coefficient value of 0.89 (95% confidence interval = 0.56, 0.99). A 76-item QoDoS(©) (version 2) emerged from content validation. Factor analysis produced a 47-item measure with four domains. The 47-item QoDoS(©) (version 3) showed high internal consistency (n = 120, Cronbach's alpha = 0.89), high reproducibility (n = 20, intra-class correlation = 0.77) and a mean completion time of 10 min. Reliability testing and construct validation was successfully performed. The QoDoS(©) is both reliable and valid for use. It has the potential for extensive use in medicines development by both the pharmaceutical industry and regulatory authorities. The QoDoS(©) can be used to assess the quality of decision-making and to inform decision makers of the factors that influence decision-making.

Technology Use in Science Instruction (TUSI): Aligning the Integration of Technology in Science Instruction in Ways Supportive of Science Education Reform

NASA Astrophysics Data System (ADS)

Campbell, Todd; Abd-Hamid, Nor Hashidah

2013-08-01

This study describes the development of an instrument to investigate the extent to which technology is integrated in science instruction in ways aligned to science reform outlined in standards documents. The instrument was developed by: (a) creating items consistent with the five dimensions identified in science education literature, (b) establishing content validity with both national and international content experts, (c) refining the item pool based on content expert feedback, (d) piloting testing of the instrument, (e) checking statistical reliability and item analysis, and (f) subsequently refining and finalization of the instrument. The TUSI was administered in a field test across eleven classrooms by three observers, with a total of 33 TUSI ratings completed. The finalized instrument was found to have acceptable inter-rater intraclass correlation reliability estimates. After the final stage of development, the TUSI instrument consisted of 26-items separated into the original five categories, which aligned with the exploratory factor analysis clustering of the items. Additionally, concurrent validity of the TUSI was established with the Reformed Teaching Observation Protocol. Finally, a subsequent set of 17 different classrooms were observed during the spring of 2011, and for the 9 classrooms where technology integration was observed, an overall Cronbach alpha reliability coefficient of 0.913 was found. Based on the analyses completed, the TUSI appears to be a useful instrument for measuring how technology is integrated into science classrooms and is seen as one mechanism for measuring the intersection of technological, pedagogical, and content knowledge in science classrooms.

eLearning to facilitate the education and implementation of the Chelsea Critical Care Physical Assessment: a novel measure of function in critical illness

PubMed Central

Corner, Evelyn J; Handy, Jonathan M; Brett, Stephen J

2016-01-01

Objective To evaluate the efficacy of eLearning in the widespread standardised teaching, distribution and implementation of the Chelsea Critical Care Physical Assessment (CPAx) tool—a validated tool to assess physical function in critically ill patients. Design Prospective educational study. An eLearning module was developed through a conceptual framework, using the four-stage technique for skills teaching to teach clinicians how to use the CPAx. Example and test video case studies of CPAx assessments were embedded within the module. The CPAx scores for the test case studies and demographic data were recorded in a secure area of the website. Data were analysed for inter-rater reliability using intraclass correlation coefficients (ICCs) to see if an eLearning educational package facilitated consistent use of the tool. A utility and content validity questionnaire was distributed after 1 year to eLearning module registrants (n=971). This was to evaluate uptake of the CPAx in clinical practice and content validity of the CPAx from the perspective of clinical users. Setting The module was distributed for use via professional forums (n=2) and direct contacts (n=95). Participants Critical care clinicians. Primary outcome measure ICC of the test case studies. Results Between July and October 2014, 421 candidates from 15 countries registered for the eLearning module. The ICC for case one was 0.996 (95% CI 0.990 to 0.999; n=207). The ICC for case two was 0.988 (0.996 to 1.000; n=184). The CPAx has a strong total scale content validity index (s-CVI) of 0.94 and is well used. Conclusions eLearning is a useful and reliable way of teaching psychomotor skills, such as the CPAx. The CPAx is a well-used measure with high content validity rated by clinicians. PMID:27067895

eLearning to facilitate the education and implementation of the Chelsea Critical Care Physical Assessment: a novel measure of function in critical illness.

PubMed

Corner, Evelyn J; Handy, Jonathan M; Brett, Stephen J

2016-04-11

To evaluate the efficacy of eLearning in the widespread standardised teaching, distribution and implementation of the Chelsea Critical Care Physical Assessment (CPAx) tool-a validated tool to assess physical function in critically ill patients. Prospective educational study. An eLearning module was developed through a conceptual framework, using the four-stage technique for skills teaching to teach clinicians how to use the CPAx. Example and test video case studies of CPAx assessments were embedded within the module. The CPAx scores for the test case studies and demographic data were recorded in a secure area of the website. Data were analysed for inter-rater reliability using intraclass correlation coefficients (ICCs) to see if an eLearning educational package facilitated consistent use of the tool. A utility and content validity questionnaire was distributed after 1 year to eLearning module registrants (n=971). This was to evaluate uptake of the CPAx in clinical practice and content validity of the CPAx from the perspective of clinical users. The module was distributed for use via professional forums (n=2) and direct contacts (n=95). Critical care clinicians. ICC of the test case studies. Between July and October 2014, 421 candidates from 15 countries registered for the eLearning module. The ICC for case one was 0.996 (95% CI 0.990 to 0.999; n=207). The ICC for case two was 0.988 (0.996 to 1.000; n=184). The CPAx has a strong total scale content validity index (s-CVI) of 0.94 and is well used. eLearning is a useful and reliable way of teaching psychomotor skills, such as the CPAx. The CPAx is a well-used measure with high content validity rated by clinicians. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Development and validation of a questionnaire to evaluate infection control in oral radiology

PubMed Central

Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-01-01

Objectives: To create and validate a questionnaire to evaluate infection control in oral radiology. Methods: The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test–retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. Results: The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722–1.000) and good to great for the yes/no questions (kappa = 0.662–0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. Conclusions: The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology. PMID:28112553

[Development and testing of a preparedness and response capacity questionnaire in public health emergency for Chinese provincial and municipal governments].

PubMed

Hu, Guo-Qing; Rao, Ke-Qin; Sun, Zhen-Qiu

2008-12-01

To develop a capacity questionnaire in public health emergency for Chinese local governments. Literature reviews, conceptual modelling, stake-holder analysis, focus group, interview, and Delphi technique were employed together to develop the questionnaire. Classical test theory and case study were used to assess the reliability and validity. (1) A 2-dimension conceptual model was built. A preparedness and response capacity questionnaire in public health emergency with 10 dimensions and 204 items, was developed. (2) Reliability and validity results. Internal consistency: except for dimension 3 and 8, the Cronbach's alpha coefficient of other dimensions was higher than 0.60. The alpha coefficients of dimension 3 and dimension 8 were 0.59 and 0.39 respectively; Content validity: the questionnaire was recognized by the investigatees; Construct validity: the Spearman correlation coefficients among the 10 dimensions fluctuated around 0.50, ranging from 0.26 to 0.75 (P<0.05); Discrimination validity: comparisons of 10 dimensions among 4 provinces did not show statistical significance using One-way analysis of variance (P>0.05). Criterion-related validity: case study showed significant difference among the 10 dimensions in Beijing between February 2003 (before SARS event) and November 2005 (after SARS event). The preparedness and response capacity questionnaire in public health emergency is a reliable and valid tool, which can be used in all provinces and municipalities in China.

A tool to assess sex-gender when selecting health research projects.

PubMed

Tomás, Concepción; Yago, Teresa; Eguiluz, Mercedes; Samitier, M A Luisa; Oliveros, Teresa; Palacios, Gemma

2015-04-01

To validate the questionnaire "Gender Perspective in Health Research" (GPIHR) to assess the inclusion of gender perspective in research projects. Validation study in two stages. Feasibility was analysed in the first, and reliability, internal consistence and validity in the second. Aragón Institute of Health Science, Aragón, Spain. GPIHR was applied to 118 research projects funded in national and international competitive tenders from 2003 to 2012. Analysis of inter- and intra-observer reliability with Kappa index and internal consistency with Cronbach's alpha. Content validity analysed through literature review and construct validity with an exploratory factor analysis. Validated GPIHR has 10 questions: 3 in the introduction, 1 for objectives, 3 for methodology and 3 for research purpose. Average time of application was 13min Inter-observer reliability (Kappa) varied between 0.35 and 0.94 and intra-observer between 0.40 and 0.94. Theoretical construct is supported in the literature. Factor analysis identifies three levels of GP inclusion: "difference by sex", "gender sensitive" and "feminist research" with an internal consistency of 0.64, 0.87 and 0.81, respectively, which explain 74.78% of variance. GPIHR questionnaire is a valid tool to assess GP and useful for those researchers who would like to include GP in their projects. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

PubMed

Guo, Yi; Bian, Jiang; Leavitt, Trevor; Vincent, Heather K; Vander Zalm, Lindsey; Teurlings, Tyler L; Smith, Megan D; Modave, François

2017-03-07

Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers' scores to the criterion scores. Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. We have developed and presented valid and reliable scoring instruments for exercise program apps. Our instrument may be useful for consumers and health care providers who are looking for apps that provide safe, progressive general exercise programs for health and fitness. ©Yi Guo, Jiang Bian, Trevor Leavitt, Heather K Vincent, Lindsey Vander Zalm, Tyler L Teurlings, Megan D Smith, François Modave. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.03.2017.

Calibration and validation of the Physical Activity Barrier Scale for persons who are blind or visually impaired.

PubMed

Lee, Miyoung; Zhu, Weimo; Ackley-Holbrook, Elizabeth; Brower, Diana G; McMurray, Bryan

2014-07-01

It is critical to employ accurate measures when assessing physical activity (PA) barriers in any subpopulation, yet existing measures are not appropriate for persons with blindness or visual impairment (PBVI) due to a lack of validity or reliability evidence. To develop and calibrate a PA barrier scale for PBVI. An expert panel (n = 3) and 18 PBVI were recruited to establish content validity for a PA barriers subscale; 160 PBVI (96 females) completed the scale along with the Physical Activity Scale for Individuals with Physical Disabilities for calibration. To establish construct-related validity evidence, Confirmative factor analysis (CFA) and Rasch analysis were applied. To investigate internal consistency and reliability, Cronbach's alpha and the reliability coefficient (R) were employed, respectively. Following CFA and Rasch analyses, five items were eliminated due to misfits; reliability coefficients were unchanged upon deletion of these items. The barriers perceived by PBVI to have the most negative impact on PA included "lack of self-discipline" (logit = 1.40) and "lack of motivation" (logit = 1.27). "Too many stairs in the exercise facility" (logit = -1.49) was perceived to have the least impact. The newly-developed scale was found to be a valid and reliable tool for evaluating PA barriers in PBVI. To enhance promotion of health-producing levels of PA in PBVI, practitioners should consider applying this new tool as a precursor to programs aimed at improving PA participation in this group. Copyright © 2014 Elsevier Inc. All rights reserved.

Valid and reliable authentic assessment of culminating student performance in the biomedical sciences.

PubMed

Oh, Deborah M; Kim, Joshua M; Garcia, Raymond E; Krilowicz, Beverly L

2005-06-01

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.