[Internal consistency and criterion validity and reliability of the Mexican Version of the Child Behavior Checklist 1.5-5 (CBCL/1.5-5)].

PubMed

Albores-Gallo, Lilia; Hernández-Guzmán, Laura; Hasfura-Buenaga, Cecilia; Navarro-Luna, Enrique

To investigate the validity and internal consistency of the Mexican version of the CBCL/1.5 -5 that assesses the most common psychopathology in pre-school children in clinical and epidemiological settings. A total of 438 parents from two groups, clinical-psychiatric (N= 62) and community (N= 376) completed the CBCL/1.5-5/Mexican version. The internal consistency was high for total problems α=0.95, and internalized α=0.89 and externalized α=0.91 subscales. The test re-test (one week) using the intraclass correlation coefficient (ICC) was ≥ 0.95 for the internalized, externalized, and total problems subscales. The ROC curve for the criterion status of clinically-referred vs. non-referred using the total problems scale ≥ 24 resulted in an AUC (area under curve) of 0.77, a specificity 0.73, and a sensitivity of 0.70. The CBCL/1.5 -5/Mexican version is a reliable and valid tool. Copyright © 2016 Sociedad Chilena de Pediatría. Publicado por Elsevier España, S.L.U. All rights reserved.

Temporal and Geographic variation in the validity and internal consistency of the Nursing Home Resident Assessment Minimum Data Set 2.0.

PubMed

Mor, Vincent; Intrator, Orna; Unruh, Mark Aaron; Cai, Shubing

2011-04-15

The Minimum Data Set (MDS) for nursing home resident assessment has been required in all U.S. nursing homes since 1990 and has been universally computerized since 1998. Initially intended to structure clinical care planning, uses of the MDS expanded to include policy applications such as case-mix reimbursement, quality monitoring and research. The purpose of this paper is to summarize a series of analyses examining the internal consistency and predictive validity of the MDS data as used in the "real world" in all U.S. nursing homes between 1999 and 2007. We used person level linked MDS and Medicare denominator and all institutional claim files including inpatient (hospital and skilled nursing facilities) for all Medicare fee-for-service beneficiaries entering U.S. nursing homes during the period 1999 to 2007. We calculated the sensitivity and positive predictive value (PPV) of diagnoses taken from Medicare hospital claims and from the MDS among all new admissions from hospitals to nursing homes and the internal consistency (alpha reliability) of pairs of items within the MDS that logically should be related. We also tested the internal consistency of commonly used MDS based multi-item scales and examined the predictive validity of an MDS based severity measure viz. one year survival. Finally, we examined the correspondence of the MDS discharge record to hospitalizations and deaths seen in Medicare claims, and the completeness of MDS assessments upon skilled nursing facility (SNF) admission. Each year there were some 800,000 new admissions directly from hospital to US nursing homes and some 900,000 uninterrupted SNF stays. Comparing Medicare enrollment records and claims with MDS records revealed reasonably good correspondence that improved over time (by 2006 only 3% of deaths had no MDS discharge record, only 5% of SNF stays had no MDS, but over 20% of MDS discharges indicating hospitalization had no associated Medicare claim). The PPV and sensitivity levels of

An Experimental Study of the Internal Consistency of Judgments Made in Bookmark Standard Setting

ERIC Educational Resources Information Center

Clauser, Brian E.; Baldwin, Peter; Margolis, Melissa J.; Mee, Janet; Winward, Marcia

2017-01-01

Validating performance standards is challenging and complex. Because of the difficulties associated with collecting evidence related to external criteria, validity arguments rely heavily on evidence related to internal criteria--especially evidence that expert judgments are internally consistent. Given its importance, it is somewhat surprising…

Sixteen-Item Anxiety Sensitivity Index: Confirmatory Factor Analytic Evidence, Internal Consistency, and Construct Validity in a Young Adult Sample from the Netherlands

ERIC Educational Resources Information Center

Vujanovic, Anka A.; Arrindell, Willem A.; Bernstein, Amit; Norton, Peter J.; Zvolensky, Michael J.

2007-01-01

The present investigation examined the factor structure, internal consistency, and construct validity of the 16-item Anxiety Sensitivity Index (ASI; Reiss Peterson, Gursky, & McNally 1986) in a young adult sample (n = 420) from the Netherlands. Confirmatory factor analysis was used to comparatively evaluate two-factor, three-factor, and…

The Iranian version of 12-item Short Form Health Survey (SF-12): factor structure, internal consistency and construct validity.

PubMed

Montazeri, Ali; Vahdaninia, Mariam; Mousavi, Sayed Javad; Omidvari, Speideh

2009-09-16

The 12-item Short Form Health Survey (SF-12) as a shorter alternative of the SF-36 is largely used in health outcomes surveys. The aim of this study was to validate the SF-12 in Iran. A random sample of the general population aged 15 years and over living in Tehran, Iran completed the SF-12. Reliability was estimated using internal consistency and validity was assessed using known groups comparison and convergent validity. In addition, the factor structure of the questionnaire was extracted by performing both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). In all, 5587 individuals were studied (2721 male and 2866 female). The mean age and formal education of the respondents were 35.1 (SD = 15.4) and 10.2 (SD = 4.4) years respectively. The results showed satisfactory internal consistency for both summary measures, that are the Physical Component Summary (PCS) and the Mental Component Summary (MCS); Cronbach's alpha for PCS-12 and MCS-12 was 0.73 and 0.72, respectively. Known-groups comparison showed that the SF-12 discriminated well between men and women and those who differed in age and educational status (P < 0.001). In addition, correlations between the SF-12 scales and single items showed that the physical functioning, role physical, bodily pain and general health subscales correlated higher with the PCS-12 score, while the vitality, social functioning, role emotional and mental health subscales more correlated with the MCS-12 score lending support to its good convergent validity. Finally the principal component analysis indicated a two-factor structure (physical and mental health) that jointly accounted for 57.8% of the variance. The confirmatory factory analysis also indicated a good fit to the data for the two-latent structure (physical and mental health). In general the findings suggest that the SF-12 is a reliable and valid measure of health related quality of life among Iranian population. However, further studies are needed to

Construct validity, test-retest reliability and internal consistency of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) in patients with carpal tunnel syndrome.

PubMed

Buntragulpoontawee, Montana; Phutrit, Suphatha; Tongprasert, Siam; Wongpakaran, Tinakon; Khunachiva, Jeeranan

2018-03-27

This study evaluated additional psychometric properties of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) which included, test-retest reliability, construct validity, internal consistency of in patients with carpal tunnel syndrome. As for determining construct validity, the Thai EuroQOL questionnaire (EQ-5D-5L) was also administered in order to examine convergent and divergent validity. Fifty patients completed both questionnaires. The DASH-TH showed excellent test-retest reliability (intraclass correlation coefficient = 0.811) and internal consistency (Cronbach's alpha = 0.911). The exploratory factor analysis yielded a six-factor solution while the confirmatory factor analysis denoted that the hypothesized model adequately fit the data with a comparative fit index of 0.967 and a Tucker-Lewis index of 0.964. The related subscales between the DASH-TH and the Thai EQ-5D-5L were significantly correlated, indicating the DASH-TH's convergent and discriminant validity. The DASH-TH demonstrated good reliability, internal consistency construct validity, and multidimensionality, in assessing the upper extremity function in carpal tunnel syndrome patients.

Response set bias, internal consistency and construct validity of the Oswestry Low Back Pain Disability Questionnaire

PubMed Central

Tibbles, Anthony C; Waalen, Judith K; Hains, François C

1998-01-01

Background: The Oswestry Low Back Pain Disability Questionnaire (ODQ) is a widely used 10-item paper and pencil measure of disability resulting from low back pain. However, few studies have assessed the psychometric properties of the instrument. This study evaluated the response set bias, the internal consistency, and the construct validity of the ODQ. Objectives: The original ODQ was compared to seven modified versions to examine whether a response set bias existed. The internal consistency of the ODQ was assessed using the Cronbach alpha. Finally, the relationship between scores on the ODQ and the Roland Morris Functional Disability Scal (RM) was examined. Methods: Seven modified versions of the ODQ were developed from the original. One of the eight versions was randomly allocated to 102 adult patients presenting with low lack pain. There was no attempt to select patients on the basis of pain intensity or prior treatment so as to maximize the range and diversity of low back pain sufferers. Results: Results suggest that the responses given on the eight versions of the ODQ are a function of content and not of the format in which the items are presented. The ODQ also has strong internal consisstency (alpha = 0.85) and is strongly correlated to the RM (r = .70, p = .0005). The ODQ is a significant predictor of the RM scores (T-9.45, p = .0005) and duration of symptoms (T = -2.17, p = .0325). Conclusion: The ODQ appears to possess stable psychometric properties. The use of more than one version provides practitioners with a means of repeatedly assessing the disability levels of patients suffering from low back pain over the course of treatment.

Internal consistency, concurrent validity, and discriminant validity of a measure of public support for policies for active living in transportation (PAL-T) in a population-based sample of adults.

PubMed

Fuller, Daniel; Gauvin, Lise; Fournier, Michel; Kestens, Yan; Daniel, Mark; Morency, Patrick; Drouin, Louis

2012-04-01

Active living is a broad conceptualization of physical activity that incorporates domains of exercise; recreational, household, and occupational activities; and active transportation. Policy makers develop and implement a variety of transportation policies that can influence choices about how to travel from one location to another. In making such decisions, policy makers act in part in response to public opinion or support for proposed policies. Measures of the public's support for policies aimed at promoting active transportation can inform researchers and policy makers. This study examined the internal consistency, and concurrent and discriminant validity of a newly developed measure of the public's support for policies for active living in transportation (PAL-T). A series of 17 items representing potential policies for promoting active transportation was generated. Two samples of participants (n = 2,001 and n = 2,502) from Montreal, Canada, were recruited via random digit dialling. Analyses were conducted on the combined data set (n = 4,503). Participants were aged 18 through 94 years (58% female). The concurrent and discriminant validity of the PAL-T was assessed by examining relationships with physical activity and smoking. To explore the usability of the PAL-T, predicted scale scores were compared to the summed values of responses. Results showed that the internal consistency of the PAL-T was 0.70. Multilevel regression demonstrated no relationship between the PAL-T and smoking status (p > 0.05) but significant relationships with utilitarian walking (p < 0.05) and cycling (p < 0.01) for at least 30 minutes on 5 days/week. The PAL-T has acceptable internal consistency and good concurrent and discriminant validity. Measuring public opinion can inform policy makers and support advocacy efforts aimed at making built environments more suitable for active transportation while allowing researchers to examine the antecedents and

The Achilles tendon total rupture score: a study of responsiveness, internal consistency and convergent validity on patients with acute Achilles tendon ruptures

PubMed Central

2012-01-01

Background The Achilles tendon Total Rupture Score was developed by a research group in 2007 in response to the need for a patient reported outcome measure for this patient population. Beyond this original development paper, no further validation studies have been published. Consequently the purpose of this study was to evaluate internal consistency, convergent validity and responsiveness of this newly developed patient reported outcome measure within patients who have sustained an isolated acute Achilles tendon rupture. Methods Sixty-four eligible patients with an acute rupture of their Achilles tendon completed the Achilles tendon Total Rupture Score alongside two further patient reported outcome measures (Disability Rating Index and EQ 5D). These were completed at baseline, six weeks, three months, six months and nine months post injury. The Achilles tendon Total Rupture Score was evaluated for internal consistency, using Cronbach's alpha, convergent validity, through correlation analysis and responsiveness, by analysing floor and ceiling effects and calculating its relative efficiency in comparison to the Disability Rating Index and EQ 5D scores. Results The Achilles tendon Total Rupture Score demonstrated high internal consistency (Cronbachs alpha > 0.8) and correlated significantly (p < 0.001) with the Disability Rating Index at five time points (pre-injury, six weeks, three, six and nine months) with correlation coefficients between -0.5 and -0.9. However, the confidence intervals were wide. Furthermore, the ability of the new score to detect clinically important changes over time (responsiveness) was shown to be greater than the Disability Rating Index and EQ 5D. Conclusions A universally accepted outcome measure is imperative to allow comparisons to be made across practice. This is the first study to evaluate aspects of validity of this newly developed outcome measure, outside of the developing centre. The ATRS demonstrated high internal consistency and

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

The Iranian version of 12-item Short Form Health Survey (SF-12): factor structure, internal consistency and construct validity

PubMed Central

Montazeri, Ali; Vahdaninia, Mariam; Mousavi, Sayed Javad; Omidvari, Speideh

2009-01-01

Background The 12-item Short Form Health Survey (SF-12) as a shorter alternative of the SF-36 is largely used in health outcomes surveys. The aim of this study was to validate the SF-12 in Iran. Methods A random sample of the general population aged 15 years and over living in Tehran, Iran completed the SF-12. Reliability was estimated using internal consistency and validity was assessed using known groups comparison and convergent validity. In addition, the factor structure of the questionnaire was extracted by performing both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Results: In all, 5587 individuals were studied (2721 male and 2866 female). The mean age and formal education of the respondents were 35.1 (SD = 15.4) and 10.2 (SD = 4.4) years respectively. The results showed satisfactory internal consistency for both summary measures, that are the Physical Component Summary (PCS) and the Mental Component Summary (MCS); Cronbach's α for PCS-12 and MCS-12 was 0.73 and 0.72, respectively. Known-groups comparison showed that the SF-12 discriminated well between men and women and those who differed in age and educational status (P < 0.001). In addition, correlations between the SF-12 scales and single items showed that the physical functioning, role physical, bodily pain and general health subscales correlated higher with the PCS-12 score, while the vitality, social functioning, role emotional and mental health subscales more correlated with the MCS-12 score lending support to its good convergent validity. Finally the principal component analysis indicated a two-factor structure (physical and mental health) that jointly accounted for 57.8% of the variance. The confirmatory factory analysis also indicated a good fit to the data for the two-latent structure (physical and mental health). Conclusion In general the findings suggest that the SF-12 is a reliable and valid measure of health related quality of life among Iranian population

Cross- cultural validation of the Brazilian Portuguese version of the Social Phobia Inventory (SPIN): study of the items and internal consistency.

PubMed

Osório, Flávia de Lima; Crippa, José Alexandre S; Loureiro, Sonia Regina

2009-03-01

The objective of the present study was to carry out the cross- cultural validation for Brazilian Portuguese of the Social Phobia Inventory, an instrument for the evaluation of fear, avoidance and physiological symptoms associated with social anxiety disorder. The process of translation and adaptation involved four bilingual professionals, appreciation and approval of the back- translation by the authors of the original scale, a pilot study with 30 Brazilian university students, and appreciation by raters who confirmed the face validity of the Portuguese version, which was named ' Inventário de Fobia Social' . As part of the psychometric study of the Social Phobia Inventory, analysis of the items and evaluation of the internal consistency of the instrument were performed in a study conducted on 2314 university students. The results demonstrated that item 11, related to the fear of public speaking, was the most frequently scored item. The correlation of the items with the total score was quite adequate, ranging from 0.44 to 0.71, as was the internal consistency, which ranged from 0.71 to 0.90. The authors conclude that the Brazilian Portuguese version of the Social Phobia Inventory proved to be adequate regarding the psychometric properties initially studied, with qualities quite close to those of the original study. Studies that will evaluate the remaining indicators of validity of the Social Phobia Inventory in clinical and non-clinical samples are considered to be opportune and necessary.

Nurses' knowledge and attitudes towards aged sexuality: validity and internal consistency of the Dutch version of the Aging Sexual Knowledge and Attitudes Scale.

PubMed

Mahieu, Lieslot; de Casterlé, Bernadette Dierckx; Van Elssen, Kim; Gastmans, Chris

2013-11-01

This paper reports a study testing the content and face validity and internal consistency of the Dutch version of the Aging Sexual Knowledge and Attitudes Scale. The ability of older residents to sexually express themselves is known to be influenced by the knowledge and attitudes of nursing home staff towards later-life sexuality. Although the Aging Sexual Knowledge and Attitudes Scale is a widely used instrument to measure this, there is no validated, Dutch translation available. Instrument development. Following a standard forward/backward translation into Dutch, the scale was further adapted for use in Flemish nursing home settings. Content and face validity and user-friendliness were assessed. The psychometric properties were determined by means of an exploratory study. Data were collected from March-April 2011 at eight Flemish nursing homes. Reliability was assessed using internal consistency and item-total correlations. Both subscales of the Flemish adaptation showed acceptable content validity. The face validity and user-friendliness were deemed favourable with hardly any remarks given by the expert panel. The Cronbach's α was 0.80 and 0.88 for the knowledge and attitude subscales, respectively. The item-total correlations ranged from 0.21-0.48 for the knowledge section and from 0.09-0.68 for the attitude subscale. We conclude from our study that the Dutch version of the scale has acceptable to good psychometric properties. The Flemish adaptation therefore seems to be a valuable instrument for studying nursing staff's knowledge and attitudes towards aged sexuality in Flanders. © 2013 Blackwell Publishing Ltd.

Internal consistency of the self-reporting questionnaire-20 in occupational groups

PubMed Central

Santos, Kionna Oliveira Bernardes; Carvalho, Fernando Martins; de Araújo, Tânia Maria

2016-01-01

ABSTRACT OBJECTIVE To assess the internal consistency of the measurements of the Self-Reporting Questionnaire (SRQ-20) in different occupational groups. METHODS A validation study was conducted with data from four surveys with groups of workers, using similar methods. A total of 9,959 workers were studied. In all surveys, the common mental disorders were assessed via SRQ-20. The internal consistency considered the items belonging to dimensions extracted by tetrachoric factor analysis for each study. Item homogeneity assessment compared estimates of Cronbach’s alpha (KD-20), the alpha applied to a tetrachoric correlation matrix and stratified Cronbach’s alpha. RESULTS The SRQ-20 dimensions showed adequate values, considering the reference parameters. The internal consistency of the instrument items, assessed by stratified Cronbach’s alpha, was high (> 0.80) in the four studies. CONCLUSIONS The SRQ-20 showed good internal consistency in the professional categories evaluated. However, there is still a need for studies using alternative methods and additional information able to refine the accuracy of latent variable measurement instruments, as in the case of common mental disorders. PMID:27007682

[Report of Internal Consistency of the Scales in Research Published in the Colombian Journal of Psychiatry].

PubMed

Campo-Arias, Adalberto

2013-03-01

Establishment of the frequency of reporting internal consistency of the scales in research published in the Colombian Journal of Psychiatry (CJP) between 2006 and 2010. A descriptive study was carried out which computes the report of internal consistency (Cronbach alpha) of scales in research published as original papers in the CJP. Validation studies were excluded. A total of 114 articles were published and 30 of them were included in the analysis. Researchers applied 67 scales for measuring some variables and Cronbach alpha of 20 (29.8%) scales was reported in the participating population. In the CJP, few published studies that apply measuring scales for variables report internal consistency in the analyzed sample. It is necessary for authors to report the internal consistency of used scales in the study population to guarantee the validity of conclusions. Copyright © 2013 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Construct validity and internal consistency reliability of the Malay version of the 21-item depression anxiety stress scale (Malay-DASS-21) among male outpatient clinic attendees in Johor.

PubMed

Rusli, B N; Amrina, K; Trived, S; Loh, K P; Shashi, M

2017-10-01

The 21-item English version of the Depression Anxiety Stress Scale (DASS-21) has been proposed as a method for assessing self-perceived depression, anxiety and stress over the past week in various clinical and nonclinical populations. Several Malay versions of the DASS-21 have been validated in various populations with varying success. One particular Malay version has been validated in various occupational groups (such as nurses and automotive workers) but not among male clinic outpatient attendees in Malaysia. To validate the Malay version of the DASS-21 (Malay-DASS-21) among male outpatient clinic attendees in Johor. A validation study with a random sample of 402 male respondents attending the outpatient clinic of a major public outpatient clinic in Johor Bahru and Segamat was carried out from January to March 2016. Construct validity of the Malay-DASS-21 was examined using Exploratory Factor Analysis (KMO = 0.947; Bartlett's test of sphericity is significant, p<0.001) through Principal Component Analysis and orthogonal (varimax) rotation with Kaiser Normalization to confirm the psychometric properties of the Malay-DASS- 21 and the internal consistency reliability using Cronbach's alpha. Construct validity of the Malay-DASS-21 based on eigenvalues and factor loadings to confirm the three factor structure (depression, anxiety, and stress) was acceptable. The internal consistency reliability of the factor construct was very impressive with Cronbach's alpha values in the range of 0.837 to 0.863. The present study showed that the Malay- DASS-21 has acceptable psychometric construct and high internal consistency reliability to measure self-perceived depression, anxiety and stress over the past week in male outpatient clinic attendees in Johor. Further studies are necessary to revalidate the Malay-DASS-21 across different populations and cultures, and using confirmatory factor analyses.

The Columbia–Suicide Severity Rating Scale: Initial Validity and Internal Consistency Findings From Three Multisite Studies With Adolescents and Adults

PubMed Central

Posner, Kelly; Brown, Gregory K.; Stanley, Barbara; Brent, David A.; Yershova, Kseniya V.; Oquendo, Maria A.; Currier, Glenn W.; Melvin, Glenn A.; Greenhill, Laurence; Shen, Sa; Mann, J. John

2013-01-01

Objective Research on suicide prevention and interventions requires a standard method for assessing both suicidal ideation and behavior to identify those at risk and to track treatment response. The Columbia–Suicide Severity Rating Scale (C-SSRS) was designed to quantify the severity of suicidal ideation and behavior. The authors examined the psychometric properties of the scale. Method The C-SSRS’s validity relative to other measures of suicidal ideation and behavior and the internal consistency of its intensity of ideation subscale were analyzed in three multisite studies: a treatment study of adolescent suicide attempters (N=124); a medication efficacy trial with depressed adolescents (N=312); and a study of adults presenting to an emergency department for psychiatric reasons (N=237). Results The C-SSRS demonstrated good convergent and divergent validity with other multi-informant suicidal ideation and behavior scales and had high sensitivity and specificity for suicidal behavior classifications compared with another behavior scale and an independent suicide evaluation board. Both the ideation and behavior subscales were sensitive to change over time. The intensity of ideation subscale demonstrated moderate to strong internal consistency. In the adolescent suicide attempters study, worst-point lifetime suicidal ideation on the C-SSRS predicted suicide attempts during the study, whereas the Scale for Suicide Ideation did not. Participants with the two highest levels of ideation severity (intent or intent with plan) at baseline had higher odds for attempting suicide during the study. Conclusions These findings suggest that the C-SSRS is suitable for assessment of suicidal ideation and behavior in clinical and research settings. PMID:22193671

The Brazilian version of the Constant-Murley Score (CMS-BR): convergent and construct validity, internal consistency, and unidimensionality.

PubMed

Barreto, Rodrigo Py Gonçalves; Barbosa, Marcus Levi Lopes; Balbinotti, Marcos Alencar Abaide; Mothes, Fernando Carlos; da Rosa, Luís Henrique Telles; Silva, Marcelo Faria

2016-01-01

To translate and culturally adapt the CMS and assess the validity of the Brazilian version (CMS-BR). The translation was carried out according to the back-translation method by four independent translators. The produced versions were synthesized through extensive analysis and by consensus of an expert committee, reaching a final version used for the cultural adaptation. A field test was conducted with 30 subjects in order to obtain semantic considerations. For the psychometric analyzes, the sample was increased to 110 participants who answered two instruments: CMS-BR and the Disabilities of the Arm, shoulder and Hand (DASH). The CMS-BR and DASH score range from 0 to 100 points. For the first, higher points reflect better function and for the latter, the inverse is true. The validity was verified by Pearson's correlation test, the unidimensionality by factorial analysis, and the internal consistency by Cronbach's alpha. The explained variance was 60.28% with factor loadings ranging from 0.60 to 0.91. The CMS-BR exhibited strong negative correlation with the DASH score (-0.82, p  < 0.05), Cronbach's alpha 0.85, and its total score was strongly correlated with the patient's range of motion (0.93, p  < 0.001). The CMS was satisfactorily adapted for Brazilian Portuguese and demonstrated evidence of validity that allows its use in this population.

Development and initial validation of the internalization of Asian American stereotypes scale.

PubMed

Shen, Frances C; Wang, Yu-Wei; Swanson, Jane L

2011-07-01

This research consists of four studies on the initial reliability and validity of the Internalization of Asian American Stereotypes Scale (IAASS), a self-report instrument that measures the degree Asian Americans have internalized racial stereotypes about their own group. The results from the exploratory and confirmatory factor analyses support a stable four-factor structure of the IAASS: Difficulties with English Language Communication, Pursuit of Prestigious Careers, Emotional Reservation, and Expected Academic Success. Evidence for concurrent and discriminant validity is presented. High internal-consistency and test-retest reliability estimates are reported. A discussion of how this scale can contribute to research and practice regarding internalized stereotyping among Asian Americans is provided.

Internal consistency reliability and validity of the Arabic translation of the Mathematics Teaching Efficacy Beliefs Instrument.

PubMed

Alkhateeb, Haitham M

2004-06-01

The Arabic translation of the Mathematics Teaching Efficacy Beliefs was completed by 144 undergraduate students (M age=20.6) in Jordan. The findings support the internal reliability of the Arabic translation of the Mathematics Teaching Efficacy Beliefs as well as its construct validity.

Strengths and Difficulties Questionnaire: internal validity and reliability for New Zealand preschoolers.

PubMed

Kersten, Paula; Vandal, Alain C; Elder, Hinemoa; McPherson, Kathryn M

2018-04-21

This observational study examines the internal construct validity, internal consistency and cross-informant reliability of the Strengths and Difficulties Questionnaire (SDQ) in a New Zealand preschool population across four ethnicity strata (New Zealand European, Māori, Pasifika, Asian). Rasch analysis was employed to examine internal validity on a subsample of 1000 children. Internal consistency (n=29 075) and cross-informant reliability (n=17 006) were examined using correlations, intraclass correlation coefficients and Cronbach's alpha on the sample available for such analyses. Data were used from a national SDQ database provided by the funder, pertaining to New Zealand domiciled children aged 4 and 5 and scored by their parents and teachers. The five subscales do not fit the Rasch model (as indicated by the overall fit statistics), contain items that are biased (differential item functioning (DIF)) by key variables, suffer from a floor and ceiling effect and have unacceptable internal consistency. After dealing with DIF, the Total Difficulty scale does fit the Rasch model and has good internal consistency. Parent/teacher inter-rater reliability was unacceptably low for all subscales. The five SDQ subscales are not valid and not suitable for use in their own right in New Zealand. We have provided a conversion table for the Total Difficulty scale, which takes account of bias by ethnic group. Clinicians should use this conversion table in order to reconcile DIF by culture in final scores. It is advisable to use both parents and teachers' feedback when considering children's needs for referral of further assessment. Future work should examine whether validity is impacted by different language versions used in the same country. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

[Factor analysis and internal consistency of pedagogical practices questionnaire among health care teachers].

PubMed

Pérez V, Cristhian; Vaccarezza G, Giulietta; Aguilar A, César; Coloma N, Katherine; Salgado F, Horacio; Baquedano R, Marjorie; Chavarría R, Carla; Bastías V, Nancy

2016-06-01

Teaching practice is one of the most complex topics of the training process in medicine and other health care careers. The Teaching Practices Questionnaire (TPQ) evaluates teaching skills. To assess the factor structure and internal consistency of the Spanish version of the TPP among health care teachers. The TPQ was answered by 315 university teachers from 13 of the 15 administrative Chilean regions, who were selected through a non-probabilistic volunteer sampling. The internal consistency of TPP factors was calculated and the correlation between them was analyzed. Six factors were identified: Student-centered teaching, Teaching planning, Assessment process, Dialogue relationship, Teacher-centered teaching and Use of technological resources. They had Cronbach alphas ranging from 0.60 to 0.85. The factorial structure of TPQ differentiates the most important functions of teaching. It also shows a theoretical consistency and a practical relevance to perform a diagnosis and continuous evaluation of teaching practices. Additionally, it has an adequate internal consistency. Thus, TPQ is valid and reliable to evaluate pedagogical practices in health care careers.

The Specific Level of Functioning Scale: construct validity, internal consistency and factor structure in a large Italian sample of people with schizophrenia living in the community.

PubMed

Mucci, Armida; Rucci, Paola; Rocca, Paola; Bucci, Paola; Gibertoni, Dino; Merlotti, Eleonora; Galderisi, Silvana; Maj, Mario

2014-10-01

The study aimed to assess the construct validity, internal consistency and factor structure of the Specific Levels of Functioning Scale (SLOF), a multidimensional instrument assessing real life functioning. The study was carried out in 895 Italian people with schizophrenia, all living in the community and attending the outpatient units of 26 university psychiatric clinics and/or community mental health departments. The construct validity of the SLOF was analyzed by means of the multitrait-multimethod approach, using the Personal and Social Performance (PSP) Scale as the gold standard. The factor structure of the SLOF was examined using both an exploratory principal component analysis and a confirmatory factor analysis. The six factors identified using exploratory principal component analysis explained 57.1% of the item variance. The examination of the multitrait-multimethod matrix revealed that the SLOF factors had high correlations with PSP factors measuring the same constructs and low correlations with PSP factors measuring different constructs. The confirmatory factor analysis (CFA) corroborated the 6-factor structure reported in the original validation study. Loadings were all significant and ranged from a minimum of 0.299 to a maximum of 0.803. The CFA model was adequately powered and had satisfactory goodness of fit indices (comparative fit index=0.927, Tucker-Lewis index=0.920 and root mean square error of approximation=0.047, 95% CI 0.045-0.049). The present study confirms, in a large sample of Italian people with schizophrenia living in the community, that the SLOF is a reliable and valid instrument for the assessment of social functioning. It has good construct validity and internal consistency, and a well-defined factor structure. Copyright © 2014 Elsevier B.V. All rights reserved.

Creation of a computer self-efficacy measure: analysis of internal consistency, psychometric properties, and validity.

PubMed

Howard, Matt C

2014-10-01

Computer self-efficacy is an often studied construct that has been shown to be related to an array of important individual outcomes. Unfortunately, existing measures of computer self-efficacy suffer from several deficiencies, including criterion contamination, outdated wording, and/or inadequate psychometric properties. For this reason, the current article presents the creation of a new computer self-efficacy measure. In Study 1, an over-representative item list is created and subsequently reduced through exploratory factor analysis to create an initial measure, and the discriminant validity of this initial measure is tested. In Study 2, the unidimensional factor structure of the initial measure is supported through confirmatory factor analysis and further reduced into a final, 12-item measure. In Study 3, the convergent and criterion validity of the 12-item measure is tested. Overall, this three study process demonstrates that the new computer self-efficacy measure has superb psychometric properties and internal reliability, and demonstrates excellent evidence for several aspects of validity. It is hoped that the 12-item computer self-efficacy measure will be utilized in future research on computer self-efficacy, which is discussed in the current article.

International Harmonization and Cooperation in the Validation of Alternative Methods.

PubMed

Barroso, João; Ahn, Il Young; Caldeira, Cristiane; Carmichael, Paul L; Casey, Warren; Coecke, Sandra; Curren, Rodger; Desprez, Bertrand; Eskes, Chantra; Griesinger, Claudius; Guo, Jiabin; Hill, Erin; Roi, Annett Janusch; Kojima, Hajime; Li, Jin; Lim, Chae Hyung; Moura, Wlamir; Nishikawa, Akiyoshi; Park, HyeKyung; Peng, Shuangqing; Presgrave, Octavio; Singer, Tim; Sohn, Soo Jung; Westmoreland, Carl; Whelan, Maurice; Yang, Xingfen; Yang, Ying; Zuang, Valérie

The development and validation of scientific alternatives to animal testing is important not only from an ethical perspective (implementation of 3Rs), but also to improve safety assessment decision making with the use of mechanistic information of higher relevance to humans. To be effective in these efforts, it is however imperative that validation centres, industry, regulatory bodies, academia and other interested parties ensure a strong international cooperation, cross-sector collaboration and intense communication in the design, execution, and peer review of validation studies. Such an approach is critical to achieve harmonized and more transparent approaches to method validation, peer-review and recommendation, which will ultimately expedite the international acceptance of valid alternative methods or strategies by regulatory authorities and their implementation and use by stakeholders. It also allows achieving greater efficiency and effectiveness by avoiding duplication of effort and leveraging limited resources. In view of achieving these goals, the International Cooperation on Alternative Test Methods (ICATM) was established in 2009 by validation centres from Europe, USA, Canada and Japan. ICATM was later joined by Korea in 2011 and currently also counts with Brazil and China as observers. This chapter describes the existing differences across world regions and major efforts carried out for achieving consistent international cooperation and harmonization in the validation and adoption of alternative approaches to animal testing.

The stroke impairment assessment set: its internal consistency and predictive validity.

PubMed

Tsuji, T; Liu, M; Sonoda, S; Domen, K; Chino, N

2000-07-01

To study the scale quality and predictive validity of the Stroke Impairment Assessment Set (SIAS) developed for stroke outcome research. Rasch analysis of the SIAS; stepwise multiple regression analysis to predict discharge functional independence measure (FIM) raw scores from demographic data, the SIAS scores, and the admission FIM scores; cross-validation of the prediction rule. Tertiary rehabilitation center in Japan. One hundred ninety stroke inpatients for the study of the scale quality and the predictive validity; a second sample of 116 stroke inpatients for the cross-validation study. Mean square fit statistics to study the degree of fit to the unidimensional model; logits to express item difficulties; discharge FIM scores for the study of predictive validity. The degree of misfit was acceptable except for the shoulder range of motion (ROM), pain, visuospatial function, and speech items; and the SIAS items could be arranged on a common unidimensional scale. The difficulty patterns were identical at admission and at discharge except for the deep tendon reflexes, ROM, and pain items. They were also similar for the right- and left-sided brain lesion groups except for the speech and visuospatial items. For the prediction of the discharge FIM scores, the independent variables selected were age, the SIAS total scores, and the admission FIM scores; and the adjusted R2 was .64 (p < .0001). Stability of the predictive equation was confirmed in the cross-validation sample (R2 = .68, p < .001). The unidimensionality of the SIAS was confirmed, and the SIAS total scores proved useful for stroke outcome prediction.

Concurrent Validity of the International Family Quality of Life Survey.

PubMed

Samuel, Preethy S; Pociask, Fredrick D; DiZazzo-Miller, Rosanne; Carrellas, Ann; LeRoy, Barbara W

2016-01-01

The measurement of the social construct of Family Quality of Life (FQOL) is a parsimonious alternative to the current approach of measuring familial outcomes using a battery of tools related to individual-level outcomes. The purpose of this study was to examine the internal consistency and concurrent validity of the International FQOL Survey (FQOLS-2006), using cross-sectional data collected from 65 family caregivers of children with developmental disabilities. It shows a moderate correlation between the total FQOL scores of the FQOLS-2006 and the Beach Center's FQOL scale. The validity of five FQOLS-2006 domains was supported by the correlations between conceptually related domains.

Weight bias internalization across weight categories among school-aged children. Validation of the Weight Bias Internalization Scale for Children.

PubMed

Zuba, Anna; Warschburger, Petra

2018-06-01

Anti-fat bias is widespread and is linked to the internalization of weight bias and psychosocial problems. The purpose of this study was to examine the internalization of weight bias among children across weight categories and to evaluate the psychometric properties of the Weight Bias Internalization Scale for Children (WBIS-C). Data were collected from 1484 primary school children and their parents. WBIS-C demonstrated good internal consistency (α = .86) after exclusion of Item 1. The unitary factor structure was supported using exploratory and confirmatory factor analyses (factorial validity). Girls and overweight children reported higher WBIS-C scores in comparison to boys and non-overweight peers (known-groups validity). Convergent validity was shown by significant correlations with psychosocial problems. Internalization of weight bias explained additional variance in different indicators of psychosocial well-being. The results suggest that the WBIS-C is a psychometrically sound and informative tool to assess weight bias internalization among children. Copyright © 2018 Elsevier Ltd. All rights reserved.

Delimiting Coefficient a from Internal Consistency and Unidimensionality

ERIC Educational Resources Information Center

Sijtsma, Klaas

2015-01-01

I discuss the contribution by Davenport, Davison, Liou, & Love (2015) in which they relate reliability represented by coefficient a to formal definitions of internal consistency and unidimensionality, both proposed by Cronbach (1951). I argue that coefficient a is a lower bound to reliability and that concepts of internal consistency and…

[Estimators of internal consistency in health research: the use of the alpha coefficient].

PubMed

da Silva, Franciele Cascaes; Gonçalves, Elizandra; Arancibia, Beatriz Angélica Valdivia; Bento, Gisele Graziele; Castro, Thiago Luis da Silva; Hernandez, Salma Stephany Soleman; da Silva, Rudney

2015-01-01

Academic production has increased in the area of health, increasingly demanding high quality in publications of great impact. One of the ways to consider quality is through methods that increase the consistency of data analysis, such as reliability which, depending on the type of data, can be evaluated by different coefficients, especially the alpha coefficient. Based on this, the present review systematically gathers scientific articles produced in the last five years, which in a methodological manner gave the α coefficient psychometric use as an estimator of internal consistency and reliability in the processes of construction, adaptation and validation of instruments. The identification of the studies was conducted systematically in the databases BioMed Central Journals, Web of Science, Wiley Online Library, Medline, SciELO, Scopus, Journals@Ovid, BMJ and Springer, using inclusion and exclusion criteria. Data analyses were performed by means of triangulation, content analysis and descriptive analysis. It was found that most studies were conducted in Iran (f=3), Spain (f=2) and Brazil (f=2). These studies aimed to test the psychometric properties of instruments, with eight studies using the α coefficient to assess reliability and nine for assessing internal consistency. All studies were classified as methodological research when their objectives were analyzed. In addition, four studies were also classified as correlational and one as descriptive-correlational. It can be concluded that though the α coefficient is widely used as one of the main parameters for assessing internal consistency of questionnaires in health sciences, its use as an estimator of trust of the methodology used and internal consistency has some critiques that should be considered.

[Discomfort associated with dental extraction surgery and development of a questionnaire (QCirDental). Part I: Impacts and internal consistency].

PubMed

Bortoluzzi, Marcelo Carlos; Martins, Luciana Dorochenko; Takahashi, André; Ribeiro, Bianca; Martins, Ligiane; Pinto, Marcia Helena Baldani

2018-01-01

The scope of this study was to develop and validate a questionnaire (QCirDental) to measure the impacts associated with dental extraction surgery. The QCirDental questionnaire was developed in two steps; (1) question and item generation and selection, and (2) pretest of the questionnaire with evaluation of the its measurement properties (internal consistency and responsiveness). The sample was composed of 123 patients. None of the patients had any difficulty in understanding the QCirDental. The instrument was found to have excellent internal consistency with Cronbach's alpha reliability coefficient of 0.83. The principal component analysis (Kaiser-Meyer-Olkin Measure of Sampling Adequacy 0,72 and Bartlett's Test of Sphericity with p < 0.001) showed six (6) dimensions explaining 67.5% of the variance. The QCirDental presented excellent internal consistency, being a questionnaire that is easy to read and understand with adequate semantic and content validity. More than 80% of the patients who underwent dental extraction reported some degree of discomfort within the perioperative period which highlights the necessity to assess the quality of care and impacts of dental extraction surgery.

A review and evaluation of the internal structure and consistency of the Approaches to Teaching Inventory

NASA Astrophysics Data System (ADS)

Harshman, Jordan; Stains, Marilyne

2017-05-01

This study presents a review from 39 studies that provide evidence for the structural validity and internal consistency of the Approaches to Teaching Inventory (ATI). In addition to this review, we evaluate many alternative factor structures on a sample of 267 first- and second-year chemistry faculty members participating in a professional development, a sample of instructors for which the ATI was originally designed. A total of 26 unique factor structures were evaluated. Through robust checking of assumptions, compilations of existing evidence, and new exploratory and confirmatory analyses, we found that there is greater evidence for the structural validity and internal consistency for the 22-item ATI than the 16-item ATI. Additionally, evidence supporting the original two-factor and four-factor structures proposed by the ATI authors (focusing on information transmission and conceptual change) were not reproducible and while alternative models were empirically viable, more theoretical justification is warranted. Recommendations for ATI use and general comments regarding best practices of reporting psychometrics in educational research contexts are discussed.

Bem Sex Role Inventory Validation in the International Mobility in Aging Study.

PubMed

Ahmed, Tamer; Vafaei, Afshin; Belanger, Emmanuelle; Phillips, Susan P; Zunzunegui, Maria-Victoria

2016-09-01

This study investigated the measurement structure of the Bem Sex Role Inventory (BSRI) with different factor analysis methods. Most previous studies on validity applied exploratory factor analysis (EFA) to examine the BSRI. We aimed to assess the psychometric properties and construct validity of the 12-item short-form BSRI in a sample administered to 1,995 older adults from wave 1 of the International Mobility in Aging Study (IMIAS). We used Cronbach's alpha to assess internal consistency reliability and confirmatory factor analysis (CFA) to assess psychometric properties. EFA revealed a three-factor model, further confirmed by CFA and compared with the original two-factor structure model. Results revealed that a two-factor solution (instrumentality-expressiveness) has satisfactory construct validity and superior fit to data compared to the three-factor solution. The two-factor solution confirms expected gender differences in older adults. The 12-item BSRI provides a brief, psychometrically sound, and reliable instrument in international samples of older adults.

Internal Validity: A Must in Research Designs

ERIC Educational Resources Information Center

Cahit, Kaya

2015-01-01

In experimental research, internal validity refers to what extent researchers can conclude that changes in dependent variable (i.e. outcome) are caused by manipulations in independent variable. The causal inference permits researchers to meaningfully interpret research results. This article discusses (a) internal validity threats in social and…

Psychometric analyses and internal consistency of the PHEEM questionnaire to measure the clinical learning environment in the clerkship of a Medical School in Chile.

PubMed

Riquelme, Arnoldo; Herrera, Cristian; Aranis, Carolina; Oporto, Jorge; Padilla, Oslando

2009-06-01

The Spanish version of the Postgraduate Hospital Educational Environment Measure (PHEEM) was evaluated in this study to determine its psychometric properties, validity and internal consistency to measure the clinical learning environment in the hospital setting of Pontificia Universidad Católica de Chile Medical School's Internship. The 40-item PHEEM questionnaire was translated from English to Spanish and retranslated to English. Content validity was tested by a focus group and minor differences in meaning were adjusted. The PHEEM was administered to clerks in years 6 and 7. Construct validity was carried out using exploratory factor analysis followed by a Varimax rotation. Internal consistency was measured using Cronbach's alpha. A total of 125 out of 220 students responded to the PHEEM. The overall response rate was 56.8% and compliances with each item ranged from 99.2% to 100%. Analyses indicate that five factors instrument accounting for 58% of the variance and internal consistency of the 40-item questionnaire is 0.955 (Cronbach's alpha). The 40-item questionnaire had a mean score of 98.21 +/- 21.2 (maximum score of 160). The Spanish version of PHEEM is a multidimensional, valid and highly reliable instrument measuring the educational environment among undergraduate medical students working in hospital-based clerkships.

Brief International Cognitive Assessment for MS (BICAMS): international standards for validation.

PubMed

Benedict, Ralph H B; Amato, Maria Pia; Boringa, Jan; Brochet, Bruno; Foley, Fred; Fredrikson, Stan; Hamalainen, Paivi; Hartung, Hans; Krupp, Lauren; Penner, Iris; Reder, Anthony T; Langdon, Dawn

2012-07-16

An international expert consensus committee recently recommended a brief battery of tests for cognitive evaluation in multiple sclerosis. The Brief International Cognitive Assessment for MS (BICAMS) battery includes tests of mental processing speed and memory. Recognizing that resources for validation will vary internationally, the committee identified validation priorities, to facilitate international acceptance of BICAMS. Practical matters pertaining to implementation across different languages and countries were discussed. Five steps to achieve optimal psychometric validation were proposed. In Step 1, test stimuli should be standardized for the target culture or language under consideration. In Step 2, examiner instructions must be standardized and translated, including all information from manuals necessary for administration and interpretation. In Step 3, samples of at least 65 healthy persons should be studied for normalization, matched to patients on demographics such as age, gender and education. The objective of Step 4 is test-retest reliability, which can be investigated in a small sample of MS and/or healthy volunteers over 1-3 weeks. Finally, in Step 5, criterion validity should be established by comparing MS and healthy controls. At this time, preliminary studies are underway in a number of countries as we move forward with this international assessment tool for cognition in MS.

The internal consistency of the North Sea carbonate system

NASA Astrophysics Data System (ADS)

Salt, Lesley A.; Thomas, Helmuth; Bozec, Yann; Borges, Alberto V.; de Baar, Hein J. W.

2016-05-01

In 2002 (February) and 2005 (August), the full suite of carbonate system parameters (total alkalinity (AT), dissolved inorganic carbon (DIC), pH, and partial pressure of CO2 (pCO2) were measured on two re-occupations of the entire North Sea basin, with three parameters (AT, DIC, pCO2) measured on four additional re-occupations, covering all four seasons, allowing an assessment of the internal consistency of the carbonate system. For most of the year, there is a similar level of internal consistency, with AT being calculated to within ± 6 μmol kg- 1 using DIC and pH, DIC to ± 6 μmol kg- 1 using AT and pH, pH to ± 0.008 using AT and pCO2, and pCO2 to ± 8 μatm using DIC and pH, with the dissociation constants of Millero et al. (2006). In spring, however, we observe a significant decline in the ability to accurately calculate the carbonate system. Lower consistency is observed with an increasing fraction of Baltic Sea water, caused by the high contribution of organic alkalinity in this water mass, not accounted for in the carbonate system calculations. Attempts to improve the internal consistency by accounting for the unconventional salinity-borate relationships in freshwater and the Baltic Sea, and through application of the new North Atlantic salinity-boron relationship (Lee et al., 2010), resulted in no significant difference in the internal consistency.

Impact of Alzheimer's Disease on Caregiver Questionnaire: internal consistency, convergent validity, and test-retest reliability of a new measure for assessing caregiver burden.

PubMed

Cole, Jason C; Ito, Diane; Chen, Yaozhu J; Cheng, Rebecca; Bolognese, Jennifer; Li-McLeod, Josephine

2014-09-04

unidimensional, Web-based measure of AD caregiver burden and is supported by strong model fit statistics from CFA, high degree of item-level reliability, good internal consistency, moderate test-retest reliability, and moderate convergent validity. Additional validation of the IADCQ is warranted to ensure invariance between the paper-based and Web-based administration and to determine an appropriate responder definition.

Analysis of the Internal Consistency of Three Autism Scales. Brief Report.

ERIC Educational Resources Information Center

Sturmey, Peter; And Others

1992-01-01

Analyses of the internal consistency of three autism scales--the Autism Behavior Checklist (ABC), the Real Life Rating Scale (RLRS), and the Childhood Autism Rating Scale (CARS)--were conducted with 34 children with pervasive developmental disabilities. Good internal consistency was found for the CARS. Adequate full-scale consistency was found for…

Internal Factor Structure and Convergent Validity Evidence: The Self-Report Version of Self-Regulation Strategy Inventory

ERIC Educational Resources Information Center

Cleary, Timothy J.; Dembitzer, Leah; Kettler, Ryan J.

2015-01-01

Using a sample of 348 middle school students, we gathered evidence regarding the internal consistency of scores, as well as the internal factor structure and convergent validity evidence for inferences from a self-report questionnaire called the Self-Regulation Strategy Inventory-Self Report. Confirmatory factor analysis revealed that the fit…

Five-Item Francis Scale of Attitude toward Christianity: Construct and Nomological Validity and Internal Consistency among Colombian College Students

ERIC Educational Resources Information Center

Ceballos, Guillermo A.; Suescun, Jesus D.; Oviedo, Heidi C.; Herazo, Edwin; Campo-Arias, Adalberto

2015-01-01

The Spanish version of the five-item Francis scale of attitude toward Christianity is a refinement of the short version of the Francis scale of attitude toward Christianity. The scale is a good measurement for intrinsic religiosity. It has been applied previously among Colombian adolescent students. The internal consistency and construct and…

The internal and external validity of the Major Depression Inventory in measuring severity of depressive states.

PubMed

Olsen, L R; Jensen, D V; Noerholm, V; Martiny, K; Bech, P

2003-02-01

We have developed the Major Depression Inventory (MDI), consisting of 10 items, covering the DSM-IV as well as the ICD-10 symptoms of depressive illness. We aimed to evaluate this as a scale measuring severity of depressive states with reference to both internal and external validity. Patients representing the score range from no depression to marked depression on the Hamilton Depression Scale (HAM-D) completed the MDI. Both classical and modern psychometric methods were applied for the evaluation of validity, including the Rasch analysis. In total, 91 patients were included. The results showed that the MDI had an adequate internal validity in being a unidimensional scale (the total score an appropriate or sufficient statistic). The external validity of the MDI was also confirmed as the total score of the MDI correlated significantly with the HAM-D (Pearson's coefficient 0.86, P < or = 0.01, Spearman 0.80, P < or = 0.01). When used in a sample of patients with different states of depression the MDI has an adequate internal and external validity.

Internalized HIV Stigma and Disclosure Concerns: Development and Validation of Two Scales in Spanish-Speaking Populations.

PubMed

Hernansaiz-Garrido, Helena; Alonso-Tapia, Jesús

2017-01-01

Internalized stigma and disclosure concerns are key elements for the study of mental health in people living with HIV. Since no measures of these constructs were available for Spanish population, this study sought to develop such instruments, to analyze their reliability and validity and to provide a short version. A heterogeneous sample of 458 adults from different Spanish-speaking countries completed the HIV-Internalized Stigma Scale and the HIV-Disclosure Concerns Scale, along with the Hospital Anxiety and Depression Scale, Rosenberg's Self-esteem Scale and other socio-demographic variables. Reliability and correlation analyses, exploratory factor analyses, path analyses with latent variables, and ANOVAs were conducted to test the scales' psychometric properties. The scales showed good reliability in terms of internal consistency and temporal stability, as well as good sensitivity and factorial and criterion validity. The HIV-Internalized Stigma Scale and the HIV-Disclosure Concerns Scale are reliable and valid means to assess these variables in several contexts.

The Internalized Stigma of Mental Illness (ISMI) scale: validation of the Japanese version.

PubMed

Tanabe, Yosuke; Hayashi, Kunihiko; Ideno, Yuki

2016-04-29

The present study investigated the reliability and validity of a Japanese version of the Internalized Stigma of Mental Illness (ISMI) scale, designed to assess internalized stigma experienced by people with mental illness. A survey was conducted with 173 outpatients with mental illness who attended psychiatric clinics on a regular basis. A retest was conducted with 51 participants to evaluate the scale's psychometric properties. The alpha coefficient for the overall internal consistency was 0.91, and the coefficients of the individual ISMI subscales ranged from 0.57 to 0.81. The test-retest reliability was r = 0.85 (n = 51, P < 0.01). In terms of criterion-related validity, the Japanese version of the ISMI scale was significantly correlated with the Beck Depression Inventory (r = 0.61, P < 0.01), the Rosenberg Self-Esteem Scale (r = -0.53, P < 0.01), and the Empowerment Scale (r = -0.52, P < 0.01). In addition, factor analyses of the ISMI items demonstrated a four-factor solution for the alienation, stereotype endorsement, discrimination experience, and social withdrawal subscales, with the stigma resistance items excluded. The Japanese version of the ISMI scale demonstrated similar reliability and validity to the original English version. Therefore, the Japanese version of the ISMI scale may be an effective and valid tool to measure internalized stigma among Japanese people who have a mental illness.

The international Hip Outcome Tool-33 (iHOT-33): multicenter validation and translation to Spanish.

PubMed

Ruiz-Ibán, Miguel Angel; Seijas, Roberto; Sallent, Andrea; Ares, Oscar; Marín-Peña, Oliver; Muriel, Alfonso; Cuéllar, Ricardo

2015-05-20

The international Hip Outcome Tool-33 (iHOT-33) is a 33-item self administered outcome measure based on a Visual Analogue Scale response format designed for young and active population with hip pathology. The aim of the present study is to translate and validate the iHOT-33 into Spanish. 97 patients undergoing hip arthroscopy were included in this prospective and multicenter study performed between January 2012 and May 2014. Crosscultural adaptation was used to translate iHOT-33 into Spanish. Patients completed the questionnaire before and after surgery. Feasibility, reliability, internal consistency, construct validity (correlation with Western Ontario and McMaster Universities Osteoarthritis Index), ceiling and floor effects and sensitivity to change were assessed for the present study. Mean age was 48 years old. Feasibility: 41.2 % patients had no blank questions, and 71.3 % of patients had fulfilled all but one or two questions. Reliability: ICC for the global questionnaire was 0.97, showing that the questionnaire is highly reproducible. Internal consistency: Cronbach's alpha was 0.98 for the global questionnaire. Construct validity: there was a high correlation with WOMAC (correlation coefficient >0.5). The Ceiling effect (taking into account the minimum detectable change) was 12.1 % and the floor effect was 21.6 %, for the global questionnaire. Large sensitivity to change was shown. the Spanish version of iHOT-33 has shown to be feasible, reliable and sensible to changes for patients undergoing hip arthroscopy. This validated translation of iHOT-33 allows for comparisons between studies involving either Spanish- or English-speaking patients. Prognostic study, Level I.

[Reliability and validity of the Turkish version of the internalized stigma of mental illness scale].

PubMed

Ersoy, Mehmet Akif; Varan, Azmi

2007-01-01

The aim of this study was to evaluate the reliability and validity of the Turkish version of the Internalized Stigma of Mental Illness Scale (ISMI) in patients with psychiatric disorders. The study included 203 patients diagnosed with various psychiatric disorders in a psychiatry outpatient clinic of a university hospital. The reliability of the scale was assessed by investigation of its internal consistency and split-half reliability. The convergent validity of the scale was demonstrated by the relationship between the Turkish form of the ISMI and various criteria scales. Cronbach's alpha value was 0.93 for the entire scale and ranged between 0.63 and 0.87 for the 5 subscales of the ISMI. In terms of convergent validity, the total score of the Turkish ISMI significantly correlated with the Beck Depression Inventory, Rosenberg Self-Esteem Scale, Sociotropy-Autonomy Scale, Brief Symptom Inventory, Multidimensional Scale of Perceived Social Support, Clinical Global Impression Scale, and Global Assessment of Functioning Scale scores. All values were in the expected direction. In the light of the findings, it was concluded that the Turkish version of ISMI could be used as a reliable and valid tool in assessing internalized stigma of the Turkish psychiatric patients.

Reliability, factor analysis and internal consistency calculation of the Insomnia Severity Index (ISI) in French and in English among Lebanese adolescents.

PubMed

Chahoud, M; Chahine, R; Salameh, P; Sauleau, E A

2017-06-01

Our goal is to validate and to verify the reliability of the French and English versions of the Insomnia Severity Index (ISI) in Lebanese adolescents. A cross-sectional study was implemented. 104 Lebanese students aged between 14 and 19 years participated in the study. The English version of the questionnaire was distributed to English-speaking students and the French version was administered to French-speaking students. A scale (1 to 7 with 1 = very well understood and 7 = not at all) was used to identify the level of the students' understanding of each instruction, question and answer of the ISI. The scale's structural validity was assessed. The factor structure of ISI was evaluated by principal component analysis. The internal consistency of this scale was evaluated by Cronbach's alpha. To assess test-retest reliability the intraclass correlation coefficient (ICC) was used. The principal component analysis confirmed the presence of a two-component factor structure in the English version and a three-component factor structure in the French version with eigenvalues > 1. The English version of the ISI had an excellent internal consistency (α = 0.90), while the French version had a good internal consistency (α = 0.70). The ICC presented an excellent agreement in the French version (ICC = 0.914, CI = 0.856-0.949) and a good agreement in the English one (ICC = 0.762, CI = 0.481-890). The Bland-Altman plots of the two versions of the ISI showed that the responses over two weeks' were comparable and very few outliers were detected. The results of our analyses reveal that both English and French versions of the ISI scale have good internal consistency and are reproducible and reliable. Therefore, it can be used to assess the prevalence of insomnia in Lebanese adolescents.

Validation of the Malayalam version of the Internalized Stigma of Mental Illness (ISMI) scale.

PubMed

James, Tintu; Kutty, V Raman; Boyd, Jennifer; Brzoska, Patrick

2016-04-01

Little is known about internalized stigma of mental illness in India. A reason for this could be the lack of valid assessment instruments adapted for the diverse cultures and languages of the country. One of the most widely used and accepted questionnaires to assess internalized stigma is the 29-item Internalized Stigma of Mental Illness (ISMI) scale. The aim of the present study was to translate and adapt the ISMI to the Malayalam-speaking population of Kerala, India and to assess its content and factorial validity. The content validity of the Malayalam-language ISMI was studied through interviews with 7 experts on stigma in India. Factorial validity was examined by means of a confirmatory factor analysis (CFA) based on a cross-sectional survey among 290 patients with mental illness attending follow-up outpatient and primary care clinics in Kerala, India. The expert panel concluded that the items of the translated questionnaire adequately represent internalized stigma in the Malayalam-speaking population of Kerala. The theorized factor structure of the ISMI consisting of five factors showed a suboptimal model fit (WRMR=0.940; TLI=0.971, CFI=0.948; RMSEA=0.059) which improved considerably after removal of the stigma resistance factor and three items with poor factor loadings (WRMR=0.819; TLI=0.982, CFI=0.966; RMSEA=0.051). Although our study identifies some sources of model ill-fit, it shows that a reduced version of the Malayalam-language ISMI can be a valuable tool for the study of internalized stigma in this cultural setting. Copyright © 2016 Elsevier B.V. All rights reserved.

[External and internal validity of a multidimensional Locus of control scale of eating attitudes for athletes (LOCSCAS)].

PubMed

Paquet, Y; Scoffier, S; d'Arripe-Longueville, F

2016-10-01

In the field of health psychology, the control has consistently been considered as a protective factor. This protective role has been also highlighted in eating attitudes' domain. However, current studies use the one-dimensional scale of Rotter or the multidimensional health locus of control scale, and no specific eating attitudes' scale in the sport context exists. Moreover, the social influence in previous scales is limited. According to recent works, the purpose of this study was to test the internal and external validity of a multidimensional locus of control scale of eating attitudes for athletes. One hundred and seventy-nine participants were solicited. A confirmatory factorial analysis was conducted in order to test the internal validity of the scale. The scale external validity was tested in relation to eating attitudes. The internal validity of the scale was verified as well as the external validity, which confirmed the importance of taking into consideration social influences. Indeed, the 2 subscales "Trainers, friends" and "Parents, family" are related respectively positively and negatively in eating disorders. Copyright © 2016 L'Encéphale, Paris. Published by Elsevier Masson SAS. All rights reserved.

Validation of a new international quality-of-life instrument specific to cosmetics and physical appearance: BeautyQoL questionnaire.

PubMed

Beresniak, Ariel; de Linares, Yolaine; Krueger, Gerald G; Talarico, Sergio; Tsutani, Kiichiro; Duru, Gérard; Berger, Geneviève

2012-11-01

To develop a new quality-of-life (QoL) instrument with international validity that specifically assesses cosmetic products and physical appearance. In the first phase, semidirected interviews involved 309 subjects. In the second stage, an acceptability study was performed on 874 subjects. Thereafter, we recruited a total of 3231 subjects, each of whom completed the BeautyQoL questionnaire, a clinical checklist for the skin, the generic QoL 36-Item Short Form Health Survey, and a sociodemographic questionnaire. A retest was performed 8 days later on a subgroup of 652 subjects. Populations in France, the United Kingdom, Germany, Spain, Sweden, Italy, Russia, the United States, Brazil, Japan, India, China, and South Africa, representing 16 languages. The general adult healthy population, including women and men. Psychometric properties, construct validity, reproducibility, and internal and external consistency. General acceptability was very good in the 16 languages, with a very low rate of no answers. The validation phase reduced the questionnaire to 42 questions structured in the following 5 dimensions that explained 76.7% of the total variance: social life, self-confidence, mood, energy, and attractiveness. Internal consistency was high (Cronbach α coefficients, 0.93-0.98). Reproducibility at 8 days was satisfactory in all dimensions. Results of external validity testing revealed that BeautyQoL scores correlated significantly with all 36-Item Short Form Health Survey scores except for physical function. These results demonstrate the validity and reliability of the BeautyQoL questionnaire as the very first international instrument specific to cosmetic products and physical appearance.

Consistency, Verification, and Validation of Turbulence Models for Reynolds-Averaged Navier-Stokes Applications

NASA Technical Reports Server (NTRS)

Rumsey, Christopher L.

2009-01-01

In current practice, it is often difficult to draw firm conclusions about turbulence model accuracy when performing multi-code CFD studies ostensibly using the same model because of inconsistencies in model formulation or implementation in different codes. This paper describes an effort to improve the consistency, verification, and validation of turbulence models within the aerospace community through a website database of verification and validation cases. Some of the variants of two widely-used turbulence models are described, and two independent computer codes (one structured and one unstructured) are used in conjunction with two specific versions of these models to demonstrate consistency with grid refinement for several representative problems. Naming conventions, implementation consistency, and thorough grid resolution studies are key factors necessary for success.

Patients' perception of postoperative pain management: validation of the International Pain Outcomes (IPO) questionnaire.

PubMed

Rothaug, Judith; Zaslansky, Ruth; Schwenkglenks, Matthias; Komann, Marcus; Allvin, Renée; Backström, Ragnar; Brill, Silviu; Buchholz, Ingo; Engel, Christoph; Fletcher, Dominique; Fodor, Lucian; Funk, Peter; Gerbershagen, Hans J; Gordon, Debra B; Konrad, Christoph; Kopf, Andreas; Leykin, Yigal; Pogatzki-Zahn, Esther; Puig, Margarita; Rawal, Narinder; Taylor, Rod S; Ullrich, Kristin; Volk, Thomas; Yahiaoui-Doktor, Maryam; Meissner, Winfried

2013-11-01

PAIN OUT is a European Commission-funded project aiming at improving postoperative pain management. It combines a registry that can be useful for quality improvement and research using treatment and patient-reported outcome measures. The core of the project is a patient questionnaire-the International Pain Outcomes questionnaire-that comprises key patient-level outcomes of postoperative pain management, including pain intensity, physical and emotional functional interference, side effects, and perceptions of care. Its psychometric quality after translation and adaptation to European patients is the subject of this validation study. The questionnaire was administered to 9,727 patients in 10 languages in 8 European countries and Israel. Construct validity was assessed using factor analysis. Discriminant validity assessment used Mann-Whitney U tests to detect mean group differences between 2 surgical disciplines. Internal consistency reliability was calculated as Cronbach's alpha. Factor analysis resulted in a 3-factor structure explaining 53.6% of variance. Cronbach's alpha at overall scale level was high (.86), and for the 3 subscales was low, moderate, or high (range, .53-.89). Significant mean group differences between general and orthopedic surgery patients confirmed discriminant validity. The psychometric quality of the International Pain Outcomes questionnaire can be regarded as satisfactory. The International Pain Outcomes questionnaire provides an instrument for postoperative pain assessment and improvement of quality of care, which demonstrated good psychometric quality when translated into a variety of languages in a large European and Israeli patient population. This measure provides the basis for the first comprehensive postoperative pain registry in Europe and other countries. Copyright © 2013. Published by Elsevier Inc.

Estimates of the Internal Consistency of a Factorially Complex Composite.

ERIC Educational Resources Information Center

Benito, Juana Gomez

1989-01-01

This study of 852 subjects in Barcelona (Spain) between 4 and 9 years old estimated the degree of consistency among elements of the Borelli-Oleron Performance Scale by taking into account item clusters and subtest clusters. The internal consistency of the subtests rose when all ages were analyzed jointly. (SLD)

Psychometrics and the neuroscience of individual differences: Internal consistency limits between-subjects effects.

PubMed

Hajcak, Greg; Meyer, Alexandria; Kotov, Roman

2017-08-01

In the clinical neuroscience literature, between-subjects differences in neural activity are presumed to reflect reliable measures-even though the psychometric properties of neural measures are almost never reported. The current article focuses on the critical importance of assessing and reporting internal consistency reliability-the homogeneity of "items" that comprise a neural "score." We demonstrate how variability in the internal consistency of neural measures limits between-subjects (i.e., individual differences) effects. To this end, we utilize error-related brain activity (i.e., the error-related negativity or ERN) in both healthy and generalized anxiety disorder (GAD) participants to demonstrate options for psychometric analyses of neural measures; we examine between-groups differences in internal consistency, between-groups effect sizes, and between-groups discriminability (i.e., ROC analyses)-all as a function of increasing items (i.e., number of trials). Overall, internal consistency should be used to inform experimental design and the choice of neural measures in individual differences research. The internal consistency of neural measures is necessary for interpreting results and guiding progress in clinical neuroscience-and should be routinely reported in all individual differences studies. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

HLA class I molecules consistently present internal influenza epitopes.

PubMed

Wahl, Angela; Schafer, Fredda; Bardet, Wilfried; Buchli, Rico; Air, Gillian M; Hildebrand, William H

2009-01-13

Cytotoxic T lymphocytes (CTL) limit influenza virus replication and prevent morbidity and mortality upon recognition of HLA class I presented epitopes on the surface of virus infected cells, yet the number and origin of the viral epitopes that decorate the infected cell are unknown. To understand the presentation of influenza virus ligands by human MHC class I molecules, HLA-B*0702-presented viral peptides were directly identified following influenza infection. After transfection with soluble class I molecules, peptide ligands unique to infected cells were eluted from isolated MHC molecules and identified by comparative mass spectrometry (MS). Then CTL were gathered following infection with influenza and viral peptides were tested for immune recognition. We found that the class I molecule B*0702 presents 3-6 viral ligands following infection with different strains of influenza. Peptide ligands derived from the internal viral nucleoprotein (NP(418-426) and NP(473-481)) and from the internal viral polymerase subunit PB1 (PB1(329-337)) were presented by B*0702 following infection with each of 3 different influenza strains; ligands NP(418-426), NP(473-481), and PB1(329-337) derived from internal viral proteins were consistently revealed by class I HLA. In contrast, ligands derived from hemagglutinin (HA) and matrix protein (M1) were presented intermittently on a strain-by-strain basis. When tested for immune recognition, HLA-B*0702 transgenic mice responded to NP(418-426) and PB1(329-337) consistently and NP(473-481) intermittently while ligands from HA and M1 were not recognized. These data demonstrate an emerging pattern whereby class I HLA reveal a handful of internal viral ligands and whereby CTL recognize consistently presented influenza ligands.

HLA class I molecules consistently present internal influenza epitopes

PubMed Central

Wahl, Angela; Schafer, Fredda; Bardet, Wilfried; Buchli, Rico; Air, Gillian M.; Hildebrand, William H.

2009-01-01

Cytotoxic T lymphocytes (CTL) limit influenza virus replication and prevent morbidity and mortality upon recognition of HLA class I presented epitopes on the surface of virus infected cells, yet the number and origin of the viral epitopes that decorate the infected cell are unknown. To understand the presentation of influenza virus ligands by human MHC class I molecules, HLA-B*0702-presented viral peptides were directly identified following influenza infection. After transfection with soluble class I molecules, peptide ligands unique to infected cells were eluted from isolated MHC molecules and identified by comparative mass spectrometry (MS). Then CTL were gathered following infection with influenza and viral peptides were tested for immune recognition. We found that the class I molecule B*0702 presents 3–6 viral ligands following infection with different strains of influenza. Peptide ligands derived from the internal viral nucleoprotein (NP418–426 and NP473–481) and from the internal viral polymerase subunit PB1 (PB1329–337) were presented by B*0702 following infection with each of 3 different influenza strains; ligands NP418–426, NP473–481, and PB1329–337 derived from internal viral proteins were consistently revealed by class I HLA. In contrast, ligands derived from hemagglutinin (HA) and matrix protein (M1) were presented intermittently on a strain-by-strain basis. When tested for immune recognition, HLA-B*0702 transgenic mice responded to NP418–426 and PB1329–337 consistently and NP473–481 intermittently while ligands from HA and M1 were not recognized. These data demonstrate an emerging pattern whereby class I HLA reveal a handful of internal viral ligands and whereby CTL recognize consistently presented influenza ligands. PMID:19122146

Validity test and its consistency in the construction of patient loyalty model

NASA Astrophysics Data System (ADS)

Yanuar, Ferra

2016-04-01

The main objective of this present study is to demonstrate the estimation of validity values and its consistency based on structural equation model. The method of estimation was then implemented to an empirical data in case of the construction the patient loyalty model. In the hypothesis model, service quality, patient satisfaction and patient loyalty were determined simultaneously, each factor were measured by any indicator variables. The respondents involved in this study were the patients who ever got healthcare at Puskesmas in Padang, West Sumatera. All 394 respondents who had complete information were included in the analysis. This study found that each construct; service quality, patient satisfaction and patient loyalty were valid. It means that all hypothesized indicator variables were significant to measure their corresponding latent variable. Service quality is the most measured by tangible, patient satisfaction is the most mesured by satisfied on service and patient loyalty is the most measured by good service quality. Meanwhile in structural equation, this study found that patient loyalty was affected by patient satisfaction positively and directly. Service quality affected patient loyalty indirectly with patient satisfaction as mediator variable between both latent variables. Both structural equations were also valid. This study also proved that validity values which obtained here were also consistence based on simulation study using bootstrap approach.

Functional Status Score for the Intensive Care Unit (FSS-ICU): An International Clinimetric Analysis of Validity, Responsiveness, and Minimal Important Difference

PubMed Central

Huang, Minxuan; Chan, Kitty S.; Zanni, Jennifer M.; Parry, Selina M.; Neto, Saint-Clair G. B.; Neto, Jose A. A.; da Silva, Vinicius Z. M.; Kho, Michelle E.; Needham, Dale M.

2017-01-01

Objective To evaluate the internal consistency, validity, responsiveness, and minimal important difference of the Functional Status Score for the Intensive Care Unit (FSS-ICU), a physical function measure designed for the intensive care unit (ICU). Design Clinimetric analysis. Settings Five international data sets from the United States, Australia, and Brazil. Patients 819 ICU patients. Intervention None. Measurements and Main Results Clinimetric analyses were initially conducted separately for each data source and time point to examine generalizability of findings, with pooled analyses performed thereafter to increase power of analyses. The FSS-ICU demonstrated good to excellent internal consistency. There was good convergent and discriminant validity, with significant and positive correlations (r = 0.30 to 0.95) between FSS-ICU and other physical function measures, and generally weaker correlations with non-physical measures (|r| = 0.01 to 0.70). Known group validity was demonstrated by significantly higher FSS-ICU scores among patients without ICU-acquired weakness (Medical Research Council sumscore ≥48 versus <48) and with hospital discharge to home (versus healthcare facility). FSS-ICU at ICU discharge predicted post-ICU hospital length of stay and discharge location. Responsiveness was supported via increased FSS-ICU scores with improvements in muscle strength. Distribution-based methods indicated a minimal important difference of 2.0 to 5.0. Conclusions The FSS-ICU has good internal consistency and is a valid and responsive measure of physical function for ICU patients. The estimated minimal important difference can be used in sample size calculations and in interpreting studies comparing the physical function of groups of ICU patients. PMID:27488220

The Clinical Impression of Severity Index for Parkinson's Disease: international validation study.

PubMed

Martínez-Martín, Pablo; Rodríguez-Blázquez, Carmen; Forjaz, Maria João; de Pedro, Jesús

2009-01-30

This study sought to provide further information about the psychometric properties of the Clinical Impression of Severity Index for Parkinson's Disease (CISI-PD), in a large, international, cross-culturally diverse sample. Six hundred and fourteen patients with PD participated in the study. Apart from the CISI-PD, assessments were based on Hoehn & Yahr (HY) staging, the Scales for Outcomes in PD-Motor (SCOPA-M), -Cognition (SCOPA-COG) and -Psychosocial (SCOPA-PS), the Cumulative Illness Rating Scale-Geriatrics, and the Hospital Anxiety and Depression Scale. The total CISI-PD score displayed no floor or ceiling effects. Internal consistency was 0.81, the test-retest intraclass correlation coefficient was 0.84, and item homogeneity was 0.52. Exploratory and confirmatory factor analysis (CFI = 0.99, RMSEA = 0.07) confirmed CISI-PD's unifactorial structure. The CISI-PD showed adequate convergent validity with SCOPA-COG and SCOPA-M (r(S) = 0.46-0.85, respectively) and discriminative validity for HY stages and disease duration (P < 0.0001). In a multiple regression model, main CISI-PD predictors were SCOPA-M, disease duration, and depression. The results obtained were not only comparable to but also extended those yielded by the preliminary validation study, thus showing that the CISI-PD is a valid instrument to measure clinical impression of severity in PD. Its simplicity and easy application make it an attractive and useful tool for clinical practice and research.

Internal vibrations of a molecule consisting of rigid segments. I - Non-interacting internal vibrations

NASA Technical Reports Server (NTRS)

He, X. M.; Craven, B. M.

1993-01-01

For molecular crystals, a procedure is proposed for interpreting experimentally determined atomic mean square anisotropic displacement parameters (ADPs) in terms of the overall molecular vibration together with internal vibrations with the assumption that the molecule consists of a set of linked rigid segments. The internal librations (molecular torsional or bending modes) are described using the variable internal coordinates of the segmented body. With this procedure, the experimental ADPs obtained from crystal structure determinations involving six small molecules (sym-trinitrobenzene, adenosine, tetra-cyanoquinodimethane, benzamide, alpha-cyanoacetic acid hydrazide and N-acetyl-L-tryptophan methylamide) have been analyzed. As a consequence, vibrational corrections to the bond lengths and angles of the molecule are calculated as well as the frequencies and force constants for each internal torsional or bending vibration.

Delphi Method Validation of a Procedural Performance Checklist for Insertion of an Ultrasound-Guided Internal Jugular Central Line.

PubMed

Hartman, Nicholas; Wittler, Mary; Askew, Kim; Manthey, David

2016-01-01

Placement of ultrasound-guided central lines is a critical skill for physicians in several specialties. Improving the quality of care delivered surrounding this procedure demands rigorous measurement of competency, and validated tools to assess performance are essential. Using the iterative, modified Delphi technique and experts in multiple disciplines across the United States, the study team created a 30-item checklist designed to assess competency in the placement of ultrasound-guided internal jugular central lines. Cronbach α was .94, indicating an excellent degree of internal consistency. Further validation of this checklist will require its implementation in simulated and clinical environments. © The Author(s) 2014.

Development of the Hand Assessment for Infants: evidence of internal scale validity.

PubMed

Krumlinde-Sundholm, Lena; Ek, Linda; Sicola, Elisa; Sjöstrand, Lena; Guzzetta, Andrea; Sgandurra, Giuseppina; Cioni, Giovanni; Eliasson, Ann-Christin

2017-12-01

The aim of this study was to develop a descriptive and evaluative assessment of upper limb function for infants aged 3 to 12 months and to investigate its internal scale validity for use with infants at risk of unilateral cerebral palsy. The concepts of the test items and scoring criteria were developed. Internal scale validity and aspects of reliability were investigated on the basis of 156 assessments of infants at 3 to 12 months corrected age (mean 7.2mo, SD 2.5) with signs of asymmetric hand use. Rasch measurement model analysis and non-parametric statistics were used. The new test, the Hand Assessment for Infants (HAI), consists of 12 unimanual and five bimanual items, each scored on a 3-point rating scale. It demonstrated a unidimensional construct and good fit to the Rasch model requirements. The excellent person reliability enabled person separation to six significant ability strata. The HAI produced an interval-level measure of bilateral hand use as well as unimanual scores of each hand, allowing a quantification of possible asymmetry expressed as an asymmetry index. The HAI can be considered a valid assessment tool for measuring bilateral hand use and quantifying side difference between hands among infants at risk of developing unilateral cerebral palsy. The Hand Assessment for Infants (HAI) measures the use of both hands and quantifies a possible asymmetry of hand use. HAI is valid for infants at 3 to 12 months corrected age at risk of unilateral cerebral palsy. © 2017 Mac Keith Press.

External Validity, Internal Validity, and Organizational Reality: A Response to Robert L. Cardy (Commentary).

ERIC Educational Resources Information Center

Steinfatt, Thomas M.

1991-01-01

Responds to an article in the same issue of this journal which defends the applied value of laboratory studies to managers. Agrees that external validity is often irrelevant, and maintains that the problem of making inferences from any subject sample in management communication is one that demands internal, not external, validity. (SR)

Assessing the internal consistency of the event-related potential: An example analysis.

PubMed

Thigpen, Nina N; Kappenman, Emily S; Keil, Andreas

2017-01-01

ERPs are widely and increasingly used to address questions in psychophysiological research. As discussed in this special issue, a renewed focus on questions of reliability and stability marks the need for intuitive, quantitative descriptors that allow researchers to communicate the robustness of ERP measures used in a given study. This report argues that well-established indices of internal consistency and effect size meet this need and can be easily extracted from most ERP datasets, as demonstrated with example analyses using a representative dataset from a feature-based visual selective attention task. We demonstrate how to measure the internal consistency of three aspects commonly considered in ERP studies: voltage measurements for specific time ranges at selected sensors, voltage dynamics across all time points of the ERP waveform, and the distribution of voltages across the scalp. We illustrate methods for quantifying the robustness of experimental condition differences, by calculating effect size for different indices derived from the ERP. The number of trials contributing to the ERP waveform was manipulated to examine the relationship between signal-to-noise ratio (SNR), internal consistency, and effect size. In the present example dataset, satisfactory consistency (Cronbach's alpha > 0.7) of individual voltage measurements was reached at lower trial counts than were required to reach satisfactory effect sizes for differences between experimental conditions. Comparing different metrics of robustness, we conclude that the internal consistency and effect size of ERP findings greatly depend on the quantification strategy, the comparisons and analyses performed, and the SNR. © 2016 Society for Psychophysiological Research.

Assessing the internal consistency of the event-related potential: An example analysis

PubMed Central

Thigpen, Nina; Kappenman, Emily; Keil, Andreas

2017-01-01

Event-related potentials (ERPs) are widely and increasingly used to address questions in Psychophysiological research. As discussed in this special issue, a renewed focus on questions of reliability and stability marks the need for intuitive, quantitative descriptors that allow researchers to communicate the robustness of ERP measures used in a given study. This report argues that well-established indices of internal consistency and effect size meet this need and can be easily extracted from most ERP data sets, as demonstrated with example analyses using a representative data set from a feature-based visual selective attention task. We demonstrate how to measure the internal consistency of three aspects commonly considered in ERP studies: Voltage measurements for specific time ranges at selected sensors, voltage dynamics across all time points of the ERP waveform, and the distribution of voltages across the scalp. We illustrate methods for quantifying the robustness of experimental condition differences, by calculating effect size for different indices derived from the ERP. The number of trials contributing to the ERP waveform was manipulated to examine the relationship between signal-to-noise ratio, internal consistency, and effect size. In the present example data set, satisfactory consistency (Cronbach’s alpha > 0.7) of individual voltage measurements was reached at lower trial counts than were required to reach satisfactory effect sizes for differences between experimental conditions. Comparing different metrics of robustness, we conclude that the SNR, internal consistency, and effect size of ERP findings greatly depend on the quantification strategy, the comparisons and analyses performed, and the signal-to-noise ratio. PMID:28000264

Internal Cluster Validation on Earthquake Data in the Province of Bengkulu

NASA Astrophysics Data System (ADS)

Rini, D. S.; Novianti, P.; Fransiska, H.

2018-04-01

K-means method is an algorithm for cluster n object based on attribute to k partition, where k < n. There is a deficiency of algorithms that is before the algorithm is executed, k points are initialized randomly so that the resulting data clustering can be different. If the random value for initialization is not good, the clustering becomes less optimum. Cluster validation is a technique to determine the optimum cluster without knowing prior information from data. There are two types of cluster validation, which are internal cluster validation and external cluster validation. This study aims to examine and apply some internal cluster validation, including the Calinski-Harabasz (CH) Index, Sillhouette (S) Index, Davies-Bouldin (DB) Index, Dunn Index (D), and S-Dbw Index on earthquake data in the Bengkulu Province. The calculation result of optimum cluster based on internal cluster validation is CH index, S index, and S-Dbw index yield k = 2, DB Index with k = 6 and Index D with k = 15. Optimum cluster (k = 6) based on DB Index gives good results for clustering earthquake in the Bengkulu Province.

A Design to Improve Internal Validity of Assessments of Teaching Demonstrations

ERIC Educational Resources Information Center

Bartsch, Robert A.; Engelhardt Bittner, Wendy M.; Moreno, Jesse E., Jr.

2008-01-01

Internal validity is important in assessing teaching demonstrations both for one's knowledge and for quality assessment demanded by outside sources. We describe a method to improve the internal validity of assessments of teaching demonstrations: a 1-group pretest-posttest design with alternative forms. This design is often more practical and…

International Validation of Two Human Recombinant Estrogen ...

EPA Pesticide Factsheets

An international validation study has been successfully completed for 2 competitive binding assays using human recombinant ERa. Assays evaluated included the Freyberger-Wilson (FW) assay using a full length human ER, and the Chemical Evaluation and Research Institute (CERI) assay using a ligand-binding domain of the human ER. Twenty three compounds were tested in 6 laboratories for the FW assay and 5 for the CERJ assay, which included three controls (used with every run), 9 uncoded, and 14 coded chemicals across 3 subtasks. The overall goal of this validation study was to demonstrate the ability of each of the two assays to reliably classify the test chemicals as binders or non-binders. Laboratories had little trouble with the ER binders that produced a full binding curve when using either the CERI or FW assays. As is typical with all ER competitive binding assays, the weak binders proved to be more challenging. However, overall results from both the FW and CERI assays were consistent and in agreement with expected classifications regardless of the form of the hrER (i.e., full length ER versus an ER ligand binding domain) or the subtle differences in the protocols for conducting each assay. The reproducibility and accuracy for classification of chemicals as potential ER binders and non- binders using the FW and CERI hrER binding assays were comparable to that of the U.S.EPA’s existing ER binding test guideline OPPTS 890.1250, while providing an improved, highe

A study of affective temperaments in Hungary: internal consistency and concurrent validity of the TEMPS-A against the TCI and NEO-PI-R.

PubMed

Rózsa, Sándor; Rihmer, Zoltán; Gonda, Xénia; Szili, Ilona; Rihmer, Annamária; Ko, Natasa; Németh, Attila; Pestality, Péter; Bagdy, György; Alhassoon, Omar; Akiskal, Kareen K; Akiskal, Hagop S

2008-02-01

that of the general population of Hungary. The distribution of the data may have in some instances deviated somewhat from the underlying assumptions for the standard psychometric tests for normality. We did not conduct test-retest reliability. The factorial structure of the TEMPS-A shows good reliability and internal consistency. Although the superstructure is reminiscent of neuroticism-extraversion, within it are embedded discernible classical affective temperaments. A provocative finding is the high prevalence of cyclothymia in Hungarian males (6%), which is rather unique when compared with the other 10 countries studied to date. This finding, coupled with high male hyperthymia (5.4%), may explain the high lifetime prevalence of bipolar disorders reported from Hungary. Inter alia, our psychometric data along with the foregoing epidemiologic considerations, are very much in line with the cyclothymic-bipolar spectrum model proposed by the senior author [Akiskal, H.S., Djenderedjian, A.H., Rosenthal, R.H., Khani, M.K., 1977. Cyclothymic disorder: validating criteria for inclusion in the bipolar affective group. Am. J. Psychiatry 134, 1227-1233].

Are Informant Reports of Personality More Internally Consistent Than Self Reports of Personality?

PubMed

Balsis, Steve; Cooper, Luke D; Oltmanns, Thomas F

2015-08-01

The present study examined whether informant-reported personality was more or less internally consistent than self-reported personality in an epidemiological community sample (n = 1,449). Results indicated that across the 5 NEO (Neuroticism-Extraversion-Openness) personality factors and the 10 personality disorder trait dimensions, informant reports tended to be more internally consistent than self reports, as indicated by equal or higher Cronbach's alpha scores and higher average interitem correlations. In addition, the informant reports collectively outperformed the self reports for predicting responses on a global measure of health, indicating that the informant reports are not only more reliable than self reports, but they can also be useful in predicting an external criterion. Collectively these findings indicate that informant reports tend to have greater internal consistency than self reports. © The Author(s) 2014.

International Psychometric Validation of an EORTC Quality of Life Module Measuring Cancer Related Fatigue (EORTC QLQ-FA12).

PubMed

Weis, Joachim; Tomaszewski, Krzysztof A; Hammerlid, Eva; Ignacio Arraras, Juan; Conroy, Thierry; Lanceley, Anne; Schmidt, Heike; Wirtz, Markus; Singer, Susanne; Pinto, Monica; Alm El-Din, Mohamed; Compter, Inge; Holzner, Bernhard; Hofmeister, Dirk; Chie, Wei-Chu; Czeladzki, Marek; Harle, Amelie; Jones, Louise; Ritter, Sabrina; Flechtner, Hans-Henning; Bottomley, Andrew

2017-05-01

The European Organisation for Research and Treatment of Cancer (EORTC) Group has developed a new multidimensional instrument measuring cancer-related fatigue to be used in conjunction with the quality of life core questionnaire (EORTC QLQ-C30). The module EORTC QLQ-FA13 assesses physical, cognitive, and emotional aspects of cancer-related fatigue. The methodology follows the EORTC guidelines for phase IV validation of modules. This paper focuses on the results of the psychometric validation of the factorial structure of the module. For validation and cross-validation confirmatory factor analysis (maximum likelihood estimation), intraclass correlation and Cronbach alpha for internal consistency were employed. The study involved an international multicenter collaboration of 11 European and non-European countries. A total of 946 patients with various tumor diagnoses were enrolled. Based on the confirmatory factor analysis, we could approve the three-dimensional structure of the module. Removing one item and reassigning the factorial mapping of another item resulted in the EORTC QLQ-FA12. For the revised scale, we found evidence supporting good local (indicator reliability ≥ 0.60, factor reliability ≥ 0.82) and global model fit (GFI t1|t2 = 0.965/0.957, CFI t1|t2 = 0.976/0.972, RMSEA t1|t2 = 0.060/0.069) for both measurement points. For each scale, test-retest reliability proved to be very good (intraclass correlation: R t1-t2 = 0.905-0.921) and internal consistency proved to be good to high (Cronbach alpha = .79-.90). Based on the former phase III module, the multidimensional structure was revised as a phase IV module (EORTC FA12) with an improved scale structure. For a comprehensive validation of the EORTC FA12, further aspects of convergent and divergent validity as well as sensitivity to change should be determined. © The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Validity and reliability of an adapted arabic version of the long international physical activity questionnaire.

PubMed

Helou, Khalil; El Helou, Nour; Mahfouz, Maya; Mahfouz, Yara; Salameh, Pascale; Harmouche-Karaki, Mireille

2017-07-24

The International Physical Actvity Questionnaire (IPAQ) is a validated tool for physical activity assessment used in many countries however no Arabic version of the long-form of this questionnaire exists to this date. Hence, the aim of this study was to cross-culturally adapt and validate an Arabic version of the long International Physical Activity Questionnaire (AIPAQ) equivalent to the French version (F-IPAQ) in a Lebanese population. The guidelines for cross-cultural adaptation provided by the World Health Organization and the International Physical Activity Questionnaire committee were followed. One hundred fifty-nine students and staff members from Saint Joseph University of Beirut were randomly recruited to participate in the study. Items of the A-IPAQ were compared to those from the F-IPAQ for concurrent validity using Spearman's correlation coefficient. Content validity of the questionnaire was assessed using factor analysis for the A-IPAQ's items. The physical activity indicators derived from the A-IPAQ were compared with the body mass index (BMI) of the participants for construct validity. The instrument was also evaluated for internal consistency reliability using Cronbach's alpha and Intraclass Correlation Coefficient (ICC). Finally, thirty-one participants were asked to complete the A-IPAQ on two occasions three weeks apart to examine its test-retest reliability. Bland-Altman analyses were performed to evaluate the extent of agreement between the two versions of the questionnaire and its repeated administrations. A high correlation was observed between answers of the F-IPAQ and those of the A-IPAQ, with Spearman's correlation coefficients ranging from 0.91 to 1.00 (p < 0.05). Bland-Altman analysis showed a high level of agreement between the two versions with all values scattered around the mean for total physical activity (mean difference = 5.3 min/week, 95% limits of agreement = -145.2 to 155.8). Negative correlations were observed between

Internal Consistencies of the Original and Revised Beck Depression Inventory.

ERIC Educational Resources Information Center

Beck, Aaron, T.; Steer, Robert A.

1984-01-01

Compared versions of the Beck Depression Inventory in psychiatric patients. The alpha coefficient for 598 inpatients and outpatients on the 1961 version was .88, and the alpha coefficient for 248 outpatients on the 1978 version was .86. Concluded that the internal consistencies of both versions were comparable. (JAC)

Good validity of the international spinal cord injury quality of life basic data set.

PubMed

Post, M W M; Adriaansen, J J E; Charlifue, S; Biering-Sørensen, F; van Asbeck, F W A

2016-04-01

Cross-sectional validation study. To examine the construct and concurrent validity of the International Spinal Cord Injury (SCI) Quality of Life (QoL) Basic Data Set. Dutch community. People 28-65 years of age, who obtained their SCI between 18 and 35 years of age, were at least 10 years post SCI and were wheelchair users in daily life. MEASURE(S): The International SCI QoL Basic Data Set consists of three single items on satisfaction with life as a whole, physical health and psychological health (0=complete dissatisfaction; 10=complete satisfaction). Reference measures were the Mental Health Inventory-5 and three items of the World Health Organization Quality of Life measure. Data of 261 participants were available. Mean time after SCI was 24.1 years (s.d. 9.1); 90.4% had a traumatic SCI, 81.5% a motor complete SCI and 40% had tetraplegia. Mean age was 47.9 years (s.d. 8.8) and 73.2% were male. Mean scores were 6.9 (s.d. 1.9) for general QoL, 5.8 (s.d. 2.2) for physical health and 7.1 (s.d. 1.9) for psychological health. No floor or ceiling effects were found. Strong inter-correlations (0.48-0.71) were found between the items, and Cronbach's alpha of the scale was good (0.81). Correlations with the reference measures showed the strongest correlations between the WHOQOL general satisfaction item and general QoL (0.64), the WHOQOL health and daily activities items and physical health (0.69 and 0.60) and the Mental Health Inventory-5 and psychological health (0.70). This first validity study of the International SCI QoL Basic Data Set shows that it appears valid for persons with SCI.

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Consistency of FMEA used in the validation of analytical procedures.

PubMed

Oldenhof, M T; van Leeuwen, J F; Nauta, M J; de Kaste, D; Odekerken-Rombouts, Y M C F; Vredenbregt, M J; Weda, M; Barends, D M

2011-02-20

In order to explore the consistency of the outcome of a Failure Mode and Effects Analysis (FMEA) in the validation of analytical procedures, an FMEA was carried out by two different teams. The two teams applied two separate FMEAs to a High Performance Liquid Chromatography-Diode Array Detection-Mass Spectrometry (HPLC-DAD-MS) analytical procedure used in the quality control of medicines. Each team was free to define their own ranking scales for the probability of severity (S), occurrence (O), and detection (D) of failure modes. We calculated Risk Priority Numbers (RPNs) and we identified the failure modes above the 90th percentile of RPN values as failure modes needing urgent corrective action; failure modes falling between the 75th and 90th percentile of RPN values were identified as failure modes needing necessary corrective action, respectively. Team 1 and Team 2 identified five and six failure modes needing urgent corrective action respectively, with two being commonly identified. Of the failure modes needing necessary corrective actions, about a third were commonly identified by both teams. These results show inconsistency in the outcome of the FMEA. To improve consistency, we recommend that FMEA is always carried out under the supervision of an experienced FMEA-facilitator and that the FMEA team has at least two members with competence in the analytical method to be validated. However, the FMEAs of both teams contained valuable information that was not identified by the other team, indicating that this inconsistency is not always a drawback. Copyright © 2010 Elsevier B.V. All rights reserved.

Internal validity of a household food security scale is consistent among diverse populations participating in a food supplement program in Colombia.

PubMed

Hackett, Michelle; Melgar-Quinonez, Hugo; Uribe, Martha C Alvarez

2008-05-23

We assessed the validity of a locally adapted Colombian Household Food Security Scale (CHFSS) used as a part of the 2006 evaluation of the food supplement component of the Plan for Improving Food and Nutrition in Antioquia, Colombia (MANA - Plan Departamental de Seguridad Alimentaria y Nutricional de Antioquia). Subjects included low-income families with pre-school age children in MANA that responded affirmatively to at least one CHFSS item (n = 1,319). Rasch Modeling was used to evaluate the psychometric characteristics of the items through measure and INFIT values. Differences in CHFSS performance were assessed by area of residency, socioeconomic status and number of children enrolled in MANA. Unidimensionality of a scale by group was further assessed using Differential Item Functioning (DIF). Most CHFSS items presented good fitness with most INFIT values within the adequate range of 0.8 to 1.2. Consistency in item measure values between groups was found for all but two items in the comparison by area of residency. Only two adult items exhibited DIF between urban and rural households. The results indicate that the adapted CHFSS is a valid tool to assess the household food security of participants in food assistance programs like MANA.

Evaluation of Dimensionality in the Assessment of Internal Consistency Reliability: Coefficient Alpha and Omega Coefficients

ERIC Educational Resources Information Center

Green, Samuel B.; Yang, Yanyun

2015-01-01

In the lead article, Davenport, Davison, Liou, & Love demonstrate the relationship among homogeneity, internal consistency, and coefficient alpha, and also distinguish among them. These distinctions are important because too often coefficient alpha--a reliability coefficient--is interpreted as an index of homogeneity or internal consistency.…

Creation and Initial Validation of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale

PubMed Central

Steele, Catriona M.; Namasivayam-MacDonald, Ashwini M.; Guida, Brittany T.; Cichero, Julie A.; Duivestein, Janice; MRSc; Hanson, Ben; Lam, Peter; Riquelme, Luis F.

2018-01-01

Objective To assess consensual validity, interrater reliability, and criterion validity of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale, a new functional outcome scale intended to capture the severity of oropharyngeal dysphagia, as represented by the degree of diet texture restriction recommended for the patient. Design Participants assigned International Dysphagia Diet Standardisation Initiative Functional Diet Scale scores to 16 clinical cases. Consensual validity was measured against reference scores determined by an author reference panel. Interrater reliability was measured overall and across quartile subsets of the dataset. Criterion validity was evaluated versus Functional Oral Intake Scale (FOIS) scores assigned by survey respondents to the same case scenarios. Feedback was requested regarding ease and likelihood of use. Setting Web-based survey. Participants Respondents (NZ170) from 29 countries. Interventions Not applicable. Main Outcome Measures Consensual validity (percent agreement and Kendall t), criterion validity (Spearman rank correlation), and interrater reliability (Kendall concordance and intraclass coefficients). Results The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed strong consensual validity, criterion validity, and interrater reliability. Scenarios involving liquid-only diets, transition from nonoral feeding, or trial diet advances in therapy showed the poorest consensus, indicating a need for clear instructions on how to score these situations. The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed greater sensitivity than the FOIS to specific changes in diet. Most (>70%) respondents indicated enthusiasm for implementing the International Dysphagia Diet Standardisation Initiative Functional Diet Scale. Conclusions This initial validation study suggests that the International Dysphagia Diet Standardisation Initiative Functional

Creation and Initial Validation of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale.

PubMed

Steele, Catriona M; Namasivayam-MacDonald, Ashwini M; Guida, Brittany T; Cichero, Julie A; Duivestein, Janice; Hanson, Ben; Lam, Peter; Riquelme, Luis F

2018-05-01

To assess consensual validity, interrater reliability, and criterion validity of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale, a new functional outcome scale intended to capture the severity of oropharyngeal dysphagia, as represented by the degree of diet texture restriction recommended for the patient. Participants assigned International Dysphagia Diet Standardisation Initiative Functional Diet Scale scores to 16 clinical cases. Consensual validity was measured against reference scores determined by an author reference panel. Interrater reliability was measured overall and across quartile subsets of the dataset. Criterion validity was evaluated versus Functional Oral Intake Scale (FOIS) scores assigned by survey respondents to the same case scenarios. Feedback was requested regarding ease and likelihood of use. Web-based survey. Respondents (N=170) from 29 countries. Not applicable. Consensual validity (percent agreement and Kendall τ), criterion validity (Spearman rank correlation), and interrater reliability (Kendall concordance and intraclass coefficients). The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed strong consensual validity, criterion validity, and interrater reliability. Scenarios involving liquid-only diets, transition from nonoral feeding, or trial diet advances in therapy showed the poorest consensus, indicating a need for clear instructions on how to score these situations. The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed greater sensitivity than the FOIS to specific changes in diet. Most (>70%) respondents indicated enthusiasm for implementing the International Dysphagia Diet Standardisation Initiative Functional Diet Scale. This initial validation study suggests that the International Dysphagia Diet Standardisation Initiative Functional Diet Scale has strong consensual and criterion validity and can be used reliably by clinicians

Internal validity of a household food security scale is consistent among diverse populations participating in a food supplement program in Colombia

PubMed Central

Hackett, Michelle; Melgar-Quinonez, Hugo; Uribe, Martha C Alvarez

2008-01-01

Objective We assessed the validity of a locally adapted Colombian Household Food Security Scale (CHFSS) used as a part of the 2006 evaluation of the food supplement component of the Plan for Improving Food and Nutrition in Antioquia, Colombia (MANA – Plan Departamental de Seguridad Alimentaria y Nutricional de Antioquia). Methods Subjects included low-income families with pre-school age children in MANA that responded affirmatively to at least one CHFSS item (n = 1,319). Rasch Modeling was used to evaluate the psychometric characteristics of the items through measure and INFIT values. Differences in CHFSS performance were assessed by area of residency, socioeconomic status and number of children enrolled in MANA. Unidimensionality of a scale by group was further assessed using Differential Item Functioning (DIF). Results Most CHFSS items presented good fitness with most INFIT values within the adequate range of 0.8 to 1.2. Consistency in item measure values between groups was found for all but two items in the comparison by area of residency. Only two adult items exhibited DIF between urban and rural households. Conclusion The results indicate that the adapted CHFSS is a valid tool to assess the household food security of participants in food assistance programs like MANA. PMID:18500988

Translation and Validation of the Korean Version of the International Knee Documentation Committee Subjective Knee Form

PubMed Central

Kim, Jin Goo; Lee, Joong Yub; Seo, Seung Suk; Choi, Choong Hyeok; Lee, Myung Chul

2013-01-01

Purpose To perform a cross-cultural adaptation and to test the measurement properties of the Korean version of International Knee Documentation Committee (K-IKDC) Subjective Knee Form. Materials and Methods According to the guidelines for cross-cultural adaptation, translation and backward translation of the English version of the IKDC Subjective Knee Form were performed. After translation into the Korean version, 150 patients who had knee-related problems were asked to complete the K-IKDC, Lysholm score, and Short Form-36 (SF-36). Of these patients, 126 were retested 2 weeks later to evaluate test-retest reliability, and 104 were recruited 3 months later to evaluate responsiveness. Construct validity was analyzed by investigating the correlation with Lysholm score and SF-36; content validity was also evaluated. Standardized mean response was calculated for evaluating responsiveness. Results The test-retest reliability proved excellent with a high value for the intraclass correlation coefficient (r=0.94). The internal consistency was strong (Cronbach's α=0.91). Good content validity with absence of floor not ceiling effects and good convergent and divergent validity were observed. Moderate responsiveness was shown (standardized mean response=0.689). Conclusions The K-IKDC demonstrated good measurement properties. We suggest that this instrument is an excellent evaluation instrument that can be used for Korean patients with knee-related injuries. PMID:24032098

International Space Station Internal Thermal Control System Lab Module Simulator Build-Up and Validation

NASA Technical Reports Server (NTRS)

Wieland, Paul; Miller, Lee; Ibarra, Tom

2003-01-01

As part of the Sustaining Engineering program for the International Space Station (ISS), a ground simulator of the Internal Thermal Control System (ITCS) in the Lab Module was designed and built at the Marshall Space Flight Center (MSFC). To support prediction and troubleshooting, this facility is operationally and functionally similar to the flight system and flight-like components were used when available. Flight software algorithms, implemented using the LabVIEW(Registered Trademark) programming language, were used for monitoring performance and controlling operation. Validation testing of the low temperature loop was completed prior to activation of the Lab module in 2001. Assembly of the moderate temperature loop was completed in 2002 and validated in 2003. The facility has been used to address flight issues with the ITCS, successfully demonstrating the ability to add silver biocide and to adjust the pH of the coolant. Upon validation of the entire facility, it will be capable not only of checking procedures, but also of evaluating payload timelining, operational modifications, physical modifications, and other aspects affecting the thermal control system.

Reliability, Dimensionality, and Internal Consistency as Defined by Cronbach: Distinct Albeit Related Concepts

ERIC Educational Resources Information Center

Davenport, Ernest C.; Davison, Mark L.; Liou, Pey-Yan; Love, Quintin U.

2015-01-01

This article uses definitions provided by Cronbach in his seminal paper for coefficient a to show the concepts of reliability, dimensionality, and internal consistency are distinct but interrelated. The article begins with a critique of the definition of reliability and then explores mathematical properties of Cronbach's a. Internal consistency…

The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education.

PubMed

Slade Shantz, Jesse Alan; Leiter, Jeff R S; Gottschalk, Tania; MacDonald, Peter Benjamin

2014-01-01

The purpose of this systematic review was to identify standard procedures for the validation of arthroscopic simulators and determine whether simulators improve the surgical skills of users. Arthroscopic simulator validation studies and randomized trials assessing the effectiveness of arthroscopic simulators in education were identified from online databases, as well as, grey literature and reference lists. Only validation studies and randomized trials were included for review. Study heterogeneity was calculated and where appropriate, study results were combined employing a random effects model. Four hundred and thirteen studies were reviewed. Thirteen studies met the inclusion criteria assessing the construct validity of simulators. A pooled analysis of internal validation studies determined that simulators could discriminate between novice and experts, but not between novice and intermediate trainees on time of completion of a simulated task. Only one study assessed the utility of a knee simulator in training arthroscopic skills directly and demonstrated that the skill level of simulator-trained residents was greater than non-simulator-trained residents. Excessive heterogeneity exists in the literature to determine the internal and transfer validity of arthroscopic simulators currently available. Evidence suggests that simulators can discriminate between novice and expert users, but discrimination between novice and intermediate trainees in surgical education should be paramount. International standards for the assessment of arthroscopic simulator validity should be developed to increase the use and effectiveness of simulators in orthopedic surgery.

Internal Consistency Reliability of the Self-Report Antisocial Process Screening Device

ERIC Educational Resources Information Center

Poythress, Norman G.; Douglas, Kevin S.; Falkenbach, Diana; Cruise, Keith; Lee, Zina; Murrie, Daniel C.; Vitacco, Michael

2006-01-01

The self-report version of the Antisocial Process Screening Device (APSD) has become a popular measure for assessing psychopathic features in justice-involved adolescents. However, the internal consistency reliability of its component scales (Narcissism, Callous-Unemotional, and Impulsivity) has been questioned in several studies. This study…

Initial Development and Validation of the Youth Internalizing Problems Screener

ERIC Educational Resources Information Center

Renshaw, Tyler L.; Cook, Clayton R.

2018-01-01

The present studies report on the initial development and validation of the Youth Internalizing Problems Screener (YIPS), which is a 10-item self-report rating scale for assessing general internalizing problems and identifying depression and anxiety caseness within the context of school mental health screening. Results from Study 1 (N = 177)…

Design and validation of a comprehensive fecal incontinence questionnaire.

PubMed

Macmillan, Alexandra K; Merrie, Arend E H; Marshall, Roger J; Parry, Bryan R

2008-10-01

Fecal incontinence can have a profound effect on quality of life. Its prevalence remains uncertain because of stigma, lack of consistent definition, and dearth of validated measures. This study was designed to develop a valid clinical and epidemiologic questionnaire, building on current literature and expertise. Patients and experts undertook face validity testing. Construct validity, criterion validity, and test-retest reliability was undertaken. Construct validity comprised factor analysis and internal consistency of the quality of life scale. The validity of known groups was tested against 77 control subjects by using regression models. Questionnaire results were compared with a stool diary for criterion validity. Test-retest reliability was calculated from repeated questionnaire completion. The questionnaire achieved good face validity. It was completed by 104 patients. The quality of life scale had four underlying traits (factor analysis) and high internal consistency (overall Cronbach alpha = 0.97). Patients and control subjects answered the questionnaire significantly differently (P < 0.01) in known-groups validity testing. Criterion validity assessment found mean differences close to zero. Median reliability for the whole questionnaire was 0.79 (range, 0.35-1). This questionnaire compares favorably with other available instruments, although the interpretation of stool consistency requires further research. Its sensitivity to treatment still needs to be investigated.

An Adapted Measure of Sibling Attachment: Factor Structure and Internal Consistency of the Sibling Attachment Inventory in Youth.

PubMed

Noel, Valerie A; Francis, Sarah E; Tilley, Micah A

2018-04-01

Parent-youth and peer relationship inventories based on attachment theory measure communication, trust, and alienation, yet sibling relationships have been overlooked. We developed the Sibling Attachment Inventory and evaluated its psychometric properties in a sample of 172 youth ages 10-14 years. We adapted the 25-item Sibling Attachment Inventory from the Inventory of Parent and Peer Attachment-Revised peer measure. Items loaded onto three factors, identified as communication, trust, and alienation, α = 0.93, 0.90, and 0.76, respectively. Sibling trust and alienation correlated with depression (r s  = -0.33, r s  = 0.48) and self-worth (r s  = 0.23; r s  = -0.32); sibling trust and alienation correlated with depression after controlling for parent trust and parent alienation (r s  = -0.23, r s  = 0.22). Preliminary analyses showed good internal consistency, construct validity, and incremental predictive validity. Following replication of these properties, this measure can facilitate large cohort assessments of sibling attachment.

Regression Discontinuity and Beyond: Options for Studying External Validity in an Internally Valid Design

ERIC Educational Resources Information Center

Wing, Coady; Bello-Gomez, Ricardo A.

2018-01-01

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

I Spy with My Little Eye: Jurors' Detection of Internal Validity Threats in Expert Evidence

PubMed Central

McAuliff, Bradley D.; Duckworth, Tejah D.

2010-01-01

This experiment examined whether jury-eligible community members (N = 223) were able to detect internally invalid psychological science presented at trial. Participants read a simulated child sexual abuse case in which the defense expert described a study he had conducted on witness memory and suggestibility. We varied the study's internal validity (valid, missing control group, confound, and experimenter bias) and publication status (published, unpublished). Expert evidence quality ratings were higher for the valid versus missing control group version only. Publication increased ratings of defendant guilt when the study was missing a control group. Variations in internal validity did not influence perceptions of child victim credibility or police interview quality. Participants' limited detection of internal validity threats underscores the need to examine the effectiveness of traditional legal safeguards against junk science in court and improve the scientific reasoning ability of lay people and legal professionals. PMID:20162342

Assessment of predictive performance in incomplete data by combining internal validation and multiple imputation.

PubMed

Wahl, Simone; Boulesteix, Anne-Laure; Zierer, Astrid; Thorand, Barbara; van de Wiel, Mark A

2016-10-26

Missing values are a frequent issue in human studies. In many situations, multiple imputation (MI) is an appropriate missing data handling strategy, whereby missing values are imputed multiple times, the analysis is performed in every imputed data set, and the obtained estimates are pooled. If the aim is to estimate (added) predictive performance measures, such as (change in) the area under the receiver-operating characteristic curve (AUC), internal validation strategies become desirable in order to correct for optimism. It is not fully understood how internal validation should be combined with multiple imputation. In a comprehensive simulation study and in a real data set based on blood markers as predictors for mortality, we compare three combination strategies: Val-MI, internal validation followed by MI on the training and test parts separately, MI-Val, MI on the full data set followed by internal validation, and MI(-y)-Val, MI on the full data set omitting the outcome followed by internal validation. Different validation strategies, including bootstrap und cross-validation, different (added) performance measures, and various data characteristics are considered, and the strategies are evaluated with regard to bias and mean squared error of the obtained performance estimates. In addition, we elaborate on the number of resamples and imputations to be used, and adopt a strategy for confidence interval construction to incomplete data. Internal validation is essential in order to avoid optimism, with the bootstrap 0.632+ estimate representing a reliable method to correct for optimism. While estimates obtained by MI-Val are optimistically biased, those obtained by MI(-y)-Val tend to be pessimistic in the presence of a true underlying effect. Val-MI provides largely unbiased estimates, with a slight pessimistic bias with increasing true effect size, number of covariates and decreasing sample size. In Val-MI, accuracy of the estimate is more strongly improved by

Validity and consistency assessment of accident analysis methods in the petroleum industry.

PubMed

Ahmadi, Omran; Mortazavi, Seyed Bagher; Khavanin, Ali; Mokarami, Hamidreza

2017-11-17

Accident analysis is the main aspect of accident investigation. It includes the method of connecting different causes in a procedural way. Therefore, it is important to use valid and reliable methods for the investigation of different causal factors of accidents, especially the noteworthy ones. This study aimed to prominently assess the accuracy (sensitivity index [SI]) and consistency of the six most commonly used accident analysis methods in the petroleum industry. In order to evaluate the methods of accident analysis, two real case studies (process safety and personal accident) from the petroleum industry were analyzed by 10 assessors. The accuracy and consistency of these methods were then evaluated. The assessors were trained in the workshop of accident analysis methods. The systematic cause analysis technique and bowtie methods gained the greatest SI scores for both personal and process safety accidents, respectively. The best average results of the consistency in a single method (based on 10 independent assessors) were in the region of 70%. This study confirmed that the application of methods with pre-defined causes and a logic tree could enhance the sensitivity and consistency of accident analysis.

The internal consistency of the standard gamble: tests after adjusting for prospect theory.

PubMed

Oliver, Adam

2003-07-01

This article reports a study that tests whether the internal consistency of the standard gamble can be improved upon by incorporating loss weighting and probability transformation parameters in the standard gamble valuation procedure. Five alternatives to the standard EU formulation are considered: (1) probability transformation within an EU framework; and, within a prospect theory framework, (2) loss weighting and full probability transformation, (3) no loss weighting and full probability transformation, (4) loss weighting and no probability transformation, and (5) loss weighting and partial probability transformation. Of the five alternatives, only the prospect theory formulation with loss weighting and no probability transformation offers an improvement in internal consistency over the standard EU valuation procedure.

Construct validity of the items on the Stroke Specific Quality of Life (SS-QOL) questionnaire that evaluate the participation component of the International Classification of Functioning, Disability and Health.

PubMed

Silva, Soraia Micaela; Corrêa, Fernanda Ishida; Pereira, Gabriela Santos; Faria, Christina Danielli Coelho de Morais; Corrêa, João Carlos Ferrari

2018-01-01

Analyze the construct validity and internal consistency of the Stroke Specific Quality of Life (SS-QOL) items that address the participation component of the ICF as well as analyze the ceiling and floor effects. One hundred subjects were analyzed: 85 community-dwelling and 15 institutionalized individuals. The analysis of construct validity was performed using classic psychometrics: (1) the comparison of known groups (individuals without restriction to participation vs. those with restriction to participation) using the Mann-Whitney test and (2) convergent validity - correlation between the scores on the SS-QOL items that address participation and the subscale scores of measures used to evaluate the similar constructs and concepts [the Short-Form Health Survey (SF-36), Functional Independence Measure (FIM) and grip strength test]. Spearman's correlation coefficients were calculated for this analysis. Cronbach's α was used for the analysis of internal consistency and both the ceiling and floor effects were analyzed. The level of significance for all analyses was α = 0.05. The a priori hypotheses regarding construct validity were partially demonstrated, as only five of the eight domains exhibited positive moderate to strong correlations (r > 0.40) with measures that address constructs similar to those addressed on the SS-QOL questionnaire. The items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. The ceiling and floor effects were considered adequate for the total SS-QOL score, but beyond acceptable standards for some domains. The 26 items of the SS-QOL questionnaire measure a multidimensional construct and therefore do not only address participation. However, the items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. Implications for rehabilitation The 26 items of the SS

Assessing motivation for work environment improvements: internal consistency, reliability and factorial structure.

PubMed

Hedlund, Ann; Ateg, Mattias; Andersson, Ing-Marie; Rosén, Gunnar

2010-04-01

Workers' motivation to actively take part in improvements to the work environment is assumed to be important for the efficiency of investments for that purpose. That gives rise to the need for a tool to measure this motivation. A questionnaire to measure motivation for improvements to the work environment has been designed. Internal consistency and test-retest reliability of the domains of the questionnaire have been measured, and the factorial structure has been explored, from the answers of 113 employees. The internal consistency is high (0.94), as well as the correlation for the total score (0.84). Three factors are identified accounting for 61.6% of the total variance. The questionnaire can be a useful tool in improving intervention methods. The expectation is that the tool can be useful, particularly with the aim of improving efficiency of companies' investments for work environment improvements. Copyright 2010 Elsevier Ltd. All rights reserved.

Threats to the Internal Validity of Experimental and Quasi-Experimental Research in Healthcare.

PubMed

Flannelly, Kevin J; Flannelly, Laura T; Jankowski, Katherine R B

2018-01-01

The article defines, describes, and discusses the seven threats to the internal validity of experiments discussed by Donald T. Campbell in his classic 1957 article: history, maturation, testing, instrument decay, statistical regression, selection, and mortality. These concepts are said to be threats to the internal validity of experiments because they pose alternate explanations for the apparent causal relationship between the independent variable and dependent variable of an experiment if they are not adequately controlled. A series of simple diagrams illustrate three pre-experimental designs and three true experimental designs discussed by Campbell in 1957 and several quasi-experimental designs described in his book written with Julian C. Stanley in 1966. The current article explains why each design controls for or fails to control for these seven threats to internal validity.

Cross-Validation of the Africentrism Scale.

ERIC Educational Resources Information Center

Kwate, Naa Oyo A.

2003-01-01

Cross-validated the Africentrism Scale, investigating the relationship between Africentrism and demographic variables in a diverse sample of individuals of African descent. Results indicated that the scale demonstrated solid internal consistency and convergent validity. Age and education related to Africentrism, with younger and less educated…

Internal consistency of the CHAMPS physical activity questionnaire for Spanish speaking older adults.

PubMed

Rosario, Martín G; Vázquez, Jenniffer M; Cruz, Wanda I; Ortiz, Alexis

2008-09-01

The Community Healthy Activities Model Program for Seniors (CHAMPS) is a physical activity monitoring questionnaire for people between 65 to 90 years old. This questionnaire has been previously translated to Spanish to be used in the Latin American population. To adapt the Spanish version of the CHAMPS questionnaire to Puerto Rico and assess its internal consistency. An external review committee adapted the existent Spanish version of the CHAMPS to be used in the Puerto Rican population. Three older adults participated in a second phase with the purpose of training the research team. After the second phase, 35 older adults participated in a third content adaptation phase. During the third phase, the preliminary Spanish version for Puerto Rico of the CHAMPS was given to the 35 participants to assess for clarity, vocabulary and understandability. Interviews to each participant in the third phase were carried out to obtain feedback and create a final Spanish version of the CHAMPS for Puerto Rico. After analyses of this phase, the external review committee prepared a final Spanish version of the CHAMPS for Puerto Rico. The final version was administered to 15 older adults (76 +/- 6.5 years) to assess the internal consistency by using Cronbach's Alpha analysis. The questionnaire showed a strong internal consistency of 0.76. The total time to answer the questionnaire was 17.4 minutes. The Spanish version of the CHAMPS questionnaire for Puerto Rico suggested being an easy to administer and consistent measurement tool to assess physical activity in older adults.

Development and Validation of a Coping with Discrimination Scale: Factor Structure, Reliability, and Validity

ERIC Educational Resources Information Center

Wei, Meifen; Alvarez, Alvin N.; Ku, Tsun-Yao; Russell, Daniel W.; Bonett, Douglas G.

2010-01-01

Four studies were conducted to develop and validate the Coping With Discrimination Scale (CDS). In Study 1, an exploratory factor analysis (N = 328) identified 5 factors: Education/Advocacy, Internalization, Drug and Alcohol Use, Resistance, and Detachment, with internal consistency reliability estimates ranging from 0.72 to 0.90. In Study 2, a…

The memory failures of everyday questionnaire (MFE): internal consistency and reliability.

PubMed

Montejo Carrasco, Pedro; Montenegro, Peña Mercedes; Sueiro, Manuel J

2012-07-01

The Memory Failures of Everyday Questionnaire (MFE) is one of the most widely-used instruments to assess memory failures in daily life. The original scale has nine response options, making it difficult to apply; we created a three-point scale (0-1-2) with response choices that make it easier to administer. We examined the two versions' equivalence in a sample of 193 participants between 19 and 64 years of age. The test-retest reliability and internal consistency of the version we propose were also computed in a sample of 113 people. Several indicators attest to the two forms' equivalence: the correlation between the items' means (r = .94; p < .001) and the order of the items' frequencies (r = .92; p < .001). However, the correlation between global scores on the two forms was not very high (r = .67; p < .001). The results indicate this new version has adequate reliability and internal consistency (r(xx) = .83; p < .001; alpha = .83; p < .001) equivalent to those of the MFE 1-9. The MFE 0-2 provides a brief, simple evaluation, so we recommend it for use in clinical practice as well as research.

Internal consistency and stability of the CANTAB neuropsychological test battery in children.

PubMed

Syväoja, Heidi J; Tammelin, Tuija H; Ahonen, Timo; Räsänen, Pekka; Tolvanen, Asko; Kankaanpää, Anna; Kantomaa, Marko T

2015-06-01

The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a computer-assessed test battery widely use in different populations. The internal consistency and 1-year stability of CANTAB tests were examined in school-age children. Two hundred-thirty children (57% girls) from five schools in the Jyväskylä school district in Finland participated in the study in spring 2011. The children completed the following CANTAB tests: (a) visual memory (pattern recognition memory [PRM] and spatial recognition memory [SRM]), (b) executive function (spatial span [SSP], Stockings of Cambridge [SOC], and intra-extra dimensional set shift [IED]), and (c) attention (reaction time [RTI] and rapid visual information processing [RVP]). Seventy-four children participated in the follow-up measurements (64% girls) in spring 2012. Cronbach's alpha reliability coefficient was used to estimate the internal consistency of the nonhampering test, and structural equation models were applied to examine the stability of these tests. The reliability and the stability could not be determined for IED or SSP because of the nature of these tests. The internal consistency was acceptable only in the RTI task. The 1-year stability was moderate-to-good for the PRM, RTI, and RVP. The SSP and IED showed a moderate correlation between the two measurement points. The SRM and the SOC tasks were not reliable or stable measures in this study population. For research purposes, we recommend using structural equation modeling to improve reliability. The results suggest that the reliability and the stability of computer-based test batteries should be confirmed in the target population before using them for clinical or research purposes. (c) 2015 APA, all rights reserved).

The Interaction with Disabled Persons scale: revisiting its internal consistency and factor structure, and examining item-level properties.

PubMed

Iacono, Teresa; Tracy, Jane; Keating, Jenny; Brown, Ted

2009-01-01

The Interaction with Disabled Persons scale (IDP) has been used in research into baseline attitudes and to evaluate whether a shift in attitudes towards people with developmental disabilities has occurred following some form of intervention. This research has been conducted on the assumption that the IDP measures attitudes as a multidimensional construct and has good internal consistency. Such assumptions about the IDP appear flawed, particularly in light of failures to replicate its underlying factor structure. The aim of this study was to evaluate the construct validity and dimensionality of the IDP. This study used a prospective survey approach. Participants were recruited from first and second year undergraduate university students enrolled in health sciences, occupational therapy, physiotherapy, community and emergency health, nursing, and combined degrees of nursing and midwifery, and health sciences and social work at a large Australian university (n=373). Students completed the IDP, a 20-item self-report scale of attitudes towards people with disabilities. The IDP data were analysed using a combination of factor analysis (Classical Test Theory approach) and Rasch analysis (Item Response Theory approach). The results indicated that the original IDP 6-factor solution was not supported. Instead, one factor consisting of five IDP items (9, 11, 12, 17, and 18) labelled Discomfort met the four criteria for empirical validation of test quality: interval level scaling (scalability), unidimensionality, lacked of DIF across the two participant groups and data collection occasions, and hierarchical ordering. Researchers should consider using the Discomfort subscale of the IDP in future attitude research since it exhibits sound measurement properties.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Demonstrating Experimenter "Ineptitude" as a Means of Teaching Internal and External Validity

ERIC Educational Resources Information Center

Treadwell, Kimberli R.H.

2008-01-01

Internal and external validity are key concepts in understanding the scientific method and fostering critical thinking. This article describes a class demonstration of a "botched" experiment to teach validity to undergraduates. Psychology students (N = 75) completed assessments at the beginning of the semester, prior to and immediately following…

International ring trial for the validation of an event-specific Golden Rice 2 quantitative real-time polymerase chain reaction method.

PubMed

Jacchia, Sara; Nardini, Elena; Bassani, Niccolò; Savini, Christian; Shim, Jung-Hyun; Trijatmiko, Kurniawan; Kreysa, Joachim; Mazzara, Marco

2015-05-27

This article describes the international validation of the quantitative real-time polymerase chain reaction (PCR) detection method for Golden Rice 2. The method consists of a taxon-specific assay amplifying a fragment of rice Phospholipase D α2 gene, and an event-specific assay designed on the 3' junction between transgenic insert and plant DNA. We validated the two assays independently, with absolute quantification, and in combination, with relative quantification, on DNA samples prepared in haploid genome equivalents. We assessed trueness, precision, efficiency, and linearity of the two assays, and the results demonstrate that both the assays independently assessed and the entire method fulfill European and international requirements for methods for genetically modified organism (GMO) testing, within the dynamic range tested. The homogeneity of the results of the collaborative trial between Europe and Asia is a good indicator of the robustness of the method.

Translation, Cultural Adaptation and Validation of the Simple Shoulder Test to Spanish

PubMed Central

Arcuri, Francisco; Barclay, Fernando; Nacul, Ivan

2015-01-01

Background: The validation of widely used scales facilitates the comparison across international patient samples. Objective: The objective was to translate, culturally adapt and validate the Simple Shoulder Test into Argentinian Spanish. Methods: The Simple Shoulder Test was translated from English into Argentinian Spanish by two independent translators, translated back into English and evaluated for accuracy by an expert committee to correct the possible discrepancies. It was then administered to 50 patients with different shoulder conditions.Psycometric properties were analyzed including internal consistency, measured with Cronbach´s Alpha, test-retest reliability at 15 days with the interclass correlation coefficient. Results: The internal consistency, validation, was an Alpha of 0,808, evaluated as good. The test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.835, evaluated as excellent. Conclusion: The Simple Shoulder Test translation and it´s cultural adaptation to Argentinian-Spanish demonstrated adequate internal reliability and validity, ultimately allowing for its use in the comparison with international patient samples.

Internal validation of the prognostic index for spine metastasis (PRISM) for stratifying survival in patients treated with spinal stereotactic radiosurgery.

PubMed

Jensen, Garrett; Tang, Chad; Hess, Kenneth R; Bishop, Andrew J; Pan, Hubert Y; Li, Jing; Yang, James N; Tannir, Nizar M; Amini, Behrang; Tatsui, Claudio; Rhines, Laurence; Brown, Paul D; Ghia, Amol J

2017-01-01

We sought to validate the Prognostic Index for Spinal Metastases (PRISM), a scoring system that stratifies patients into subgroups by overall survival.Methods and materials: The PRISM was previously created from multivariate Cox regression with patients enrolled in prospective single institution trials of stereotactic spine radiosurgery (SSRS) for spinal metastasis. We assess model calibration and discrimination within a validation cohort of patients treated off-trial with SSRS for metastatic disease at the same institution. The training and validation cohorts consisted of 205 and 249 patients respectively. Similar survival trends were shown in the 4 PRISM. Survival was significantly different between PRISM subgroups (P<0.0001). C-index for the validation cohort was 0.68 after stratification into subgroups. We internally validated the PRISM with patients treated off-protocol, demonstrating that it can distinguish subgroups by survival, which will be useful for individualizing treatment of spinal metastases and stratifying patients for clinical trials.

Factor structure and internal consistency of the Greek version of the Flow State Scale.

PubMed

Doganis, G; Iosifidou, P; Vlachopoulos, S

2000-12-01

The present study tested the internal consistency and the factor struc ture of a translated version of the Flow State Scale with Greek sport participants. Sport psychology literature is not conclusive regarding sex differences and the type of sport in flow. The sample was comprised of 144 women from interactive sports (volleyball and handball) who were drawn from the second division of the first national category. Athletes completed the scale immediately after a game. Values of Cronbach alpha were used to estimate the internal consistency of the scale and confirmatory factor analysis to examine the model. The results showed acceptable psychometric prop erties of the scale and suggest a need for improvement of the problematic items.

Expanding the Reach of Participatory Risk Management: Testing an Online Decision-Aiding Framework for Informing Internally Consistent Choices.

PubMed

Bessette, Douglas L; Campbell-Arvai, Victoria; Arvai, Joseph

2016-05-01

This article presents research aimed at developing and testing an online, multistakeholder decision-aiding framework for informing multiattribute risk management choices associated with energy development and climate change. The framework was designed to provide necessary background information and facilitate internally consistent choices, or choices that are in line with users' prioritized objectives. In order to test different components of the decision-aiding framework, a six-part, 2 × 2 × 2 factorial experiment was conducted, yielding eight treatment scenarios. The three factors included: (1) whether or not users could construct their own alternatives; (2) the level of detail regarding the composition of alternatives users would evaluate; and (3) the way in which a final choice between users' own constructed (or highest-ranked) portfolio and an internally consistent portfolio was presented. Participants' self-reports revealed the framework was easy to use and providing an opportunity to develop one's own risk-management alternatives (Factor 1) led to the highest knowledge gains. Empirical measures showed the internal consistency of users' decisions across all treatments to be lower than expected and confirmed that providing information about alternatives' composition (Factor 2) resulted in the least internally consistent choices. At the same time, those users who did not develop their own alternatives and were not shown detailed information about the composition of alternatives believed their choices to be the most internally consistent. These results raise concerns about how the amount of information provided and the ability to construct alternatives may inversely affect users' real and perceived internal consistency. © 2015 Society for Risk Analysis.

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the

Reliability and Validity of the Persian Language Version of the International Consultation on Incontinence Questionnaire - Male Lower Urinary Tract Symptoms (ICIQ-MLUTS).

PubMed

Pourmomeny, Abbas Ali; Ghanei, Behnaz; Alizadeh, Farshid

2018-05-01

Assessment instruments are essential for research, allowing diagnosis and evaluating treatment outcomes in subjects with lower urinary tract disorders of both genders. The purpose of this study was to translate the Male Lower Urinary Tract Symptoms (MLUTS) Questionnaire and determine its psychometric properties in Persian subjects. After getting permission from the International Consultation on Incontinence Modular Questionnaire (ICIQ) web site, the forward and backward translation of the MLUTS questionnaire were carried out by researcher team. The content/face validity, construct validity and reliability were assessed in a sample of MLUTS Iranian patients by measuring with the Cronbach's alpha test. In total, 121 male patients were included in the study. The mean age of the patients was 60.5 years. Cronbach alpha value was 0.757, consecrated the internal consistency of the form (r > 0.7). The internal consistency of each question was examined separately and found to be over 0.7. For the evaluation of reliability test-retest was done, the test was administered to 20% of the patients for a second time with an interval of 1-2 weeks. The intraclass correlation coefficient (ICC) score was 0.901. The Correlation coefficient between the MLUTS and International Prostate Symptoms Score (IPSS) was 0.879. ICIQ-MLUTS is a robust instrument, which can be used for evaluating male LUTS in Persian patients. We believe that the Persian version of the MLUTS is an important tool for research and clinical setting. © 2017 John Wiley & Sons Australia, Ltd.

The Validity and Reliability of the Mobbing Scale (MS)

ERIC Educational Resources Information Center

Yaman, Erkan

2009-01-01

The aim of this research is to develop the Mobbing Scale and examine its validity and reliability. The sample of the study consisted of 515 persons from Sakarya and Bursa. In this study, construct validity, internal consistency, test-retest reliability, and item analysis of the scale were examined. As a result of factor analysis for construct…

Use of Internal Consistency Coefficients for Estimating Reliability of Experimental Tasks Scores

PubMed Central

Green, Samuel B.; Yang, Yanyun; Alt, Mary; Brinkley, Shara; Gray, Shelley; Hogan, Tiffany; Cowan, Nelson

2017-01-01

Reliabilities of scores for experimental tasks are likely to differ from one study to another to the extent that the task stimuli change, the number of trials varies, the type of individuals taking the task changes, the administration conditions are altered, or the focal task variable differs. Given reliabilities vary as a function of the design of these tasks and the characteristics of the individuals taking them, making inferences about the reliability of scores in an ongoing study based on reliability estimates from prior studies is precarious. Thus, it would be advantageous to estimate reliability based on data from the ongoing study. We argue that internal consistency estimates of reliability are underutilized for experimental task data and in many applications could provide this information using a single administration of a task. We discuss different methods for computing internal consistency estimates with a generalized coefficient alpha and the conditions under which these estimates are accurate. We illustrate use of these coefficients using data for three different tasks. PMID:26546100

Study on the Validity and Reliability of Melbourne Decision Making Scale in Turkey

ERIC Educational Resources Information Center

Çolakkadioglu, Oguzhan; Deniz, M. Engin

2015-01-01

This study is to analyze the validity and reliability of Melbourne Decision Making Questionnaire (MDMQ). The sample consisted of 650 university students. The structural validity of the MDMQ, as well as correlations among its sub-scales, measure-bound validity, internal consistency, item total correlations and test-retest reliability coefficients…

Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project.

PubMed

2003-02-01

International interest in clinical practice guidelines has never been greater but many published guidelines do not meet the basic quality requirements. There have been renewed calls for validated criteria to assess the quality of guidelines. To develop and validate an international instrument for assessing the quality of the process and reporting of clinical practice guideline development. The instrument was developed through a multi-staged process of item generation, selection and scaling, field testing, and refinement procedures. 100 guidelines selected from 11 participating countries were evaluated independently by 194 appraisers with the instrument. Following refinement the instrument was further field tested on three guidelines per country by a new set of 70 appraisers. The final version of the instrument contained 23 items grouped into six quality domains with a 4 point Likert scale to score each item (scope and purpose, stakeholder involvement, rigour of development, clarity and presentation, applicability, editorial independence). 95% of appraisers found the instrument useful for assessing guidelines. Reliability was acceptable for most domains (Cronbach's alpha 0.64-0.88). Guidelines produced as part of an established guideline programme had significantly higher scores on editorial independence and, after the publication of a national policy, had significantly higher quality scores on rigour of development (p<0.005). Guidelines with technical documentation had higher scores on that domain (p<0.0001). This is the first time an appraisal instrument for clinical practice guidelines has been developed and tested internationally. The instrument is sensitive to differences in important aspects of guidelines and can be used consistently and easily by a wide range of professionals from different backgrounds. The adoption of common standards should improve the consistency and quality of the reporting of guideline development worldwide and provide a framework to

The Iranian Version of the Exercise Self-Efficacy Scale (ESES): Factor Structure, Internal Consistency and Construct Validity

ERIC Educational Resources Information Center

Noroozi, Azita; Ghofranipour, Fazlollah; Heydarnia, Ali Reza; Nabipour, Iraj; Tahmasebi, Rahim; Tavafian, Sedighe Sadat

2011-01-01

Purpose: The exercise self-efficacy scale (ESES) is largely used among diabetic patients to enhance exercise behaviour. However, the Iranian version of ESES was not available. The aim of this study was to validate ESES in this country. Method: Data were collected from 348 women who referred to a diabetes institute in Iran through convenience…

Development and Validation of the Internalized Racial Oppression Scale for Black Individuals

ERIC Educational Resources Information Center

Bailey, Tamba-Kuii M.; Chung, Y. Barry; Williams, Wendi S.; Singh, Anneliese A.; Terrell, Heather K.

2011-01-01

This article describes the development and validation of the Internalized Racial Oppression Scale (IROS) for Black individuals in 2 studies using a total sample of 468 Black college students. The IROS is intended to measure the degree to which racial oppression is internalized and replicated by Black individuals in the United States. An…

[MusiQol: international questionnaire investigating quality of life in multiple sclerosis: validation results for the German subpopulation in an international comparison].

PubMed

Flachenecker, P; Vogel, U; Simeoni, M C; Auquier, P; Rieckmann, P

2011-10-01

The existing health-related quality of life questionnaires on multiple sclerosis (MS) only partially reflect the patient's point of view on the reduction of activities of daily living. Their development and validation was not performed in different languages. That is what prompted the development of the Multiple Sclerosis International Quality of Life (MusiQoL) Questionnaire as an international multidimensional measurement instrument. This paper presents this new development and the results of the German subgroup versus the total international sample. A total of 1,992 MS patients from 15 countries, including 209 German patients, took part in the study between January 2004 and February 2005. The patients took the MusiQoL survey at baseline and at 21±7 days as well as completing a symptom-related checklist and the SF-36 short form survey. Demographics, history and MS classification data were also generated. Reproducibility, sensitivity, convergent and discriminant validity were analysed. Convergent and discriminant validity and reproducibility were satisfactory for all dimensions of the MusiQoL. The dimensional scores correlated moderately but significantly with the SF-36 scores, but showed a discriminant validity in terms of gender, socioeconomic status and health status that was more pronounced in the overall population than in the German subpopulation. The highest correlations were observed between the MusiQoL dimension of activities of daily living and the Expanded Disability Status Scale (EDSS). The results of this study confirm the validity and reliability of MusiQoL as an instrument for measuring the quality of life of German and international MS patients.

Validation of the International Consultation on Incontinence Questionnaire-Vaginal Symptoms (ICIQ-VS) in two south- Asian languages.

PubMed

Ekanayake, Chanil D; Pathmeswaran, Arunasalam; Herath, Rasika P; Perera, H Suharshi S; Patabendige, Malitha; Wijesinghe, Prasantha S

2017-12-01

The multifaceted nature of pelvic floor disorders means that a systematic evaluation is required for optimal treatment outcome. It is also generally acknowledged that a valid tool is necessary to objectively assess symptoms reported by affected women. The International Consultation on Incontinence Questionnaire-Vaginal Symptoms (ICIQ-VS) questionnaire was translated to Sinhala and Tamil and a validation study carried out among women attending gynecology clinics at North Colombo Teaching Hospital, Ragama, and the district general hospitals Mannar and Vavuniya. Content validity was assessed by the level of missing answers, which was < 4% and 2% for each item in Sinhala and Tamil, respectively. Construct validity was assessed by the ability of the questionnaire to differentiate between patients and controls. Both differentiated patients from controls on vaginal symptoms score (VSS) (p < 0.001), sexual symptoms score (SSS) (p < 0.01), and quality of life (QoL) (p < 0.001). There was a strong positive correlation between Pelvic Organ Prolapse Quantification (POP-Q) scores and VSS (Sinhala r s  = 0.64, p < 0.001, Tamil r s  = 0.65, p < 0.001), and QoL (Sinhala r s  = 0.49, p < 0.001, Tamil r s  = 0.60, p < 0.001). Internal consistency as assessed using Cronbach's coefficient alpha: 0.78 (0.76-0.78) and 0.83 (0.80-0.84) in Sinhala and Tamil, respectively. Test-retest reliability was assessed by weighted kappa scores (Sinhala 0.58-0.88 and Tamil 0.76-0.90). Both questionnaires were sensitive to change and showed that VSS and QoL improved following surgery (Wilcoxon matched-pairs signed-rank test p < 0.001). The validated Sinhala and Tamil translations of ICIQ-VS will be useful for assessing vaginal and sexual symptoms among women speaking Sinhala and Tamil.

Validation of the Short Form of the Academic Procrastination Scale.

PubMed

Yockey, Ronald D

2016-02-01

The factor structure, internal consistency reliability, and convergent validity of the five-item Academic Procrastination Scale-Short Form was investigated on an ethnically diverse sample of college students. The results provided support for the Academic Procrastination Scale-Short Form as a unidimensional measure of academic procrastination, which possessed good internal consistency reliability in this sample of 282 students. The scale also demonstrated good convergent validity, with moderate to large correlations with both the Procrastination Assessment Scale-Students and the Tuckman Procrastination Scale. Implications of the results are discussed and recommendations for future work provided.

Cross-cultural Adaption and Validation of the Danish Voice Handicap Index.

PubMed

Sorensen, Jesper Roed; Printz, Trine; Mehlum, Camilla Slot; Heidemann, Christian Hamilton; Groentved, Aagot Moeller; Godballe, Christian

2018-02-02

We aimed to assess psychometric properties, including internal consistency, reliability, and clinical validity of the Danish version of the Voice Handicap Index (VHI). A cross-sectional survey study was carried out. For validation, the existing nonvalidated Danish version of the VHI was used. Data from 208 patients with voice disorders of different etiology (neurogenic, functional, and structural) and a control group of 85 vocally healthy individuals were included. A test-retest reliability analysis of 42 patients and 45 control persons was performed. The internal consistency, test-retest reliability, and clinical validity of the questionnaire were assessed. Internal consistency was high with a Cronbach α >0.90 for both the patient and control group. Test-retest reliability measured as intraclass correlation coefficient was good with 0.93 (95% confidence interval [95% confidence interval]: 0.87-0.96) for patients and 0.78 (95% confidence interval: 0.63-0.87) for the control group which indicates sufficient reliability of the questionnaire. The Danish VHI has good clinical validity as it has a strong correlation between patient's perception of the severity of their voice disorder and the VHI score from the Spearman correlation of 0.69. The existing Danish version of the VHI has been thoroughly validated and found to be in line with the original VHI from Jacobsen et al. It showed good internal consistency, test-retest reliability, and clinical validity. It is suitable for use in daily practice and in research projects as it is able to assess patients' perception of their voice disorder severity. Copyright © 2018 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Validation of the Social Appearance Anxiety Scale: Factor, Convergent, and Divergent Validity

ERIC Educational Resources Information Center

Levinson, Cheri A.; Rodebaugh, Thomas L.

2011-01-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor,…

WOrk-Related Questionnaire for UPper extremity disorders (WORQ-UP): Factor Analysis and Internal Consistency.

PubMed

Aerts, Bas R; Kuijer, P Paul; Beumer, Annechien; Eygendaal, Denise; Frings-Dresen, Monique H

2018-04-17

To test a 17-item questionnaire, the WOrk-Related Questionnaire for UPper extremity disorders (WORQ-UP), for dimensionality of the items (factor analysis) and internal consistency. Cross-sectional study. Outpatient clinic. A consecutive sample of patients (N=150) consisting of all new referral patients (either from a general physician or other hospital) who visited the orthopedic outpatient clinic because of an upper extremity musculoskeletal disorder. Not applicable. Number and dimensionality of the factors in the WORQ-UP. Four factors with eigenvalues (EVs) >1.0 were found. The factors were named exertion, dexterity, tools & equipment, and mobility. The EVs of the factors were, respectively, 5.78, 2.38, 1.81, and 1.24. The factors together explained 65.9% of the variance. The Cronbach alpha values for these factors were, respectively, .88, .74, .87, and .66. The 17 items of the WORQ-UP resemble 4 factors-exertion, dexterity, tools & equipment, and mobility-with a good internal consistency. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Validating the Attitudes toward Sex Offenders Scale

ERIC Educational Resources Information Center

Whitehead, Charmeka

2009-01-01

This study investigated the reliability and validity of the Attitudes Toward Sex Offenders Scale (ATS) measurement by assessing attitudes of counselors in training towards juvenile sex offenders. The specific aims of this study were to determine (a) internal consistency of the ATS, (b) construct validity of the ATS based on exploratory factor…

Selective Mutism Questionnaire: measurement structure and validity.

PubMed

Letamendi, Andrea M; Chavira, Denise A; Hitchcock, Carla A; Roesch, Scott C; Shipon-Blum, Elisa; Stein, Murray B

2008-10-01

To evaluate the factor structure, reliability, and validity of the 17-item Selective Mutism Questionnaire (SMQ). Diagnostic interviews were administered via telephone to 102 parents of children identified with selective mutism (SM) and 43 parents of children without SM from varying U.S. geographic regions. Children were between the ages of 3 and 11 inclusive and comprised 58% girls and 42% boys. SM diagnoses were determined using the Anxiety Disorders Interview Schedule for Children-Parent Version; SM severity was assessed using the 17-item SMQ; and behavioral and affective symptoms were assessed using the Child Behavior Checklist. An exploratory factor analysis was conducted to investigate the dimensionality of the SMQ and a modified parallel analysis procedure was used to confirm exploratory factor analysis results. Internal consistency, construct validity, and incremental validity were also examined. The exploratory factor analysis yielded a 13-item solution consisting of three factors: social situations outside of school, school situations, and home and family situations. Internal consistency of SMQ factors and total scale ranged from moderate to high. Convergent and incremental validity was also well supported. Measure structure findings are consistent with the three-factor solution found in a previous psychometric evaluation of the SMQ. Results also suggest that the SMQ provides useful and unique information in the prediction of SM phenomena beyond other child anxiety measures.

Development of a multidimensional labour satisfaction questionnaire: dimensions, validity, and internal reliability

PubMed Central

Smith, L

2001-01-01

Background—No published quantitative instrument exists to measure maternal satisfaction with the quality of different models of labour care in the UK. Methods—A quantitative psychometric multidimensional maternal satisfaction questionnaire, the Women's Views of Birth Labour Satisfaction Questionnaire (WOMBLSQ), was developed using principal components analysis with varimax rotation of successive versions. Internal reliability and content and construct validity were assessed. Results—Of 300 women sent the first version (WOMBLSQ1), 120 (40%) replied; of 300 sent WOMBLSQ2, 188 (62.7%) replied; of 500 women sent WOMBLSQ3, 319 (63.8%) replied; and of 2400 women sent WOMBLSQ4, 1683 (70.1%) replied. The latter two versions consisted of 10 dimensions in addition to general satisfaction. These were (Cronbach's alpha): professional support in labour (0.91), expectations of labour (0.90), home assessment in early labour (0.90), holding the baby (0.87), support from husband/partner (0.83), pain relief in labour (0.83), pain relief immediately after labour (0.65), knowing labour carers (0.82), labour environment (0.80), and control in labour (0.62). There were moderate correlations (range 0.16–0.73) between individual dimensions and the general satisfaction scale (0.75). Scores on individual dimensions were significantly related to a range of clinical and demographic variables. Conclusion—This multidimensional labour satisfaction instrument has good validity and internal reliability. It could be used to assess care in labour across different models of maternity care, or as a prelude to in depth exploration of specific areas of concern. Its external reliability and transferability to care outside the South West region needs further evaluation, particularly in terms of ethnicity and social class. Key Words: Women's Views of Birth Labour Satisfaction Questionnaire (WOMBLSQ); labour; questionnaire PMID:11239139

Development and validation of the Australian version of the Birth Satisfaction Scale-Revised (BSS-R).

PubMed

Jefford, Elaine; Hollins Martin, Caroline J; Martin, Colin R

2018-02-01

The 10-item Birth Satisfaction Scale-Revised (BSS-R) has recently been endorsed by international expert consensus for global use as the birth satisfaction outcome measure of choice. English-language versions of the tool include validated UK and US versions; however, the instrument has not, to date, been contextualised and validated in an Australian English-language version. The current investigation sought to develop and validate an English-language version of the tool for use within the Australian context. A two-stage study. Following review and modification by expert panel, the Australian BSS-R (A-BSS-R) was (Stage 1) evaluated for factor structure, internal consistency, known-groups discriminant validity and divergent validity. Stage 2 directly compared the A-BSS-R data set with the original UK data set to determine the invariance characteristics of the new instrument. Participants were a purposive sample of Australian postnatal women (n = 198). The A-BSS-R offered a good fit to data consistent with the BSS-R tridimensional measurement model and was found to be conceptually and measurement equivalent to the UK version. The A-BSS-R demonstrated excellent known-groups discriminant validity, generally good divergent validity and overall good internal consistency. The A-BSS-R represents a robust and valid measure of the birth satisfaction concept suitable for use within Australia and appropriate for application to International comparative studies.

Internal consistency of the Spanish health literacy test (TOFHLA-SPR) for Puerto Rico.

PubMed

Rivero-Méndez, Marta; Suárez, Erick; Solís-Báez, Solymar S; Hernández, Gloryvee; Cordero, Wanda; Vázquez, Irma; Medina, Zullettevy; Padilla, Raisa; Flores, Aida; Bonilla, José Luis; Holzemer, William L

2010-03-01

Low functional health literacy has been related to poor viral control, and lower levels of ART adherence in people living with HIV/AIDS. Research in functional health literacy among people living with HIV/AIDS in Puerto Rico (PR) is an unexplored area. The purpose of this paper is to describe how the full-length Spanish Version of the Test of Functional Health Literacy in Adults (TOFHLA-S) scale was adapted to PR. Thirty participants (women = 16, men = 14) completed a basic demographic questionnaire, the TOFHLA-S and participated in an interview. Analyses were performed to examine the information provided by participants and the internal consistency of the TOFHLA-S. The mean age was 47.7 years (range 34-77). Thirty-seven percent had less than 12 years of formal schooling and 43% reported having education above high school. Changes suggested by participants included: increasing font size from 14 to 16 points for better readability and changes/simplification of several words in order to make them colloquial and comprehensible for the PR context. The reliability coefficient obtained for this scale was strong (estimated alpha = 0.95) however, differences were observed by subtype: numeracy (estimated alpha(num) = .819 vs. comprehension (estimated alpha =. 953). Based on this process, we have adapted the original version of the TOFHLA-S and the new version of the full-length TOFHLA-S, PR is now valid for further research and testing levels of functional health literacy in a larger sample in PR.

Translation and linguistic validation of the Persian version of the Bristol Female Lower Urinary Tract Symptoms instrument.

PubMed

Pourmomeny, Abbas Ali; Rezaeian, Zahra Sadat; Soltanmohamadi, Mahsa

2017-09-01

The aim of this study was to evaluate the psychometric properties of the Persian version of the International Consultation on Incontinence Modular Questionnaire for Female Lower Urinary Tract Symptoms (ICIQ-FLUTS) in patients with urinary tract dysfunction. After gaining permission from the International Consultation on Incontinence Modular Questionnaire (ICIQ) advisory board, the English Female Lower Urinary Tract Symptoms (FLUTS) questionnaire was translated into Persian and then translated back into English. One hundred fourteen women with pelvic floor dysfunction were asked to complete the Persian FLUTS and International Consultation on Incontinence Modular Questionnaire Overactive Bladder Questionnaire (ICIQ-OAB). The Persian FLUTS questionnaire was also readministered to 20 patients 2 weeks after their initial visit. Study data were analyzed using SPSS V16.0. To validate the translated questionnaire, we assayed content/face validity, internal consistency/reliability, and construct validity. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and the intraclass correlation coefficient (ICC) respectively. The mean age of the patients was 48.8 years old, 84% were married, and 59% had at least one Caesarean. Except for very few missing data, there is no any ambiguity in the Persian version of the FLUTS questionnaire. The Cronbach's alpha was 0.83, indicating a high internal consistency. Concerning criterion validity, correlation between the Persian FLUTS and the OAB was 0.77 (p < 0.001). The initial testing of the Persian version of the FLUTS questionnaire demonstrates good internal consistency, content validity, and reliability.

Living with chronic illness scale: international validation of a new self-report measure in Parkinson’s disease

PubMed Central

Ambrosio, Leire; Portillo, Mari Carmen; Rodríguez-Blázquez, Carmen; Rodriguez-Violante, Mayela; Castrillo, Juan Carlos Martínez; Arillo, Víctor Campos; Garretto, Nélida Susana; Arakaki, Tomoko; Dueñas, Marcos Serrano; Álvarez, Mario; Ibáñez, Ivonne Pedroso; Carvajal, Ana; Martínez-Martín, Pablo

2016-01-01

Understanding how a person lives with a chronic illness, such as Parkinson’s disease (PD), is necessary to provide individualized care and professionals role in person-centered care at clinical and community levels is paramount. The present study was aimed to analyze the psychometric properties of the Living with Chronic Illness-PD Scale (EC-PC) in a wide Spanish-speaking population with PD. International cross-sectional study with retest was carried out with 324 patients from four Latin American countries and Spain. Feasibility, acceptability, scaling assumptions, reliability, precision, and construct validity were tested. The study included 324 patients, with age (mean±s.d.) 66.67±10.68 years. None of the EC-PC items had missing values and all acceptability parameters fulfilled the standard criteria. Around two-third of the items (61.54%) met scaling assumptions standards. Concerning internal consistency, Cronbach’s alpha values were 0.68–0.88; item-total correlation was >0.30, except for two items; item homogeneity index was >0.30, and inter-item correlation values 0.14–0.76. Intraclass correlation coefficient for EC-PC stability was 0.76 and standard error of measurement (s.e.m.) for precision was 8.60 (for a EC-PC s.d.=18.57). EC-PC presented strong correlation with social support (rS=0.61) and moderate correlation with life satisfaction (rS=0.46). Weak and negligible correlations were found with the other scales. Internal validity correlations ranged from 0.46 to 0.78. EC-PC total scores were significantly different for each severity level based on Hoehn and Yahr and Clinical Impression of Severity Index, but not for Patient Global Impression of Severity. The EC-PC has satisfactory acceptability, reliability, precision, and validity to evaluate living with PD. PMID:28725703

Measuring Long-Distance Romantic Relationships: A Validity Study

ERIC Educational Resources Information Center

Pistole, M. Carole; Roberts, Amber

2011-01-01

This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

International Validation of Two Human Recombinant Estrogen Receptor (ERa) Binding Assays

EPA Science Inventory

An international validation study has been successfully completed for 2 competitive binding assays using human recombinant ERa. Assays evaluated included the Freyberger-Wilson (FW) assay using a full length human ER, and the Chemical Evaluation and Research Institute (CERI) assay...

Validation of the Physician Teaching Motivation Questionnaire (PTMQ).

PubMed

Dybowski, Christoph; Harendza, Sigrid

2015-10-02

Physicians play a major role as teachers in undergraduate medical education. Studies indicate that different forms and degrees of motivation can influence work performance in general and that teachers' motivation to teach can influence students' academic achievements in particular. Therefore, the aim of this study was to develop and to validate an instrument measuring teaching motivations in hospital-based physicians. We chose self-determination theory as a theoretical framework for item and scale development. It distinguishes between different dimensions of motivation depending on the amount of self-regulation and autonomy involved and its empirical evidence has been demonstrated in other areas of research. To validate the new instrument (PTMQ = Physician Teaching Motivation Questionnaire), we used data from a sample of 247 physicians from internal medicine and surgery at six German medical faculties. Structural equation modelling was conducted to confirm the factorial structure, correlation analyses and linear regressions were performed to examine concurrent and incremental validity. Structural equation modelling confirmed a good global fit for the factorial structure of the final instrument (RMSEA = .050, TLI = .957, SRMR = .055, CFI = .966). Cronbach's alphas indicated good internal consistencies for all scales (α = .75 - .89) except for the identified teaching motivation subscale with an acceptable internal consistency (α = .65). Tests of concurrent validity with global work motivation, perceived teaching competence, perceived teaching involvement and voluntariness of lesson allocation delivered theory-consistent results with slight deviations for some scales. Incremental validity over global work motivation in predicting perceived teaching involvement was also confirmed. Our results indicate that the PTMQ is a reliable, valid and therefore suitable instrument for assessing physicians' teaching motivation.

Development and validation of the brief esophageal dysphagia questionnaire.

PubMed

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

Validity and Reliability of Internalized Stigma of Mental Illness (Cantonese)

ERIC Educational Resources Information Center

Young, Daniel Kim-Wan; Ng, Petrus Y. N.; Pan, Jia-Yan; Cheng, Daphne

2017-01-01

Purpose: This study aims to translate and test the reliability and validity of the Internalized Stigma of Mental Illness-Cantonese (ISMI-C). Methods: The original English version of ISMI is translated into the ISMI-C by going through forward and backward translation procedure. A cross-sectional research design is adopted that involved 295…

Internal validation of two new retrotransposons-based kits (InnoQuant® HY and InnoTyper® 21) at a forensic lab.

PubMed

Martins, Cátia; Ferreira, Paulo Miguel; Carvalho, Raquel; Costa, Sandra Cristina; Farinha, Carlos; Azevedo, Luísa; Amorim, António; Oliveira, Manuela

2018-02-01

Obtaining a genetic profile from pieces of evidence collected at a crime scene is the primary objective of forensic laboratories. New procedures, methods, kits, software or equipment must be carefully evaluated and validated before its implementation. The constant development of new methodologies for DNA testing leads to a steady process of validation, which consists of demonstrating that the technology is robust, reproducible, and reliable throughout a defined range of conditions. The present work aims to internally validate two new retrotransposon-based kits (InnoQuant ® HY and InnoTyper ® 21), under the working conditions of the Laboratório de Polícia Científica da Polícia Judiciária (LPC-PJ). For the internal validation of InnoQuant ® HY and InnoTyper ® 21 sensitivity, repeatability, reproducibility, and mixture tests and a concordance study between these new kits and those currently in use at LPC-PJ (Quantifiler ® Duo and GlobalFiler™) were performed. The results obtained for sensitivity, repeatability, and reproducibility tests demonstrated that both InnoQuant ® HY and InnoTyper ® 21 are robust, reproducible, and reliable. The results of the concordance studies demonstrate that InnoQuant ® HY produced quantification results in nearly 29% more than Quantifiler ® Duo (indicating that this new kit is more effective in challenging samples), while the differences observed between InnoTyper ® 21 and GlobalFiler™ are not significant. Therefore, the utility of InnoTyper ® 21 has been proven, especially by the successful amplification of a greater number of complete genetic profiles (27 vs. 21). The results herein presented allowed the internal validation of both InnoQuant ® HY and InnoTyper ® 21, and their implementation in the LPC-PJ laboratory routine for the treatment of challenging samples. Copyright © 2017 Elsevier B.V. All rights reserved.

Issues in cross-cultural validity: example from the adaptation, reliability, and validity testing of a Turkish version of the Stanford Health Assessment Questionnaire.

PubMed

Küçükdeveci, Ayse A; Sahin, Hülya; Ataman, Sebnem; Griffiths, Bridget; Tennant, Alan

2004-02-15

Guidelines have been established for cross-cultural adaptation of outcome measures. However, invariance across cultures must also be demonstrated through analysis of Differential Item Functioning (DIF). This is tested in the context of a Turkish adaptation of the Health Assessment Questionnaire (HAQ). Internal construct validity of the adapted HAQ is assessed by Rasch analysis; reliability, by internal consistency and the intraclass correlation coefficient; external construct validity, by association with impairments and American College of Rheumatology functional stages. Cross-cultural validity is tested through DIF by comparison with data from the UK version of the HAQ. The adapted version of the HAQ demonstrated good internal construct validity through fit of the data to the Rasch model (mean item fit 0.205; SD 0.998). Reliability was excellent (alpha = 0.97) and external construct validity was confirmed by expected associations. DIF for culture was found in only 1 item. Cross-cultural validity was found to be sufficient for use in international studies between the UK and Turkey. Future adaptation of instruments should include analysis of DIF at the field testing stage in the adaptation process.

[Intraobserver reliability and internal consistency of the Behavioral Pain Scale in mechanically-ventilated patients].

PubMed

Navarro-Colom, M; Sendra-Lluis, M A; Castillo-Masa, A M; Robleda, G

2015-01-01

The Behavioral Pain Scale (BPS) is a tool of pain assessment that often gives contradictory results when used by different raters. To assess internal consistency and interrater reliability of BPS scale in the pain assessment performed by intensives care nurses. A prospective observational study in 34 mechanically-ventilated patients, carried out in an Intensive Care Unit from April to June 2012. Variables analyzed included demographic characteristics, diagnosis of referral, clinical status, pain and sedation level. Pain was assessed by two nurses independently at rest (T1) and during a mobilization procedure (T2) using the BPS scale. Internal consistency was calculated by Cronbach's alpha, and intraobserver reliability was determined with the intraclass correlation coefficient (ICC), with a confidence interval (CI) of 95%. This study was approved by the Ethical Committee for Clinical Research. One-hundred and twenty-eight pain assessments were performed. The Cronbach's alpha of total BPS score at rest was 0.66 (95%CI: 0.33 to 0.83) and during mobilization of 0.73 (95%CI: 0.47 to 0.87). The CCI of total BPS score was 0.50 (95%CI: 0.19 to 0.71) at rest and 0.58 (95%CI: 0.31 to 0.77) during mobilization. The level of internal consistency of the scale is appropriate and moderate interrater agreement. For the BPS useful in clinical practice, it is imperative that nurses have prior experience with a regulated use of this tool. Copyright © 2014 Elsevier España, S.L.U. y SEEIUC. All rights reserved.

Validating Computational Human Behavior Models: Consistency and Accuracy Issues

DTIC Science & Technology

2004-06-01

includes a discussion of SME demographics, content, and organization of the datasets . This research generalizes data from two pilot studies and two base...meet requirements for validating the varied and complex behavioral models. Through a series of empirical studies , this research identifies subject...meet requirements for validating the varied and complex behavioral models. Through a series of empirical studies , this research identifies subject

Validity aspects of the patient feedback questionnaire on consultation skills (PFC), a promising learning instrument in medical education.

PubMed

Reinders, Marcel E; Blankenstein, Annette H; Knol, Dirk L; de Vet, Henrica C W; van Marwijk, Harm W J

2009-08-01

A focus on the communicator competency is considered to be an important requirement to help physicians to acquire consultation skills. A feedback questionnaire, in which patients assess consultation skills might be a useful learning tool. An existing questionnaire on patient perception of patient-centeredness (PPPC) was adapted to cover the 'communicator' items in the competency profile. We assessed the face and content validity, the construct validity and the internal consistency of this new patient feedback on consultation skills (PFC) questionnaire. We assessed the face validity of the PFC by interviewing patients and general practice trainees (GPTs) during the developmental process. The content validity was determined by experts (n=10). First-year GPTs (23) collected 222 PFCs, from which the data were used to assess the construct validity (factor analysis), internal consistency, response rates and ceiling effects. The PFC adequately covers the corresponding 'communicator' competency (face and content validity). Factor analysis showed a one-dimensional construct. The internal consistency was high (Cronbach's alpha 0.89). For the single items, the response rate varied from 89.2% to 100%; the maximum score (ceiling effect) varied from 45.5% to 89.2%. The PFC appears to be a valid, internally consistent instrument. The PFC may be a valuable learning tool with which GPTs, other physicians and medical students can acquire feedback from patients regarding their consultation skills.

An Overlooked Population in Community College: International Students' (In)Validation Experiences With Academic Advising

ERIC Educational Resources Information Center

Zhang, Yi

2016-01-01

Objective: Guided by validation theory, this study aims to better understand the role that academic advising plays in international community college students' adjustment. More specifically, this study investigated how academic advising validates or invalidates their academic and social experiences in a community college context. Method: This…

Validation of the Sinhala translation of the International Consultation on Incontinence Modular Questionnaire for female lower urinary tract symptoms among women in Sri Lanka.

PubMed

de Silva, Gayan; Furukan, Rameez; Goonewardene, Malik

2017-12-01

The objective of this study was to translate the International Consultation on Incontinence Modular Questionnaire for female lower urinary tract symptoms (ICIQ-FLUTS) into Sinhala and validate the Sinhala translation for use in clinical practice. The ICIQ-FLUTS was translated into Sinhala in accordance with the ICIQ validation protocol. The Sinhala translation was validated by administering it to 133 women with FLUTS, mainly urinary incontinence and or urgency, and to 118 women with symptoms other than FLUTS during the period 25 October 2013 to 23 December 2016, in the Academic Obstetrics and Gynaecology Unit, Teaching Hospital Mahamodara, Galle, Sri Lanka. The Sinhala translation had good content validity (assessed by a panel of clinicians including a content specialist, and a group of women with and without FLUTS), good internal consistency (Cronbach's alpha coefficient in the range 0.69-0.75) was stable (no significant differences between median test-retest scores in a subgroup of 24 women with FLUTS), had good construct validity (marked difference between median scores in women presenting with and without FLUTS, p < 0.001), and good responsiveness (marked improvements between scores before and after treatment, p < 0.001). The Sinhala translation of the ICIQ-FLUTS is valid and reliable for assessing Sinhalese-speaking women with FLUTS, especially urinary incontinence and/or urgency.

Reliability and Validation of the International Consultation on Incontinence Questionnaire in Over Active Bladder to Persian Language.

PubMed

Sari Motlagh, Reza; Hajebrahimi, Sakineh; Sadeghi-Bazargani, Homayoun; Joodi Tutunsaz, Javad

2015-05-01

Overactive bladder syndrome is a common syndrome in the world in both men and women. Correct diagnosis and accurate measurement of symptoms severity and also quality of life of patients is necessary to ensure proper treatment and to facilitate sound relationships among patients, researchers and doctors. The International Consultation on Incontinence Questionnaire in Over Active Bladder (ICIQ-OAB) questionnaire is a concise and strong tool to evaluate the symptoms of OAB and their effects on patients' quality of life and treatment results. The objective of this study was to translate and validate a simple and strong tool that could be used in clinics and research. First, the original British English questionnaire was translated into Persian by two bilingual and originally Persian-speaking translators. Then the Persian version was back translated to English and a native English speaker studied and compared the questionnaire with the original version. At the end, the translated and corrected Persian version was finalized by a research team. Content validity of the items and ensuring that the questions could convey the main concept to readers was assessed through Modified Content Validity Index (MCVI). Reliability was calculated by Cronbach's α coefficient. Internal Consistency of the questionnaire with the calculation of Kendall correlation coefficient were evaluated by performing test-retest in 50 participants. The modified content validity index was > 0.78 for all of the questions. Cronbach's α coefficient was calculated 0.76 for all of the participants. Kendall correlation coefficient was calculated for test-re-test assessment 0.66. Both of which indicates the reliability of this questionnaire. Persian version of ICIQ-OAB questionnaire is a simple and strong tool for research, treatment and screening purposes. © 2014 Wiley Publishing Asia Pty Ltd.

Clinical audit project in undergraduate medical education curriculum: an assessment validation study

PubMed Central

Steketee, Carole; Mak, Donna

2016-01-01

Objectives To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. Methods A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). Results The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students’ and examiners’ response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach’s alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. Conclusions This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.  PMID:27716612

INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD): development and validation.

PubMed

Juneja, Monica; Mishra, Devendra; Russell, Paul S S; Gulati, Sheffali; Deshmukh, Vaishali; Tudu, Poma; Sagar, Rajesh; Silberberg, Donald; Bhutani, Vinod K; Pinto, Jennifer M; Durkin, Maureen; Pandey, Ravindra M; Nair, M K C; Arora, Narendra K

2014-05-01

To develop and validate INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD). Diagnostic test evaluation by cross sectional design. Four tertiary pediatric neurology centers in Delhi and Thiruvanthapuram, India. Children aged 2-9 years were enrolled in the study. INDT-ASD and Childhood Autism Rating Scale (CARS) were administered in a randomly decided sequence by trained psychologist, followed by an expert evaluation by DSM-IV TR diagnostic criteria (gold standard). Psychometric parameters of diagnostic accuracy, validity (construct, criterion and convergent) and internal consistency. 154 children (110 boys, mean age 64.2 mo) were enrolled. The overall diagnostic accuracy (AUC=0.97, 95% CI 0.93, 0.99; P<0.001) and validity (sensitivity 98%, specificity 95%, positive predictive value 91%, negative predictive value 99%) of INDT-ASD for Autism spectrum disorder were high, taking expert diagnosis using DSM-IV-TR as gold standard. The concordance rate between the INDT-ASD and expert diagnosis for 'ASD group' was 82.52% [Cohen's k=0.89; 95% CI (0.82, 0.97); P=0.001]. The internal consistency of INDT-ASD was 0.96. The convergent validity with CARS (r = 0.73, P= 0.001) and divergent validity with Binet-Kamat Test of intelligence (r = -0.37; P=0.004) were significantly high. INDT-ASD has a 4-factor structure explaining 85.3% of the variance. INDT-ASD has high diagnostic accuracy, adequate content validity, good internal consistency high criterion validity and high to moderate convergent validity and 4-factor construct validity for diagnosis of Autistm spectrum disorder.

Clinical audit project in undergraduate medical education curriculum: an assessment validation study.

PubMed

Tor, Elina; Steketee, Carole; Mak, Donna

2016-09-24

To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students' and examiners' response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach's alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents.

PubMed

Garcia-Lopez, LuisJoaquín; Moore, Harry T A

2015-01-01

Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided.

Development and validation of a knowledge test for health professionals regarding lifestyle modification.

PubMed

Talip, Whadi-ah; Steyn, Nelia P; Visser, Marianne; Charlton, Karen E; Temple, Norman

2003-09-01

We wanted to develop and validate a test that assesses the knowledge and practices of health professionals (HPs) with regard to the role of nutrition, physical activity, and smoking cessation (lifestyle modification) in chronic diseases of lifestyle. A descriptive cross-sectional validation study was carried out. The validation design consisted of two phases, namely 1) test planning and development and 2) test evaluation. The study sample consisted of five groups of HPs: dietitians, dietetic interns, general practitioners, medical students, and nurses. The overall response rate was 58%, resulting in a sample size of 186 participants. A test was designed to evaluate the knowledge and practices of HPs. The test was first evaluated by an expert group to ensure content, construct, and face validity. Thereafter, the questionnaire was tested on five groups of HPs to test for criterion validity. Internal consistency was evaluated by Cronbach's alpha. An expert panel ensured content, construct, and face validity of the test. Groups with the most training and exposure to nutrition (dietitians and dietetic interns) had the highest group mean score, ranging from 61% to 88%, whereas those with limited nutrition training (general practitioners, medical students, and nurses) had significantly lower scores, ranging from 26% to 80%. This result demonstrated criterion validity. Internal consistency of the overall test demonstrated a Cronbach's alpha of 0.99. Most HPs identified the mass media as their main source of information on lifestyle modification. These HPs also identified lack of time, lack of patient compliance, and lack of knowledge as barriers that prevent them from providing counseling on lifestyle modification. The results of this study showed that this test instrument identifies groups of health professionals with adequate training (knowledge) in lifestyle modification and those who require further training (knowledge).

[Validating the Spanish version of the Nursing Activities Score].

PubMed

Sánchez-Sánchez, M M; Arias-Rivera, S; Fraile-Gamo, M P; Thuissard-Vasallo, I J; Frutos-Vivar, F

2015-01-01

Validating workload scores ensures that they are appropriate for the purpose for which they were developed. To validate the Nursing Activities Score (NAS) Spanish version. Observational and prospective study. 1,045 patients who were admitted to a medical-surgical unit and a serious burns unit in 2006 were included. The nurse in charge assessed patient workloads by Nine Equivalent of Nursing Manpower use Score and NAS. To assess the internal consistency of the measurements of NAS, item-test correlations, Cronbach's α and Cronbach's α corrected by omitting each of the items were calculated. The intraobserver and interobserver reliability were assessed with the intraclass correlation coefficient by viewing recordings and Kappa (interobserver reliability) was estimated. For the analysis of internal validity, a factorial principal components analysis was performed. Convergent validity was assessed using the Spearman correlation coefficient values obtained from the Nine Equivalent of Nursing Manpower use Score and Spanish-NAS scales. For internal consistency, 164 questionnaires were analysed and a Cronbach's α of 0.373 was calculated. The intraclass correlation coefficient for intraobserver reliability estimate was 0.837 (95% IC: 0.466-0.950) and 0.662 (95% IC: 0.033-0.882) for interobserver reliability. The estimated kappa was 0.371. For internal validity, exploratory factor analysis showed that the first item explained 58.9% of the variance of the questionnaire. For convergent validity 1006 questionnaires were included and a Spearman correlation coefficient of 0.746 was observed. The psychometric properties of Spanish-NAS are acceptable. Copyright © 2014 Elsevier España, S.L.U. y SEEIUC. All rights reserved.

Development and validation of a stock addiction inventory (SAI).

PubMed

Youn, HyunChul; Choi, Jung-Seok; Kim, Dai-Jin; Choi, Sam-Wook

2016-01-01

Investing in financial markets is promoted and protected by the government as an essential economic activity, but can turn into a gambling addiction problem. Until now, few scales have widely been used to identify gambling addicts in financial markets. This study aimed to develop a self-rating scale to distinguish them. In addition, the reliability and validity of the stock addiction inventory (SAI) were demonstrated. A set of questionnaires, including the SAI, south oaks gambling screen (SOGS), and DSM-5 diagnostic criteria, for gambling disorder was completed by 1005 participants. Factor analysis, internal consistency testing, t tests, analysis of variance, and partial correlation analysis were conducted to verify the reliability and validity of SAI. The factor analysis results showed the final SAI consisting of two factors and nine items. The internal consistency and concurrent validity of SAI were verified. The Cronbach's α for the total scale was 0.892, and the SAI and its factors were significantly correlated with SOGS. This study developed a specific scale for financial market investments or trading; this scale proved to be reliable and valid. Our scale expands the understanding of gambling addiction in financial markets and provides a diagnostic reference.

Internal Consistency of the Spanish Health Literacy Test (TOFHLA-SPR) for Puerto Rico

PubMed Central

Rivero-Méndez, Marta; Suárez, Erick; Solís-Báez, Solymar S.; Hernández, Gloryvee; Cordero, Wanda; Vázquez, Irma; Medina, Zullettevy; Padilla, Raisa; Flores, Aida; Bonilla, José Luis; Holzemer, William L.

2010-01-01

Background Low functional health literacy has been related to poor viral control, and lower levels of ART adherence in people living with HIV/AIDS. Research in functional health literacy among people living with HIV/AIDS in Puerto Rico (PR) is an unexplored area. The purpose of this paper is to describe how the full-length Spanish Version of the Test of Functional Health Literacy in Adults (TOFHLA-S) scale was adapted to PR. Methods Thirty participants (women = 16, men = 14) completed a basic demographic questionnaire, the TOFHLA-S and participated in an interview. Analyses were performed to examine the information provided by participants and the internal consistency of the TOFHLA-S. Results The mean age was 47.7 years (range 34-77). Thirty-seven percent had less than 12 years of formal schooling and 43% reported having education above high school. Changes suggested by participants included: increasing font size from 14 to 16 points for better readability and changes/simplification of several words in order to make them colloquial and comprehensible for the PR context. The reliability coefficient obtained for this scale was strong (estimated alpha = 0.95) however, differences were observed by subtype: numeracy (estimated alphanum = .819 vs. comprehension (estimated alpha =. 953). Conclusions Based on this process, we have adapted the original version of the TOFHLA-S and the new version of the full-length TOFHLA-S, PR is now valid for further research and testing levels of functional health literacy in a larger sample in PR. PMID:20222334

The Perceived Leadership Communication Questionnaire (PLCQ): Development and Validation.

PubMed

Schneider, Frank M; Maier, Michaela; Lovrekovic, Sara; Retzbach, Andrea

2015-01-01

The Perceived Leadership Communication Questionnaire (PLCQ) is a short, reliable, and valid instrument for measuring leadership communication from both perspectives of the leader and the follower. Drawing on a communication-based approach to leadership and following a theoretical framework of interpersonal communication processes in organizations, this article describes the development and validation of a one-dimensional 6-item scale in four studies (total N = 604). Results from Study 1 and 2 provide evidence for the internal consistency and factorial validity of the PLCQ's self-rating version (PLCQ-SR)-a version for measuring how leaders perceive their own communication with their followers. Results from Study 3 and 4 show internal consistency, construct validity, and criterion validity of the PLCQ's other-rating version (PLCQ-OR)-a version for measuring how followers perceive the communication of their leaders. Cronbach's α had an average of.80 over the four studies. All confirmatory factor analyses yielded good to excellent model fit indices. Convergent validity was established by average positive correlations of.69 with subdimensions of transformational leadership and leader-member exchange scales. Furthermore, nonsignificant correlations with socially desirable responding indicated discriminant validity. Last, criterion validity was supported by a moderately positive correlation with job satisfaction (r =.31).

[Internal validity and diagnostic utility of the Eating Disorder Inventory in Mexican women].

PubMed

García-García, Eduardo; Vázquez-Velázquez, Verónica; López-Alvarenga, Juan Carlos; Arcila-Martínez, Denise

2003-01-01

To assess the diagnostic utility and internal validity of the Eating Disorder Inventory (EDI-2) in Mexican women. An observational, cross-sectional study was conducted between October 2000 and January 2001. The sample population consisted of two groups of women: patients diagnosed with anorexia nervosa or bulimia, but no other psychiatric pathology, seen by psychiatrists at the Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán (National Institute of Medical Sciences and Nutrition Salvador Zubirán), and a randomly selected sample of women from a school in Mexico City. A structured interview was conducted using SCID/DSM-IV as the gold standard. Finally the EDI-2 was administered. Statistical analysis was performed using Student's t test for independent samples, Cronbach's alpha test, and calculation of sensitivity, specificity, and positive and negative predictive values. No significant differences were found for weight, height, and body mass index. Women with no eating disorders were younger than those with eating disorders (16.7 +/- 2.8 vs. 19.9 +/- 4.3, p = 0.004). The EDI-2 total score was clearly different between the groups (53.8 +/- 32.4 vs. 146.3 +/- 45.6 respectively, p < 0.001). All Cronbach's alpha coefficients for all subscales were over 0.85. For the total score, a sensitive cutoff point of 80 (sensitivity 90.9, 95% confidence interval [CI] 69.4 to 98.4; specificity 80, 95% CI 58.7 to 92.4) and a specific cutoff point of 105 (sensitivity 81.8, 95% CI 59 to 94; specificity 89.3, 95% CI 70.6 to 97.2) are recommended. The EDI-2 has a high internal validity and should be a useful tool to assess eating disorders.

Validity and reliability of the NAB Naming Test.

PubMed

Sachs, Bonnie C; Rush, Beth K; Pedraza, Otto

2016-05-01

Confrontation naming is commonly assessed in neuropsychological practice, but few standardized measures of naming exist and those that do are susceptible to the effects of education and culture. The Neuropsychological Assessment Battery (NAB) Naming Test is a 31-item measure used to assess confrontation naming. Despite adequate psychometric information provided by the test publisher, there has been limited independent validation of the test. In this study, we investigated the convergent and discriminant validity, internal consistency, and alternate forms reliability of the NAB Naming Test in a sample of adults (Form 1: n = 247, Form 2: n = 151) clinically referred for neuropsychological evaluation. Results indicate adequate-to-good internal consistency and alternate forms reliability. We also found strong convergent validity as demonstrated by relationships with other neurocognitive measures. We found preliminary evidence that the NAB Naming Test demonstrates a more pronounced ceiling effect than other commonly used measures of naming. To our knowledge, this represents the largest published independent validation study of the NAB Naming Test in a clinical sample. Our findings suggest that the NAB Naming Test demonstrates adequate validity and reliability and merits consideration in the test arsenal of clinical neuropsychologists.

Dysphagia in Multiple Sclerosis: Evaluation and Validation of the DYMUS Questionnaire.

PubMed

Alali, Dalal; Ballard, Kirrie; Vucic, Steve; Bogaardt, Hans

2018-06-01

The 10-item Dysphagia in Multiple Sclerosis (DYMUS) questionnaire is a self-administered tool used to identify swallowing problems in adults with MS. The questionnaire was not validated against other existing questionnaires to assess its convergent validity. Moreover, its test-retest reliability was not measured previously. Therefore, the purpose of this study was to assess the factor analysis, internal consistency and test-retest reliability of the DYMUS, as well as its convergent validity against an established and validated questionnaire, the EAT-10. English-speaking adults with MS in New South Wales, Australia who were seen for routine medical check-ups were invited to complete two questionnaires across two phases. One hundred participants completed phase 1, while 55 completed phase 2. Statistical analyses were performed to investigate the psychometric properties of the DYMUS questionnaire. Internal consistency (Cronbach's Alpha) reduced the DYMUS questionnaire from ten to five items. The shortened version of the DYMUS showed high internal consistency (alpha = 0.904). It also showed satisfactory reproducibility, and adequate correlation with the 10-item Eating Assessment Tool (EAT-10). Evaluation of the DYMUS resulted in a shortened version of the questionnaire with five questions related to dysphagia. This shortened version is considered an easy and useful tool in identifying patients with MS-related dysphagia.

Development and Validation of the Brief Esophageal Dysphagia Questionnaire

PubMed Central

Taft, Tiffany H.; Riehl, Megan; Sodikoff, Jamie B.; Kahrilas, Peter J.; Keefer, Laurie; Doerfler, Bethany; Pandolfino, John E.

2017-01-01

Background Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. Methods 1,638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. Key Results The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. Conclusions & Inferences The BEDQ represents a rapid, reliable and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. PMID:27380834

Reliability and validity of advanced theory-of-mind measures in middle childhood and adolescence.

PubMed

Hayward, Elizabeth O; Homer, Bruce D

2017-09-01

Although theory-of-mind (ToM) development is well documented for early childhood, there is increasing research investigating changes in ToM reasoning in middle childhood and adolescence. However, the psychometric properties of most advanced ToM measures for use with older children and adolescents have not been firmly established. We report on the reliability and validity of widely used, conventional measures of advanced ToM with this age group. Notable issues with both reliability and validity of several of the measures were evident in the findings. With regard to construct validity, results do not reveal a clear empirical commonality between tasks, and, after accounting for comprehension, developmental trends were evident in only one of the tasks investigated. Statement of contribution What is already known on this subject? Second-order false belief tasks have acceptable internal consistency. The Eyes Test has poor internal consistency. Validity of advanced theory-of-mind tasks is often based on the ability to distinguish clinical from typical groups. What does this study add? This study examines internal consistency across six widely used advanced theory-of-mind tasks. It investigates validity of tasks based on comprehension of items by typically developing individuals. It further assesses construct validity, or commonality between tasks. © 2017 The British Psychological Society.

Validation of the Inventory of Depressive Symptomatology (IDS) in Cocaine Dependent Inmates.

ERIC Educational Resources Information Center

Suris, Alina; Kashner, T. Michael; Gillaspy, James A., Jr.; Biggs, Melanie; Rush, A. John

2001-01-01

While the reliability and validity of Inventory of Depressive Symptomatology (IDS) scores have been established with outpatient adults being treated in community psychiatric clinics, it has not been used in special or dually diagnosed populations. Establishes internal consistency, concurrent validity, and construct validity for both the clinical…

Reliability and Validity of the Turkish Version of the Gastrointestinal Symptom Rating Scale.

PubMed

Turan, Nuray; Aşt, Türkinaz Atabek; Kaya, Nurten

The purpose of this methodological study is to investigate the validity and reliability of the Turkish version of the Gastrointestinal Symptom Rating Scale (GSRS). The scale was adapted to the Turkish language via backward translation. Content validity was examined by referring to experts. Reliability was examined via test-retest reliability and internal consistency, and validity was examined with divergent and convergent validity. The Epworth Sleepiness Scale (ESS) and the Marlowe-Crowne Social Desirability Scale (MCSDS) were used for divergent validity. As for convergent validity, the Constipation Severity Instrument (CSI) and the Patient Assessment of Constipation Quality of Life Scale (PAC-QOLQ) were utilized. The relationship between the GSRS and the health-related quality of life (36-item short-form health survey [SF-36]) was also analyzed. The study population consisted of patients in orthopedic clinic who volunteered to participate. Test-retest reliability was examined with the participation of 30 patients; internal consistency and validity were examined with 150 patients. Test-retest reliability correlation coefficients of the GSRS varied from 0.39 to 0.87 for all items. For internal consistency, the GSRS's item total correlation was found to be 0.17-0.67, and Cronbach α was 0.82 for all items. There was a positive linear significant correlation between the GSRS, CSI, and PAC-QOLQ. There was no significant correlation between the GSRS, MCSDS, and ESS. Higher GSRS scores inversely correlated with general quality of life (SF-36). The Turkish version of the GSRS has been found to be a reliable and valid instrument for assessing patients' gastrointestinal symptoms. Therefore, this instrument can be confidently used with Turkish individuals.

The internal consistency and concurrent validity of the Hopelessness, Helplessness, and Haplessness Scale in a Turkish clinical sample.

PubMed

Vatan, Sevginar; Lester, David

2008-12-01

The aim of this study was to estimate the concurrent validity of the Hopelessness, Helplessness, and Haplessness Scale developed by Lester (1998). Data were obtained from 75 psychiatric patients. Cronbach alphas ranged from .67 to .90. Scores on the scales were associated with Beck, Weissman, Lester, and Trexler's measure of hopelessness, with the correlation strongest for the new hopelessness scale.

Internal Consistency of Performance Evaluations as a Function of Music Expertise and Excerpt Familiarity

ERIC Educational Resources Information Center

Kinney, Daryl W.

2009-01-01

The purpose of this study was to examine the effects of music experience and excerpt familiarity on the internal consistency of performance evaluations. Participants included nonmusic majors who had not participated in high school music ensembles, nonmusic majors who had participated in high school music ensembles, music majors, and experts…

Validation of the Weight Concerns Scale Applied to Brazilian University Students.

PubMed

Dias, Juliana Chioda Ribeiro; da Silva, Wanderson Roberto; Maroco, João; Campos, Juliana Alvares Duarte Bonini

2015-06-01

The aim of this study was to evaluate the validity and reliability of the Portuguese version of the Weight Concerns Scale (WCS) when applied to Brazilian university students. The scale was completed by 1084 university students from Brazilian public education institutions. A confirmatory factor analysis was conducted. The stability of the model in independent samples was assessed through multigroup analysis, and the invariance was estimated. Convergent, concurrent, divergent, and criterion validities as well as internal consistency were estimated. Results indicated that the one-factor model presented an adequate fit to the sample and values of convergent validity. The concurrent validity with the Body Shape Questionnaire and divergent validity with the Maslach Burnout Inventory for Students were adequate. Internal consistency was adequate, and the factorial structure was invariant in independent subsamples. The results present a simple and short instrument capable of precisely and accurately assessing concerns with weight among Brazilian university students. Copyright © 2015 Elsevier Ltd. All rights reserved.

The relationship between external and internal validity of randomized controlled trials: A sample of hypertension trials from China.

PubMed

Zhang, Xin; Wu, Yuxia; Ren, Pengwei; Liu, Xueting; Kang, Deying

2015-10-30

To explore the relationship between the external validity and the internal validity of hypertension RCTs conducted in China. Comprehensive literature searches were performed in Medline, Embase, Cochrane Central Register of Controlled Trials (CCTR), CBMdisc (Chinese biomedical literature database), CNKI (China National Knowledge Infrastructure/China Academic Journals Full-text Database) and VIP (Chinese scientific journals database) as well as advanced search strategies were used to locate hypertension RCTs. The risk of bias in RCTs was assessed by a modified scale, Jadad scale respectively, and then studies with 3 or more grading scores were included for the purpose of evaluating of external validity. A data extract form including 4 domains and 25 items was used to explore relationship of the external validity and the internal validity. Statistic analyses were performed by using SPSS software, version 21.0 (SPSS, Chicago, IL). 226 hypertension RCTs were included for final analysis. RCTs conducted in university affiliated hospitals (P < 0.001) or secondary/tertiary hospitals (P < 0.001) were scored at higher internal validity. Multi-center studies (median = 4.0, IQR = 2.0) were scored higher internal validity score than single-center studies (median = 3.0, IQR = 1.0) (P < 0.001). Funding-supported trials had better methodological quality (P < 0.001). In addition, the reporting of inclusion criteria also leads to better internal validity (P = 0.004). Multivariate regression indicated sample size, industry-funding, quality of life (QOL) taken as measure and the university affiliated hospital as trial setting had statistical significance (P < 0.001, P < 0.001, P = 0.001, P = 0.006 respectively). Several components relate to the external validity of RCTs do associate with the internal validity, that do not stand in an easy relationship to each other. Regarding the poor reporting, other possible links between two variables need to trace in the

Development and validation of the Hospitality Axiological Scale for Humanization of Nursing Care

PubMed Central

Galán González-Serna, José María; Ferreras-Mencia, Soledad; Arribas-Marín, Juan Manuel

2017-01-01

ABSTRACT Objective: to develop and validate a scale to evaluate nursing attitudes in relation to hospitality for the humanization of nursing care. Participants: the sample consisted of 499 nursing professionals and undergraduate students of the final two years of the Bachelor of Science in Nursing program. Method: the instrument has been developed and validated to evaluate the ethical values related to hospitality using a methodological approach. Subsequently, a model was developed to measure the dimensions forming the construct hospitality. Results: the Axiological Hospitality Scale showed a high internal consistency, with Cronbach’s Alpha=0.901. The validation of the measuring instrument was performed using factorial, exploratory and confirmatory analysis techniques with high goodness of fit measures. Conclusions: the developed instrument showed an adequate validity and a high internal consistency. Based on the consistency of its psychometric properties, it is possible to affirm that the scale provides a reliable measurement of the hospitality. It was also possible to determine the dimensions or sources that embrace it: respect, responsibility, quality and transpersonal care. PMID:28793127

Evaluation of the internal construct validity of the Personal Care Participation Assessment and Resource Tool (PC-PART) using Rasch analysis.

PubMed

Darzins, Susan; Imms, Christine; Di Stefano, Marilyn; Taylor, Nicholas F; Pallant, Julie F

2014-11-05

The Personal Care Participation Assessment and Resource Tool (PC-PART) is a 43-item, clinician-administered assessment, designed to identify patients' unmet needs (participation restrictions) in activities of daily living (ADL) required for community life. This information is important for identifying problems that need addressing to enable, for example, discharge from inpatient settings to community living. The objective of this study was to evaluate internal construct validity of the PC-PART using Rasch methods. Fit to the Rasch model was evaluated for 41 PC-PART items, assessing threshold ordering, overall model fit, individual item fit, person fit, internal consistency, Differential Item Functioning (DIF), targeting of items and dimensionality. Data used in this research were taken from admission data from a randomised controlled trial conducted at two publically funded inpatient rehabilitation units in Melbourne, Australia, with 996 participants (63% women; mean age 74 years) and with various impairment types. PC-PART items assessed as one scale, and original PC-PART domains evaluated as separate scales, demonstrated poor fit to the Rasch model. Adequate fit to the Rasch model was achieved in two newly formed PC-PART scales: Self-Care (16 items) and Domestic Life (14 items). Both scales were unidimensional, had acceptable internal consistency (PSI =0.85, 0.76, respectively) and well-targeted items. Rasch analysis did not support conventional summation of all PC-PART item scores to create a total score. However, internal construct validity of the newly formed PC-PART scales, Self-Care and Domestic Life, was supported. Their Rasch-derived scores provided interval-level measurement enabling summation of scores to form a total score on each scale. These scales may assist clinicians, managers and researchers in rehabilitation settings to assess and measure changes in ADL participation restrictions relevant to community living. Data used in this research were

Reliability and validity of the Bowel Function Index for evaluating opioid-induced constipation: translation, cultural adaptation and validation of the Portuguese version (BFI-P).

PubMed

Dueñas, María; Mendonça, Liliane; Sampaio, Rute; Gouvinhas, Cláudia; Oliveira, Daniela; Castro-Lopes, José Manuel; Azevedo, Luís Filipe

2017-03-01

The Bowel Function Index (BFI) is a simple and sound bowel function and opioid-induced constipation (OIC) screening tool. We aimed to develop the translation and cultural adaptation of this measure (BFI-P) and to assess its reliability and validity for the Portuguese language and a chronic pain population. The BFI-P was created after a process including translation, back translation and cultural adaptation. Participants (n = 226) were recruited in a chronic pain clinic and were assessed at baseline and after one week. Internal consistency, test-retest reliability, responsiveness, construct (convergent and known groups) and factorial validity were assessed. Test-retest reliability had an intra-class correlation of 0.605 for BFI mean score. Internal consistency of BFI had Cronbach's alpha of 0.865. The construct validity of BFI-P was shown to be excellent and the exploratory factor analysis confirmed its unidimensional structure. The responsiveness of BFI-P was excellent, with a suggested 17-19 point and 8-12 point change in score constituting a clinically relevant change in constipation for patients with and without previous constipation, respectively. This study had some limitations, namely, the criterion validity of BFI-P was not directly assessed; and the absence of a direct criterion for OIC precluded the assessment of the criterion based responsiveness of BFI-P. Nevertheless, BFI may importantly contribute to better OIC screening and its Portuguese version (BFI-P) has been shown to have excellent reliability, internal consistency, validity and responsiveness. Further suggestions regarding statistically and clinically important change cut-offs for this instrument are presented.

The Selective Mutism Questionnaire: Measurement Structure and Validity

PubMed Central

Letamendi, Andrea M.; Chavira, Denise A.; Hitchcock, Carla A.; Roesch, Scott C.; Shipon-Blum, Elisa; Stein, Murray B.; Roesch, Scott C.

2010-01-01

Objective To evaluate the factor structure, reliability, and validity of the 17-item Selective Mutism Questionnaire. Method Diagnostic interviews were administered via telephone to 102 parents of children identified with selective mutism (SM) and 43 parents of children without SM from varying U.S. geographic regions. Children were between the ages of 3 and 11 inclusive and comprised 58% girls and 42% boys. SM diagnoses were determined using the Anxiety Disorders Interview Schedule for Children - Parent Version (ADIS-C/P); SM severity was assessed using the 17-item Selective Mutism Questionnaire (SMQ); and behavioral and affective symptoms were assessed using the Child Behavior Checklist (CBCL). An exploratory factor analysis (EFA) was conducted to investigate the dimensionality of the SMQ and a modified parallel analysis procedure was used to confirm EFA results. Internal consistency, construct validity, and incremental validity were also examined. Results The EFA yielded a 13-item solution consisting of three factors: a) Social Situations Outside of School, b) School Situations, and c) Home and Family Situations. Internal consistency of SMQ factors and total scale ranged from moderate to high. Convergent and incremental validity were also well supported. Conclusions Measure structure findings are consistent with the 3-factor solution found in a previous psychometric evaluation of the SMQ. Results also suggest that the SMQ provides useful and unique information in the prediction of SM phenomenon beyond other child anxiety measures. PMID:18698268

Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reidunsdatter, Randi J.; Lund, Jo-Asmund; Department of Oncology, St. Olavs University Hospital, Trondheim

Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales weremore » constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.« less

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents

PubMed Central

Garcia-Lopez, LuisJoaquín; Moore, Harry T. A.

2015-01-01

Objectives Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. Methods The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Results Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Conclusions Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided. PMID:26317695

Validation of the Walking Impairment Questionnaire for Spanish patients.

PubMed

Lozano, Francisco S; March, José R; González-Porras, José R; Carrasco, Eduardo; Lobos, José M; Areitio-Aurtena, Alix

2013-09-01

The Walking Impairment Questionnaire (WIQ) is a short, easy to complete, disease-specific questionnaire to assess intermittent claudication. A Spanish version of the WIQ for Hispanic Americans has recently been validated in Texas, but it needs to be validated for European Spanish people. After translation and cultural adaptation of the WIQ, 920 patients with intermittent claudication (ankle brachial index < 0.9) completed two questionnaires (Spanish version of the WIQ and European Quality of Life 5 Dimension [EQ-5D]). The validity of the WIQ was determined by correlating WIQ and EQ-5D. Test-retest reliability and internal consistency were determined using the intra-class correlation coefficient (ICC) and Cronbach's alpha, respectively. The three domains of the WIQ were moderately correlated with the EQ-5D health outcome (r = 0.54 to 0.60; p < 0.001). Test-retest reliabilities ranged from ICC = 0.89 to 0.91 and internal consistency (Cronbach's alpha = 0.92) was high. The Spanish version of the WIQ for European Spanish patients was valid and reproducible, suggesting that it could be used in Spanish patients with intermittent claudication.

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

International physical activity questionnaire: reliability and validity of the Turkish version.

PubMed

Saglam, Melda; Arikan, Hulya; Savci, Sema; Inal-Ince, Deniz; Bosnak-Guclu, Meral; Karabulut, Erdem; Tokgozoglu, Lale

2010-08-01

Physical inactivity is a global problem which is related to many chronic health disorders. Physical activity scales which allow cross-cultural comparisons have been developed. The goal was to assess the reliability and validity of a Turkish version of the International Physical Activity Questionnaire (IPAQ). 1,097 university students (721 women, 376 men; ages 18-32) volunteered. Short and long forms of the IPAQ gave good agreement and comparable 1-wk. test-retest reliabilities. Caltrac accelerometer data were compared with IPAQ scores in 80 participants with good agreement for short and long forms. Turkish versions of the IPAQ short and long forms are reliable and valid in assessment of physical activity.

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Development and Validation of the International Baccalaureate Learner Profile Questionnaire (IBLPQ)

ERIC Educational Resources Information Center

Walker, Allan; Lee, Moosung; Bryant, Darren A.

2016-01-01

The Learner Profile (LP) frames International Baccalaureate (IB) learning outcomes across the three programme levels and, as such, plays a key role in measuring the success of the rapidly growing number of IB schools in the Asia-Pacific Region. Our aim was to develop an instrument to measure the IBLP and validate the instrument through a series of…

Validation study of the Japanese version of the Obsessive-Compulsive Drinking Scale.

PubMed

Tatsuzawa, Yasutaka; Yoshimasu, Haruo; Moriyama, Yasushi; Furusawa, Teruyuki; Yoshino, Aihide

2002-02-01

The Obsessive-Compulsive Drinking Scale (OCDS) is a self-rating questionnaire that measures cognitive and behavioral aspects of craving for alcohol. The OCDS consists of two subscales: the obsessive thoughts of drinking subscale (OS) and the compulsive drinking subscale (CS). This study aims to validate the Japanese version of the OCDS. First, internal consistency and discriminant validity were evaluated. Second, a prospective longitudinal 3-month outcome study of 67 patients with alcohol dependence who participated in a relapse prevention program was designed to assess the concurrent and predictive validity of the OCDS. The OCDS demonstrated high internal consistency. The OS had high discriminant validity, while the CS did not. Twenty-three patients (34.3%) dropped out of treatment. These patients had significantly higher OS scores than those who completed the program. At 3 months, the relapse group had significantly higher OCDS scores than the no relapse group. Also, the OCDS score was higher in subjects who had early-onset alcohol dependence than late-onset dependence. The OCDS is useful for evaluating cognitive aspect of craving and predicts dropout and relapse.

Validity of three clinical performance assessments of internal medicine clerks.

PubMed

Hull, A L; Hodder, S; Berger, B; Ginsberg, D; Lindheim, N; Quan, J; Kleinhenz, M E

1995-06-01

To analyze the construct validity of three methods to assess the clinical performances of internal medicine clerks. A multitrait-multimethod (MTMM) study was conducted at the Case Western Reserve University School of Medicine to determine the convergent and divergent validity of a clinical evaluation form (CEF) completed by faculty and residents, an objective structured clinical examination (OSCE), and the medicine subject test of the National Board of Medical Examiners. Three traits were involved in the analysis: clinical skills, knowledge, and personal characteristics. A correlation matrix was computed for 410 third-year students who completed the clerkship between August 1988 and July 1991. There was a significant (p < .01) convergence of the four correlations that assessed the same traits by using different methods. However, the four convergent correlations were of moderate magnitude (ranging from .29 to .47). Divergent validity was assessed by comparing the magnitudes of the convergence correlations with the magnitudes of correlations among unrelated assessments (i.e., different traits by different methods). Seven of nine possible coefficients were smaller than the convergent coefficients, suggesting evidence of divergent validity. A significant CEF method effect was identified. There was convergent validity and some evidence of divergent validity with a significant method effect. The findings were similar for correlations corrected for attenuation. Four conclusions were reached: (1) the reliability of the OSCE must be improved, (2) the CEF ratings must be redesigned to further discriminate among the specific traits assessed, (3) additional methods to assess personal characteristics must be instituted, and (4) several assessment methods should be used to evaluate individual student performances.

Brazilian Portuguese version of the Revised Fibromyalgia Impact Questionnaire (FIQR-Br): cross-cultural validation, reliability, and construct and structural validation.

PubMed

Lupi, Jaqueline Basilio; Carvalho de Abreu, Daniela Cristina; Ferreira, Mariana Candido; Oliveira, Renê Donizeti Ribeiro de; Chaves, Thais Cristina

2017-08-01

This study aimed to culturally adapt and validate the Revised Fibromyalgia Impact Questionnaire (FIQR) to Brazilian Portuguese, by the use of analysis of internal consistency, reliability, and construct and structural validity. A total of 100 female patients with fibromyalgia participated in the validation process of the Brazilian Portuguese version of the FIQR (FIQR-Br).The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Pearson's rank correlation for construct validity, and confirmatory factor analysis (CFA) for structural validity. It was verified excellent levels of reliability, with ICC greater than 0.75 for all questions and domains of the FIQR-Br. For internal consistency, alpha values greater than 0.70 for the items and domains of the questionnaire were observed. Moderate (0.40 < r < 0.70) and strong (r > 0.70) correlations were observed for the scores of domains and total score between the FIQR-Br and FIQ-Br. The structure of the three domains of the FIQR-Br was confirmed by CFA. The results of this study suggest that that the FIQR-Br is a reliable and valid instrument for assessing fibromyalgia-related impact, and supports its use in clinical settings and research. The structure of the three domains of the FIQR-Br was also confirmed. Implications for Rehabilitation Fibromyalgia is a chronic musculoskeletal disorder characterized by widespread and diffuse pain, fatigue, sleep disturbances, and depression. The disease significantly impairs patients' quality of life and can be highly disabling. To be used in multicenter research efforts, the Revised Fibromyalgia Impact Questionnaire (FIQR) must be cross-culturally validated and psychometrically tested. This paper will make available a new version of the FIQR-Br since another version already exists, but there are concerns about its measurement properties. The availability of an instrument adapted to

Arabic validation of the Urogenital Distress Inventory and Adapted Incontinence Impact Questionnaires--short forms.

PubMed

El-Azab, Ahmed S; Mascha, Edward J

2009-01-01

The purpose of this study was to adapt the IIQ-7 to suit the Egyptian culture and then to assess validity and reliability of the adapted and translated IIQ-7 and UDI-6. IIQ-7 was modified to suit Egyptian culture. Linguistic validation of the two questionnaires was done. Initial test-retest reliability and internal consistency of adapted translated questionnaires were done in a pilot study. The final validity, test-retest reliability and internal consistency study included 204 women with urinary incontinence (UI). Participants completed the two questionnaires at enrollment and after 2 weeks. All participants underwent urodynamics. Baseline urodynamic diagnosis was compared with diagnoses made by questionnaires to assess validity. Test-retest reliability was excellent for both the IIQ-7 and UDI-6. For the UDI-6, the mean difference (SD) between first and second visits was -1.63 (7.0), and the 95% CI for the mean difference was -2.6 and -0.68. The 95% limits of agreement were -15.3 and 12.0. Lin's concordance correlation coefficient (LCCC) (95% CI) for the UDI was 0.89 (0.85 and 0.91). For the IIQ-7, the mean difference (SD) was 0.37 (7.1), and the 95% CI for the mean difference was -0.60 and 1.3. The 95% limits of agreement were -13.5 and 14.2. LCCC (95% CI) for the IIQ was 0.90 (0.87 and 0.92). Internal consistency as assessed using Cronbach's alpha was 0.32 and 0.31 for the UDI-6 and IIQ-7, respectively. Validity assessments indicated that both IIQ and UDI scales can distinguish objective disease states. UDI-6 and the modified IIQ-7 are easy to administer, test-retest reliable, and valid questionnaires, with relatively low internal consistency. (c) 2008 Wiley-Liss, Inc.

Factor Structure, Internal Consistency, and Screening Sensitivity of the GARS-2 in a Developmental Disabilities Sample

PubMed Central

Volker, Martin A.; Dua, Elissa H.; Lopata, Christopher; Thomeer, Marcus L.; Toomey, Jennifer A.; Smerbeck, Audrey M.; Rodgers, Jonathan D.; Popkin, Joshua R.; Nelson, Andrew T.; Lee, Gloria K.

2016-01-01

The Gilliam Autism Rating Scale-Second Edition (GARS-2) is a widely used screening instrument that assists in the identification and diagnosis of autism. The purpose of this study was to examine the factor structure, internal consistency, and screening sensitivity of the GARS-2 using ratings from special education teaching staff for a sample of 240 individuals with autism or other significant developmental disabilities. Exploratory factor analysis yielded a correlated three-factor solution similar to that found in 2005 by Lecavalier for the original GARS. Though the three factors appeared to be reasonably consistent with the intended constructs of the three GARS-2 subscales, the analysis indicated that more than a third of the GARS-2 items were assigned to the wrong subscale. Internal consistency estimates met or exceeded standards for screening and were generally higher than those in previous studies. Screening sensitivity was .65 and specificity was .81 for the Autism Index using a cut score of 85. Based on these findings, recommendations are made for instrument revision. PMID:26981279

Validation of Bengali perceived stress scale among LGBT population.

PubMed

Mozumder, Muhammad Kamruzzaman

2017-08-29

Lesbian, gay, bisexual and transgender (LGBT) population encounter more stressful life circumstances compared to general population. Perceived Stress Scale (PSS) can be a useful tool for measuring their stress. However, psychometric properties of PSS have never been tested on LGBT population. This cross sectional study employed a two-stage sampling strategy to collect data from 296 LGBT participants from six divisional districts of Bangladesh. Exploratory (EFA) and confirmatory factor analysis (CFA) were carried out on PSS 10 along with analysis of reliability and validity. EFA revealed a two-factor structure of PSS for LGBT population explaining 43.55% - 51.45% of total variance. This measurement model was supported by multiple fit indices during CFA. Acceptable Cronbach's alpha indicated internal consistency reliability and high correlations with Self Reporting Questionnaire 20 demonstrated construct validity of PSS 10 for LGBT population. This study provided evidence of satisfactory psychometric properties of Bengali PSS 10 in terms of factor structure, internal consistency and validity among LGBT population.

[Validation of the German version of the Oxford Elbow Score : A cross-sectional study].

PubMed

Marquardt, J; Schöttker-Königer, T; Schäfer, A

2016-08-01

Elbow complaints are complex problems leading to severe consequences for affected people and the healthcare system. The German version of the Oxford Elbow Score (OES) is the first German-speaking instrument that specifically measures elbow complaints from the patient's perspective and changes of their health status. The aim of this study is the validation of the German version of the OES. In this context the internal consistency and the construct validity were investigated. 59 patients with elbow complaints completed the German version of the OES, the DASH and the SF-36 in a cross-sectional study. The internal consistency was calculated with Cronbach's alpha coefficients. Spearman's correlation coefficients were used to confirm construct validity. Cronbach's alpha for pain, function and psychological subscales was 0.88, 0.81 and 0.90, respectively. The whole questionnaire presents a Cronbach's alpha value of 0.93. Convergent construct validity was confirmed with correlation coefficients containing values of -0.84, -0.77 and -0.82 compared to DASH and values ranging from 0.41 to 0.80 compared with the physical domains of the SF-36. The divergent construct validity presented values ranging from 0.07 to 0.20 with the SF-36 domains of "general health perception" and "mental health". The German OES is an internal consistent instrument with good convergent and divergent construct validity. Other aspects of the validity, the reliability and the responsiveness should be confirmed through further studies.

Validation of Portuguese version of Quality of Erection Questionnaire (QEQ) and comparison to International Index of Erectile Function (IIEF) and RAND 36-Item Health Survey

PubMed Central

Reis, Ana Luiza; Reis, Leonardo Oliveira; Saade, Ricardo Destro; Santos, Carlos Alberto; de Lima, Marcelo Lopes; Fregonesi, Adriano

2015-01-01

Purpose To validate the Quality of Erection Questionnaire (QEQ) considering Brazilian social-cultural aspects. Materials and Methods To determine equivalence between the Portuguese and the English QEQ versions, the Portuguese version was back-translated by two professors who are native English speakers. After language equivalence had been determined, urologists considered the QEQ Portuguese version suitable. Men with self-reported erectile dysfunction (ED) and infertile men who had a stable sexual relationship for at least 6 months were invited to answer the QEQ, the International Index of Erectile Function (IIEF) and the RAND 36-Item Health Survey (RAND-36). The questionnaires were presented together and answered without help in a private room. Internal consistency (Cronbach’s α), test-retest reliability (Spearman), convergent validity (Spearman correlation) coefficients and known-groups validity (the ability of the QEQ Portuguese version to differentiate erectile dysfunction severity groups) were assessed. Results We recruited 197 men (167 ED patients and 30 non-ED patients), mean age of 53.3 and median of 55.5 years (23-82 years). The Portuguese version of the QEQ had high internal consistency (Cronbach α=0.93), high stability between test and retest (ICC 0.83, with IC 95%: 0.76-0.88, p<0.001) and Spearman correlation coefficient r=0.82 (p<0.001), which demonstrated the high correlation between the QEQ and IIEF results. The correlations between the QEQ and RAND-36 were significantly low in ED (r=0.20, p=0.01) and non-ED patients (r=0.37, p=0.04). Conclusion The QEQ Portuguese version presented good psychometric properties and high convergent validity in relation to IIEF. The low correlations between the QEQ and the RAND-36, as well as between the IIEF and the RAND-36 indicated IIEF and QEQ specificity, which may have resulted from the patients’ psychological adaptations that minimized the impact of ED on Quality of Life (QoL) and reestablished the well

Design and validation of a consistent and reproducible manufacture process for the production of clinical-grade bone marrow-derived multipotent mesenchymal stromal cells.

PubMed

Codinach, Margarita; Blanco, Margarita; Ortega, Isabel; Lloret, Mireia; Reales, Laura; Coca, Maria Isabel; Torrents, Sílvia; Doral, Manel; Oliver-Vila, Irene; Requena-Montero, Miriam; Vives, Joaquim; Garcia-López, Joan

2016-09-01

Multipotent mesenchymal stromal cells (MSC) have achieved a notable prominence in the field of regenerative medicine, despite the lack of common standards in the production processes and suitable quality controls compatible with Good Manufacturing Practice (GMP). Herein we describe the design of a bioprocess for bone marrow (BM)-derived MSC isolation and expansion, its validation and production of 48 consecutive batches for clinical use. BM samples were collected from the iliac crest of patients for autologous therapy. Manufacturing procedures included: (i) isolation of nucleated cells (NC) by automated density-gradient centrifugation and plating; (ii) trypsinization and expansion of secondary cultures; and (iii) harvest and formulation of a suspension containing 40 ± 10 × 10(6) viable cells. Quality controls were defined as: (i) cell count and viability assessment; (ii) immunophenotype; and (iii) sterility tests, Mycoplasma detection, endotoxin test and Gram staining. A 3-week manufacturing bioprocess was first designed and then validated in 3 consecutive mock productions, prior to producing 48 batches of BM-MSC for clinical use. Validation included the assessment of MSC identity and genetic stability. Regarding production, 139.0 ± 17.8 mL of BM containing 2.53 ± 0.92 × 10(9) viable NC were used as starting material, yielding 38.8 ± 5.3 × 10(6) viable cells in the final product. Surface antigen expression was consistent with the expected phenotype for MSC, displaying high levels of CD73, CD90 and CD105, lack of expression of CD31 and CD45 and low levels of HLA-DR. Tests for sterility, Mycoplasma, Gram staining and endotoxin had negative results in all cases. Herein we demonstrated the establishment of a feasible, consistent and reproducible bioprocess for the production of safe BM-derived MSC for clinical use. Copyright © 2016 International Society for Cellular Therapy. Published by Elsevier Inc. All rights reserved.

Validity and reliability of Arabic MOS social support survey.

PubMed

Dafaalla, Mohamed; Farah, Abdulraheem; Bashir, Sheima; Khalil, Ammar; Abdulhamid, Rabab; Mokhtar, Mousab; Mahadi, Mohamed; Omer, Zulfa; Suliman, Asgad; Elkhalifa, Mohammed; Abdelgadir, Hanin; Kheir, Abdelmoneim E M; Abdalrahman, Ihab

2016-01-01

We aimed to generate a valid reliable Arabic version of MOS social support survey (MOS-SSS). We did a cross sectional study in medical students of Faculty of Medicine in Khartoum, Sudan. We did a clustered random sampling in 500 students of which 487 were suitable for analysis. We followed the standard translation process for translating the MOS-SSS. We accomplished factor analysis to assess construct validity, and generated item-scales correlations to evaluate the convergent and discriminant validity. We extracted the Cronbach's α and Spearman Brown coefficient of spit half method to determine internal consistency. We measured stability by correlation between the scores of the MOS survey taken at two different occasions with ten days apart in 252 participants. All items correlated highly (0.788 or greater) with their hypothesized scales. All items in subscales correlated higher by two standard errors with their own scale than with any other scale. Principle component analysis with varimax rotation was conducted on the 19 items and examination of scree plot graphically suggested 4 predominant factors that account for 72 % of variance. It showed high loadings, ranging from 0.720 to 0.84 for items of emotional support, 0.699-0.845 for tangible support, 0.518-0.823 for affectionate support, and 0.740-0.816 for positive social interaction. Cronbach's alpha for overall MOS scale and subscales indicated high internal consistency. The test-retest correlation showed weak correlation between the test and retest (ranges from 0.04 to 0.104). The Arabic MOS-SSS had high validity and internal consistency.

Validation of the Spanish version of the Index of Spouse Abuse.

PubMed

Plazaola-Castaño, Juncal; Ruiz-Pérez, Isabel; Escribà-Agüir, Vicenta; Jiménez-Martín, Juan Manuel; Hernández-Torres, Elisa

2009-04-01

Partner violence against women is a major public health problem. Although there are currently a number of validated screening and diagnostic tools that can be used to evaluate this type of violence, such tools are not available in Spain. The aim of this study is to analyze the validity and reliability of the Spanish version of the Index of Spouse Abuse (ISA). A cross-sectional study was carried out in 2005 in two health centers in Granada, Spain, in 390 women between 18 and 70 years old. Analyses of the factorial structure, internal consistency, test-retest reliability, and construct validity were conducted. Cutoff points for each subscale were also defined. For the construct validity analysis, the SF-36 perceived general health dimension, the Rosenberg Self-Esteem Scale and the Goldberg 12-item General Health Questionnaire were included. The psychometric analysis shows that the instrument has good internal consistency, reproducibility, and construct validity. The scale is useful for the analysis of partner violence against women in both a research setting and a healthcare setting.

Construct Validation of the Piers-Harris Children's Self Concept Scale.

ERIC Educational Resources Information Center

Franklin, Melvin R., Jr.; And Others

1981-01-01

Results indicated that the Piers-Harris Children's Self Concept Scale demonstrates both convergent and discriminant validity in an assessment of a relatively stable and internally consistent construct. (Author/BW)

Development and Validation of a Spanish Version of the Grit-S Scale

PubMed Central

Arco-Tirado, Jose L.; Fernández-Martín, Francisco D.; Hoyle, Rick H.

2018-01-01

This paper describes the development and initial validation of a Spanish version of the Short Grit (Grit-S) Scale. The Grit-S Scale was adapted and translated into Spanish using the Translation, Review, Adjudication, Pre-testing, and Documentation model and responses to a preliminary set of items from a large sample of university students (N = 1,129). The resultant measure was validated using data from a large stratified random sample of young adults (N = 1,826). Initial validation involved evaluating the internal consistency of the adapted scale and its subscales and comparing the factor structure of the adapted version to that of the original scale. The results were comparable to results from similar analyses of the English version of the scale. Although the internal consistency of the subscales was low, the internal consistency of the full scale was well-within the acceptable range. A two-factor model offered an acceptable account of the data; however, when a single correlated error involving two highly similar items was included, a single factor model fit the data very well. The results support the use of overall scores from the Spanish Grit-S Scale in future research. PMID:29467705

SU-C-BRF-05: Design and Geometric Validation of An Externally and Internally Deformable, Programmable Lung Motion Phantom

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cheung, Y; Sawant, A

Purpose: Most clinically-deployed strategies for respiratory motion management in lung radiotherapy (e.g., gating, tracking) use external markers that serve as surrogates for tumor motion. However, typical lung phantoms used to validate these strategies are rigid-exterior+rigid-interior or rigid-exterior+deformable-interior. Neither class adequately represents the human anatomy, which is deformable internally as well as externally. We describe the construction and experimental validation of a more realistic, externally- and internally-deformable, programmable lung phantom. Methods: The outer shell of a commercially-available lung phantom (RS- 1500, RSD Inc.) was used. The shell consists of a chest cavity with a flexible anterior surface, and embedded vertebrae, rib-cagemore » and sternum. A 3-axis platform was programmed with sinusoidal and six patient-recorded lung tumor trajectories. The platform was used to drive a rigid foam ‘diaphragm’ that compressed/decompressed the phantom interior. Experimental characterization comprised of mapping the superior-inferior (SI) and anterior-posterior (AP) trajectories of external and internal radioopaque markers with kV x-ray fluoroscopy and correlating these with optical surface monitoring using the in-room VisionRT system. Results: The phantom correctly reproduced the programmed motion as well as realistic effects such as hysteresis. The reproducibility of marker trajectories over multiple runs for sinusoidal as well as patient traces, as characterized by fluoroscopy, was within 0.4 mm RMS error for internal as well as external markers. The motion trajectories of internal and external markers as measured by fluoroscopy were found to be highly correlated (R=0.97). Furthermore, motion trajectories of arbitrary points on the deforming phantom surface, as recorded by the VisionRT system also showed a high correlation with respect to the fluoroscopically-measured trajectories of internal markers (R=0.92). Conclusion: We

The Koukopoulos Mixed Depression Rating Scale (KMDRS): An International Mood Network (IMN) validation study of a new mixed mood rating scale.

PubMed

Sani, Gabriele; Vöhringer, Paul A; Barroilhet, Sergio A; Koukopoulos, Alexia E; Ghaemi, S Nassir

2018-05-01

It has been proposed that the broad major depressive disorder (MDD) construct is heterogenous. Koukopoulos has provided diagnostic criteria for an important subtype within that construct, "mixed depression" (MxD), which encompasses clinical pictures characterized by marked psychomotor or inner excitation and rage/anger, along with severe depression. This study provides psychometric validation for the first rating scale specifically designed to assess MxD symptoms cross-sectionally, the Koukopoulos Mixed Depression Rating Scale (KMDRS). 350 patients from the international mood network (IMN) completed three rating scales: the KMDRS, Montgomery-Asberg Depression Rating Scale (MADRS) and Young Mania Rating Scale (YMRS). KMDRS' psychometric properties assessed included Cronbach's alpha, inter-rater reliability, factor analysis, predictive validity, and Receiver Operator Curve analysis. Internal consistency (Cronbach's alpha = 0.76; 95% CI 0.57, 0.94) and interrater reliability (kappa = 0.73) were adequate. Confirmatory factor analysis identified 2 components: anger and psychomotor excitation (80% of total variance). Good predictive validity was seen (C-statistic = 0.82 95% CI 0.68, 0.93). Severity cut-off scores identified were as follows: none (0-4), possible (5-9), mild (10-15), moderate (16-20) and severe (> 21) MxD. Non DSM-based diagnosis of MxD may pose some difficulties in the initial use and interpretation of the scoring of the scale. Moreover, the cross-sectional nature of the evaluation does not verify the long-term stability of the scale. KMDRS was a reliable and valid instrument to assess MxD symptoms. Copyright © 2018 Elsevier B.V. All rights reserved.

Consistent Measurement and Physical Character of the DSD: Disdrometer to Satellite

NASA Technical Reports Server (NTRS)

Petersen, Walt; Thurai, Merhala; Gatlin, Patrick; Tokay, Ali; Morris, Bob; Wolff, David; Pippitt, Jason; Marks, David; Berendes, Todd

2017-01-01

Objective: Validate GPM (Global Precipitation Measurement) Drop Size Distribution Retrievals: Drop size distributions (DSD) are critical to GPM DPR (Dual-frequency Precipitation Radar)-based rainfall retrievals; NASA GPM Science Requirements stipulate that the GPM Core observatory radar estimation of D (sub m) (mean diameter) shall be within plus or minus 0.5 millimeters of GV (Ground Validation); GV translates disdrometer measurements to polarimetric radar-based DSD and precipitation type retrievals (e.g., convective vs. stratiform (C/S)) for coincident match-up to GPM core overpasses; How well do we meet the requirement across product versions, rain types (e.g., C/S partitioning), and rain rates (heavy, light) and is behavior physically and internally consistent?

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for the detection of genotoxic carcinogens: I. Summary of pre-validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Burlinson, Brian; Escobar, Patricia A; Kraynak, Andrew R; Nakagawa, Yuzuki; Nakajima, Madoka; Pant, Kamala; Asano, Norihide; Lovell, David; Morita, Takeshi; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this validation effort was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The purpose of the pre-validation studies (i.e., Phase 1 through 3), conducted in four or five laboratories with extensive comet assay experience, was to optimize the protocol to be used during the definitive validation study. Copyright © 2015 Elsevier B.V. All rights reserved.

Standardization, evaluation and early-phase method validation of an analytical scheme for batch-consistency N-glycosylation analysis of recombinant produced glycoproteins.

PubMed

Zietze, Stefan; Müller, Rainer H; Brecht, René

2008-03-01

In order to set up a batch-to-batch-consistency analytical scheme for N-glycosylation analysis, several sample preparation steps including enzyme digestions and fluorophore labelling and two HPLC-methods were established. The whole method scheme was standardized, evaluated and validated according to the requirements on analytical testing in early clinical drug development by usage of a recombinant produced reference glycoprotein (RGP). The standardization of the methods was performed by clearly defined standard operation procedures. During evaluation of the methods, the major interest was in the loss determination of oligosaccharides within the analytical scheme. Validation of the methods was performed with respect to specificity, linearity, repeatability, LOD and LOQ. Due to the fact that reference N-glycan standards were not available, a statistical approach was chosen to derive accuracy from the linearity data. After finishing the validation procedure, defined limits for method variability could be calculated and differences observed in consistency analysis could be separated into significant and incidental ones.

The Utrecht questionnaire (U-CEP) measuring knowledge on clinical epidemiology proved to be valid.

PubMed

Kortekaas, Marlous F; Bartelink, Marie-Louise E L; de Groot, Esther; Korving, Helen; de Wit, Niek J; Grobbee, Diederick E; Hoes, Arno W

2017-02-01

Knowledge on clinical epidemiology is crucial to practice evidence-based medicine. We describe the development and validation of the Utrecht questionnaire on knowledge on Clinical epidemiology for Evidence-based Practice (U-CEP); an assessment tool to be used in the training of clinicians. The U-CEP was developed in two formats: two sets of 25 questions and a combined set of 50. The validation was performed among postgraduate general practice (GP) trainees, hospital trainees, GP supervisors, and experts. Internal consistency, internal reliability (item-total correlation), item discrimination index, item difficulty, content validity, construct validity, responsiveness, test-retest reliability, and feasibility were assessed. The questionnaire was externally validated. Internal consistency was good with a Cronbach alpha of 0.8. The median item-total correlation and mean item discrimination index were satisfactory. Both sets were perceived as relevant to clinical practice. Construct validity was good. Both sets were responsive but failed on test-retest reliability. One set took 24 minutes and the other 33 minutes to complete, on average. External GP trainees had comparable results. The U-CEP is a valid questionnaire to assess knowledge on clinical epidemiology, which is a prerequisite for practicing evidence-based medicine in daily clinical practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Community validation of the IDEA study cognitive screen in rural Tanzania.

PubMed

Gray, William K; Paddick, Stella Maria; Collingwood, Cecilia; Kisoli, Aloyce; Mbowe, Godfrey; Mkenda, Sarah; Lissu, Carolyn; Rogathi, Jane; Kissima, John; Walker, Richard W; Mushi, Declare; Chaote, Paul; Ogunniyi, Adesola; Dotchin, Catherine L

2016-11-01

The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly because of difficulties in screening for cognitive impairment in the community. As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, we aimed to validate the IDEA cognitive screen in a community-based sample in rural Tanzania METHODS: Study participants were recruited from people who attended screening days held in villages within the rural Hai district of Tanzania. Criterion validity was assessed against the gold standard clinical dementia diagnosis using DSM-IV criteria. Construct validity was assessed against, age, education, sex and grip strength and instrumental activities of daily living (IADLs). Internal consistency and floor and ceiling effects were also examined. During community screening, the IDEA cognitive screen had high criterion validity, with an area under the receiver operating characteristic curve of 0.855 (95% CI 0.794 to 0.915). Higher scores on the screen were significantly correlated with lower age, male sex, having attended school, better grip strength and improved performance in activities of daily living. Factor analysis revealed a single factor with an eigenvalue greater than one, although internal consistency was only moderate (Cronbach's alpha = 0.534). The IDEA cognitive screen had high criterion and construct validity and is suitable for use as a cognitive screening instrument in a community setting in SSA. Only moderate internal consistency may partly reflect the multi-domain nature of dementia as diagnosed clinically. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Reliability and Validity of the Lichtenberg Financial Decision Screening Scale.

PubMed

Lichtenberg, Peter A; Teresi, Jeanne A; Ocepek-Welikson, Katja; Eimicke, Joseph P

2017-03-01

The scarcity of empirically validated assessment instruments continues to impede the work of professionals in a number of fields, including medicine, finance, and estate planning; adult protective services; and criminal justice-and, more importantly, it impedes their ability to effectively assist and, in some case, protect their clients. Other professionals (e.g. legal, financial, medical, mental health services) are in a position to prevent financial exploitation and would benefit from access to new instruments. The Lichtenberg Financial Decision Screening Scale (LFDSS) was introduced in 2016, along with evidence for its convergent validity (Lichtenberg et al., 2016). Using a sample of 213 participants, this study investigated the internal consistency of the LFDSS and its criterion validity based on ratings by professionals using the scale. Results demonstrate that the LFDSS has excellent internal consistency and clinical utility properties. This paper provides support for use of the LFDSS as a reliable and valid instrument. The LFDSS and instructions for its use are included in the article, along with information about online tools and support.

Reliability and validity of the de Morton Mobility Index in individuals with sub-acute stroke.

PubMed

Braun, Tobias; Marks, Detlef; Thiel, Christian; Grüneberg, Christian

2018-02-04

To establish the validity and reliability of the de Morton Mobility Index (DEMMI) in patients with sub-acute stroke. This cross-sectional study was performed in a neurological rehabilitation hospital. We assessed unidimensionality, construct validity, internal consistency reliability, inter-rater reliability, minimal detectable change and possible floor and ceiling effects of the DEMMI in adult patients with sub-acute stroke. The study included a total sample of 121 patients with sub-acute stroke. We analysed validity (n = 109) and reliability (n = 51) in two sub-samples. Rasch analysis indicated unidimensionality with an overall fit to the model (chi-square = 12.37, p = 0.577). All hypotheses on construct validity were confirmed. Internal consistency reliability (Cronbach's alpha = 0.94) and inter-rater reliability (intraclass correlation coefficient = 0.95; 95% confidence interval: 0.92-0.97) were excellent. The minimal detectable change with 90% confidence was 13 points. No floor or ceiling effects were evident. These results indicate unidimensionality, sufficient internal consistency reliability, inter-rater reliability, and construct validity of the DEMMI in patients with a sub-acute stroke. Advantages of the DEMMI in clinical application are the short administration time, no need for special equipment and interval level data. The de Morton Mobility Index, therefore, may be a useful performance-based bedside test to measure mobility in individuals with a sub-acute stroke across the whole mobility spectrum. Implications for Rehabilitation The de Morton Mobility Index (DEMMI) is an unidimensional measurement instrument of mobility in individuals with sub-acute stroke. The DEMMI has excellent internal consistency and inter-rater reliability, and sufficient construct validity. The minimal detectable change of the DEMMI with 90% confidence in stroke rehabilitation is 13 points. The lack of any floor or ceiling effects on hospital admission indicates

The Riso-Hudson Enneagram Type Indicator: Estimates of Reliability and Validity

ERIC Educational Resources Information Center

Newgent, Rebecca A.; Parr, Patricia E.; Newman, Isadore; Higgins, Kristin K.

2004-01-01

This investigation was conducted to estimate the reliability and validity of scores on the Riso-Hudson Enneagram Type Indicator (D. R. Riso & R. Hudson, 1999a). Results of 287 participants were analyzed. Alpha suggests an adequate degree of internal consistency. Evidence provides mixed support for construct validity using correlational and…

Discriminative and Criterion Validity of the Autism Spectrum Identity Scale (ASIS)

ERIC Educational Resources Information Center

McDonald, T. A. M.

2017-01-01

Individuals on the autism spectrum face stigma that can influence identity development. Previous research on the 22-item Autism Spectrum Identity Scale (ASIS) reported a four-factor structure with strong split-sample cross-validation and good internal consistency. This study reports the discriminative and criterion validity of the ASIS with other…

Validation of a global scale to assess the quality of interprofessional teamwork in mental health settings.

PubMed

Tomizawa, Ryoko; Yamano, Mayumi; Osako, Mitue; Hirabayashi, Naotugu; Oshima, Nobuo; Sigeta, Masahiro; Reeves, Scott

2017-12-01

Few scales currently exist to assess the quality of interprofessional teamwork through team members' perceptions of working together in mental health settings. The purpose of this study was to revise and validate an interprofessional scale to assess the quality of teamwork in inpatient psychiatric units and to use it multi-nationally. A literature review was undertaken to identify evaluative teamwork tools and develop an additional 12 items to ensure a broad global focus. Focus group discussions considered adaptation to different care systems using subjective judgements from 11 participants in a pre-test of items. Data quality, construct validity, reproducibility, and internal consistency were investigated in the survey using an international comparative design. Exploratory factor analysis yielded five factors with 21 items: 'patient/community centred care', 'collaborative communication', 'interprofessional conflict', 'role clarification', and 'environment'. High overall internal consistency, reproducibility, adequate face validity, and reasonable construct validity were shown in the USA and Japan. The revised Collaborative Practice Assessment Tool (CPAT) is a valid measure to assess the quality of interprofessional teamwork in psychiatry and identifies the best strategies to improve team performance. Furthermore, the revised scale will generate more rigorous evidence for collaborative practice in psychiatry internationally.

Validation of the King's Sarcoidosis Questionnaire (KSQ) in a Dutch sarcoidosis population.

PubMed

Van Manen, Mirjam J G; Wapenaar, Monique; Strookappe, Bert; Drent, Marjolein; Elfferich, Marjon; de Vries, Jolanda; Gosker, Harry R; Birring, Surinder S; Patel, Amit S; van den Toorn, Leon; van den Blink, Bernt; Boomars, Karin; Hoitsma, Elske; Wijsenbeek, Marlies S

2016-03-29

The King's Sarcoidosis Questionnaire (KSQ) is a brief questionnaire assessing health status using five modules (General Health Status, Lung, Eyes, Skin, Medication) in patients with sarcoidosis. The KSQ was only validated in one English sarcoidosis cohort. The aim of this study was to validate the KSQ in a Dutch sarcoidosis population. The KSQ was translated according to international guidelines and tested in interviews with patients. Consecutive outpatients completed multiple questionnaires twice, two weeks apart. Construct validity, internal consistency and repeatability were determined. Of the 98 patients included 85 had lung, 22 skin and 24 eye disease. There was good construct validity of the KSQ General Health Status module against the World Health Organization Quality of Life-BREF questionnaire. The Medication module correlated weak to moderate with most questionnaires. The correlations with organ-specific questionnaires varied from strong for Eyes (r=0.75), Skin (r=-0.62) to moderate for Lung (r=-0.45 with MRC breathlessness scale). Internal consistency was good for all KSQ modules (Cronbach's α 0.72-0.93). Intraclass correlation coefficients (0.70-0.90) and Bland-Altman plots showed good repeatability of the KSQ. The Dutch KSQ is the first translation of the English KSQ, validated in a Dutch sarcoidosis population.

Testing the validity of the International Atomic Energy Agency (IAEA) safety culture model.

PubMed

López de Castro, Borja; Gracia, Francisco J; Peiró, José M; Pietrantoni, Luca; Hernández, Ana

2013-11-01

This paper takes the first steps to empirically validate the widely used model of safety culture of the International Atomic Energy Agency (IAEA), composed of five dimensions, further specified by 37 attributes. To do so, three independent and complementary studies are presented. First, 290 students serve to collect evidence about the face validity of the model. Second, 48 experts in organizational behavior judge its content validity. And third, 468 workers in a Spanish nuclear power plant help to reveal how closely the theoretical five-dimensional model can be replicated. Our findings suggest that several attributes of the model may not be related to their corresponding dimensions. According to our results, a one-dimensional structure fits the data better than the five dimensions proposed by the IAEA. Moreover, the IAEA model, as it stands, seems to have rather moderate content validity and low face validity. Practical implications for researchers and practitioners are included. Copyright © 2013 Elsevier Ltd. All rights reserved.

Validation of the MISSCARE-BRASIL survey - A tool to assess missed nursing care.

PubMed

Siqueira, Lillian Dias Castilho; Caliri, Maria Helena Larcher; Haas, Vanderlei José; Kalisch, Beatrice; Dantas, Rosana Aparecida Spadoti

2017-12-21

to analyze the metric validity and reliability properties of the MISSCARE-BRASIL survey. methodological research conducted by assessing construct validity and reliability via confirmatory factor analysis, known-groups validation, convergent construct validation, analysis of internal consistency and test-retest reliability. The sample consisted of 330 nursing professionals, of whom 86 participated in the retest phase. of the 330 participants, 39.7% were aides, 33% technicians, 20.9% nurses, and 6.4% nurses with administrative roles. Confirmatory factorial analysis demonstrated that the Brazilian Portuguese version of the instrument is adequately adjusted to the dimensional structure the scale authors originally proposed. The correlation between "satisfaction with position/role" and "satisfaction with teamwork" and the survey's missed care variables was moderate (Spearman's coefficient =0.35; p<0.001). The results of the Student's t-test indicated known-group validity. Professionals from closed units reported lower levels of missed care in comparison with the other units. The reliability showed a strong correlation, with the exception of "institutional management/leadership style" (intraclass correlation coefficient (ICC)=0.15; p=0.04). The internal consistency was adequate (Cronbach's alpha was greater than 0.70). the MISSCARE-BRASIL was valid and reliable in the group studied. The application of the MISSCARE-BRASIL can contribute to identifying solutions for missed nursing care.

An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures.

PubMed

Ponterotto, Joseph G; Ruckdeschel, Daniel E

2007-12-01

The present article addresses issues in reliability assessment that are often neglected in psychological research such as acceptable levels of internal consistency for research purposes, factors affecting the magnitude of coefficient alpha (alpha), and considerations for interpreting alpha within the research context. A new reliability matrix anchored in classical test theory is introduced to help researchers judge adequacy of internal consistency coefficients with research measures. Guidelines and cautions in applying the matrix are provided.

IMatter: validation of the NHS Scotland Employee Engagement Index.

PubMed

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

Validating internal controls for quantitative plant gene expression studies

PubMed Central

Brunner, Amy M; Yakovlev, Igor A; Strauss, Steven H

2004-01-01

Background Real-time reverse transcription PCR (RT-PCR) has greatly improved the ease and sensitivity of quantitative gene expression studies. However, accurate measurement of gene expression with this method relies on the choice of a valid reference for data normalization. Studies rarely verify that gene expression levels for reference genes are adequately consistent among the samples used, nor compare alternative genes to assess which are most reliable for the experimental conditions analyzed. Results Using real-time RT-PCR to study the expression of 10 poplar (genus Populus) housekeeping genes, we demonstrate a simple method for determining the degree of stability of gene expression over a set of experimental conditions. Based on a traditional method for analyzing the stability of varieties in plant breeding, it defines measures of gene expression stability from analysis of variance (ANOVA) and linear regression. We found that the potential internal control genes differed widely in their expression stability over the different tissues, developmental stages and environmental conditions studied. Conclusion Our results support that quantitative comparisons of candidate reference genes are an important part of real-time RT-PCR studies that seek to precisely evaluate variation in gene expression. The method we demonstrated facilitates statistical and graphical evaluation of gene expression stability. Selection of the best reference gene for a given set of experimental conditions should enable detection of biologically significant changes in gene expression that are too small to be revealed by less precise methods, or when highly variable reference genes are unknowingly used in real-time RT-PCR experiments. PMID:15317655

Validating internal controls for quantitative plant gene expression studies.

PubMed

Brunner, Amy M; Yakovlev, Igor A; Strauss, Steven H

2004-08-18

Real-time reverse transcription PCR (RT-PCR) has greatly improved the ease and sensitivity of quantitative gene expression studies. However, accurate measurement of gene expression with this method relies on the choice of a valid reference for data normalization. Studies rarely verify that gene expression levels for reference genes are adequately consistent among the samples used, nor compare alternative genes to assess which are most reliable for the experimental conditions analyzed. Using real-time RT-PCR to study the expression of 10 poplar (genus Populus) housekeeping genes, we demonstrate a simple method for determining the degree of stability of gene expression over a set of experimental conditions. Based on a traditional method for analyzing the stability of varieties in plant breeding, it defines measures of gene expression stability from analysis of variance (ANOVA) and linear regression. We found that the potential internal control genes differed widely in their expression stability over the different tissues, developmental stages and environmental conditions studied. Our results support that quantitative comparisons of candidate reference genes are an important part of real-time RT-PCR studies that seek to precisely evaluate variation in gene expression. The method we demonstrated facilitates statistical and graphical evaluation of gene expression stability. Selection of the best reference gene for a given set of experimental conditions should enable detection of biologically significant changes in gene expression that are too small to be revealed by less precise methods, or when highly variable reference genes are unknowingly used in real-time RT-PCR experiments.

Development of the Persian version of the Vertigo Symptom Scale: Validity and reliability

PubMed Central

Kamalvand, Atefeh; Ghahraman, Mansoureh Adel; Jalaie, Shohreh

2017-01-01

Background: Vertigo Symptom Scale (VSS) is a proper instrument for assessing the patient status, clarifying the symptoms, and examining the relative impact of the vertigo and anxiety on reported handicap. Our aim is the translation and cross-cultural adaptation of the VSS into Persian language (VSS-P) and investigating its validity and reliability in patients with peripheral vestibular disorders. Materials and Methods: VSS was translated into Persian. Cross-cultural adaptation was carried out on 101 patients with peripheral vestibular disorders and 34 participants with no history of vertigo. They completed the Persian versions of VSS, dizziness handicap inventory (DHI), and Beck anxiety inventory (BAI). Internal, discriminant, and convergent validities, internal consistency, and test-retest reliability were determined. Results: The VSS-P showed good face validity. Internal validity was confirmed and demonstrated the presence of two vertigo (VSS-VER) and autonomic-anxiety (VSS-AA) subscales. Significant difference between the median scores for patient and healthy groups was reported in discriminate validity (P <0.001). Convergent validity revealed high correlation between both BAI and DHI with VSS-P. There was a high test-retest reliability; with intraclass correlation coefficient of 0.89, 0.86, and 0.91 for VSS-AA, VER, and VSS-P, respectively. The internal consistency was good with Cronbach's alpha 0.90 for VER subscale, 0.86 for VSS-AA subscale, and 0.92 for the overall VSS-P. Conclusion: The Persian version of the VSS could be used clinically as a valid and reliable tool. Thus, it is a key instrument to focus on the symptoms associated with dizziness. PMID:28616045

Development of the Persian version of the Vertigo Symptom Scale: Validity and reliability.

PubMed

Kamalvand, Atefeh; Ghahraman, Mansoureh Adel; Jalaie, Shohreh

2017-01-01

Vertigo Symptom Scale (VSS) is a proper instrument for assessing the patient status, clarifying the symptoms, and examining the relative impact of the vertigo and anxiety on reported handicap. Our aim is the translation and cross-cultural adaptation of the VSS into Persian language (VSS-P) and investigating its validity and reliability in patients with peripheral vestibular disorders. VSS was translated into Persian. Cross-cultural adaptation was carried out on 101 patients with peripheral vestibular disorders and 34 participants with no history of vertigo. They completed the Persian versions of VSS, dizziness handicap inventory (DHI), and Beck anxiety inventory (BAI). Internal, discriminant, and convergent validities, internal consistency, and test-retest reliability were determined. The VSS-P showed good face validity. Internal validity was confirmed and demonstrated the presence of two vertigo (VSS-VER) and autonomic-anxiety (VSS-AA) subscales. Significant difference between the median scores for patient and healthy groups was reported in discriminate validity ( P <0.001). Convergent validity revealed high correlation between both BAI and DHI with VSS-P. There was a high test-retest reliability; with intraclass correlation coefficient of 0.89, 0.86, and 0.91 for VSS-AA, VER, and VSS-P, respectively. The internal consistency was good with Cronbach's alpha 0.90 for VER subscale, 0.86 for VSS-AA subscale, and 0.92 for the overall VSS-P. The Persian version of the VSS could be used clinically as a valid and reliable tool. Thus, it is a key instrument to focus on the symptoms associated with dizziness.

World Workshop on Oral Medicine VI: an international validation study of clinical competencies for advanced training in oral medicine.

PubMed

Steele, John C; Clark, Hadleigh J; Hong, Catherine H L; Jurge, Sabine; Muthukrishnan, Arvind; Kerr, A Ross; Wray, David; Prescott-Clements, Linda; Felix, David H; Sollecito, Thomas P

2015-08-01

To explore international consensus for the validation of clinical competencies for advanced training in Oral Medicine. An electronic survey of clinical competencies was designed. The survey was sent to and completed by identified international stakeholders during a 10-week period. To be validated, an individual competency had to achieve 90% or greater consensus to keep it in its current format. Stakeholders from 31 countries responded. High consensus agreement was achieved with 93 of 101 (92%) competencies exceeding the benchmark for agreement. Only 8 warranted further attention and were reviewed by a focus group. No additional competencies were suggested. This is the first international validated study of clinical competencies for advanced training in Oral Medicine. These validated clinical competencies could provide a model for countries developing an advanced training curriculum for Oral Medicine and also inform review of existing curricula. Copyright © 2015 Elsevier Inc. All rights reserved.

Transcultural adaptation and validation of the Korean version of Caregiver Priorities & Child Health Index of Life with Disabilities (CPCHILD).

PubMed

Sung, Ki Hyuk; Kwon, Soon-Sun; Narayanan, Unni G; Chung, Chin Youb; Lee, Kyoung Min; Lee, Seung Yeol; Lee, Damian J; Park, Moon Seok

2015-01-01

The aim of this study was to translate and transculturally adapt the Caregiver Priorities & Child Health Index of Life with Disabilities (CPCHILD) questionnaire into Korean language, and to test the reliability and validity, including the internal consistency, known-group validity and factor analysis of the Korean version of the CPCHILD. A Korean version of CPCHILD was produced according to internationally accepted guidelines. For validity testing, 194 consecutive parents or caregivers of children with cerebral palsy (CP) were recruited and completed the questionnaire. Internal consistency, test-retest reliability, and known-groups validity were evaluated and factor analysis was performed to validate the Korean version of the CPCHILD. In terms of internal consistency, a Cronbach's alpha was above 0.90 in all domains of the CPCHILD (range 0.921 to 0.966), except the 5th domain (0.628). In terms of known-groups validity, the total score of the CPCHILD was significantly different according to the Gross Motor Function Classification System (GMFCS) level (p < 0.001). Intra-class correlation coefficient spanned from 0.517 to 0.801. Factor analysis showed that the five-factor solution of the CPCHILD explained 76.7% of the variance with 59.0, 6.5, 5.1, 4.2 and 3.2% of variance by each components number. The Korean version of CPCHILD was found to be a reliable and valid questionnaire of caregivers' perspectives on the health-related quality of life in severely affected children with CP. However, the Korean version of CPCHILD contains some redundant items, and factor analysis suggested a five-domain questionnaire. Implication for Rehabilitation The Korean version of CPCHILD is a reliable, internally consistent, valid instrument for assessing the health-related quality of life in severely affected children with CP from the perspective of caregivers. After the transcultural adaptation and validation of the Korean CPCHILD, it can be reliably used in clinical and research

Internal Consistency of the easyCBM© CCSS Reading Measures: Grades 3-8. Technical Report #1407

ERIC Educational Resources Information Center

Guerreiro, Meg; Alonzo, Julie; Tindal, Gerald

2014-01-01

This technical report documents findings from a study of the internal consistency and split-half reliability of the easyCBM© CCSS Reading measures, grades 3-8. Data, drawn from an extant data set gathered in school year 2013-2014, include scores from over 150,000 students' fall and winter benchmark assessments. Findings suggest that the easyCBM©…

The validity and internal structure of the Bipolar Depression Rating Scale: data from a clinical trial of N-acetylcysteine as adjunctive therapy in bipolar disorder.

PubMed

Berk, Michael; Dodd, Seetal; Dean, Olivia M; Kohlmann, Kristy; Berk, Lesley; Malhi, Gin S

2010-10-01

Berk M, Dodd S, Dean OM, Kohlmann K, Berk L, Malhi GS. The validity and internal structure of the Bipolar Depression Rating Scale: data from a clinical trial of N-acetylcysteine as adjunctive therapy in bipolar disorder. The phenomenology of unipolar and bipolar disorders differ in a number of ways, such as the presence of mixed states and atypical features. Conventional depression rating instruments are designed to capture the characteristics of unipolar depression and have limitations in capturing the breadth of bipolar disorder. The Bipolar Depression Rating Scale (BDRS) was administered together with the Montgomery Asberg Rating Scale (MADRS) and Young Mania Rating Scale (YMRS) in a double-blind randomised placebo-controlled clinical trial of N-acetyl cysteine for bipolar disorder (N = 75). A factor analysis showed a two-factor solution: depression and mixed symptom clusters. The BDRS has strong internal consistency (Cronbach's alpha = 0.917), the depression cluster showed robust correlation with the MADRS (r = 0.865) and the mixed subscale correlated with the YMRS (r = 0.750). The BDRS has good internal validity and inter-rater reliability and is sensitive to change in the context of a clinical trial.

Concurrent validation of CHIRP, a new instrument for measuring healthcare student attitudes towards interdisciplinary teamwork.

PubMed

Hollar, David; Hobgood, Cherri; Foster, Beverly; Aleman, Marco; Sawning, Susan

2012-01-01

Positive attitudes towards teamwork among health care professionals are critical to patient safety. The purpose of this study is to describe the development and concurrent validation of a new instrument to measure attitudes towards healthcare teamwork that is generalizable across various populations of healthcare students. The Collaborative Healthcare Interdisciplinary Planning (CHIRP) scale was validated against the Readiness for Inter-Professional Learning Scale (RIPLS). Analyses included student (n = 266) demographics, ANOVA, internal consistency, factor analysis, and Rasch analysis. The two instruments correlated at r = .582. The CHIRP showed a multifactorial structure having excellent internal consistency (alpha = .850), with 25 of the 36 scale items loading onto a single Teamwork Attitudes factor. The RIPLS likewise had strong internal consistency (alpha = .796) and a three-factor structure, supporting previous studies of the instrument. However, Rasch analyses showed 14 (38.9%) of the 36 CHIRP items, but only four (21.1%) of the 19 RIPLS items remaining within the satisfactory standardized OUTFIT zone of 2.0 standard deviation units. We propose the 14 fitting items as a new, validated teamwork attitudes scale.

Brazilian validation of the Alberta Infant Motor Scale.

PubMed

Valentini, Nadia Cristina; Saccani, Raquel

2012-03-01

The Alberta Infant Motor Scale (AIMS) is a well-known motor assessment tool used to identify potential delays in infants' motor development. Although Brazilian researchers and practitioners have used the AIMS in laboratories and clinical settings, its translation to Portuguese and validation for the Brazilian population is yet to be investigated. This study aimed to translate and validate all AIMS items with respect to internal consistency and content, criterion, and construct validity. A cross-sectional and longitudinal design was used. A cross-cultural translation was used to generate a Brazilian-Portuguese version of the AIMS. In addition, a validation process was conducted involving 22 professionals and 766 Brazilian infants (aged 0-18 months). The results demonstrated language clarity and internal consistency for the motor criteria (motor development score, α=.90; prone, α=.85; supine, α=.92; sitting, α=.84; and standing, α=.86). The analysis also revealed high discriminative power to identify typical and atypical development (motor development score, P<.001; percentile, P=.04; classification criterion, χ(2)=6.03; P=.05). Temporal stability (P=.07) (rho=.85, P<.001) was observed, and predictive power (P<.001) was limited to the group of infants aged from 3 months to 9 months. Limited predictive validity was observed, which may have been due to the restricted time that the groups were followed longitudinally. In sum, the translated version of AIMS presented adequate validity and reliability.

Development and validation of the Stirling Eating Disorder Scales.

PubMed

Williams, G J; Power, K G; Miller, H R; Freeman, C P; Yellowlees, A; Dowds, T; Walker, M; Parry-Jones, W L

1994-07-01

The development and reliability/validity check of an 80-item, 8-scale measure for use with eating disorder patients is presented. The Stirling Eating Disorder Scales (SEDS) assess anorexic dietary behavior, anorexic dietary cognitions, bulimic dietary behavior, bulimic dietary cognitions, high perceived external control, low assertiveness, low self-esteem, and self-directed hostility. The SEDS were administered to 82 eating disorder patients and 85 controls. Results indicate that the SEDS are acceptable in terms of internal consistency, reliability, group validity, and concurrent validity.

Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil.

PubMed

Ghisi, Gabriela Lima de Melo; Dos Santos, Rafaella Zulianello; Bonin, Christiani Batista Decker; Roussenq, Suellen; Grace, Sherry L; Oh, Paul; Benetti, Magnus

2014-01-01

To translate, culturally adapt and psychometrically validate the Information Needs in Cardiac Rehabilitation (INCR) tool to Portuguese. The identification of information needs is considered the first step to improve knowledge that ultimately could improve health outcomes. The Portuguese version generated was tested in 300 cardiac rehabilitation patients (CR) (34% women; mean age = 61.3 ± 2.1 years old). Test-retest reliability was assessed using intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and the criterion validity was assessed with regard to patients' education and duration in CR. All 9 subscales were considered internally consistent (á > 0.7). Significant differences between mean total needs and educational level (p < 0.05) and duration in CR (p = 0.03) supported criterion validity. The overall mean (4.6 ± 0.4), as well as the means of the 9 subscales were high (emergency/safety was the greatest need). The Portuguese INCR was demonstrated to have sufficient reliability, consistency and validity. Copyright © 2014 Elsevier Inc. All rights reserved.

[Validity and reliability of a scale to assess self-efficacy for physical activity in elderly].

PubMed

Borges, Rossana Arruda; Rech, Cassiano Ricardo; Meurer, Simone Teresinha; Benedetti, Tânia Rosane Bertoldo

2015-04-01

This study aimed to analyze the confirmatory factor validity and reliability of a self-efficacy scale for physical activity in a sample of 118 elderly (78% women) from 60 to 90 years of age. Mplus 6.1 was used to evaluate the confirmatory factor analysis. Reliability was tested by internal consistency and temporal stability. The original scale consisted of five items with dichotomous answers (yes/no), independently for walking and moderate and vigorous physical activity. The analysis excluded the item related to confidence in performing physical activities when on vacation. Two constructs were identified, called "self-efficacy for walking" and "self-efficacy for moderate and vigorous physical activity", with a factor load ≥ 0.50. Internal consistency was adequate both for walking (> 0.70) and moderate and vigorous physical activity (> 0.80), and temporal stability was adequate for all the items. In conclusion, the self-efficacy scale for physical activity showed adequate validity, reliability, and internal consistency for evaluating this construct in elderly Brazilians.

Cross-cultural adaptation, reliability, internal consistency and validation of the Spinal Function Sort (SFS) for French- and German-speaking patients with back complaints.

PubMed

Borloz, S; Trippolini, M A; Ballabeni, P; Luthi, F; Deriaz, O

2012-09-01

Functional subjective evaluation through questionnaire is fundamental, but not often realized in patients with back complaints, lacking validated tools. The Spinal Function Sort (SFS) was only validated in English. We aimed to translate, adapt and validate the French (SFS-F) and German (SFS-G) versions of the SFS. Three hundred and forty-four patients, experiencing various back complaints, were recruited in a French (n = 87) and a German-speaking (n = 257) center. Construct validity was estimated via correlations with SF-36 physical and mental scales, pain intensity and hospital anxiety and depression scales (HADS). Scale homogeneities were assessed by Cronbach's α. Test-retest reliability was assessed on 65 additional patients using intraclass correlation (IC). For the French and German translations, respectively, α were 0.98 and 0.98; IC 0.98 (95% CI: [0.97; 1.00]) and 0.94 (0.90; 0.98). Correlations with physical functioning were 0.63 (0.48; 0.74) and 0.67 (0.59; 0.73); with physical summary 0.60 (0.44; 0.72) and 0.52 (0.43; 0.61); with pain -0.33 (-0.51; -0.13) and -0.51 (-0.60; -0.42); with mental health -0.08 (-0.29; 0.14) and 0.25 (0.13; 0.36); with mental summary 0.01 (-0.21; 0.23) and 0.28 (0.16; 0.39); with depression -0.26 (-0.45; -0.05) and -0.42 (-0.52; -0.32); with anxiety -0.17 (-0.37; -0.04) and -0.45 (-0.54; -0.35). Reliability was excellent for both languages. Convergent validity was good with SF-36 physical scales, moderate with VAS pain. Divergent validity was low with SF-36 mental scales in both translated versions and with HADS for the SFS-F (moderate in SFS-G). Both versions seem to be valid and reliable for evaluating perceived functional capacity in patients with back complaints.

A Validation Study of the Dutch Childhood Trauma Questionnaire-Short Form: Factor Structure, Reliability, and Known-Groups Validity

ERIC Educational Resources Information Center

Thombs, Brett D.; Bernstein, David P.; Lobbestael, Jill; Arntz, Arnoud

2009-01-01

Objective: The 28-item Childhood Trauma Questionnaire-Short Form (CTQ-SF) has been translated into at least 10 different languages. The validity of translated versions of the CTQ-SF, however, has generally not been examined. The objective of this study was to investigate the factor structure, internal consistency reliability, and known-groups…

Validation of the Impact of Health Information Technology (I-HIT) Scale: an international collaborative.

PubMed

Dykes, Patricia C; Hurley, Ann C; Brown, Suzanne; Carr, Robyn; Cashen, Margaret; Collins, Rita; Cook, Robyn; Currie, Leanne; Docherty, Charles; Ensio, Anneli; Foster, Joanne; Hardiker, Nicholas R; Honey, Michelle L L; Killalea, Rosaleen; Murphy, Judy; Saranto, Kaija; Sensmeier, Joyce; Weaver, Charlotte

2009-01-01

In 2005, the Healthcare Information Management Systems Society (HIMSS) Nursing Informatics Community developed a survey to measure the impact of health information technology (HIT), the I-HIT Scale, on the role of nurses and interdisciplinary communication in hospital settings. In 2007, nursing informatics colleagues from Australia, England, Finland, Ireland, New Zealand, Scotland and the United States formed a research collaborative to validate the I-HIT across countries. All teams have completed construct and face validation in their countries. Five out of six teams have initiated reliability testing by practicing nurses. This paper reports the international collaborative's validation of the I-HIT Scale completed to date.

The Classroom Environment Questionnaire (CEQ): Development and preliminary structural validity.

PubMed

Lyons, Carissa; Brown, Ted; Bourke-Taylor, Helen

2018-04-16

Occupational therapists offer a unique perspective regarding the contribution of the environment to occupational performance. Therefore, a scale that measures the unique characteristics of the primary school classroom environment where children complete their daily schoolwork occupations is needed. The aim of this study was to develop and psychometrically evaluate a new teacher-report questionnaire that measures a number of environmental characteristics of primary school classrooms. Participants (N = 117) completed the Classroom Environment Questionnaire (CEQ), which utilises a 4-point Likert scale where teachers rate 51 environmental characteristics of their classroom. Teachers also rate the extent to which they believe the physical, social, temporal, institutional and cultural classroom environmental domains contribute to students' schoolwork performance using a 10-point scale. The structural validity of the CEQ was examined using principal component analysis (PCA). Inter-item correlations were examined using Pearson r correlations, while the internal consistency of the CEQ was assessed using Cronbach's alpha. PCA revealed the CEQ to be multidimensional, with 31 items loading onto nine viable factors, representing the unique nature of classroom environments. Based on the PCA results, 20 items were removed from the CEQ. Cronbach's alpha and correlation analysis indicated that most CEQ subsections had acceptable internal consistency (alpha range 0.70-0.82), with four subsections demonstrating a lower level of internal consistency (alpha range 0.55-0.69). Preliminary structural validity and internal consistency analysis findings confirm that the CEQ has potential to be a useful scale for professionals wishing to examine the unique characteristics of primary school classrooms that influence the occupational performance of students. Ongoing analyses will be undertaken to further explore the CEQ's validity and reliability. © 2018 Occupational Therapy Australia.

Psychometric Arabic Sino-Nasal Outcome Test-22: validation and translation in chronic rhinosinusitis patients.

PubMed

Alanazy, Fatma; Dousary, Surayie Al; Albosaily, Ahmed; Aldriweesh, Turki; Alsaleh, Saad; Aldrees, Turki

2018-01-01

The Sino-Nasal Outcome Test (SNOT)-22 has multiple items that reflect how nasal disease affects quality of life. Currently, no validated Arabic version of the SNOT-22 is available. . To develop an Arabic-validated version of SNOT-22. Prospective. Tertiary care center. This single-center validation study was conducted between 2015 and 2017 at King Abdul-Aziz University Hospital, Riyadh, Saudi Arabia. The SNOT-22 English version was translated into Arabic by the forward and backward method. The test and retest reliability, internal consistency, responsiveness to surgical treatment, discriminant validity, sensitivity and specificity all were tested. Validated Arabic version of the SNOT-22. Of 265 individuals, 171 were healthy volunteers and 94 were chronic rhinosinusitis patients. The Arabic version showed high internal consistency (Cronbach's of 0.94), and the ability to differentiate between diseased and healthy volunteers (P < .001). The translated versions demonstrated the ability to detect the change scores significantly in response to intervention (P < .001). This is the first validated Arabic version of SNOT-22. The instrument can be used among the Arabic population. No subjects from other Arab countries.

The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

PubMed

Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

2017-01-12

Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in

Transcultural Adaptation and Validation of the German Version of the Vocal Tract Discomfort Scale.

PubMed

Lukaschyk, Julia; Brockmann-Bauser, Meike; Beushausen, Ulla

2017-03-01

Currently, there is no standardized German questionnaire to assess vocal tract discomfort in voice patients. The aim of this study was to evaluate the internal consistency, reliability, and validity of the German version of the Vocal Tract Discomfort (VTD) Scale. This is a cross-sectional study. First, a cross-cultural translation and adaptation from English to German was performed. One hundred seven patients between the ages of 18 and 76 with voice disorders were divided into two different diagnosis-related groups (organic and functional voice disorder) and 50 vocally healthy adults were included. All participants completed the VTD Scale and the Voice Handicap Index (VHI). The internal consistency of the VTD Scale was analyzed through Cronbach's α coefficient. Pearson correlation between the VDT Scale and VHI total scores was used to determine criterion validity. The VDT Scale score differences related to diagnosis groups were assessed with analysis of variance. Excellent internal consistency was found (α = 0.919, P < 0.05), and criterion validity was confirmed by a high correlation between the total VTD Scale and VHI (r = 0.674). There was a significant difference between the diagnosis groups' total VTD Scale score (F[4.135] = 15.114, P = 0.000). Furthermore, the vocally healthy adults had significantly lower values than the two diagnosis groups (x¯: 11.48, s = 8.340). The German version of the VTD Scale has an excellent internal consistency and reliability, and shows high clinical validity. Thus, it is a useful instrument in voice diagnostics. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Cross-cultural adaptation and validation of the Protective Nursing Advocacy Scale for Brazilian nurses 1

PubMed Central

Tomaschewski-Barlem, Jamila Geri; Lunardi, Valéria Lerch; Barlem, Edison Luiz Devos; da Silveira, Rosemary Silva; Dalmolin, Graziele de Lima; Ramos, Aline Marcelino

2015-01-01

Abstract Objective: to adapt culturally and validate the Protective Nursing Advocacy Scale for Brazilian nurses. Method: methodological study carried out with 153 nurses from two hospitals in the South region of Brazil, one public and the other philanthropic. The cross-cultural adaptation of the Protective Nursing Advocacy Scale was performed according to international standards, and its validation was carried out for use in the Brazilian context, by means of factor analysis and Cronbach's alpha as measure of internal consistency. Results: by means of evaluation by a committee of experts and application of pre-test, face validity and content validity of the instrument were considered satisfactory. From the factor analysis, five constructs were identified: negative implications of the advocacy practice, advocacy actions, facilitators of the advocacy practice, perceptions that favor practice advocacy and barriers to advocacy practice. The instrument showed satisfactory internal consistency, with Cronbach's alpha values ranging from 0.70 to 0.87. Conclusion: it was concluded that the Protective Nursing Advocacy Scale - Brazilian version, is a valid and reliable instrument for use in the evaluation of beliefs and actions of health advocacy, performed by Brazilian nurses in their professional practice environment. PMID:26444169

Alternative Fistula Risk Score for Pancreatoduodenectomy (a-FRS): Design and International External Validation.

PubMed

Mungroop, Timothy H; van Rijssen, L Bengt; van Klaveren, David; Smits, F Jasmijn; van Woerden, Victor; Linnemann, Ralph J; de Pastena, Matteo; Klompmaker, Sjors; Marchegiani, Giovanni; Ecker, Brett L; van Dieren, Susan; Bonsing, Bert; Busch, Olivier R; van Dam, Ronald M; Erdmann, Joris; van Eijck, Casper H; Gerhards, Michael F; van Goor, Harry; van der Harst, Erwin; de Hingh, Ignace H; de Jong, Koert P; Kazemier, Geert; Luyer, Misha; Shamali, Awad; Barbaro, Salvatore; Armstrong, Thomas; Takhar, Arjun; Hamady, Zaed; Klaase, Joost; Lips, Daan J; Molenaar, I Quintus; Nieuwenhuijs, Vincent B; Rupert, Coen; van Santvoort, Hjalmar C; Scheepers, Joris J; van der Schelling, George P; Bassi, Claudio; Vollmer, Charles M; Steyerberg, Ewout W; Abu Hilal, Mohammed; Groot Koerkamp, Bas; Besselink, Marc G

2017-12-12

The aim of this study was to develop an alternative fistula risk score (a-FRS) for postoperative pancreatic fistula (POPF) after pancreatoduodenectomy, without blood loss as a predictor. Blood loss, one of the predictors of the original-FRS, was not a significant factor during 2 recent external validations. The a-FRS was developed in 2 databases: the Dutch Pancreatic Cancer Audit (18 centers) and the University Hospital Southampton NHS. Primary outcome was grade B/C POPF according to the 2005 International Study Group on Pancreatic Surgery (ISGPS) definition. The score was externally validated in 2 independent databases (University Hospital of Verona and University Hospital of Pennsylvania), using both 2005 and 2016 ISGPS definitions. The a-FRS was also compared with the original-FRS. For model design, 1924 patients were included of whom 12% developed POPF. Three predictors were strongly associated with POPF: soft pancreatic texture [odds ratio (OR) 2.58, 95% confidence interval (95% CI) 1.80-3.69], small pancreatic duct diameter (per mm increase, OR: 0.68, 95% CI: 0.61-0.76), and high body mass index (BMI) (per kg/m increase, OR: 1.07, 95% CI: 1.04-1.11). Discrimination was adequate with an area under curve (AUC) of 0.75 (95% CI: 0.71-0.78) after internal validation, and 0.78 (0.74-0.82) after external validation. The predictive capacity of a-FRS was comparable with the original-FRS, both for the 2005 definition (AUC 0.78 vs 0.75, P = 0.03), and 2016 definition (AUC 0.72 vs 0.70, P = 0.05). The a-FRS predicts POPF after pancreatoduodenectomy based on 3 easily available variables (pancreatic texture, duct diameter, BMI) without blood loss and pathology, and was successfully validated for both the 2005 and 2016 POPF definition.

The WOMB (Women's views of birth) antenatal satisfaction questionnaire: development, dimensions, internal reliability, and validity.

PubMed Central

Smith, L F

1999-01-01

BACKGROUND: Antenatal services continue to change, stimulated by the Changing Childbirth report. Women's views should be an important component of assessing the quality of such services. To date, no published quantitative multidimensional assessment instrument has been available to measure their satisfaction with care. AIM: To develop a valid, reliable, multidimensional questionnaire to assess quality of antenatal care. METHOD: A multidimensional satisfaction questionnaire was developed using psychometric methods. Following fieldwork to pilot a questionnaire, three successive versions of it were given by midwives to pregnant women in their final trimester in nine trusts in the old South Western region of England. Their replies were analysed by principal components analysis (PCA) with varimax rotation; internal reliability was assessed by Cronbach's alpha. Face, content, and construct validity were all assessed during development. RESULTS: Out of 196 women, 134 (68.4%) returned the pilot questionnaires. One hundred and seventy-two (57.3%) out of 300 women returned version 1 of the WOMB (WOMen's views of Birth) antenatal satisfaction questionnaire proper, 283 (56.6%) out of 500 returned version 2, and 328 (65.6%) out of 500 returned the final development version. This final version consisted of 11 dimensions in addition to a general satisfaction one. These were [Cronbach's alpha]: five related to antenatal clinic characteristics (travelling to clinic [0.75], waiting at clinic [0.90], clinic environment [0.69], timing of appointment [0.78], car parking [0.85]), three 'professional' characteristics (professional competence [0.80], knowing carers [0.79], information provided [0.81]), antenatal classes [0.76], social support from other pregnant women [0.83], checking for the baby's heart beat [0.63]. There were significant moderate correlations (range = 0.24 to 0.77) between individual dimensions and the general satisfaction dimension. Women's dimension scores were

Assessment of the validity of the CUDIT-R in a subpopulation of cannabis users.

PubMed

Loflin, Mallory; Babson, Kimberly; Browne, Kendall; Bonn-Miller, Marcel

2018-01-01

The Cannabis Use Disorders Identification Test-Revised (CUDIT-R) is an 8-item measure used to screen for cannabis use disorders (CUD). Despite widespread use of the tool, assessments of the CUDIT-R's validity in subpopulations are limited. The current study tested the structural validity and internal consistency of one of the most widely used screening measures for CUD (i.e., CUDIT-R) among a sample of military veterans who use cannabis for medicinal purposes. The present study used confirmatory factor analysis (CFA) to test the internal consistency and validity of the single-factor structure of the original screener among a sample of veterans who use cannabis for medicinal purposes (n = 90 [90% male]; M age  = 55.31, SD = 15.37). Measures included demographics and the CUDIT-R, obtained from the baseline assessment of an ongoing longitudinal study. The CFA revealed that the single-factor model previously validated in recreational using samples only accounted for 38.34% of total variance in responses on the CUDIT-R (χ 2  = 66.09, df = 28, p < 0.05; RMSEA = 0.06) and demonstrated acceptable but modest internal consistency (Cronbach's α = 0.73). More psychometric work is needed to determine the reliability and validity of using the CUDIT-R to screen for CUD among military veterans who use medicinal cannabis and other subpopulations of cannabis users.

Validation of a short food frequency questionnaire to evaluate nutritional lifestyles in hypercholesterolemic patients.

PubMed

Béliard, Sophie; Coudert, Mathieu; Valéro, René; Charbonnier, Laurie; Duchêne, Emilie; Allaert, François André; Bruckert, Éric

2012-12-01

The purpose of our study was to develop and validate a short food frequency questionnaire which could assess the nutritional lifestyles of hypercholesterolemic patients consulting in daily practice. The questionnaire explores 11 nutrient categories. Hundred and thirty-one patients were recruited for the construct validity and 58 patients for the external validity in La Pitié Hospital, Paris. The reference method used was the diet history. To measure the internal consistency and to test the sensibility to change on a large scale, the questionnaire was used in an observational study conducted in Spain in 1048 moderate hypercholesterolemic patients. Psychometric analyses included construct validity, internal consistency, test-retest reliability, external validity and sensibility to change. Validation of the questionnaire indicated a good internal consistency (Cronbach Coefficient Alpha at 0.69) and test-retest reliability (intraclass correlation coefficient=0.89). The correlation between the scores of the FFQ and those of the diet history was significant with a Pearson correlation coefficient at 0.3 (P=0.029). The comparison between the ranking of the patients showed an agreement of 72% with a kappa of 0.48 [0.10; 0.69]. The sensibility to change was good with a score evolution improving one and four months after nutrition advices: 28.2% of patients ranked in group 1 at inclusion versus 61.3% (P<0.0001) at one month and 75.2% (P<0.0001) at four months. In conclusion, we developed and validated a food questionnaire for hypercholesterolemic patients, which can be used as a therapeutic education tool in daily practice or in clinical research. Copyright © 2012. Published by Elsevier Masson SAS.

The validity and reliability of tinnitus handicap inventory Thai version.

PubMed

Limviriyakul, Siriporn; Supavanich, Walop

2012-11-01

Demonstrate the reliability and validity of the Tinnitus Handicap Inventory Thai Version (THI-T), a self-report measure of tinnitus. A cross-sectional psychometric validation study was used to determine internal consistency reliability and validity of the Tinnitus Handicap Inventory Thai Version at the Otoneurology clinic at Tertiary care center The cross-cultural adaptation of the Tinnitus Handicapped Inventory English version (Newman et al, 1996) was translated into Thai version following the steps indicated by Guillemin et al. The reliability was constructed by using Cronbach's coefficient alpha. The validity was analyzed by the correlation between Tinnitus Handicap Inventory Thai version and the 36-items short form health survey and visual analog scale using Spearman and Pearson test. The result showed good internal consistency reliabilities of total, functional, emotional, and catastrophic scale (a = 0.902, 0.804, 0.831 and 0.661, respectively) of Tinnitus Handicap Inventory Thai Version. Spearman correlation showed the significant correlation of Tinnitus Handicap Inventory to 36-items short form health survey and visual analog scale. Tinnitus Handicap Inventory Thai Version will be a vigorous tool in evaluating tinnitus patients as well as monitoring the progress of their symptoms.

[Validation of a Japanese version of the Experience in Close Relationship- Relationship Structure].

PubMed

Komura, Kentaro; Murakami, Tatsuya; Toda, Koji

2016-08-01

The purpose of this study was to translate the Experience of Close Relationship-Relationship Structure (ECRRS) and evaluate its validity. In study 1 (N = 982), evidence based internal structure (factor structure, internal consistency, and correlation among sub-scales) and evidence based relations to other variables (depression, reassurance seeking and self-esteem) were confirmed. In study 2 (N = 563), evidence based on internal structure was reconfirmed, and evidence based relations to other variables (IWMS, RQ, and ECR-GO) were confirmed. In study 3 (N = 342), evidence based internal structure (test-retest reliability) was confirmed. Based on these results, we concluded that ECR-RS was valid for measuring adult attachment style.

EAQUATE: An International Experiment for Hyper-Spectral Atmospheric Sounding Validation

NASA Technical Reports Server (NTRS)

Taylor, J. P.; Smith, W.; Cuomo, V.; Larar, A.; Zhou, D.; Serio, C.; Maestri, T.; Rizzi, R.; Newman, S.; Antonelli, P.;

Reliability and Validity of the Psychoeducational Profile-Third Edition Caregiver Report in Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Fu, Chung-Pei; Chen, Kuan-Lin; Tseng, Mei-Hui; Chiang, Fu-Mei; Hsieh, Ching-Lin

2012-01-01

The aim of this study was to examine the internal consistency, inter-respondent reliability, and convergent and divergent validity of the Psychoeducational Profile-third edition Caregiver Report (PEP3-CR) in children with Autism Spectrum Disorders (ASD). We examined the internal consistency on 66 mothers of children with ASD who completed the…

Analysis of internal and external validity criteria for a computerized visual search task: A pilot study.

PubMed

Richard's, María M; Introzzi, Isabel; Zamora, Eliana; Vernucci, Santiago

2017-01-01

Inhibition is one of the main executive functions, because of its fundamental role in cognitive and social development. Given the importance of reliable and computerized measurements to assessment inhibitory performance, this research intends to analyze the internal and external criteria of validity of a computerized conjunction search task, to evaluate the role of perceptual inhibition. A sample of 41 children (21 females and 20 males), aged between 6 and 11 years old (M = 8.49, SD = 1.47), intentionally selected from a private management school of Mar del Plata (Argentina), middle socio-economic level were assessed. The Conjunction Search Task from the TAC Battery, Coding and Symbol Search tasks from Wechsler Intelligence Scale for Children were used. Overall, results allow us to confirm that the perceptual inhibition task form TAC presents solid rates of internal and external validity that make a valid measurement instrument of this process.

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

The Validation of a Case-Based, Cumulative Assessment and Progressions Examination

PubMed Central

Coker, Adeola O.; Copeland, Jeffrey T.; Gottlieb, Helmut B.; Horlen, Cheryl; Smith, Helen E.; Urteaga, Elizabeth M.; Ramsinghani, Sushma; Zertuche, Alejandra; Maize, David

2016-01-01

Objective. To assess content and criterion validity, as well as reliability of an internally developed, case-based, cumulative, high-stakes third-year Annual Student Assessment and Progression Examination (P3 ASAP Exam). Methods. Content validity was assessed through the writing-reviewing process. Criterion validity was assessed by comparing student scores on the P3 ASAP Exam with the nationally validated Pharmacy Curriculum Outcomes Assessment (PCOA). Reliability was assessed with psychometric analysis comparing student performance over four years. Results. The P3 ASAP Exam showed content validity through representation of didactic courses and professional outcomes. Similar scores on the P3 ASAP Exam and PCOA with Pearson correlation coefficient established criterion validity. Consistent student performance using Kuder-Richardson coefficient (KR-20) since 2012 reflected reliability of the examination. Conclusion. Pharmacy schools can implement internally developed, high-stakes, cumulative progression examinations that are valid and reliable using a robust writing-reviewing process and psychometric analyses. PMID:26941435

Internal validation of STRmix™ for the interpretation of single source and mixed DNA profiles.

PubMed

Moretti, Tamyra R; Just, Rebecca S; Kehl, Susannah C; Willis, Leah E; Buckleton, John S; Bright, Jo-Anne; Taylor, Duncan A; Onorato, Anthony J

2017-07-01

The interpretation of DNA evidence can entail analysis of challenging STR typing results. Genotypes inferred from low quality or quantity specimens, or mixed DNA samples originating from multiple contributors, can result in weak or inconclusive match probabilities when a binary interpretation method and necessary thresholds (such as a stochastic threshold) are employed. Probabilistic genotyping approaches, such as fully continuous methods that incorporate empirically determined biological parameter models, enable usage of more of the profile information and reduce subjectivity in interpretation. As a result, software-based probabilistic analyses tend to produce more consistent and more informative results regarding potential contributors to DNA evidence. Studies to assess and internally validate the probabilistic genotyping software STRmix™ for casework usage at the Federal Bureau of Investigation Laboratory were conducted using lab-specific parameters and more than 300 single-source and mixed contributor profiles. Simulated forensic specimens, including constructed mixtures that included DNA from two to five donors across a broad range of template amounts and contributor proportions, were used to examine the sensitivity and specificity of the system via more than 60,000 tests comparing hundreds of known contributors and non-contributors to the specimens. Conditioned analyses, concurrent interpretation of amplification replicates, and application of an incorrect contributor number were also performed to further investigate software performance and probe the limitations of the system. In addition, the results from manual and probabilistic interpretation of both prepared and evidentiary mixtures were compared. The findings support that STRmix™ is sufficiently robust for implementation in forensic laboratories, offering numerous advantages over historical methods of DNA profile analysis and greater statistical power for the estimation of evidentiary weight, and

Validation of a Russian Language Oswestry Disability Index Questionnaire.

PubMed

Yu, Elizabeth M; Nosova, Emily V; Falkenstein, Yuri; Prasad, Priya; Leasure, Jeremi M; Kondrashov, Dimitriy G

2016-11-01

Study Design  Retrospective reliability and validity study. Objective  To validate a recently translated Russian language version of the Oswestry Disability Index (R-ODI) using standardized methods detailed from previous validations in other languages. Methods  We included all subjects who were seen in our spine surgery clinic, over the age of 18, and fluent in the Russian language. R-ODI was translated by six bilingual people and combined into a consensus version. R-ODI and visual analog scale (VAS) questionnaires for leg and back pain were distributed to subjects during both their initial and follow-up visits. Test validity, stability, and internal consistency were measured using standardized psychometric methods. Results Ninety-seven subjects participated in the study. No change in the meaning of the questions on R-ODI was noted with translation from English to Russian. There was a significant positive correlation between R-ODI and VAS scores for both the leg and back during both the initial and follow-up visits ( p  < 0.01 for all). The instrument was shown to have high internal consistency (Cronbach α = 0.82) and moderate test-retest stability (interclass correlation coefficient = 0.70). Conclusions  The R-ODI is both valid and reliable for use among the Russian-speaking population in the United States.

Reliability, Validity, and Cross-Cultural Adaptation of the Turkish Version of the Bournemouth Questionnaire.

PubMed

Gunaydin, Gurkan; Citaker, Seyit; Meray, Jale; Cobanoglu, Gamze; Gunaydin, Ozge Ece; Hazar Kanik, Zeynep

2016-11-01

Validation of a self-report questionnaire. The purpose of this study was to investigate adaptation, validity, and reliability of the Turkish version of the Bournemouth Questionnaire. Low back pain is one of the most frequent disorders leading to activity limitation. This pain affects most of people in their lives. The most important point to evaluate patient's functional abilities and to decide a successful therapy procedure is to manage the assessment questionnaires precisely. One hundred ten patients with chronic low back pain were included in present study. To assess reliability, test-retest and internal consistency analyses were applied. The results of test-retest analysis were assessed by using Intraclass Correlation Coefficient method (95% confidence interval). For internal consistency, Cronbach alpha value was calculated. Validity of the questionnaire was assessed in terms of construct validity. For construct validity, factor analysis and convergent validity were tested. For convergent validity, total points of the Bournemouth Questionnaire were assessed with the total points of Quebec Back Pain Disability Scale and Roland Morris Disability Questionnaire by using Pearson correlation coefficient analysis. Cronbach alpha value was found 0.914, showing that this questionnaire has high internal consistency. The results of test-retest analysis were varying between 0.851 and 0.927, which shows that test-retest results are highly correlated. Factor analysis test indicated that this questionnaire had one factor. Pearson correlation coefficient of the Bournemouth Questionnaire with Roland Morris Disability Questionnaire was calculated 0.703 and it was found with Quebec Back Pain Disability Scale is 0.659. These results showed that the Bournemouth Questionnaire is very good correlated with Roland Morris Disability Questionnaire and Quebec Back Pain Disability Scale. The Turkish version of the Bournemouth Questionnaire is valid and reliable. 3.

[Validation of a scale measuring coping with extreme risks].

PubMed

López-Vázquez, Esperanza; Marván, María Luisa

2004-01-01

The objective of this study was to validate, in Mexico, the French coping scale "Echelle Toulousaine de Coping". In the fall of 2001, the scale questionnaire was applied to 209 subjects living in different areas of Mexico, exposed to five different types of extreme natural or industrial risks. The discriminatory capacity of the items, as well as the factorial structure and internal consistency of the scale, were analyzed using Mann-Whitney's U test, principal components factorial analysis, and Cronbach's alpha. The final scale was composed of 26 items forming two groups: active coping and passive coping. Internal consistency of the instrument was high, both in the total sample and in the subsample of natural and industrial risks. The coping scale is reliable and valid for the Mexican population. The English version of this paper is available at: http://www.insp.mx/salud/index.html.

Validating a measure to assess factors that affect assistive technology use by students with disabilities in elementary and secondary education.

PubMed

Zapf, Susan A; Scherer, Marcia J; Baxter, Mary F; H Rintala, Diana

2016-01-01

The purpose of this study was to measure the predictive validity, internal consistency and clinical utility of the Matching Assistive Technology to Child & Augmentative Communication Evaluation Simplified (MATCH-ACES) assessment. Twenty-three assistive technology team evaluators assessed 35 children using the MATCH-ACES assessment. This quasi-experimental study examined the internal consistency, predictive validity and clinical utility of the MATCH-ACES assessment. The MATCH-ACES assessment predisposition scales had good internal consistency across all three scales. A significant relationship was found between (a) high student perseverance and need for assistive technology and (b) high teacher comfort and interest in technology use (p = (0).002). Study results indicate that the MATCH-ACES assessment has good internal consistency and validity. Predisposition characteristics of student and teacher combined can influence the level of assistive technology use; therefore, assistive technology teams should assess predisposition factors of the user when recommending assistive technology. Implications for Rehabilitation Educational and medical professionals should be educated on evidence-based assistive technology assessments. Personal experience and psychosocial factors can influence the outcome use of assistive technology. Assistive technology assessments must include an intervention plan for assistive technology service delivery to measure effective outcome use.

Construct validity of the Free and Cued Selective Reminding Test in older adults with memory complaints.

PubMed

Clerici, Francesca; Ghiretti, Roberta; Di Pucchio, Alessandra; Pomati, Simone; Cucumo, Valentina; Marcone, Alessandra; Vanacore, Nicola; Mariani, Claudio; Cappa, Stefano Francesco

2017-06-01

The Free and Cued Selective Reminding Test (FCSRT) is the memory test recommended by the International Working Group on Alzheimer's disease (AD) for the detection of amnestic syndrome of the medial temporal type in prodromal AD. Assessing the construct validity and internal consistency of the Italian version of the FCSRT is thus crucial. The FCSRT was administered to 338 community-dwelling participants with memory complaints (57% females, age 74.5 ± 7.7 years), including 34 with AD, 203 with Mild Cognitive Impairment, and 101 with Subjective Memory Impairment. Internal Consistency was estimated using Cronbach's alpha coefficient. To assess convergent validity, five FCSRT scores (Immediate Free Recall, Immediate Total Recall, Delayed Free Recall, Delayed Total Recall, and Index of Sensitivity of Cueing) were correlated with three well-validated memory tests: Story Recall, Rey Auditory Verbal Learning test, and Rey Complex Figure (RCF) recall (partial correlation analysis). To assess divergent validity, a principal component analysis (an exploratory factor analysis) was performed including, in addition to the above-mentioned memory tasks, the following tests: Word Fluencies, RCF copy, Clock Drawing Test, Trail Making Test, Frontal Assessment Battery, Raven Coloured Progressive Matrices, and Stroop Colour-Word Test. Cronbach's alpha coefficients for immediate recalls (IFR and ITR) and delayed recalls (DFR and DTR) were, respectively, .84 and .81. All FCSRT scores were highly correlated with those of the three well-validated memory tests. The factor analysis showed that the FCSRT does not load on the factors saturated by non-memory tests. These findings indicate that the FCSRT has a good internal consistency and has an excellent construct validity as an episodic memory measure. © 2015 The British Psychological Society.

Validation of the Spanish version of the Irrational Procrastination Scale (IPS).

PubMed

Guilera, Georgina; Barrios, Maite; Penelo, Eva; Morin, Christopher; Steel, Piers; Gómez-Benito, Juana

2018-01-01

The present study is centered in adapting and validating a Spanish version of the Irrational Procrastination Scale (IPS). The sample consists of 365 adults aged 18-77 years (M = 37.70, SD = 12.64). Participants were administered two measures of procrastination, the IPS and the Decisional Procrastination Questionnaire, as well as the Big Five Inventory, and the Satisfaction With Life Scale. First, the factor and replication analysis revealed that the internal structure of the scale is clearly one-dimensional, supporting the idea that IPS seems to measure general procrastination as a single trait. Second, the internal consistency is satisfactory as is the temporal stability of the IPS scores. Third, the correlations encountered between the IPS scores and other measures of procrastination, personality traits and satisfaction with life are all in the expected direction and magnitude. Finally, consistent with previous research, procrastination is related to age, with the youngest being the most procrastinating group. This study represents the first attempt in adapting and validating the IPS measure of procrastination into Spanish. Results suggest that the Spanish version of the IPS offers valid and reliable scores when applied to adult population.

Validation of the Spanish version of the Irrational Procrastination Scale (IPS)

PubMed Central

Guilera, Georgina; Penelo, Eva; Morin, Christopher; Steel, Piers; Gómez-Benito, Juana

2018-01-01

The present study is centered in adapting and validating a Spanish version of the Irrational Procrastination Scale (IPS). The sample consists of 365 adults aged 18–77 years (M = 37.70, SD = 12.64). Participants were administered two measures of procrastination, the IPS and the Decisional Procrastination Questionnaire, as well as the Big Five Inventory, and the Satisfaction With Life Scale. First, the factor and replication analysis revealed that the internal structure of the scale is clearly one-dimensional, supporting the idea that IPS seems to measure general procrastination as a single trait. Second, the internal consistency is satisfactory as is the temporal stability of the IPS scores. Third, the correlations encountered between the IPS scores and other measures of procrastination, personality traits and satisfaction with life are all in the expected direction and magnitude. Finally, consistent with previous research, procrastination is related to age, with the youngest being the most procrastinating group. This study represents the first attempt in adapting and validating the IPS measure of procrastination into Spanish. Results suggest that the Spanish version of the IPS offers valid and reliable scores when applied to adult population. PMID:29304119

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students.

PubMed

Čatipović, Marija; Marković, Martina; Grgurić, Josip

2018-04-27

Validating a questionnaire/instrument before proceeding to the field for data collection is important. An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students ( N = 277). For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students.

Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale with Elementary Age English Learners

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Richards-Tutor, Catherine; Oakes, Wendy Peia; Connor, Kristin

2014-01-01

We report findings of a validation study exploring the Student Risk Screening Scale (SRSS; Drummond, 1994) for use with English learners (ELs) attending a large suburban elementary school. First, we explored the reliability of the SRSS by examining internal consistency, with results indicating adequate internal consistency (0.83). Second, we…

Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents.

PubMed

Reimers, Anne K; Jekauc, Darko; Mess, Filip; Mewes, Nadine; Woll, Alexander

2012-08-29

The purpose of this study was to examine the internal consistency, test-retest reliability, construct validity and predictive validity of a new German self-report instrument to assess the influence of social support and the physical environment on physical activity in adolescents. Based on theoretical consideration, the short scales on social support and physical environment were developed and cross-validated in two independent study samples of 9 to 17 year-old girls and boys. The longitudinal sample of Study I (n = 196) was recruited from a German comprehensive school, and subjects in this study completed the questionnaire twice with a between-test interval of seven days. Cronbach's alphas were computed to determine the internal consistency of the factors. Test-retest reliability of the latent factors was assessed using intra-class coefficients. Factorial validity of the scales was assessed using principle components analysis. Construct validity was determined using a cross-validation technique by performing confirmatory factor analysis with the independent nationwide cross-sectional sample of Study II (n = 430). Correlations between factors and three measures of physical activity (objectively measured moderate-to-vigorous physical activity (MVPA), self-reported habitual MVPA and self-reported recent MVPA) were calculated to determine the predictive validity of the instrument. Construct validity of the social support scale (two factors: parental support and peer support) and the physical environment scale (four factors: convenience, public recreation facilities, safety and private sport providers) was shown. Both scales had moderate test-retest reliability. The factors of the social support scale also had good internal consistency and predictive validity. Internal consistency and predictive validity of the physical environment scale were low to acceptable. The results of this study indicate moderate to good reliability and construct validity of the

[Validity and reliability of the CERAD-Col neuropsychological battery].

PubMed

Aguirre-Acevedo, D C; Gómez, R D; Moreno, S; Henao-Arboleda, E; Motta, M; Muñoz, C; Arana, A; Pineda, D A; Lopera, F

Alzheimer's disease (AD) is an important public health problem due to its disabling character and high individual, familial and social costs. The CERAD neuropsychological battery has been widely used for evaluation and diagnosis of the cognitive deficit associated with AD. This instrument has been adapted to the Colombian culture (CERAD-Col) for the Neurosciences Group. A study was carried out to establish the validity and reliability of the CERAD-Col in Colombian, Spanish-speaking individuals aged 50 years or more. It included 151 controls and 151 AD patients. Controls were selected from a convenience sample of 848 adults aged 50 years or more. The construct validity was determined in three ways: 1) factorial analysis; 2) correlation with the functional scales FAST and GDS (convergent-type validity) and, 3) comparison between the two groups. Internal consistency was determined by means of Cronbach's alpha coefficient. Three factors -memory, language and praxis- explained 88% of the total variance. Moderate but statistically significant correlations were found between neuropsychological tests and functional scales. Internal consistency and test-retest reproducibility were high. The AD group exhibited significantly lower scores (p < 0.05) than the control one. CERAD-Col is valid and reliable for the diagnosis of AD in Colombian Spanish-speaking population aged 50 years or more.

Translating and validating a Training Needs Assessment tool into Greek

PubMed Central

Markaki, Adelais; Antonakis, Nikos; Hicks, Carolyn M; Lionis, Christos

2007-01-01

Background The translation and cultural adaptation of widely accepted, psychometrically tested tools is regarded as an essential component of effective human resource management in the primary care arena. The Training Needs Assessment (TNA) is a widely used, valid instrument, designed to measure professional development needs of health care professionals, especially in primary health care. This study aims to describe the translation, adaptation and validation of the TNA questionnaire into Greek language and discuss possibilities of its use in primary care settings. Methods A modified version of the English self-administered questionnaire consisting of 30 items was used. Internationally recommended methodology, mandating forward translation, backward translation, reconciliation and pretesting steps, was followed. Tool validation included assessing item internal consistency, using the alpha coefficient of Cronbach. Reproducibility (test – retest reliability) was measured by the kappa correlation coefficient. Criterion validity was calculated for selected parts of the questionnaire by correlating respondents' research experience with relevant research item scores. An exploratory factor analysis highlighted how the items group together, using a Varimax (oblique) rotation and subsequent Cronbach's alpha assessment. Results The psychometric properties of the Greek version of the TNA questionnaire for nursing staff employed in primary care were good. Internal consistency of the instrument was very good, Cronbach's alpha was found to be 0.985 (p < 0.001) and Kappa coefficient for reproducibility was found to be 0.928 (p < 0.0001). Significant positive correlations were found between respondents' current performance levels on each of the research items and amount of research involvement, indicating good criterion validity in the areas tested. Factor analysis revealed seven factors with eigenvalues of > 1.0, KMO (Kaiser-Meyer-Olkin) measure of sampling adequacy = 0.680 and

Assessing impact of physical activity-based youth development programs: validation of the Life Skills Transfer Survey (LSTS).

PubMed

Weiss, Maureen R; Bolter, Nicole D; Kipp, Lindsay E

2014-09-01

A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program. In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the Life Skills Transfer Survey (LSTS), a measure of perceived life skills transfer. Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS. RESULTS from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

The validation of the Supervision of Thesis Questionnaire (STQ).

PubMed

Henricson, Maria; Fridlund, Bengt; Mårtensson, Jan; Hedberg, Berith

2018-06-01

The supervision process is characterized by differences between the supervisors' and the students' expectations before the start of writing a bachelor thesis as well as after its completion. A review of the literature did not reveal any scientifically tested questionnaire for evaluating nursing students' expectations of the supervision process when writing a bachelor thesis. The aim of the study was to determine the construct validity and internal consistency reliability of a questionnaire for measuring nursing students' expectations of the bachelor thesis supervision process. The study had a developmental and methodological design carried out in four steps including construct validity and internal consistency reliability statistical procedures: construction of the items, assessment of face validity, data collection and data analysis. This study was conducted at a university in southern Sweden, where students on the "Nursing student thesis, 15 ECTS" course were consecutively selected for participation. Of the 512 questionnaires distributed, 327 were returned, a response rate of 64%. Five factors with a total variance of 74% and good communalities, ≥0.64, were extracted from the 10-item STQ. The internal consistency of the 10 items was 0.68. The five factors were labelled: The nature of the supervision process, The supervisor's role as a coach, The students' progression to self-support, The interaction between students and supervisor and supervisor competence. A didactic, useful and secure questionnaire measuring nursing students' expectations of the bachelor thesis supervision process based on three main forms of supervision was created. Copyright © 2018 Elsevier Ltd. All rights reserved.

Living Kidney Donation Questionnaire (PCID-DVR-Ríos): Validation and Psychometric Characteristics in a Spanish-Speaking Population.

PubMed

Ríos, A; López-Navas, A I; De-Francisco, C; Sánchez, Á; Hernández, A M; Ramírez, P; Parrilla, P

2018-03-01

The attitude toward living kidney donation is important for certain promotion campaigns, however, there are few validated questionnaires in this regard. The aim of this work was to analyze the psychometric characteristics of the attitudes questionnaire about living renal donation, PCID-DVR-Ríos (Cuestionario del Proyecto Colaborativo Internacional Donante sobre Donación de Vivo Renal [Questionnaire of the International Collaborative Donor Project on Living Kidney Donation] developed by Dr Ríos) for the validation of the questionnaire in population of Spanish speakers. The sample studied represented the population >18 years of age, native and resident of Spain, stratified by age and sex. The measurement instrument was the PCID-DVR-Ríos questionnaire. Analysis of data was structured in several stages: an initial description of the data, exploratory factor analysis, item analysis, and internal consistency of the factors. The questionnaire consists of 11 items, distributed in 3 factors of 6, 3, and 2 items. This structure accounts for 63.995% of the total variance. By factors, the variance is distributed as follows: factor 1: 38.461%; factor 2: 14.228%; and factor 3: 11.306%. The analysis of items and internal consistency supported the trifactorial composition. Each factor is internally consistent (α1 = .80; α2 = .70; α3 = .55). The analyzed dimensions of the PCID-DVR Ríos questionnaire to analyze attitude toward living kidney donation showed a good fit in terms of factorial validity and internal consistency values. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and validation of a scale to measure perceived control of internal states.

PubMed

Pallant, J F

2000-10-01

One of the key developments in the psychological literature on control has been the growing recognition of the multidimensional nature of the control construct. Recent research suggests that perceived control of internal states may be just as important as perceived control of external events. The Perceived Control of Internal States Scale was developed to provide a measure of the degree to which people feel they have control of their internal states (emotions, thoughts, physical reactions). I report the results of 2 studies (N= 689), supporting the reliability, construct, and incremental validity of the scale. The buffering effects of perceived control for people facing major life events was also explored, with higher levels of perceived control being associated with less physical and psychological symptoms of strain.

Internal Consistency and Associated Characteristics of Informant Discrepancies in Clinic Referred Youths Age 11 to 17 Years

PubMed Central

De Los Reyes, Andres; Youngstrom, Eric A.; Pabón, Shairy C.; Youngstrom, Jennifer K.; Feeny, Norah C.; Findling, Robert L.

2011-01-01

In this study, we examined the internal consistency of informant discrepancies in reports of youth behavior and emotional problems and their unique relations with youth, caregiver, and family characteristics. In a heterogeneous multisite clinic sample of 420 youths (ages 11 to 17 years), high internal consistency estimates were observed across measures of informant discrepancies. Further, latent profile analyses identified systematic patterns of discrepancies, characterized by their magnitude and direction (i.e., which informant reported greater youth problems). Additionally, informant discrepancies systematically and uniquely related to informants' own perspectives of youth mood problems, and these relations remained significant after taking into account multiple informants' reports of informant characteristics widely known to relate to informant discrepancies. These findings call into the question the prevailing view of informant discrepancies as indicative of unreliability and/or bias on the part of informants' reports of youths' behavior. PMID:21229442

Development of a framework for international certification by OIE of diagnostic tests validated as fit for purpose.

PubMed

Wright, P; Edwards, S; Diallo, A; Jacobson, R

2006-01-01

Historically, the OIE has focused on test methods applicable to trade and the international movement of animals and animal products. With its expanding role as the World Organisation for Animal Health, the OIE has recognised the need to evaluate test methods relative to specific diagnostic applications other than trade. In collaboration with its international partners, the OIE solicited input from experts through consultants' meetings on the development of guidelines for validation and certification of diagnostic assays for infectious animal diseases. Recommendations from the first meeting were formally adopted and have subsequently been acted upon by the OIE. A validation template has been developed that specifically requires a test to be fit or suited for its intended purpose (e.g. as a screening or a confirmatory test). This is a key criterion for validation. The template incorporates four distinct stages of validation, each of which has bearing on the evaluation of fitness for purpose. The OIE has just recently created a registry for diagnostic tests that fulfil these validation requirements. Assay developers are invited to submit validation dossiers to the OIE for evaluation by a panel of experts. Recognising that validation is an incremental process, tests methods achieving at least the first stages of validation may be provisionally accepted. To provide additional confidence in assay performance, the OIE, through its network of Reference Laboratories, has embarked on the development of evaluation panels. These panels would contain specially selected test samples that would assist in verifying fitness for purpose.

Feasibility and validity of International Classification of Diseases based case mix indices.

PubMed

Yang, Che-Ming; Reinke, William

2006-10-06

Severity of illness is an omnipresent confounder in health services research. Resource consumption can be applied as a proxy of severity. The most commonly cited hospital resource consumption measure is the case mix index (CMI) and the best-known illustration of the CMI is the Diagnosis Related Group (DRG) CMI used by Medicare in the U.S. For countries that do not have DRG type CMIs, the adjustment for severity has been troublesome for either reimbursement or research purposes. The research objective of this study is to ascertain the construct validity of CMIs derived from International Classification of Diseases (ICD) in comparison with DRG CMI. The study population included 551 acute care hospitals in Taiwan and 2,462,006 inpatient reimbursement claims. The 18th version of GROUPER, the Medicare DRG classification software, was applied to Taiwan's 1998 National Health Insurance (NHI) inpatient claim data to derive the Medicare DRG CMI. The same weighting principles were then applied to determine the ICD principal diagnoses and procedures based costliness and length of stay (LOS) CMIs. Further analyses were conducted based on stratifications according to teaching status, accreditation levels, and ownership categories. The best ICD-based substitute for the DRG costliness CMI (DRGCMI) is the ICD principal diagnosis costliness CMI (ICDCMI-DC) in general and in most categories with Spearman's correlation coefficients ranging from 0.938-0.462. The highest correlation appeared in the non-profit sector. ICD procedure costliness CMI (ICDCMI-PC) outperformed ICDCMI-DC only at the medical center level, which consists of tertiary care hospitals and is more procedure intensive. The results of our study indicate that an ICD-based CMI can quite fairly approximate the DRGCMI, especially ICDCMI-DC. Therefore, substituting ICDs for DRGs in computing the CMI ought to be feasible and valid in countries that have not implemented DRGs.

Feasibility, internal consistency and covariates of TICS-m (telephone interview for cognitive status-modified) in a population-based sample: findings from the KORA-Age study.

PubMed

Lacruz, Me; Emeny, Rt; Bickel, H; Linkohr, B; Ladwig, Kh

2013-09-01

Test the feasibility of the modified telephone interview for cognitive status (TICS-m) as a screening tool to detect cognitive impairment in a population-based sample of older subjects. Data were collected from 3,578 participants, age 65-94 years, of the KORA-Age study. We used analysis of covariance to test for significant sex, age and educational differences in raw TICS-m scores. Internal consistency was analysed by assessing Cronbach's alpha. Correction for education years was undertaken, and participants were divided in three subgroups following validated cut-offs. Finally, a logistic regression was performed to determine the impact of sex on cognition subgroups. Internal consistency of the TICS-m was 0.78. Study participants needed approximately 5.4 min to complete the interview. Lower raw TICS-m scores were associated with male sex, older age and lower education (all p < 0.0001). After correction for education years, 2,851 (79%) had a non-impaired cognitive status (score >31). Male sex was independently associated with having a score equal to or below 27 and 31 (OR = 1.9, 95% CI 1.4-2.5 and OR = 1.5, 95% CI 1.2-1.7, respectively). The TICS-m is a feasible questionnaire for community-dwelling older adults with normal cognitive function or moderate cognitive impairment. Lower cognitive performance was associated with being a man, being older, and having fewer years of formal education. Copyright © 2012 John Wiley & Sons, Ltd.

Brazilian version of the Nottingham Sensory Assessment: validity, agreement and reliability.

PubMed

Lima, Daniela H F; Queiroz, Ana P; De Salvo, Geovana; Yoneyama, Simone M; Oberg, Telma D; Lima, Núbia M F V

2010-01-01

To investigate the inter-rater and intra-rater reliability, construct validity and internal consistency of the Brazilian version of the Nottingham Sensory Assessment for Stroke Patients (NSA). The instrument was translated into Portuguese from its original in English by a bilingual translator and was then back-translated into English. Twenty-one hemiparetics were evaluated by two examiners using the NSA and the Fugl-Meyer Assessment (FMA) of physical performance. Significant correlation were found between the FMA and the NSA (r=0.752). The NSA showed excellent internal consistency (0.86), and there were acceptable inter- and intra-rater reliability for all items of the NSA, except temperature. Significant ceiling effects were found for the NSA and the FMA. The Brazilian version of the NSA met the criteria for agreement, internal consistency and concurrent validity. It was quick and easy to apply, and it could be used within clinical practice in neuro-rehabilitation outpatient clinics to assess sensory functions following stroke. The significant ceiling effect for the NSA did not limit its use, given that for the same patients, the FMA also showed ceiling effects.

Cross-cultural adaptation and validation of the Turkish version of Oxford hip score.

PubMed

Tuğay, Baki Umut; Tuğay, Nazan; Güney, Hande; Hazar, Zeynep; Yüksel, İnci; Atilla, Bülent

2015-06-01

The purpose of this study was to translate the Oxford hip score (OHS) into Turkish and to evaluate the psychometric properties by testing the internal consistency, reproducibility, construct validity, and responsiveness in patients with hip osteoarthritis (OA). Oxford hip score was translated and culturally adapted according to the guidelines in the literature. Seventy patients (mean age 61.45 ± 9.29 years) with hip osteoarthritis participated in the study. Patients completed the Turkish Oxford hip score (OHS-TR), the Short-Form 36 (SF-36), and Western Ontario and McMaster Universities Index (WOMAC). Internal consistency was tested using Cronbach's α coefficient. Patients completed OHS-TR questionnaire twice in 7 days for determining the reproducibility. Correlation between the total results of both tests was determined by the Pearson correlation coefficient and intraclass correlation coefficient (ICC). Validity was assessed by calculating the Pearson correlation coefficient between the OHS-TR and WOMAC and SF-36 scores. Floor and ceiling effects were analyzed. The internal consistency was high (Cronbach's α 0.93). The construct validity showed a significant correlation between the OHS-TR and WOMAC and related SF-36 domains (p < 0.001). The ICC's ranged between 0.80 and 0.99. There was no floor or ceiling effect in total OHS-TR score. The OHS-TR questionnaire is valid, reliable, and responsive for the Turkish-speaking patients with hip OA.

Reliability, validity, sensitivity and specificity of Guajarati version of the Roland-Morris Disability Questionnaire.

PubMed

Nambi, S Gopal

2013-01-01

The most common instruments developed to assess the functional status of patients with Non specific low back pain is the Roland-Morris Disability Questionnaire (RMDQ). Clinical and epidemiological research related to low back pain in the Gujarati population would be facilitated by the availability of well-established outcome measures. To find the reliability, validity, sensitivity and specificity of the Gujarati version of the RMDQ for use in Non Specific Chronic low back pain. A reliability, validity, sensitivity and specificity study of Gujarati version of the Roland-Morris Disability Questionnaire (RMDQ). Thirty out patients with Non Specific Chronic low back pain were assessed by the RMDQ. Reliability is assessed by using internal consistency and the intra-class correlation coefficient (ICC). Internal construct validity is assessed by RASCH Analysis and external construct validity is assessed by association with pain and spinal movement. Clinical calculator was used to determine the sensitivity and specificity. Internal consistency of the RMDQ is found to be adequate (> 0.65) at both times, with high ICC's also at both time points. Internal construct validity of the scale is good, indicating a single underlying construct. Expected associations with pain and spinal movement confirm external construct validity. The Sensitivity and Specificity at cut off point of 0.5 was 80% and 84% with respectively positive predictive value (PPV) of 83.33% and negative predictive value (NPV) of 80.76%. The Questionnaire is at the ordinal level. The RMDQ is a one-dimensional, ordinal measure, which works well in the Gujarati population.

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs

Development and validation of the Vietnamese primary care assessment tool

PubMed Central

2018-01-01

Objective To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. Design A quantitative cross sectional study. Setting 56 communes in 3 representative provinces of central Vietnam. Participants Total of 3289 people who used health care services at health facility at least once over the past two years. Results The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach’s alpha above 0.70 except for the subscale of Family Centeredness. Conclusions The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops. PMID:29324851

Development and validation of the Vietnamese primary care assessment tool.

PubMed

Hoa, Nguyen Thi; Tam, Nguyen Minh; Peersman, Wim; Derese, Anselme; Markuns, Jeffrey F

2018-01-01

To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. A quantitative cross sectional study. 56 communes in 3 representative provinces of central Vietnam. Total of 3289 people who used health care services at health facility at least once over the past two years. The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach's alpha above 0.70 except for the subscale of Family Centeredness. The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops.

The Children's Dermatology Life Quality Index (CDLQI): linguistic and cultural validation in Serbian.

PubMed

Janković, Slavenka; Vukićević, Jelica; Djordjević, Sanja; Janković, Janko; Marinković, Jelena; Erić, Miloš

2013-01-01

The Children's Dermatology Life Quality Index (CDLQI) evaluates the impact of skin diseases on the patient's quality of life. The purpose of the study was to translate and to validate the CDLQI into Serbian. The CDLQI was translated into Serbian following international recommendations for translation and cultural adaptation. The validation study was carried out on a large cohort of secondary schoolchildren who self-reported acne. Translating the CDLQI consisted of forward translation, reconciliation, back translation, back-translation review, and cognitive debriefing. The good internal consistency of the scale was demonstrated with a Cronbach alpha coefficient of 0.87. A Spearman correlation coefficient of 0.66 between the CDLQI and the Cardiff Acne Disability Index (CADI) was deemed satisfactory to demonstrate concurrent validity. The translation, cross-cultural adaptation, and psychometric qualities of the CDLQI were satisfactory, enabling its application in clinical practice and future studies.

Apparent and internal validity of a Monte Carlo-Markov model for cardiovascular disease in a cohort follow-up study.

PubMed

Nijhuis, Rogier L; Stijnen, Theo; Peeters, Anna; Witteman, Jacqueline C M; Hofman, Albert; Hunink, M G Myriam

2006-01-01

To determine the apparent and internal validity of the Rotterdam Ischemic heart disease & Stroke Computer (RISC) model, a Monte Carlo-Markov model, designed to evaluate the impact of cardiovascular disease (CVD) risk factors and their modification on life expectancy (LE) and cardiovascular disease-free LE (DFLE) in a general population (hereinafter, these will be referred to together as (DF)LE). The model is based on data from the Rotterdam Study, a cohort follow-up study of 6871 subjects aged 55 years and older who visited the research center for risk factor assessment at baseline (1990-1993) and completed a follow-up visit 7 years later (original cohort). The transition probabilities and risk factor trends used in the RISC model were based on data from 3501 subjects (the study cohort). To validate the RISC model, the number of simulated CVD events during 7 years' follow-up were compared with the observed number of events in the study cohort and the original cohort, respectively, and simulated (DF)LEs were compared with the (DF)LEs calculated from multistate life tables. Both in the study cohort and in the original cohort, the simulated distribution of CVD events was consistent with the observed number of events (CVD deaths: 7.1% v. 6.6% and 7.4% v. 7.6%, respectively; non-CVD deaths: 11.2% v. 11.5% and 12.9% v. 13.0%, respectively). The distribution of (DF)LEs estimated with the RISC model consistently encompassed the (DF)LEs calculated with multistate life tables. The simulated events and (DF)LE estimates from the RISC model are consistent with observed data from a cohort follow-up study.

Concurrent Validity Between a Shared Curriculum, the Internal Medicine In-Training Examination, and the American Board of Internal Medicine Certifying Examination.

PubMed

Sisson, Stephen D; Bertram, Amanda; Yeh, Hsin-Chieh

2015-03-01

A core objective of residency education is to facilitate learning, and programs need more curricula and assessment tools with demonstrated validity evidence. We sought to demonstrate concurrent validity between performance on a widely shared, ambulatory curriculum (the Johns Hopkins Internal Medicine Curriculum), the Internal Medicine In-Training Examination (IM-ITE), and the American Board of Internal Medicine Certifying Examination (ABIM-CE). A cohort study of 443 postgraduate year (PGY)-3 residents at 22 academic and community hospital internal medicine residency programs using the curriculum through the Johns Hopkins Internet Learning Center (ILC). Total and percentile rank scores on ILC didactic modules were compared with total and percentile rank scores on the IM-ITE and total scores on the ABIM-CE. The average score on didactic modules was 80.1%; the percentile rank was 53.8. The average IM-ITE score was 64.1% with a percentile rank of 54.8. The average score on the ABIM-CE was 464. Scores on the didactic modules, IM-ITE, and ABIM-CE correlated with each other (P < .05). Residents completing greater numbers of didactic modules, regardless of scores, had higher IM-ITE total and percentile rank scores (P < .05). Resident performance on modules covering back pain, hypertension, preoperative evaluation, and upper respiratory tract infection was associated with IM-ITE percentile rank. Performance on a widely shared ambulatory curriculum is associated with performance on the IM-ITE and the ABIM-CE.

Concurrent Validity Between a Shared Curriculum, the Internal Medicine In-Training Examination, and the American Board of Internal Medicine Certifying Examination

PubMed Central

Sisson, Stephen D.; Bertram, Amanda; Yeh, Hsin-Chieh

2015-01-01

Background A core objective of residency education is to facilitate learning, and programs need more curricula and assessment tools with demonstrated validity evidence. Objective We sought to demonstrate concurrent validity between performance on a widely shared, ambulatory curriculum (the Johns Hopkins Internal Medicine Curriculum), the Internal Medicine In-Training Examination (IM-ITE), and the American Board of Internal Medicine Certifying Examination (ABIM-CE). Methods A cohort study of 443 postgraduate year (PGY)-3 residents at 22 academic and community hospital internal medicine residency programs using the curriculum through the Johns Hopkins Internet Learning Center (ILC). Total and percentile rank scores on ILC didactic modules were compared with total and percentile rank scores on the IM-ITE and total scores on the ABIM-CE. Results The average score on didactic modules was 80.1%; the percentile rank was 53.8. The average IM-ITE score was 64.1% with a percentile rank of 54.8. The average score on the ABIM-CE was 464. Scores on the didactic modules, IM-ITE, and ABIM-CE correlated with each other (P < .05). Residents completing greater numbers of didactic modules, regardless of scores, had higher IM-ITE total and percentile rank scores (P < .05). Resident performance on modules covering back pain, hypertension, preoperative evaluation, and upper respiratory tract infection was associated with IM-ITE percentile rank. Conclusions Performance on a widely shared ambulatory curriculum is associated with performance on the IM-ITE and the ABIM-CE. PMID:26217421

Validity and reliability testing of the Prenatal Psychosocial Profile.

PubMed

Curry, M A; Campbell, R A; Christian, M

1994-04-01

Two studies of low-income pregnant women (N = 179) were done to examine the validity and reliability of the Prenatal Psychosocial Profile (PPP). The PPP, a composite of the Rosenberg Self-Esteem Scale, the Support Behaviors Inventory, and a newly developed measure of stress, is a brief, comprehensive clinical assessment of psychosocial risk during pregnancy. Construct validity of the stress scale was supported by theoretically predicted negative correlations with self-esteem, partner support, and support from others (N = 91). Convergent validity of the stress scale was demonstrated by a correlation of .71 with the Difficult Life Circumstances Scale. Adequate levels of internal consistency were found. Interrelationships between the four subscales were consistent with the underlying conceptualization, and there was beginning evidence of the factorial independence of the subscales.

Validation of the Modified Fatigue Impact Scale in Parkinson's disease.

PubMed

Schiehser, Dawn M; Ayers, Catherine R; Liu, Lin; Lessig, Stephanie; Song, David S; Filoteo, J Vincent

2013-03-01

Fatigue is a common symptom in Parkinson's disease (PD); however, a multidimensional scale that measures the impact of fatigue on functioning has yet to be validated in this population. The aim of this study was to examine the validity of the Modified Fatigue Impact Scale (MFIS), a self-report measure that assesses the effects of fatigue on physical, cognitive, and psychosocial functioning, in a sample of nondemented PD patients. PD patients (N = 100) completed the MFIS, the Positive and Negative Affect Schedule (PANAS-X), and several additional measures of psychosocial, cognitive, and motor functioning. A Principal Component Analysis (PCA) and item analysis using Cronbach's alpha were conducted to determine structural validity and internal consistency of the MFIS. Correlational analyses were performed between the MFIS and the PANAS-X fatigue subscale to evaluate convergent validity and between the MFIS and measures of depression, anxiety, apathy, and disease-related symptoms to determine divergent validity. The PCA identified two viable MFIS subscales: a cognitive subscale and a combination of the original scale's physical and psychosocial subscales as one factor. Item analysis revealed high internal consistency of all 21 items and the items within the two subscales. The MFIS had strong convergent validity with the PANAS-X fatigue subscale and adequate divergent validity with measures of disease stage, motor function, and cognition. Overall, this study demonstrates that the MFIS is a valid multidimensional measure that can be used to evaluate the impact of fatigue on cognitive and physical/social functioning in PD patients without dementia. Published by Elsevier Ltd.

Internal validation of STRmix™ - A multi laboratory response to PCAST.

PubMed

Bright, Jo-Anne; Richards, Rebecca; Kruijver, Maarten; Kelly, Hannah; McGovern, Catherine; Magee, Alan; McWhorter, Andrew; Ciecko, Anne; Peck, Brian; Baumgartner, Chase; Buettner, Christina; McWilliams, Scott; McKenna, Claire; Gallacher, Colin; Mallinder, Ben; Wright, Darren; Johnson, Deven; Catella, Dorothy; Lien, Eugene; O'Connor, Craig; Duncan, George; Bundy, Jason; Echard, Jillian; Lowe, John; Stewart, Joshua; Corrado, Kathleen; Gentile, Sheila; Kaplan, Marla; Hassler, Michelle; McDonald, Naomi; Hulme, Paul; Oefelein, Rachel H; Montpetit, Shawn; Strong, Melissa; Noël, Sarah; Malsom, Simon; Myers, Steven; Welti, Susan; Moretti, Tamyra; McMahon, Teresa; Grill, Thomas; Kalafut, Tim; Greer-Ritzheimer, MaryMargaret; Beamer, Vickie; Taylor, Duncan A; Buckleton, John S

2018-05-01

We report a large compilation of the internal validations of the probabilistic genotyping software STRmix™. Thirty one laboratories contributed data resulting in 2825 mixtures comprising three to six donors and a wide range of multiplex, equipment, mixture proportions and templates. Previously reported trends in the LR were confirmed including less discriminatory LRs occurring both for donors and non-donors at low template (for the donor in question) and at high contributor number. We were unable to isolate an effect of allelic sharing. Any apparent effect appears to be largely confounded with increased contributor number. Copyright © 2018. Published by Elsevier B.V.

Impact of applying the more stringent validation criteria of the revised European Society of Hypertension International Protocol 2010 on earlier validation studies.

PubMed

Stergiou, George S; Karpettas, Nikos; Atkins, Neil; O'Brien, Eoin

2011-04-01

Since 2002 when the European Society of Hypertension International Protocol (ESH-IP) was published it has become the preferred protocol for validating blood pressure monitors worldwide. In 2010, a revised version of the ESH-IP with more stringent criteria was published. This study assesses the impact of applying the revised ESH-IP criteria. A systematic literature review of ESH-IP studies reported between 2002 and 2010 was conducted. The impact of applying the ESH-IP 2010 criteria retrospectively on the data reported in these studies was investigated. The performance of the oscillometric devices in the last decade was also investigated on the basis of the ESH-IP criteria. Among 119 published studies, 112 with sufficient data were analyzed. According to ESH-IP 2002, the test device failed in 19 studies, whereas by applying the ESH-IP 2010 criteria in 28 additional studies increased the failure rate from 17 to 42%. Of these 28 studies, in 20 (71%) the test device failed at part 1 (accuracy per measurement) and in 22 (79%) at part 2 (accuracy per subject). Most of the failures involved the '5 mmHg or less' criterion. In the last decade there has been a consistent trend toward improved performance of oscillometric devices assessed on the basis of the ESH-IP criteria. This retrospective analysis shows that the stricter revised ESH-IP 2010 criteria will noticeably increase the failure rate of devices being validated. Oscillometric devices are becoming more accurate, and the revised ESH-IP by acknowledging this trend will allow more accurate devices to enter the market.

The Chinese version of the Outcome Expectations for Exercise scale: validation study.

PubMed

Lee, Ling-Ling; Chiu, Yu-Yun; Ho, Chin-Chih; Wu, Shu-Chen; Watson, Roger

2011-06-01

Estimates of the reliability and validity of the English nine-item Outcome Expectations for Exercise (OEE) scale have been tested and found to be valid for use in various settings, particularly among older people, with good internal consistency and validity. Data on the use of the OEE scale among older Chinese people living in the community and how cultural differences might affect the administration of the OEE scale are limited. To test the validity and reliability of the Chinese version of the Outcome Expectations for Exercise scale among older people. A cross-sectional validation study was designed to test the Chinese version of the OEE scale (OEE-C). Reliability was examined by testing both the internal consistency for the overall scale and the squared multiple correlation coefficient for the single item measure. The validity of the scale was tested on the basis of both a traditional psychometric test and a confirmatory factor analysis using structural equation modelling. The Mokken Scaling Procedure (MSP) was used to investigate if there were any hierarchical, cumulative sets of items in the measure. The OEE-C scale was tested in a group of older people in Taiwan (n=108, mean age=77.1). There was acceptable internal consistency (alpha=.85) and model fit in the scale. Evidence of the validity of the measure was demonstrated by the tests for criterion-related validity and construct validity. There was a statistically significant correlation between exercise outcome expectations and exercise self-efficacy (r=.34, p<.01). An analysis of the Mokken Scaling Procedure found that nine items of the scale were all retained in the analysis and the resulting scale was reliable and statistically significant (p=.0008). The results obtained in the present study provided acceptable levels of reliability and validity evidence for the Chinese Outcome Expectations for Exercise scale when used with older people in Taiwan. Future testing of the OEE-C scale needs to be carried out

The Safety Culture Enactment Questionnaire (SCEQ): Theoretical model and empirical validation.

PubMed

de Castro, Borja López; Gracia, Francisco J; Tomás, Inés; Peiró, José M

2017-06-01

This paper presents the Safety Culture Enactment Questionnaire (SCEQ), designed to assess the degree to which safety is an enacted value in the day-to-day running of nuclear power plants (NPPs). The SCEQ is based on a theoretical safety culture model that is manifested in three fundamental components of the functioning and operation of any organization: strategic decisions, human resources practices, and daily activities and behaviors. The extent to which the importance of safety is enacted in each of these three components provides information about the pervasiveness of the safety culture in the NPP. To validate the SCEQ and the model on which it is based, two separate studies were carried out with data collection in 2008 and 2014, respectively. In Study 1, the SCEQ was administered to the employees of two Spanish NPPs (N=533) belonging to the same company. Participants in Study 2 included 598 employees from the same NPPs, who completed the SCEQ and other questionnaires measuring different safety outcomes (safety climate, safety satisfaction, job satisfaction and risky behaviors). Study 1 comprised item formulation and examination of the factorial structure and reliability of the SCEQ. Study 2 tested internal consistency and provided evidence of factorial validity, validity based on relationships with other variables, and discriminant validity between the SCEQ and safety climate. Exploratory Factor Analysis (EFA) carried out in Study 1 revealed a three-factor solution corresponding to the three components of the theoretical model. Reliability analyses showed strong internal consistency for the three scales of the SCEQ, and each of the 21 items on the questionnaire contributed to the homogeneity of its theoretically developed scale. Confirmatory Factor Analysis (CFA) carried out in Study 2 supported the internal structure of the SCEQ; internal consistency of the scales was also supported. Furthermore, the three scales of the SCEQ showed the expected correlation

Validity and Reliability of International Physical Activity Questionnaire-Short Form in Chinese Youth

ERIC Educational Resources Information Center

Wang, Chao; Chen, Peijie; Zhuang, Jie

2013-01-01

Purpose: The psychometric profiles of the widely used International Physical Activity Questionnaire-Short Form (IPAQ-SF) in Chinese youth have not been reported. The purpose of this study was to examine the validity and reliability of the IPAQ-SF using a sample of Chinese youth. Method: One thousand and twenty-one youth (M[subscript age] = 14.26 ±…

The 11-item Medication Adherence Reasons Scale: reliability and factorial validity among patients with hypertension in Malaysian primary healthcare settings.

PubMed

Shima, Razatul; Farizah, Hairi; Majid, Hazreen Abdul

2015-08-01

The aim of this study was to assess the reliability and validity of a modified Malaysian version of the Medication Adherence Reasons Scale (MAR-Scale). In this cross-sectional study, the 15-item MAR-Scale was administered to 665 patients with hypertension who attended one of the four government primary healthcare clinics in the Hulu Langat and Klang districts of Selangor, Malaysia, between early December 2012 and end-March 2013. The construct validity was examined in two phases. Phase I consisted of translation of the MAR-Scale from English to Malay, a content validity check by an expert panel, a face validity check via a small preliminary test among patients with hypertension, and exploratory factor analysis (EFA). Phase II involved internal consistency reliability calculations and confirmatory factor analysis (CFA). EFA verified five existing factors that were previously identified (i.e. issues with medication management, multiple medications, belief in medication, medication availability, and the patient's forgetfulness and convenience), while CFA extracted four factors (medication availability issues were not extracted). The final modified MAR-Scale model, which had 11 items and a four-factor structure, provided good evidence of convergent and discriminant validities. Cronbach's alpha coefficient was > 0.7, indicating good internal consistency of the items in the construct. The results suggest that the modified MAR-Scale has good internal consistencies and construct validity. The validated modified MAR-Scale (Malaysian version) was found to be suitable for use among patients with hypertension receiving treatment in primary healthcare settings. However, the comprehensive measurement of other factors that can also lead to non-adherence requires further exploration.

Validity and reliability of the Mexican resilience measurement scale in families of children with chronic conditions.

PubMed

Toledano-Toledano, Filiberto; Moral de la Rubia, José; McCubbin, Laurie D; Liebenberg, Linda; Vera Jiménez, Jesús Alejandro; Rivera-Rivera, Leonor; Hart, Angie; Barajas Nava, Leticia Andrea; Salazar García, Marcela; Martínez Valverde, Silvia; Rivera Aragón, Sofía; Sánchez Gómez, Concepción; Villavicencio Guzmán, Laura; Granados García, Victor; Garduño Espinosa, Juan

2017-12-13

The resilience to face disease is a process of positive adaptation despite the loss of health. It involves developing vitality and skills to overcome the negative effects of adversity, risks, and vulnerability caused by disease. In Mexico, the Mexican Resilience Measurement Scale (RESI-M) has been validated with a general population and has a five-factor structure. However, this scale does not allow evaluation of resilience in specific subpopulations, such as caregivers. This study investigated the psychometric properties of RESI-M in 446 family caregivers of children with chronic diseases. A confirmatory factor analysis (CFA) was performed, internal consistency values were calculated using Cronbach's alpha coefficient, and mean comparisons were determined using t-tests. The expected five-factor model showed an adequate fit with the data based on a maximum likelihood test. The internal consistency for each factor ranged from .76 to .93, and the global internal consistency was .95. No average difference in RESI-M and its factors was found between women and men. The RESI-M showed internal consistency and its model of five correlated factors was valid among family caregivers of children with chronic diseases.

Psychosocial Adjustment to Illness Scale: Factor structure, reliability, and validity assessment in a sample of Greek breast cancer patients.

PubMed

Kolokotroni, Philippa; Anagnostopoulos, Fotios; Missitzis, Ioannis

2017-07-01

The study and measurement of psychosocial adjustment is important for evaluating patients' well-being, and assessing the illness's course, treatment's success, and patients' recovery. In this study, internal consistency reliability and construct validity of the Greek version of the Psychosocial Adjustment to Illness Scale-Self-Report (PAIS-SR) were examined. Demographic and psychosocial data were collected from a sample of 243 women with breast cancer, recruited from September 2011 to December 2012. With some exceptions in specific items, the original conceptually-derived PAIS-SR subscales emerged in a seven-factor solution. Social Environment, Job and Household Duties, and Psychological Distress accounted for more of the total variance than other subscales. PAIS-SR showed good internal consistency reliability, with Cronbach's alpha coefficients >0.62. Correlations of PAIS-SR domains with measures of quality of life and posttraumatic stress symptoms supported the convergent validity of the PAIS-SR and its significance for cancer research. The Greek version of the PAIS-SR has acceptable internal consistency reliability and construct validity, as well as satisfactory convergent validity. Results provide some suggestions for the development of programs to evaluate adjustment status and implement psychosocial interventions among breast cancer survivors.

Validation of the Pain Resilience Scale in Chinese-speaking patients with temporomandibular disorders pain.

PubMed

He, S L; Wang, J H; Ji, P

2018-03-01

To validate the Pain Resilience Scale (PRS) for use in Chinese patients with temporomandibular disorders (TMD) pain. According to international guidelines, the original PRS was first translated and cross-culturally adapted to formulate the Chinese version of PRS (PRS-C). A total of 152 patients with TMD pain were recruited to complete series of questionnaires. Reliability of the PRS-C was investigated using internal consistency and test-retest reliability. Validity of the PRS-C was calculated using cross-cultural validity and convergent validity. Cross-cultural validity was evaluated by examining the confirmatory factor analysis (CFA). And convergent validity was examined through correlating the PRS-C scores with scores of 2 commonly used pain-related measures (the Connor-Davidson Resilience Scale [CD-RISC] and the Tampa Scale for Kinesiophobia for Temporomandibular Disorders [TSK-TMD]). The PRS-C had a high internal consistency (Cronbach's alpha = 0.92) and good test-retest reliability (intra-class correlation coefficient [ICC] = 0.81). The CFA supported a 2-factor model for the PRS-C with acceptable fit to the data. The fit indices were chi-square/DF = 2.21, GFI = 0.91, TLI = 0.97, CFI = 0.98 and RMSEA = 0.08. As regards convergent validity, the PRS-C evidenced moderate-to-good relationships with the CD-RISC and the TSK-TMD. The PRS-C shows good psychometric properties and could be considered as a reliable and valid measure to evaluate pain-related resilience in patients with TMD pain. © 2017 John Wiley & Sons Ltd.

Validating the Alcohol Use Disorders Identification Test with Persons Who Have a Serious Mental Illness

ERIC Educational Resources Information Center

O'Hare, Thomas; Sherrer, Margaret V.; LaButti, Annamaria; Emrick, Kelly

2004-01-01

Objective/Method: The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual assessments and program evaluation for integrated mental health-substance abuse services for persons with serious mental illness. This investigation examines the internal consistency reliability, concurrent validity,…

JaCVAM-organized international validation study of the in vivo rodent alkaline comet assay for detection of genotoxic carcinogens: II. Summary of definitive validation study results.

PubMed

Uno, Yoshifumi; Kojima, Hajime; Omori, Takashi; Corvi, Raffaella; Honma, Masamistu; Schechtman, Leonard M; Tice, Raymond R; Beevers, Carol; De Boeck, Marlies; Burlinson, Brian; Hobbs, Cheryl A; Kitamoto, Sachiko; Kraynak, Andrew R; McNamee, James; Nakagawa, Yuzuki; Pant, Kamala; Plappert-Helbig, Ulla; Priestley, Catherine; Takasawa, Hironao; Wada, Kunio; Wirnitzer, Uta; Asano, Norihide; Escobar, Patricia A; Lovell, David; Morita, Takeshi; Nakajima, Madoka; Ohno, Yasuo; Hayashi, Makoto

2015-07-01

The in vivo rodent alkaline comet assay (comet assay) is used internationally to investigate the in vivo genotoxic potential of test chemicals. This assay, however, has not previously been formally validated. The Japanese Center for the Validation of Alternative Methods (JaCVAM), with the cooperation of the U.S. NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)/the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM), the European Centre for the Validation of Alternative Methods (ECVAM), and the Japanese Environmental Mutagen Society/Mammalian Mutagenesis Study Group (JEMS/MMS), organized an international validation study to evaluate the reliability and relevance of the assay for identifying genotoxic carcinogens, using liver and stomach as target organs. The ultimate goal of this exercise was to establish an Organisation for Economic Co-operation and Development (OECD) test guideline. The study protocol was optimized in the pre-validation studies, and then the definitive (4th phase) validation study was conducted in two steps. In the 1st step, assay reproducibility was confirmed among laboratories using four coded reference chemicals and the positive control ethyl methanesulfonate. In the 2nd step, the predictive capability was investigated using 40 coded chemicals with known genotoxic and carcinogenic activity (i.e., genotoxic carcinogens, genotoxic non-carcinogens, non-genotoxic carcinogens, and non-genotoxic non-carcinogens). Based on the results obtained, the in vivo comet assay is concluded to be highly capable of identifying genotoxic chemicals and therefore can serve as a reliable predictor of rodent carcinogenicity. Copyright © 2015 Elsevier B.V. All rights reserved.

Gene-Environment Interplay in Internalizing Disorders: Consistent Findings across Six Environmental Risk Factors

PubMed Central

Hicks, Brian M.; DiRago, Ana C.; Iacono, William G.; McGue, Matt

2009-01-01

Background Newer behavior genetic methods can better elucidate gene-environment (G-E) interplay in the development of internalizing (INT) disorders (i.e., major depression and anxiety disorders). However, no study to date has conducted a comprehensive analysis examining multiple environmental risks with the purpose of delineating how general G-E mechanisms influence the development of INT disorders. Methods The sample consisted of 1315 male and female twin pairs participating in the age 17 assessment of the Minnesota Twin Family Study. Quantitative G-E interplay models were used to examine how genetic and environmental risk for INT disorders changes as a function of environmental context. Multiple measures and informants were employed to construct composite measures of INT disorders and 6 environmental risk factors including: stressful life events, mother-child and father-child relationship problems, antisocial and prosocial peer affiliation, and academic achievement and engagement. Results Significant moderation effects were detected between each environmental risk factor and INT such that in the context of greater environmental adversity, nonshared environmental factors became more important in the etiology of INT symptoms. Conclusion Our results are consistent with the interpretation that environmental stressors have a causative effect on the emergence of INT disorders. The consistency of our results suggests a general mechanism of environmental influence on INT disorders regardless of the specific form of environmental risk. PMID:19594836

Gene-environment interplay in internalizing disorders: consistent findings across six environmental risk factors.

PubMed

Hicks, Brian M; DiRago, Ana C; Iacono, William G; McGue, Matt

2009-10-01

Behavior genetic methods can help to elucidate gene-environment (G-E) interplay in the development of internalizing (INT) disorders (i.e., major depression and anxiety disorders). To date, however, no study has conducted a comprehensive analysis examining multiple environmental risk factors with the purpose of delineating general mechanisms of G-E influence in the development of INT disorders. The sample consisted of 1315 male and female twin pairs participating in the age 17 assessment of the Minnesota Twin Family Study. Quantitative G-E interplay models were used to examine how genetic and environmental risk for INT disorders changes as a function of environmental context. Multiple measures and informants were employed to construct composite measures of INT disorders and six environmental risk factors including: stressful life events, mother-child and father-child relationship problems, antisocial and prosocial peer affiliation, and academic achievement and engagement. Significant moderation effects were detected between each environmental risk factor and INT such that in the context of greater environmental adversity, nonshared environmental factors became more important in the etiology of INT symptoms. Our results are consistent with the interpretation that environmental stressors have a causative effect on the emergence of INT disorders. The consistency of our results suggests a general mechanism of environmental influence on INT disorders regardless of the specific form of environmental risk.

Validation of post-traumatic stress disorder (PTSD) and complex PTSD using the International Trauma Questionnaire.

PubMed

Hyland, P; Shevlin, M; Brewin, C R; Cloitre, M; Downes, A J; Jumbe, S; Karatzias, T; Bisson, J I; Roberts, N P

2017-09-01

The 11th version of the International Classification of Diseases (ICD-11) has proposed two related trauma diagnoses: Post-traumatic stress disorder (PTSD) and Complex PTSD (CPTSD). Using a newly developed, disorder-specific measure of PTSD and CPTSD called the International Trauma Questionnaire (ITQ) the current study will (i) assess the factorial validity of ICD-11 PTSD and CPTSD; (ii) provide the first test of the discriminant validity of these constructs; and (iii) provide the first comparison of ICD-11, and Diagnostic and Statistical Manual, Fifth Edition (DSM-5), PTSD diagnostic rates using disorder-specific measures. ICD-11 and DSM-5 PTSD-specific measures were completed by a British clinical sample of trauma-exposed patients (N = 171). The structure and validity of ICD-11 PTSD and CPTSD were assessed by means of factor analysis and assessing relationships with criterion variables. Diagnostic rates under ICD-11 were significantly lower than those under DSM-5. A two-factor second-order model reflecting the distinction between PTSD and CPTSD best represented the data from the ITQ; and the PTSD and CPTSD factors differentially predicted multiple psychological variables. The factorial and discriminant validity of ICD-11 PTSD and CPTSD was supported, and ICD-11 produces fewer diagnostic cases than DSM-5. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Reliability and validity of a new scale on internal coherence (ICS) of cancer patients

PubMed Central

Kröz, Matthias; Büssing, Arndt; von Laue, Hans Broder; Reif, Marcus; Feder, Gene; Schad, Friedemann; Girke, Matthias; Matthes, Harald

2009-01-01

Background Current inventories on quality of life used in oncology mainly focus on functional aspects of patients in the context of disease adaption and treatments (side) effects (EORTC QLQ C30) or generically the status of common functions (Medical Outcome Study SF 36). Beyond circumscribed dimensions of quality of life (i.e., physical, emotional, social, cognitive etc.), there is a lack of inventories which also address other relevant dimensions such as the 'sense of coherence' (SOC) in cancer patients. SOC is important because of its potential prognostic relevance in cancer patients, but the current SOC scale has mainly been validated for psychiatric and psychosomatic patients. Our two-step validation study addresses the internal coherence (ICS) scale, which is based on expert rating, using specific items for oncological patients, with respect to its reliability, validity and sensitivity to chemotherapy. Methods The items were tested on 114 participants (57 cancer patients and a matched control group), alongside questions on autonomic regulation (aR), the Hospital Anxiety and Depression Scale (HADS), self-regulation (SRQ) and Karnofsky the Performance-Index (KPI). A retest of 65 participants was carried out after a median time span of four weeks. In the second part of the study, the ICS was used to assess internal coherence during chemotherapy in 25 patients with colorectal carcinoma (CRC) and 17 breast cancer patients. ICS was recorded before, during and 4 – 8 weeks after treatment. Results The 10-item scale of 'internal coherence' (ICS) shows good to very good reliability: Cronbach-α r = 0.91, retest-reliability r = 0.80. The ICS correlates with r = 0.43 – 0.72 to the convergence criteria (all p < 0.001). We are able to show decreased ICS-values after the third cycle for CRC and breast cancer patients, with a subsequent increase of ICS scores after the end of chemotherapy. Conclusion The ICS has good to very good reliability, validity and sensitivity to

Validity of the International Fitness Scale "IFIS" in older adults.

PubMed

Merellano-Navarro, Eugenio; Collado-Mateo, Daniel; García-Rubio, Javier; Gusi, Narcís; Olivares, Pedro R

2017-09-01

To validate the "International Fitness Scale" (IFIS) in older adults. Firstly, cognitive interviews were performed to ensure that the questionnaire was comprehensive for older Chilean adults. After that, a transversal study of 401 institutionalized and non-institutionalized older adults from Maule region in Chile was conducted. A battery of validated fitness tests for this population was used in order to compare the responses obtained in the IFIS with the objectively measured fitness performance (back scratch, chair sit-and-reach, handgrip, 30-s chair stand, timed up-and-go and 6-min walking). Indicated that IFIS presented a high compliance in the comprehension of the items which defined it, and it was able of categorizing older adults according to their measured physical fitness levels. The analysis of covariance ANCOVA adjusted by sex and age showed a concordance between IFIS and the score in physical fitness tests. Based on the results of this study, IFIS questionnaire is a good alternative to assess physical fitness in older adults. Copyright © 2017 Elsevier Inc. All rights reserved.

Cross-validating a bidimensional mathematics anxiety scale.

PubMed

Haiyan Bai

2011-03-01

The psychometric properties of a 14-item bidimensional Mathematics Anxiety Scale-Revised (MAS-R) were empirically cross-validated with two independent samples consisting of 647 secondary school students. An exploratory factor analysis on the scale yielded strong construct validity with a clear two-factor structure. The results from a confirmatory factor analysis indicated an excellent model-fit (χ(2) = 98.32, df = 62; normed fit index = .92, comparative fit index = .97; root mean square error of approximation = .04). The internal consistency (.85), test-retest reliability (.71), interfactor correlation (.26, p < .001), and positive discrimination power indicated that MAS-R is a psychometrically reliable and valid instrument for measuring mathematics anxiety. Math anxiety, as measured by MAS-R, correlated negatively with student achievement scores (r = -.38), suggesting that MAS-R may be a useful tool for classroom teachers and other educational personnel tasked with identifying students at risk of reduced math achievement because of anxiety.

The utility of the Total Neuropathy Score as an instrument to assess neuropathy severity in chronic kidney disease: A validation study.

PubMed

Issar, Tushar; Arnold, Ria; Kwai, Natalie C G; Pussell, Bruce A; Endre, Zoltan H; Poynten, Ann M; Kiernan, Matthew C; Krishnan, Arun V

2018-05-01

To demonstrate construct validity of the Total Neuropathy Score (TNS) in assessing peripheral neuropathy in subjects with chronic kidney disease (CKD). 113 subjects with CKD and 40 matched controls were assessed for peripheral neuropathy using the TNS. An exploratory factor analysis was conducted and internal consistency of the scale was evaluated using Cronbach's alpha. Construct validity of the TNS was tested by comparing scores between case and control groups. Factor analysis revealed valid item correlations and internal consistency of the TNS was good with a Cronbach's alpha of 0.897. Subjects with CKD scored significantly higher on the TNS (CKD: median, 6, interquartile range, 1-13; controls: median, 0, interquartile range, 0-1; p < 0.001). Subgroup analysis revealed construct validity was maintained for subjects with stages 3-5 CKD with and without diabetes. The TNS is a valid measure of peripheral neuropathy in patients with CKD. The TNS is the first neuropathy scale to be formally validated in patients with CKD. Copyright © 2018 International Federation of Clinical Neurophysiology. Published by Elsevier B.V. All rights reserved.

The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study.

PubMed

Faber, Irene R; Nijhuis-Van Der Sanden, Maria W G; Elferink-Gemser, Marije T; Oosterveld, Frits G J

2015-01-01

A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their talent development programme consisting of eight items measuring perceptuo-motor skills specific to table tennis under varying conditions. This study aimed to investigate this assessment regarding its reproducibility, internal consistency, underlying dimensions and concurrent validity in 113 young table tennis players (6-10 years). Intraclass correlation coefficients of six test items met the criteria of 0.7 with coefficients of variation between 3% and 8%. Cronbach's alpha valued 0.853 for internal consistency. The principal components analysis distinguished two conceptually meaningful factors: "ball control" and "gross motor function." Concurrent validity analyses demonstrated moderate associations between the motor skills assessment's results and national ranking; boys r = -0.53 (P < 0.001) and girls r = -0.45 (P = 0.015). In conclusion, this evaluation demonstrated six test items with acceptable reproducibility, good internal consistency and good prospects for validity. Two test items need revision to upgrade reproducibility. Since the motor skills assessment seems to be a reproducible, objective part of a talent development programme, more longitudinal studies are required to investigate its predictive validity.

Consistency of internal fluxes in a hydrological model running at multiple time steps

NASA Astrophysics Data System (ADS)

Ficchi, Andrea; Perrin, Charles; Andréassian, Vazken

2016-04-01

Improving hydrological models remains a difficult task and many ways can be explored, among which one can find the improvement of spatial representation, the search for more robust parametrization, the better formulation of some processes or the modification of model structures by trial-and-error procedure. Several past works indicate that model parameters and structure can be dependent on the modelling time step, and there is thus some rationale in investigating how a model behaves across various modelling time steps, to find solutions for improvements. Here we analyse the impact of data time step on the consistency of the internal fluxes of a rainfall-runoff model run at various time steps, by using a large data set of 240 catchments. To this end, fine time step hydro-climatic information at sub-hourly resolution is used as input of a parsimonious rainfall-runoff model (GR) that is run at eight different model time steps (from 6 minutes to one day). The initial structure of the tested model (i.e. the baseline) corresponds to the daily model GR4J (Perrin et al., 2003), adapted to be run at variable sub-daily time steps. The modelled fluxes considered are interception, actual evapotranspiration and intercatchment groundwater flows. Observations of these fluxes are not available, but the comparison of modelled fluxes at multiple time steps gives additional information for model identification. The joint analysis of flow simulation performance and consistency of internal fluxes at different time steps provides guidance to the identification of the model components that should be improved. Our analysis indicates that the baseline model structure is to be modified at sub-daily time steps to warrant the consistency and realism of the modelled fluxes. For the baseline model improvement, particular attention is devoted to the interception model component, whose output flux showed the strongest sensitivity to modelling time step. The dependency of the optimal model

Reliability and validity of the Lithuanian Tinnitus Handicap Inventory.

PubMed

Ulozienė, Ingrida; Balnytė, Renata; Alzbutienė, Giedrė; Arechvo, Irina; Vaitkus, Antanas; Šileikaitė, Milda; Šaferis, Viktoras; Ulozas, Virgilijus

2016-01-01

The aim of this study was to determine the reliability and validity of the Lithuanian version of the Tinnitus Handicap Inventory (THI), a self-report measure of perceived tinnitus handicap. A cross-sectional psychometric validation study was performed in the University Hospital. A total of 248 subjects reporting chronic tinnitus as their primary complaint or secondary to hearing loss were encluded in the study and filled in the Lithuanian version of THI. For assessment of construct validity a subgroup of 55 participants completed the Lithuanian version of the Hospital Anxiety and Depression Scale as a measure of self-perceived levels of anxiety and depression. Test-retest and internal consistency reliability as well as construct validity were calculated. The Lithuanian version of the THI and its subscales showed a robust internal consistency reliability (Cronbach's alpha=0.93) comparable to the original version. Statistically significant correlations were observed between the Lithuanian translation of the THI and the measures of self-perceived levels of anxiety and depression using HADS. Confirmatory factor analysis demonstrated that the three subscales of the THI Lithuanian version corresponded to three different factors, which strongly correlated between themselves. The results suggest that the Lithuanian version of THI maintains its original validity and may serve as reliable and valid measure of general tinnitus related distress that can be used in a clinical setting to quantify the impact of tinnitus on daily living. Copyright © 2016 The Lithuanian University of Health Sciences. Production and hosting by Elsevier Urban & Partner Sp. z o.o. All rights reserved.

Social Support Questionnaire for Children: Development and Initial Validation

ERIC Educational Resources Information Center

Gordon-Hollingsworth, Arlene T.; Thompson, Julia E.; Geary, Meghan A.; Schexnaildre, Mark A.; Lai, Betty S.; Kelley, Mary Lou

2016-01-01

The Social Support Questionnaire for Children (SSQC) is a 50-item scale that assesses children's social support from parents, relatives, nonrelative adults, siblings, and peers. The SSQC demonstrates good psychometric properties (e.g., internal consistency, factorial validity). Furthermore, the SSQC appears to be an ethnically sensitive measure of…

Reliability and Validity of the Alcohol Consequences Expectations Scale

ERIC Educational Resources Information Center

Arriola, Kimberly R. Jacob; Usdan, Stuart; Mays, Darren; Weitzel, Jessica Aungst; Cremeens, Jennifer; Martin, Ryan J.; Borba, Christina; Bernhardt, Jay M.

2009-01-01

Objectives: To examine the reliability and validity of a new measure of alcohol outcome expectations for college students, the Alcohol Consequences Expectations Scale (ACES). Methods: College students (N = 169) completed the ACES and several other measures. Results: Results support the existence of 5 internally consistent subscales. Additionally,…

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

PubMed

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Translation and validation of the Rhinosinusitis Disability Index for use in Nigeria.

PubMed

Asoegwu, C N; Nwawolo, C C; Okubadejo, N U

2017-07-01

The Rhinosinusitis Disability Index (RSDI) is a validated and reliable measure of severity of chronic rhinosinusitis. The objective of this study was to translate and validate the instrument for use in Nigeria. This is a methodological study. 71 patients with chronic rhinosinusitis attending two Otolaryngology clinics in Lagos, Nigeria. Using standardized methods and trained translators, the RSDI was translated to vernacular (Yoruba language) and back-translated to culturally appropriate English. Data analysis comprised of assessment of the item quality, content validity and internal consistency of the back-translated Rhinosinusitis Disability Index (bRSDI), and correlation to the original RSDI. Content validity (floor and ceiling effects) showed 0% floor and ceiling effects for the total scores, 0% ceiling effects for all domains and floor effect for physical domain, and 9.9 and 8.5% floor effects for functional and emotional domains, respectively. The mean item-own correlation for physical domain was 0.54 ± 0.08, 0.72 ± 0.08 for functional domain and 0.74 ± 0.07 for emotional domain. All domain item-own correlations were higher than item-other domain correlations. The total Cronbach's alpha was 0.936 and was higher than 0.70 for all the domains representing good internal consistency. Pearson correlation analysis showed strong correlation of RSDI to bRSDI (total score 0.881; p = 0.000, and domain subscores-physical: 0.788; p = 0.000, functional: 0.830; p = 0.000, and emotional: 0.888; p = 0.000). The back-translated Rhinosinusitis Disability Index shows good face and content validity with good internal consistency while correlating linearly and significantly with the original Rhinosinusitis Disability Index and is recommended for use in Nigeria.

Development and internal validation of a side-specific, multiparametric magnetic resonance imaging-based nomogram for the prediction of extracapsular extension of prostate cancer.

PubMed

Martini, Alberto; Gupta, Akriti; Lewis, Sara C; Cumarasamy, Shivaram; Haines, Kenneth G; Briganti, Alberto; Montorsi, Francesco; Tewari, Ashutosh K

2018-04-19

To develop a nomogram for predicting side-specific extracapsular extension (ECE) for planning nerve-sparing radical prostatectomy. We retrospectively analysed data from 561 patients who underwent robot-assisted radical prostatectomy between February 2014 and October 2015. To develop a side-specific predictive model, we considered the prostatic lobes separately. Four variables were included: prostate-specific antigen; highest ipsilateral biopsy Gleason grade; highest ipsilateral percentage core involvement; and ECE on multiparametric magnetic resonance imaging (mpMRI). A multivariable logistic regression analysis was fitted to predict side-specific ECE. A nomogram was built based on the coefficients of the logit function. Internal validation was performed using 'leave-one-out' cross-validation. Calibration was graphically investigated. The decision curve analysis was used to evaluate the net clinical benefit. The study population consisted of 829 side-specific cases, after excluding negative biopsy observations (n = 293). ECE was reported on mpMRI and final pathology in 115 (14%) and 142 (17.1%) cases, respectively. Among these, mpMRI was able to predict ECE correctly in 57 (40.1%) cases. All variables in the model except highest percentage core involvement were predictors of ECE (all P ≤ 0.006). All variables were considered for inclusion in the nomogram. After internal validation, the area under the curve was 82.11%. The model demonstrated excellent calibration and improved clinical risk prediction, especially when compared with relying on mpMRI prediction of ECE alone. When retrospectively applying the nomogram-derived probability, using a 20% threshold for performing nerve-sparing, nine out of 14 positive surgical margins (PSMs) at the site of ECE resulted above the threshold. We developed an easy-to-use model for the prediction of side-specific ECE, and hope it serves as a tool for planning nerve-sparing radical prostatectomy and in the reduction of PSM in

Development and validation of the Chinese version of dry eye related quality of life scale.

PubMed

Zheng, Bang; Liu, Xiao-Jing; Sun, Yue-Qian Fiona; Su, Jia-Zeng; Zhao, Yang; Xie, Zheng; Yu, Guang-Yan

2017-07-17

To develop the Chinese version of quality of life scale for dry eye patients based on the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire and to assess the reliability and validity of the developed scale. The original IDEEL was adapted cross-culturally to Chinese language and further developed following standard procedures. A total of 100 Chinese patients diagnosed with dry eye syndrome were included to investigate the psychometric properties of the Chinese version of scale. Psychometric tests included internal consistency (Cronbach's ɑ coefficients), construct validity (exploratory factor analysis), and known-groups validity (the analysis of variance). The Chinese version of Dry Eye Related Quality of Life (CDERQOL) Scale contains 45 items classified into 5 domains. Good to excellent internal consistency reliability was demonstrated for all 5 domains (Cronbach's ɑ coefficients range from 0.716 to 0.913). Construct validity assessment indicated a consistent factorial structure of the CDERQOL scale with hypothesized construct, with the exception of "Dry Eye Symptom-Bother" domain. All domain scores were detected with significant difference across three severity groups of dry eye patients (P < 0.05) except for "Satisfaction with Treatment" domain, indicating good known-groups validity. The results indicated that the CDERQOL scale is a reliable and valid instrument for patients with dry eye syndrome among Chinese population, and could be used as a supplementary diagnostic and treatment-effectiveness measure.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students

PubMed Central

Marković, Martina; Grgurić, Josip

2018-01-01

Background: Validating a questionnaire/instrument before proceeding to the field for data collection is important. Methods: An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students (N = 277). Results: For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. Conclusions: The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students. PMID:29702616

Validation of the Personal Need for Structure Scale in Chinese.

PubMed

Shi, Junqi; Wang, Lei; Chen, Yang

2009-08-01

To validate the Chinese version of the Personal Need for Structure Scale, questionnaires were administered to 1,418 individuals in three samples. Item-total correlations and internal consistency of the scale were acceptable. The test-retest reliability was .79. Confirmatory factor analysis indicated that the Chinese version comprised two dimensions, as did the original version; Desire for Structure and Response to Lack of Structure. Correlation coefficients between the Personal Need for Structure Scale and other related measures indicated that the scale has acceptable discriminant validity and convergent validity.

An Evaluation of the Validity and Reliability of a Food Behavior Checklist Modified for Children

ERIC Educational Resources Information Center

Branscum, Paul; Sharma, Manoj; Kaye, Gail; Succop, Paul

2010-01-01

Objective: The objective of this study was to report the construct validity and internal consistency reliability of the Food Behavior Checklist modified for children (FBC-MC), with low-income, Youth Expanded Food and Nutrition Education Program (EFNEP)-eligible children. Methods: Using a cross-sectional research design, construct validity was…

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Development of a framework for international certification by the OIE of diagnostic tests validated as fit for purpose.

PubMed

Wright, P; Edwards, S; Diallo, A; Jacobson, R

2007-01-01

Historically, the OIE has focussed on test methods applicable to trade and the international movement of animals and animal products. With its expanding role as the World Organisation for Animal Health, the OIE has recognised the need to evaluate test methods relative to specific diagnostic applications other than trade. In collaboration with its international partners, the OIE solicited input from experts through consultants meetings on the development of guidelines for validation and certification of diagnostic assays for infectious animal diseases. Recommendations from the first meeting were formally adopted and have subsequently been acted upon by the OIE. A validation template has been developed that specifically requires a test to be fit or suited for its intended purpose (e.g. as a screening or a confirmatory test). This is a key criterion for validation. The template incorporates four distinct stages of validation, each of which has bearing on the evaluation of fitness for purpose. The OIE has just recently created a registry for diagnostic tests that fulfil these validation requirements. Assay developers are invited to submit validation dossiers to the OIE for evaluation by a panel of experts. Recognising that validation is an incremental process, tests methods achieving at least the first stages of validation may be provisionally accepted. To provide additional confidence in assay performance, the OIE, through its network of Reference Laboratories, has embarked on the development of evaluation panels. These panels would contain specially selected test samples that would assist in verifying fitness for purpose.

Tandem internal models execute motor learning in the cerebellum.

PubMed

Honda, Takeru; Nagao, Soichi; Hashimoto, Yuji; Ishikawa, Kinya; Yokota, Takanori; Mizusawa, Hidehiro; Ito, Masao

2018-06-25

In performing skillful movement, humans use predictions from internal models formed by repetition learning. However, the computational organization of internal models in the brain remains unknown. Here, we demonstrate that a computational architecture employing a tandem configuration of forward and inverse internal models enables efficient motor learning in the cerebellum. The model predicted learning adaptations observed in hand-reaching experiments in humans wearing a prism lens and explained the kinetic components of these behavioral adaptations. The tandem system also predicted a form of subliminal motor learning that was experimentally validated after training intentional misses of hand targets. Patients with cerebellar degeneration disease showed behavioral impairments consistent with tandemly arranged internal models. These findings validate computational tandemization of internal models in motor control and its potential uses in more complex forms of learning and cognition. Copyright © 2018 the Author(s). Published by PNAS.

Translation, cultural adaptation and validation of the Diabetes Attitudes Scale - third version into Brazilian Portuguese 1

PubMed Central

Vieira, Gisele de Lacerda Chaves; Pagano, Adriana Silvino; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Torres, Heloísa de Carvalho

2018-01-01

ABSTRACT Objective: to perform the translation, adaptation and validation of the Diabetes Attitudes Scale - third version instrument into Brazilian Portuguese. Methods: methodological study carried out in six stages: initial translation, synthesis of the initial translation, back-translation, evaluation of the translated version by the Committee of Judges (27 Linguists and 29 health professionals), pre-test and validation. The pre-test and validation (test-retest) steps included 22 and 120 health professionals, respectively. The Content Validity Index, the analyses of internal consistency and reproducibility were performed using the R statistical program. Results: in the content validation, the instrument presented good acceptance among the Judges with a mean Content Validity Index of 0.94. The scale presented acceptable internal consistency (Cronbach’s alpha = 0.60), while the correlation of the total score at the test and retest moments was considered high (Polychoric Correlation Coefficient = 0.86). The Intra-class Correlation Coefficient, for the total score, presented a value of 0.65. Conclusion: the Brazilian version of the instrument (Escala de Atitudes dos Profissionais em relação ao Diabetes Mellitus) was considered valid and reliable for application by health professionals in Brazil. PMID:29319739

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire

PubMed Central

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-01-01

Background Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. Methods The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test – retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. Results The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81–0.93), suggesting that all items were appropriate to measure. Kappa coefficient for

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire.

PubMed

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-03-04

Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test - retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81-0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test - retest

Validation in Support of Internationally Harmonised OECD Test Guidelines for Assessing the Safety of Chemicals.

PubMed

Gourmelon, Anne; Delrue, Nathalie

Ten years elapsed since the OECD published the Guidance document on the validation and international regulatory acceptance of test methods for hazard assessment. Much experience has been gained since then in validation centres, in countries and at the OECD on a variety of test methods that were subjected to validation studies. This chapter reviews validation principles and highlights common features that appear to be important for further regulatory acceptance across studies. Existing OECD-agreed validation principles will most likely generally remain relevant and applicable to address challenges associated with the validation of future test methods. Some adaptations may be needed to take into account the level of technique introduced in test systems, but demonstration of relevance and reliability will continue to play a central role as pre-requisite for the regulatory acceptance. Demonstration of relevance will become more challenging for test methods that form part of a set of predictive tools and methods, and that do not stand alone. OECD is keen on ensuring that while these concepts evolve, countries can continue to rely on valid methods and harmonised approaches for an efficient testing and assessment of chemicals.

A Note on the Incremental Validity of Aggregate Predictors.

ERIC Educational Resources Information Center

Day, H. D.; Marshall, David

Three computer simulations were conducted to show that very high aggregate predictive validity coefficients can occur when the across-case variability in absolute score stability occurring in both the predictor and criterion matrices is quite small. In light of the increase in internal consistency reliability achieved by the method of aggregation…

Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents

PubMed Central

2012-01-01

Background The purpose of this study was to examine the internal consistency, test-retest reliability, construct validity and predictive validity of a new German self-report instrument to assess the influence of social support and the physical environment on physical activity in adolescents. Methods Based on theoretical consideration, the short scales on social support and physical environment were developed and cross-validated in two independent study samples of 9 to 17 year-old girls and boys. The longitudinal sample of Study I (n = 196) was recruited from a German comprehensive school, and subjects in this study completed the questionnaire twice with a between-test interval of seven days. Cronbach’s alphas were computed to determine the internal consistency of the factors. Test-retest reliability of the latent factors was assessed using intra-class coefficients. Factorial validity of the scales was assessed using principle components analysis. Construct validity was determined using a cross-validation technique by performing confirmatory factor analysis with the independent nationwide cross-sectional sample of Study II (n = 430). Correlations between factors and three measures of physical activity (objectively measured moderate-to-vigorous physical activity (MVPA), self-reported habitual MVPA and self-reported recent MVPA) were calculated to determine the predictive validity of the instrument. Results Construct validity of the social support scale (two factors: parental support and peer support) and the physical environment scale (four factors: convenience, public recreation facilities, safety and private sport providers) was shown. Both scales had moderate test-retest reliability. The factors of the social support scale also had good internal consistency and predictive validity. Internal consistency and predictive validity of the physical environment scale were low to acceptable. Conclusions The results of this study indicate moderate to good

Cost Assessment and Validation Task Force on the International Space Station

NASA Technical Reports Server (NTRS)

1998-01-01

The Cost Assessment and Validation (CAV) Task Force was established for independent review and assessment of cost, schedule and partnership performance on the International Space Station (ISS) Program. The CAV Task Force has made the following key findings: The International Space Station Program has made notable and reasonable progress over the past four years in defining and executing a very challenging and technically complex effort; The Program, size, complexity, and ambitious schedule goals were beyond that which could be reasonably achieved within the $2.1 billion annual cap or $17.4 billion total cap; A number of critical risk elements are likely to have an adverse impact on the International Space Station cost and schedule; The schedule uncertainty associated with Russian implementation of joint Partnership agreements is the major threat to the ISS Program; The Fiscal Year (FY) 1999 budget submission to Congress is not adequate to execute the baseline ISS Program, cover normal program, growth, and address the known critical risks. Additional annual funding of between $130 million and $250 million will be required; and Completion of ISS assembly is likely to be delayed from, one to three years beyond December 2003.

Validation of a Thermo-Ablative Model of Elastomeric Internal Insulation Materials

NASA Technical Reports Server (NTRS)

Martin, Heath T.

2017-01-01

In thermo-ablative material modeling, as in many fields of analysis, the quality of the existing models significantly exceeds that of the experimental data required for their validation. In an effort to narrow this gap, a laboratory-scale internal insulation test bed was developed that exposes insulation samples to realistic solid rocket motor (SRM) internal environments while being instrumented to record real-time rates of both model inputs (i.e., chamber pressure, total surface heat flux, and radiative heat flux) as well as model outputs (i.e., material decomposition depths (MDDs) and in-depth material temperatures). In this work, the measured SRM internal environment parameters were used in conjunction with equilibrium thermochemistry codes as inputs to one-dimensional thermo-ablative models of the PBINBR and CFEPDM insulation samples used in the lab-scale test firings. The computed MDD histories were then compared with those deduced from real-time X-ray radiography of the insulation samples, and the calculated in-depth temperatures were compared with those measured by embedded thermocouples. The results of this exercise emphasize the challenges of modeling and testing elastomeric materials in SRM environments while illuminating the path forward to improved fidelity.

Cross-cultural adaptation, reliability and construct validity of the Tampa scale for kinesiophobia for temporomandibular disorders (TSK/TMD-Br) into Brazilian Portuguese.

PubMed

Aguiar, A S; Bataglion, C; Visscher, C M; Bevilaqua Grossi, D; Chaves, T C

2017-07-01

Fear of movement (kinesiophobia) seems to play an important role in the development of chronic pain. However, for temporomandibular disorders (TMD), there is a scarcity of studies about this topic. The Tampa Scale for Kinesiophobia for TMD (TSK/TMD) is the most widely used instrument to measure fear of movement and it is not available in Brazilian Portuguese. The purpose of this study was to culturally adapt the TSK/TMD to Brazilian Portuguese and to assess its psychometric properties regarding internal consistency, reliability, and construct and structural validity. A total of 100 female patients with chronic TMD participated in the validation process of the TSK/TMD-Br. The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Spearman's rank correlation for construct validity and confirmatory factor analysis (CFA) for structural validity. CFA endorsed the pre-specified model with two domains and 12-items (Activity Avoidance - AA/Somatic Focus - SF) and all items obtained a loading factor greater than 0·4. Acceptable levels of reliability were found (ICC > 0·75) for all questions and domains of the TSK/TMD-Br. For internal consistency, Cronbach's α of 0·78 for both domains were found. Moderate correlations (0·40 < r < 0.60) were observed for 84% of the analyses conducted between TSK/TMD-Br scores versus catastrophising, depression and jaw functional limitation. TSK/TMD-Br 12 items and two-factor demonstrated sound psychometric properties (transcultural validity, reliability, internal consistency and structural validity). In such a way, the instrument can be used in clinical settings and for research purposes. © 2017 John Wiley & Sons Ltd.

Development and validation of a questionnaire assessing the perceived control in health care among older adults with care needs in the Netherlands.

PubMed

Claassens, L; Terwee, C B; Deeg, D J H; Broese van Groenou, M I; Widdershoven, G A M; Huisman, M

2016-04-01

In response to the increased emphasis placed on older people's self-reliance in many welfare societies, we aimed to develop and validate a measurement instrument, assessing perceived control in health care among older adults with care needs. The target group consists of older people who live (semi-)independently and use professional health care, with or without informal care. Phase I (development) of the study consisted of the construction of the instrument based on the input from a variety of stakeholders. Phase II (validation) entailed a quantitative study in a sample of 247 respondents selected from the Longitudinal Aging Study Amsterdam, to assess the instrument's construct validity (structural validity and hypotheses testing) and reliability (internal consistency). The questionnaire consists of 29 items, related to organizing professional care, communication with care professionals, health management in the home situation, planning (more) complex care in the future, and perceived support from the social network. Based on a factor analysis, we identified three subscales: (I.) 'perceived personal control in health care'; (II.) 'anticipated personal control regarding future health care'; and (III.) 'perceived support from the social network,' with internal consistencies varying from Cronbach's α = .71 to .90. Factor I was associated with mastery, self-efficacy, self-esteem (r = .31-.35) and factor III with social loneliness (r = -.42). Factor II correlated less strongly with mastery, self-efficacy, and self-esteem (r < .30). Our questionnaire revealed sufficient construct validity and internal consistency. The instrument provides a basis for further quantitative research regarding control, especially in relation to health care-related outcomes.

Validation of microwave radiometry for measuring the internal temperature profile of human tissue

NASA Astrophysics Data System (ADS)

Levick, A.; Land, D.; Hand, J.

2011-06-01

A phantom target with a known linear temperature gradient has been developed for validating microwave radiometry for measuring internal temperature profiles within human tissue. The purpose of the phantom target is to simulate the temperature gradient found within the surface layers of a baby's brain during hypothermal neuroprotection therapy, in which the outer surface of the phantom represents the skin surface and the inner surface the brain core. The target comprises a volume of phantom tissue material with similar dielectric properties to high water-content human tissue, contained between two copper plates at known temperatures. The antenna of a microwave radiometer is in contact with one surface of the phantom material. We have measured the microwave temperature of the phantom with microwave radiometry in a frequency band of 3.0-3.5 GHz. Our microwave temperature measurements have small 0.05 °C (type A) uncertainties associated with random effects and provide temperatures consistent with values determined using theoretical models of the antenna-target system within uncertainties. The measurements are in good agreement with the major signal contribution being formed over a near plane-wave response within the material with a much smaller contribution from close to the antenna face.

Validation of the Epworth Sleepiness Scale for Children and Adolescents using Rasch analysis.

PubMed

Janssen, Kitty C; Phillipson, Sivanes; O'Connor, Justen; Johns, Murray W

2017-05-01

A validated measure of daytime sleepiness for adolescents is needed to better explore emerging relationships between sleepiness and the mental and physical health of adolescents. The Epworth Sleepiness Scale (ESS) is a widely used scale for daytime sleepiness in adults but contains references to alcohol and driving. The Epworth Sleepiness Scale for Children and Adolescents (ESS-CHAD) has been proposed as the official modified version of the ESS for children and adolescents. This study describes the psychometric analysis of the ESS-CHAD as a measure of daytime sleepiness for adolescents. The ESS-CHAD was completed by 297 adolescents, 12-18 years old, from two independent schools in Victoria, Australia. Exploratory factor analysis and Rasch analysis was conducted to determine the validity of the scale. Exploratory factor analysis and Rasch analysis indicated that ESS-CHAD has internal validity and a unidimensional structure with good model fit. Rasch analysis of four subgroups based on gender and year-level were consistent with the overall results. The results were consistent with published ESS results, which strongly indicates that the changes to the scale do not affect the scale's capacity to measure daytime sleepiness. It is concluded that the ESS-CHAD is a reliable and internally valid measure of daytime sleepiness in adolescents 12-18 years old. Further studies are needed to establish the internal validity of the ESS-CHAD for children under 12 years, and to establish external validity and accurate cut-off points for children and adolescents. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of the Modified Fatigue Impact Scale in mild to moderate traumatic brain injury.

PubMed

Schiehser, Dawn M; Delano-Wood, Lisa; Jak, Amy J; Matthews, Scott C; Simmons, Alan N; Jacobson, Mark W; Filoteo, J Vincent; Bondi, Mark W; Orff, Henry J; Liu, Lin

2015-01-01

To evaluate the validity of the Modified Fatigue Impact Scale (MFIS) in veterans with a history of mild to moderate traumatic brain injury (TBI). Veterans (N = 106) with mild (92%) or moderate (8%) TBI. Veterans Administration Health System. Factor structure, internal consistency, convergent validity, sensitivity, and specificity of the MFIS were examined. Principal component analysis identified 2 viable MFIS factors: a Cognitive subscale and a Physical/Activities subscale. Item analysis revealed high internal consistency of the MFIS Total scale and subscale items. Strong convergent validity of the MFIS scales was established with 2 Beck Depression Inventory II fatigue items. Receiver operating characteristic curve analysis revealed good to excellent accuracy of the MFIS in classifying fatigued versus nonfatigued individuals. The MFIS is a valid multidimensional measure that can be used to evaluate the impact of fatigue on cognitive and physical functioning in individuals with mild to moderate TBI. The psychometric properties of the MFIS make it useful for evaluating fatigue and provide the potential for improving research on fatigue in this population.

Measurement of fatigue: Comparison of the reliability and validity of single-item and short measures to a comprehensive measure.

PubMed

Kim, Hee-Ju; Abraham, Ivo

2017-01-01

Evidence is needed on the clinicometric properties of single-item or short measures as alternatives to comprehensive measures. We examined whether two single-item fatigue measures (i.e., Likert scale, numeric rating scale) or a short fatigue measure were comparable to a comprehensive measure in reliability (i.e., internal consistency and test-retest reliability) and validity (i.e., convergent, concurrent, and predictive validity) in Korean young adults. For this quantitative study, we selected the Functional Assessment of Chronic Illness Therapy-Fatigue for the comprehensive measure and the Profile of Mood States-Brief, Fatigue subscale for the short measure; and constructed two single-item measures. A total of 368 students from four nursing colleges in South Korea participated. We used Cronbach's alpha and item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability. We assessed Pearson's correlation with a comprehensive measure for convergent validity, with perceived stress level and sleep quality for concurrent validity and the receiver operating characteristic curve for predictive validity. The short measure was comparable to the comprehensive measure in internal consistency reliability (Cronbach's alpha=0.81 vs. 0.88); test-retest reliability (intraclass correlation coefficient=0.66 vs. 0.61); convergent validity (r with comprehensive measure=0.79); concurrent validity (r with perceived stress=0.55, r with sleep quality=0.39) and predictive validity (area under curve=0.88). Single-item measures were not comparable to the comprehensive measure. A short fatigue measure exhibited similar levels of reliability and validity to the comprehensive measure in Korean young adults. Copyright © 2016 Elsevier Ltd. All rights reserved.

The 11-item Medication Adherence Reasons Scale: reliability and factorial validity among patients with hypertension in Malaysian primary healthcare settings

PubMed Central

Shima, Razatul; Farizah, Hairi; Majid, Hazreen Abdul

2015-01-01

INTRODUCTION The aim of this study was to assess the reliability and validity of a modified Malaysian version of the Medication Adherence Reasons Scale (MAR-Scale). METHODS In this cross-sectional study, the 15-item MAR-Scale was administered to 665 patients with hypertension who attended one of the four government primary healthcare clinics in the Hulu Langat and Klang districts of Selangor, Malaysia, between early December 2012 and end-March 2013. The construct validity was examined in two phases. Phase I consisted of translation of the MAR-Scale from English to Malay, a content validity check by an expert panel, a face validity check via a small preliminary test among patients with hypertension, and exploratory factor analysis (EFA). Phase II involved internal consistency reliability calculations and confirmatory factor analysis (CFA). RESULTS EFA verified five existing factors that were previously identified (i.e. issues with medication management, multiple medications, belief in medication, medication availability, and the patient’s forgetfulness and convenience), while CFA extracted four factors (medication availability issues were not extracted). The final modified MAR-Scale model, which had 11 items and a four-factor structure, provided good evidence of convergent and discriminant validities. Cronbach’s alpha coefficient was > 0.7, indicating good internal consistency of the items in the construct. The results suggest that the modified MAR-Scale has good internal consistencies and construct validity. CONCLUSION The validated modified MAR-Scale (Malaysian version) was found to be suitable for use among patients with hypertension receiving treatment in primary healthcare settings. However, the comprehensive measurement of other factors that can also lead to non-adherence requires further exploration. PMID:25902719

Validity and Reliability of the Italian Version of the Functioning Assessment Short Test (FAST) in Bipolar Disorder

PubMed Central

Moro, Maria Francesca; Colom, Francesc; Floris, Francesca; Pintus, Elisa; Pintus, Mirra; Contini, Francesca; Carta, Mauro Giovanni

2012-01-01

Background: Functioning Assessment Short Test (FAST) is a brief instrument designed to assess the main functioning problems experienced by psychiatric patients, specifically bipolar patients. It includes 24 items assessing impairment or disability in six domains of functioning: autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time. The aim of this study is to measure the validity and reliability of the Italian version of this instrument. Methods: Twenty-four patients with DSM-IV TR bipolar disorder and 20 healthy controls were recruited and evaluated in three private clinics in Cagliari (Sardinia, Italy). The psychometric properties of FAST (feasibility, internal consistency, concurrent validity, discriminant validity (patients vs controls and eutimic patients vs manic and depressed), and test-retest reliability were analyzed. Results: The internal consistency obtained was very high with a Cronbach's alpha of 0.955. A highly significant negative correlation with GAF was obtained (r = -0.9; p < 0.001) pointing to a reasonable degree of concurrent validity. FAST show a good test-retest reliability between two independent evaluation differing of one week (mean K =0.73). The total FAST scores were lower in controls as compared with Bipolar Patients and in Euthimic patients compared with Depressed or Manic. Conclusion: The Italian version of the FAST showed similar psychometrics properties as far as regard internal consistency and discriminant validity of the original version and show a good test retest reliability measure by means of K statistics. PMID:22905035

[German translation and validation of the Stress Appraisal Measure (SAM)].

PubMed

Delahaye, M; Stieglitz, R D; Graf, M; Keppler, C; Maes, J; Pflueger, M

2015-05-01

In the present study, the German-language version of the Stress Appraisal Measure (SAM) by Peacock and Wong was validated in a student population. SAM is a relatively short questionnaire (28 items) that evaluates a current, stress-triggering event. The theoretical background is provided by the stress model of Lazarus and Folkman. 85 students (age: 23; 59 female, 26 male) were exposed to two stress scenarios in order to test whether they were suited to provoke stress. A factor analysis was performed and the internal consistency of the seven SAM scales was determined. In addition, the convergent validity of SAM with State and Trait Anxiety Inventory (STAI), Coping Inventory for Stressful Situations (CISS) and specific emotion scales was investigated via Pearson's product-moment correlation. The two stress scenarios were suited to evoke stress. The factor structure and the internal consistency of the individual scales, as well as the convergent validity of SAM were replicated with minor limitations in the present German version. Some items (especially from the fifth factor) were only replicated partially. SAM can also be employed in the German language version. © Georg Thieme Verlag KG Stuttgart · New York.

Validation and cross cultural adaptation of the Italian version of the Harris Hip Score.

PubMed

Dettoni, Federico; Pellegrino, Pietro; La Russa, Massimo R; Bonasia, Davide E; Blonna, Davide; Bruzzone, Matteo; Castoldi, Filippo; Rossi, Roberto

2015-01-01

The Harris Hip Score (HHS) is one of the most widely used health related quality of life (HRQOL) measures for the assessment of hip pathology: in spite of this, a validation study, and an official Italian version have not been provided yet. The aim of this study was to create an Italian valid and reliable version of the HHS. The score was translated and modified in Italian; then 103 patients with different hip pathologies were evaluated using this HHS version and also with the WOMAC and the SF-12 questionnaires. Content, construct and criterion validities were tested, such as interobserver reliability, test-retest reliability and internal consistency. Cross-cultural adaptation was easy, and only minor adaptation was required in the translation process. Construct and criterion validity of the HHS Italian Version were confirmed by satisfactory values of Spearman's Rho for correlation between specific domains of HHS and Womac and SF12 scores. Interobserver and test-retest reliabilities obtained values of 0.996 and 0.975 respectively; Cronbach's alpha for internal consistency was 0.816. Statistical and clinical analysis showed that HHS is highly valid and reliable in this new Italian version.

Validity and Reliability of the Turkish Version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form.

PubMed

Yalin Sapmaz, Şermin; Ergin, Dilek; Özek Erkuran, Handan; Şen Celasin, Nesrin; Öztürk, Masum; Karaarslan, Duygu; Köroğlu, Ertuğrul; Aydemir, Ömer

2017-09-01

This study assessed the validity and reliability of the Turkish version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form for use among the Turkish population. The study group consisted of 30 patients that had been treated in a child psychiatry unit and diagnosed with posttraumatic stress disorder and 83 healthy volunteers that were attending middle or high school during the study period. For reliability analyses, the internal consistency coefficient and the test-retest correlation coefficient were measured. For validity analyses, the exploratory factor analysis and correlation analysis with the Child Posttraumatic Stress Reaction Index for concurrent validity were measured. The Cronbach's alpha (the internal consistency coefficient) of the scale was 0.909, and the test-retest correlation coefficient was 0.663. One factor that could explain 58.5% of the variance was obtained and was congruent with the original construct of the scale. As for concurrent validity, the scale showed high correlation with the Child Posttraumatic Stress Reaction Index. It was concluded that the Turkish version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form can be used as a valid and reliable tool.

Reliability and validity of the Treatment Satisfaction Questionnaire for Medication among Portuguese-speaking Brazilian patients with hypertension.

PubMed

Sauer Liberato, Ana Carolina; Cunha Matheus Rodrigues, Roberta; Kim, MyoungJin; Mallory, Caroline

2016-07-01

This study examined the reliability and validity of the Brazilian Portuguese version of the Treatment Satisfaction Questionnaire for Medication (version 1.4) among patients with hypertension. Understanding the patient experience with treatment satisfaction will contribute to improved medication adherence and control of hypertension. Hypertension is a serious problem in Brazil that is associated with chronic illness controlled, in part, by consistent adherence to medications. Patient satisfaction with medication treatment is associated with adherence to medication. The Treatment Satisfaction Questionnaire for Medication (version 1.4) is a promising instrument for measuring medication; however, to date there has been no report of the reliability and validity of the instrument with Portuguese-speaking adults with hypertension in Brazil. Cross-sectional descriptive exploratory study. A convenience sample of 300 patients with hypertension in an outpatient setting in the southeast region of São Paulo state in Brazil completed the Treatment Satisfaction Questionnaire for Medication (version 1.4). The instrument, comprised of four subscales, was evaluated for reliability using correlation analyses and internal consistency. Confirmatory factor analysis was used to determine factorial validity. Correlational analyses, internal consistency (Cronbach's alpha) and hierarchical confirmatory factor analysis demonstrate adequate support for the four-factor dimensionality, reliability and factorial validity of the Treatment Satisfaction Questionnaire for Medication (version 1.4). This study provides modest evidence for internal consistency and factorial validity of the Treatment Satisfaction Questionnaire for Medication (version 1.4) in Portuguese-speaking adult Brazilians with hypertension. Future testing should focus on extending reliability testing, discriminant validity and potential translation and literacy issues in this population. Within known limitations, clinicians will

Turkish Version of the Student Nurse Stress Index: Validity and Reliability.

PubMed

Sarikoc, Gamze; Bayram Demiralp, Meral; Oksuz, Emine; Pazar, Berrin

2017-06-01

This study aimed to adapt the Student Nurse Stress Index (SNSI) for the Turkish nursing students and investigate its psychometric properties. Research was conducted with 152 volunteer female students who attended a university college in Ankara, Turkey. Test-retest reliability was investigated for the scale internal consistency (Cronbach α) and stability. Also, content validity and construct validity of the SNSI were assessed. In order to determine the construct validity of SNSI, Uygulamalı Çok Değişkenli İstatistiksel Yöntemler and confirmatory factor analysis was conducted. The Turkish version of SNSI with 15 items comprised four factors (academic load, clinical concerns, personal problems, interface worries). The content validity index (CVI) score was .97. Factor loadings of Turkish version of SNSI varied between .532 and .868. The "personal problems" subscale explained 19.01% of the variance; "clinical concerns" explained 18.51%; "interface worries" explained 15.32%; "academic load" explained 14.14%. The total variance explained was 66.99%. CFA results (χ 2 /SD, GFI, CFI, TLI, IFI, RMSEA and SRMR) were acceptable and in good agreement. The internal consistency coefficient of the SNSI was .86. Results showed that the SNSI had a satisfactory level of reliability and validity in nursing students in Turkey. Multicenter studies including nursing students from different nursing schools are recommended for the SNSI to be generalized. Copyright © 2017. Published by Elsevier B.V.

The teamwork in assertive community treatment (TACT) scale: development and validation.

PubMed

Wholey, Douglas R; Zhu, Xi; Knoke, David; Shah, Pri; Zellmer-Bruhn, Mary; Witheridge, Thomas F

2012-11-01

Team design is meticulously specified for assertive community treatment (ACT) teams, yet performance can vary across ACT teams, even those with high fidelity. By developing and validating the Teamwork in Assertive Community Treatment (TACT) scale, investigators examined the role of team processes in ACT performance. The TACT scale measuring ACT teamwork was developed from a conceptual model grounded in organizational research and adapted for the ACT and mental health context. TACT subscales were constructed after exploratory and confirmatory factor analyses. The reliability, discriminant validity, predictive validity, temporal stability, internal consistency, and within-team agreement were established with surveys from approximately 300 members of 26 Minnesota ACT teams who completed the questionnaire three times, at six-month intervals. Nine TACT subscales emerged from the analyses: exploration, exploitation of new and existing knowledge, psychological safety, goal agreement, conflict, constructive controversy, information accessibility, encounter preparedness, and consumer-centered care. These nine subscales demonstrated fit and temporal stability (confirmatory factor analysis), high internal consistency (Cronbach's alpha), and within-team agreement and between-team differences (rwg and intraclass correlations). Correlational analyses of the subscales revealed that they measure related yet distinctive aspects of ACT team processes, and regression analyses demonstrated predictive validity (encounter preparedness is related to staff outcomes). The TACT scale demonstrated high reliability and validity and can be included in research and evaluation of teamwork in ACT and mental health teams.

Professional Learning Communities Assessment: Adaptation, Internal Validity, and Multidimensional Model Testing in Turkish Context

ERIC Educational Resources Information Center

Dogan, Selçuk; Tatik, R. Samil; Yurtseven, Nihal

2017-01-01

The main purpose of this study is to adapt and validate the Professional Learning Communities Assessment Revised (PLCA-R) by Olivier, Hipp, and Huffman within the context of Turkish schools. The instrument was translated and adapted to administer to teachers in Turkey. Internal structure of the Turkish version of PLCA-R was investigated by using…

Establishing a 'Physician's Spiritual Well-being Scale' and testing its reliability and validity.

PubMed

Fang, C K; Li, P Y; Lai, M L; Lin, M H; Bridge, D T; Chen, H W

2011-01-01

The purpose of this study was to develop a Physician's Spiritual Well-Being Scale (PSpWBS). The significance of a physician's spiritual well-being was explored through in-depth interviews with and qualitative data collection from focus groups. Based on the results of qualitative analysis and related literature, the PSpWBS consisting of 25 questions was established. Reliability and validity tests were performed on 177 subjects. Four domains of the PSpWBS were devised: physician's characteristics; medical practice challenges; response to changes; and overall well-being. The explainable total variance was 65.65%. Cronbach α was 0.864 when the internal consistency of the whole scale was calculated. Factor analysis showed that the internal consistency Cronbach α value for each factor was between 0.625 and 0.794 and the split-half reliability was 0.865. The scale has satisfactory reliability and validity and could serve as the basis for assessment of the spiritual well-being of a physician.

The Math Essential Skills Screener--Upper Elementary Version (MESS-U): Studies of Reliability and Validity

ERIC Educational Resources Information Center

Erford, Bradley T.; Biddison, Amanda R.

2006-01-01

The Math Essential Skills Screener--Upper Elementary Version (MESS-U) is part of a series of screening tests designed to help identify students ages 9-11 who are at risk for mathematics failure. Internal consistency, test-retest reliability, item analysis, decision efficiency, convergent validity and factorial validity of the MESS-U were studied…

The Rothschild Scale for Antidepressant Tachyphylaxis: reliability and validity.

PubMed

Rothschild, Anthony J

2008-01-01

After successful treatment of an episode of major depression, many patients complain of symptoms of apathy or decreased motivation (described by patients as "the blahs"), fatigue, dullness in cognitive function, sleep disturbance, weight gain, and sexual dysfunction; however, the characterization of this phenomenon of antidepressant tachyphylaxis has been hampered by the lack of an accepted definition and a reliable and valid assessment tool. To address this problem, the development and assessment of the Rothschild Scale for Antidepressant Tachyphylaxis (RSAT) are described. The RSAT consists of 6 self-report items assessing energy level, motivation and interest, cognitive functioning, weight gain, sleep, and sexual functioning. A seventh item, affect, is assessed by the interviewer. Each item is measured within a 5-point ordinal scale with anchor points developed to illustrate each rating. This study assesses the internal consistency, test-retest reliability, convergent and discriminant validity, sensitivity, specificity, and positive and negative predictive values of the RSAT. The RSAT demonstrated excellent internal consistency and scale reliability (Cronbach alpha = .902). The RSAT also demonstrated strong test-retest reliability (for depressed patients: r = 0.822, P < .01; for control subjects: r = 0.887, P < .01). The total RSAT score did not correlate with severity of depression as measured by the total Hamilton Depression Rating Scale score or the Hamilton Depression Rating Scale item 1 (depressed mood), supporting the discriminant validity of the RSAT for use in antidepressant tachyphylaxis. The RSAT is a reliable measure of antidepressant tachyphylaxis.

Portuguese Version of the Pain Beliefs and Perceptions Inventory: A Multicenter Validation Study.

PubMed

Azevedo, Luís Filipe; Sampaio, Rute; Camila Dias, Cláudia; Romão, José; Lemos, Laurinda; Agualusa, Luís; Vaz-Serra, Sílvia; Patto, Teresa; Costa-Pereira, Altamiro; Castro-Lopes, José Manuel

2017-07-01

We aimed to perform the translation, cultural adaptation, and validation of the Pain Beliefs and Perceptions Inventory (PBPI) for the European Portuguese language and chronic pain population. This is a longitudinal multicenter validation study. A Portuguese version of the PBPI (PBPI-P) was created through a process of translation, back translation, and expert panel evaluation. The PBPI-P was administered to a total of 122 patients from 13 chronic pain clinics in Portugal, at baseline and after 7 days. Internal consistency and test-retest reliability were assessed by Cronbach's alpha (α) and intraclass correlation coefficient (ICC). Construct (convergent and discriminant) validity was assessed based on a set of previously developed theoretical hypotheses about interrelations between the PBPI-P and other measures. Exploratory and confirmatory factor analyses were performed to test the theoretical structure of the PBPI-P. The internal consistency and test-retest reliability coefficients for each respective subscale were α = 0.620 and ICC = 0.801 for mystery; α = 0.744 and ICC = 0.841 for permanence; α = 0.778 and ICC = 0.791 for constancy; and α = 0.764 and ICC = 0.881 for self-blame. Exploratory and confirmatory factor analysis revealed a four-factor structure (performance, constancy, self-blame, and mystery) that explained 63% of the variance. The construct validity of the PBPI-P was shown to be adequate, with more than 90% of the previously defined hypotheses regarding interrelations with other measures confirmed. The PBPI-P has been shown to be adequate and to have excellent reliability, internal consistency, and validity. It may contribute to a better pain assessment and is suitable for research and clinical use. © 2016 World Institute of Pain.

French translation and validation of the "Anterior Knee Pain Scale" (AKPS).

PubMed

Buckinx, F; Bornheim, S; Remy, G; Van Beveren, J; Reginster, Jy; Bruyère, O; Dardenne, N; Kaux, J F

2017-12-21

To linguistically and cross-culturally translate the Anterior Knee Pain Scale into French and to evaluate the reliability and validity of this translated version of the questionnaire. The translation part was performed in six stages, according to international guidelines: (i) two initial translations from English to French; (ii) synthesis of the two translations; (iii) backward translations into the original language; (iv) expert committee to compare the backward translations with the original questionnaire; (v) pre-final version testing and (VI) expert committee appraisal. To validate the French version of the Anterior Knee Pain Scale, we assessed its validity, reliability and floor/ceiling effects. To do this, volunteer patients from the French part of Belgium and from France, with patellofemoral pain were asked to answer the French version of the Anterior Knee Pain Scale at baseline and after 7 days, as well as the generic SF-36 questionnaire. The Anterior Knee Pain Scale was translated without any major difficulties. A total of 101 subjects aged 34.5 ± 11.4 years (58.4% of women) were included in this study. Results indicated an excellent test-retest reliability (Intra-class correlation coefficient (ICC) = 0.97, 95%CI: 0.96-0.98), a high internal consistency (Cronbach's alpha = 0.87), a consistent construct validity (high correlations with the SF-36 questionnaire were found with domains related to physical function (r = 0.80), physical role (r = 0.70) and pain (r = 0.64)) and low or moderate correlations with domains related to mental health (r = 0.26), vitality (r = 0.32) and social function (r = 0.41). Moreover, no floor/ceiling effects have been found. A valid French version of the Anterior Knee Pain Scale is now available and can be used with confidence to better assess the disease burden associated with patellofemoral pain. It was successfully cross-culturally adapted into French. Implications for rehabilitation The

DNA Commission of the International Society for Forensic Genetics: Recommendations on the validation of software programs performing biostatistical calculations for forensic genetics applications.

PubMed

Coble, M D; Buckleton, J; Butler, J M; Egeland, T; Fimmers, R; Gill, P; Gusmão, L; Guttman, B; Krawczak, M; Morling, N; Parson, W; Pinto, N; Schneider, P M; Sherry, S T; Willuweit, S; Prinz, M

2016-11-01

The use of biostatistical software programs to assist in data interpretation and calculate likelihood ratios is essential to forensic geneticists and part of the daily case work flow for both kinship and DNA identification laboratories. Previous recommendations issued by the DNA Commission of the International Society for Forensic Genetics (ISFG) covered the application of bio-statistical evaluations for STR typing results in identification and kinship cases, and this is now being expanded to provide best practices regarding validation and verification of the software required for these calculations. With larger multiplexes, more complex mixtures, and increasing requests for extended family testing, laboratories are relying more than ever on specific software solutions and sufficient validation, training and extensive documentation are of upmost importance. Here, we present recommendations for the minimum requirements to validate bio-statistical software to be used in forensic genetics. We distinguish between developmental validation and the responsibilities of the software developer or provider, and the internal validation studies to be performed by the end user. Recommendations for the software provider address, for example, the documentation of the underlying models used by the software, validation data expectations, version control, implementation and training support, as well as continuity and user notifications. For the internal validations the recommendations include: creating a validation plan, requirements for the range of samples to be tested, Standard Operating Procedure development, and internal laboratory training and education. To ensure that all laboratories have access to a wide range of samples for validation and training purposes the ISFG DNA commission encourages collaborative studies and public repositories of STR typing results. Published by Elsevier Ireland Ltd.

A validation study on the traditional Chinese version of Spinal Appearance Questionnaire for adolescent idiopathic scoliosis.

PubMed

Guo, Jing; Lau, Ajax Hong Yin; Chau, Jack; Ng, Bobby Kin Wah; Lee, Kwong Man; Qiu, Yong; Cheng, Jack Chun Yiu; Lam, Tsz Ping

2016-10-01

"Simplified Chinese" version of Spinal Appearance Questionnaire (SC-SAQ) for patients with adolescent idiopathic scoliosis (AIS) was available but did not fit for communities using "Traditional Chinese" as their primary language. We developed a traditional Chinese version of SAQ (TC-SAQ) and evaluated its reliability and validity. TC-SAQ was administered to 112 AIS patients, of which 101 bilingual (English and Chinese) patients completed E-SAQ and the traditional Chinese version of Scoliosis Research Society-22 questionnaire (TC-SRS-22). Internal consistency and test-retest reliability were evaluated. Concurrent validity was evaluated by comparing TC-SAQ score with E-SAQ score, and convergent validity by comparing TC-SAQ score with TC-SRS-22 self-image domain score, and discriminant validity by analyzing the relationship between TC-SAQ score and patients' characteristics. Internal consistency of individual TC-SAQ domain was high (Cronbach's α = 0.785 to 0.940), except for general (Cronbach's α = 0.665) and shoulders (Cronbach's α = 0.421) domain. Test-retest reliability of TC-SAQ was good (ICCs of each domain from 0.798 to 0.865). Concurrent validity demonstrated an excellent correlation between TC-SAQ and E-SAQ scores (r = 0.820 to 0.954, P < 0.0001 for all domains). Correlation between TC-SAQ domains and TC-SRS-22 self-image domain was weak to moderate. TC-SAQ total score and individual domain scores (except waist and chest domains) were positively correlated to major curve magnitude. TC-SAQ had good internal consistency and test-retest reliability. Concurrent validity evaluated against the original English version was excellent. TC-SAQ was both reliable and valid for clinical use for AIS patients using traditional Chinese as their primary language.

Validation of Assessment Vignettes and Scoring Rubric of Multicultural and International Competency in Faculty Teaching

ERIC Educational Resources Information Center

Henderson, Sheila J.; Horton, Ruth A.; Saito, Paul K.; Shorter-Gooden, Kumea

2016-01-01

The purpose of this research was to develop a new tool for assessing multicultural and international competency in faculty teaching through vignette scenarios of university classroom critical incidents--across disciplines of clinical and forensics psychology, business, and education. Construct and content validity of the initial draft vignettes…

International standards for monoclonal antibodies to support pre- and post-marketing product consistency: Evaluation of a candidate international standard for the bioactivities of rituximab.

PubMed

Prior, Sandra; Hufton, Simon E; Fox, Bernard; Dougall, Thomas; Rigsby, Peter; Bristow, Adrian

2018-01-01

The intrinsic complexity and heterogeneity of therapeutic monoclonal antibodies is built into the biosimilarity paradigm where critical quality attributes are controlled in exhaustive comparability studies with the reference medicinal product. The long-term success of biosimilars will depend on reassuring healthcare professionals and patients of consistent product quality, safety and efficacy. With this aim, the World Health Organization has endorsed the need for public bioactivity standards for therapeutic monoclonal antibodies in support of current controls. We have developed a candidate international potency standard for rituximab that was evaluated in a multi-center collaborative study using participants' own qualified Fc-effector function and cell-based binding bioassays. Dose-response curve model parameters were shown to reflect similar behavior amongst rituximab preparations, albeit with some differences in potency. In the absence of a common reference standard, potency estimates were in poor agreement amongst laboratories, but the use of the candidate preparation significantly reduced this variability. Our results suggest that the candidate rituximab standard can support bioassay performance and improve data harmonization, which when implemented will promote consistency of rituximab products over their life-cycles. This data provides the first scientific evidence that a classical standardization exercise allowing traceability of bioassay data to an international standard is also applicable to rituximab. However, we submit that this new type of international standard needs to be used appropriately and its role not to be mistaken with that of the reference medicinal product.

International standards for monoclonal antibodies to support pre- and post-marketing product consistency: Evaluation of a candidate international standard for the bioactivities of rituximab

PubMed Central

Prior, Sandra; Hufton, Simon E.; Dougall, Thomas; Rigsby, Peter; Bristow, Adrian

2018-01-01

ABSTRACT The intrinsic complexity and heterogeneity of therapeutic monoclonal antibodies is built into the biosimilarity paradigm where critical quality attributes are controlled in exhaustive comparability studies with the reference medicinal product. The long-term success of biosimilars will depend on reassuring healthcare professionals and patients of consistent product quality, safety and efficacy. With this aim, the World Health Organization has endorsed the need for public bioactivity standards for therapeutic monoclonal antibodies in support of current controls. We have developed a candidate international potency standard for rituximab that was evaluated in a multi-center collaborative study using participants' own qualified Fc-effector function and cell-based binding bioassays. Dose-response curve model parameters were shown to reflect similar behavior amongst rituximab preparations, albeit with some differences in potency. In the absence of a common reference standard, potency estimates were in poor agreement amongst laboratories, but the use of the candidate preparation significantly reduced this variability. Our results suggest that the candidate rituximab standard can support bioassay performance and improve data harmonization, which when implemented will promote consistency of rituximab products over their life-cycles. This data provides the first scientific evidence that a classical standardization exercise allowing traceability of bioassay data to an international standard is also applicable to rituximab. However, we submit that this new type of international standard needs to be used appropriately and its role not to be mistaken with that of the reference medicinal product. PMID:28985159

Reliability and Validity of Scores on the IFSP Rating Scale

ERIC Educational Resources Information Center

Jung, Lee Ann; McWilliam, R. A.

2005-01-01

Evidence is presented regarding the construct validity and internal consistency reliability of scores for an investigator-developed individualized family service plan (IFSP) rating scale. One hundred and twenty IFSPs were rated using a 12-item instrument, the IFSP Rating Scale (McWilliam & Jung, 2001). Using principal components factor…

Development and validation of the Smartphone Addiction Inventory (SPAI).

PubMed

Lin, Yu-Hsuan; Chang, Li-Ren; Lee, Yang-Han; Tseng, Hsien-Wei; Kuo, Terry B J; Chen, Sue-Huei

2014-01-01

The aim of this study was to develop a self-administered scale based on the special features of smartphone. The reliability and validity of the Smartphone Addiction Inventory (SPAI) was demonstrated. A total of 283 participants were recruited from Dec. 2012 to Jul. 2013 to complete a set of questionnaires, including a 26-item SPAI modified from the Chinese Internet Addiction Scale and phantom vibration and ringing syndrome questionnaire. There were 260 males and 23 females, with ages 22.9 ± 2.0 years. Exploratory factor analysis, internal-consistency test, test-retest, and correlation analysis were conducted to verify the reliability and validity of the SPAI. Correlations between each subscale and phantom vibration and ringing were also explored. Exploratory factor analysis yielded four factors: compulsive behavior, functional impairment, withdrawal and tolerance. Test-retest reliabilities (intraclass correlations  = 0.74-0.91) and internal consistency (Cronbach's α = 0.94) were all satisfactory. The four subscales had moderate to high correlations (0.56-0.78), but had no or very low correlation to phantom vibration/ringing syndrome. This study provides evidence that the SPAI is a valid and reliable, self-administered screening tool to investigate smartphone addiction. Phantom vibration and ringing might be independent entities of smartphone addiction.

Development of a valid Simplified Chinese version of the International Hip Outcome Tool (SC-iHOT-33) in young patients having total hip arthroplasty.

PubMed

Li, D H; Wang, W; Li, X; Gao, Y L; Liu, D H; Liu, D L; Xu, W D

2017-01-01

The International Hip Outcome Tool (iHOT-33) is a questionnaire designed for young, active patients with hip disorders. It has proven to be a highly reliable and valid questionnaire. The main purpose of our study was to adapt the iHOT-33 questionnaire into simplified Chinese and to assess its psychometric properties in Chinese patients. The iHOT-33 was cross culturally adapted into Chinese and 138 patients completed the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), the EuroQol-5D (EQ-5D), and the Chinese version of the iHOT-33(SC-iHOT-33) pre- or postoperatively within 6 months' follow-up. The Cronbach's alpha, intraclass correlation coefficient (ICC), Pearson's correlation coefficient (r), effect size (ES), and standardized response mean (SRM) were calculated to assess the reliability, validity, and responsiveness of the SC-iHOT-33, respectively. Total Cronbach's alpha was 0.965, which represented excellent internal consistency of the SC-iHOT-33. The ICC ranges from 0.866 to 0.929, which shows excellent test-retest reliability. The subscales of SC-iHOT-33 had the highest correlation coefficient (r = 0.812) with the physical function subscales of the WOMAC, as well as good correlation between the social/emotional subscale of the SC-iHOT-33 and the EQ-5D (r = 0.740, r = 0.743). No floor or ceiling effects were found. The ES and SRM values indicated good responsiveness of 2.44 and 2.67, respectively. The SC-iHOT-33 questionnaire is reliable, valid, and responsive for the evaluation of young, Chinese, active patients with hip disorders. Copyright © 2016 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Reliability and validity of the Nurse Practitioners' Roles and Competencies Scale.

PubMed

Lin, Li-Chun; Lee, Sheuan; Ueng, Steve Wen-Neng; Tang, Woung-Ru

2016-01-01

The objective of this study was to test the reliability and construct validity of the Nurse Practitioners' Roles and Competencies Scale. The role of nurse practitioners has attracted international attention. The advanced nursing role played by nurse practitioners varies with national conditions and medical environments. To date, no suitable measurement tool has been available for assessing the roles and competencies of nurse practitioners in Asian countries. Secondary analysis of data from three studies related to nurse practitioners' role competencies. We analysed data from 563 valid questionnaires completed in three studies to identify the factor structure of the Nurse Practitioners' Roles and Competencies Scale. To this end, we performed exploratory factor analysis using principal component analysis extraction with varimax orthogonal rotation. The internal consistency reliabilities of the overall scale and its subscales were examined using Cronbach's alpha coefficient. The scale had six factors: professionalism, direct care, clinical research, practical guidance, medical assistance, as well as leadership and reform. These factors explained 67·5% of the total variance in nurse practitioners' role competencies. Cronbach's alpha coefficient for the overall scale was 0·98, and those of its subscales ranged from 0·83-0·97. The internal consistency reliability and construct validity of the Nurse Practitioners' Roles and Competencies Scale were good. The high internal consistency reliabilities suggest item redundancy, which should be minimised by using item response theory to enhance the applicability of this questionnaire for future academic and clinical studies. The Nurse Practitioners' Roles and Competencies Scale can be used as a tool for assessing the roles and competencies of nurse practitioners in Taiwan. Our findings can also serve as a reference for other Asian countries to develop the nurse practitioner role. © 2015 John Wiley & Sons Ltd.

Translation, Adaptation and Cross Language Validation of Tinnitus Handicap Inventory in Urdu.

PubMed

Aqeel, Muhammad; Ahmed, Ammar

2017-12-01

Tinnitus is characterized as a perception of numerous auditory sounds in absence of external stimulus. Tinnitus can have a considerable consequence on a person's quality of life, and is considered to be very complicated to quantify. The aim of this study was to investigate the reliability and validity of Urdu translation of the Tinnitus Handicap Inventory (THI) in Pakistan. It was designed to assess the presence of various auditory sounds without the external stimulus. Scale consisted of 25 items having three subscales functional, emotional, and catastrophic. The study comprised into two stages, preliminary and main studies. The results of preliminary study revealed that the overall scale had high internal consistency [alpha coefficient of Urdu version of THI (THI-U)= 0.99, alpha coefficient of English version of THI=0.98]. The overall scale had test-retest correlation over a fifteen days period of interval (0.99). Main study was performed on 110 tinnitus patients. The results of main study showed that the internal consistency and reliability of Urdu version was (α=0.93). The THI-U and its subscales demonstrated good internal consistency reliability ( α =0.81 to 0.86). High to moderate correlations were noted between tinnitus symptom ratings. A confirmatory factor analysis was used to validate the three subscales of THI-U, and high inter-correlations were found between the subscales also results revealed that a three-factor model for the THI-U was most tenable. The results displayed that the confirmatory factor analysis confirmed to validate the three subscales of THI-U. THI-U might present important information about precise facets of tinnitus distress along with diagnostic interviews in clinical practice.

Reliability and Validity of the Evidence-Based Practice Confidence (EPIC) Scale

ERIC Educational Resources Information Center

Salbach, Nancy M.; Jaglal, Susan B.; Williams, Jack I.

2013-01-01

Introduction: The reliability, minimal detectable change (MDC), and construct validity of the evidence-based practice confidence (EPIC) scale were evaluated among physical therapists (PTs) in clinical practice. Methods: A longitudinal mail survey was conducted. Internal consistency and test-retest reliability were estimated using Cronbach's alpha…

Relationship between Internal Quality Audit and Quality Culture toward Implementation Consistency of ISO 9000 in Private College of Sulawesi Province, Indonesia

ERIC Educational Resources Information Center

Mail, Abdul; Pratikto; Suparman, Sudjito; Purnomo; Santoso, Budi

2014-01-01

The study aims to find out the influence of internal quality process on the growth of quality culture in private college. This study is treated toward 178 lecturers of 25 private colleges in Sulawesi, Indonesia by means of questionnaire. Confirmatory factor analysis applied to assess the reliability of validity and measurement model. Relationship…

Validation of the Arabic version of the score for allergic rhinitis tool.

PubMed

Alharethy, Sami; Wedami, Mawaheb Al; Syouri, Falah; Alqabbani, Almaha A; Baqays, Abdulsalam; Mesallam, Tamer; Aldrees, Turki

2017-01-01

Allergic rhinitis (AR) is a common inflammation of the nasal mucosa in response to allergen exposure. We translated and validated the Score for Allergic Rhinitis (SFAR) into an Arabic version so that the disease can be studied in an Arabic population. SFAR is a non-invasive self-administered tool that evaluates eight items related to AR. This study aimed to translate and culturally adapt the SFAR questionnaire into Arabic, and assess the validity, consistency, and reliability of the translated version in an Arabic-speaking population of patients with suspected AR. Cross-sectional. Tertiary care hospital in Riyadh. The Arabic version of the SFAR was administered to patients with suspected AR and control participants. Comparison of the AR and control groups to determine the test-retest reliability and internal consistency of the instrument. The AR (n=173) and control (n=75) groups had significantly different Arabic SFAR scores (P < .0001). The instrument provided satisfactory internal consistency (Cronbach's alpha value of 0.7). The test-retest reliability was excellent for the total Arabic SFAR score (r =0.836, P < .0001). These findings demonstrate that the Arabic version of the SFAR is a valid tool that can be used to screen Arabic speakers with suspected AR. The absence of objective allergy testing.

Validation of the Mandarin Chinese version of the Leicester Cough Questionnaire in bronchiectasis.

PubMed

Gao, Y-H; Guan, W-J; Xu, G; Gao, Y; Lin, Z-Y; Tang, Y; Lin, Z-M; Li, H-M; Luo, Q; Zhong, N-S; Birring, S S; Chen, R-C

2014-12-01

The Leicester Cough Questionnaire (LCQ) has been validated for assessing cough-specific health status in bronchiectasis. We translated the LCQ into Mandarin Chinese and investigated its validity, reliability and responsiveness. The LCQ was translated into Mandarin Chinese using the forward-backward translation procedure. A total of 144 out-patients completed the Mandarin Chinese version of the LCQ (LCQ-MC), the Hospital Anxiety and Depression Scale (HADS) and the St George's Respiratory Questionnaire. Reassessments were performed during exacerbations and at 6 months. Concurrent validation, internal consistency, repeatability and responsiveness were determined. Minor cultural adaptations were made to the wording of LCQ-MC. No other difficulties were found during the translation process, with all items easily adapted to acceptable Mandarin Chinese. The questionnaire was not changed in terms of content layout and the order of the questions. In cognitive debriefing interviews, participants reported that the questionnaire was acceptable, relevant, comprehensive and easy to complete. The LCQ-MC showed good concurrent validity, internal consistency and test-retest reliability. Responsiveness was shown by significant changes in LCQ-MC scores between steady state, the first exacerbation and following 2-week antibiotic treatment (both interval changes, P < 0.01) CONCLUSION: The LCQ-MC is a valid, reliable and responsive instrument for determining cough-specific health status in Chinese bronchiectasis patients.

Translation and validation of the Cardiac Depression Scale to Arabic.

PubMed

Papasavvas, T; Al-Amin, H; Ghabrash, H F; Micklewright, D

2016-08-01

The Cardiac Depression Scale (CDS) has been designed to measure depressive symptoms in patients with heart disease. There is no Arabic version of the CDS. We translated and validated the CDS in an Arabic sample of patients with heart disease. Forward and back translation of the CDS was followed by assessment of cultural relevance and content validity. The Arabic version of the CDS (A-CDS) and the Arabic version of the Hospital Anxiety and Depression Scale (A-HADS) were then administered to 260 Arab in-patients with heart disease from 18 Arabic countries. Construct validity was assessed using exploratory factor analysis with polychoric correlations. Internal consistency was assessed using ordinal reliability alpha and item-to-factor polychoric correlations. Concurrent validity was assessed using Pearson's correlation coefficient between the A-CDS and the depression subscale of the A-HADS (A-HADS-D). Cultural relevance and content validity of the A-CDS were satisfactory. Exploratory factor analysis revealed three robust factors, without cross-loadings, that formed a single dimension. Internal consistency was high (ordinal reliability alpha for the total scale and the three factors were .94, .91, .86, and .87, respectively; item-to-factor correlations ranged from .77 to .91). Concurrent validity was high (r=.72). The A-CDS demonstrated a closer to normal distribution of scores than the A-HADS-D. Sensitivity and specificity of the A-CDS were not objectively assessed. The A-CDS appears to be a valid and reliable instrument to measure depressive symptoms in a representative sample of Arab in-patients with heart disease. Copyright © 2016 Elsevier B.V. All rights reserved.

The Reliability and Validity of Scores from the Children's Version of the Perception of Success Questionnaire.

ERIC Educational Resources Information Center

Liukkonen, Jarmo; Leskinen, Esko

1999-01-01

Analyzed the reliability and validity of scores of 557 14-year-old Finnish male soccer players on the children's version of the Perception of Success Questionnaire (G. Roberts and others, 1998). Internal consistency coefficients for the two subscales' scores were high, and scores on both scales had strong construct validity. (LSD)

Workplace nutrition knowledge questionnaire: psychometric validation and application.

PubMed

Guadagnin, Simone C; Nakano, Eduardo Y; Dutra, Eliane S; de Carvalho, Kênia M B; Ito, Marina K

2016-11-01

Workplace dietary intervention studies in low- and middle-income countries using psychometrically sound measures are scarce. This study aimed to validate a nutrition knowledge questionnaire (NQ) and its utility in evaluating the changes in knowledge among participants of a Nutrition Education Program (NEP) conducted at the workplace. A NQ was tested for construct validity, internal consistency and discriminant validity. It was applied in a NEP conducted at six workplaces, in order to evaluate the effect of an interactive or a lecture-based education programme on nutrition knowledge. Four knowledge domains comprising twenty-three items were extracted in the final version of the NQ. Internal consistency of each domain was significant, with Kuder-Richardson formula values>0·60. These four domains presented a good fit in the confirmatory factor analysis. In the discriminant validity test, both the Expert and Lay groups scored>0·52, but the Expert group scores were significantly higher than those of the Lay group in all domains. When the NQ was applied in the NEP, the overall questionnaire scores increased significantly because of the NEP intervention, in both groups (P<0·001). However, the increase in NQ scores was significantly higher in the interactive group than in the lecture group, in the overall score (P=0·008) and in the healthy eating domain (P=0·009). The validated NQ is a short and useful tool to assess gain in nutrition knowledge among participants of NEP at the workplace. According to the NQ, an interactive nutrition education had a higher impact on nutrition knowledge than a lecture programme.

Hypertension Knowledge-Level Scale (HK-LS): a study on development, validity and reliability.

PubMed

Erkoc, Sultan Baliz; Isikli, Burhanettin; Metintas, Selma; Kalyoncu, Cemalettin

2012-03-01

This study was conducted to develop a scale to measure knowledge about hypertension among Turkish adults. The Hypertension Knowledge-Level Scale (HK-LS) was generated based on content, face, and construct validity, internal consistency, test re-test reliability, and discriminative validity procedures. The final scale had 22 items with six sub-dimensions. The scale was applied to 457 individuals aged ≥ 18 years, and 414 of them were re-evaluated for test-retest reliability. The six sub-dimensions encompassed 60.3% of the total variance. Cronbach alpha coefficients were 0.82 for the entire scale and 0.92, 0.59, 0.67, 0.77, 0.72, and 0.76 for the sub-dimensions of definition, medical treatment, drug compliance, lifestyle, diet, and complications, respectively. The scale ensured internal consistency in reliability and construct validity, as well as stability over time. Significant relationships were found between knowledge score and age, gender, educational level, and history of hypertension of the participants. No correlation was found between knowledge score and working at an income-generating job. The present scale, developed to measure the knowledge level of hypertension among Turkish adults, was found to be valid and reliable.

A Validation of the Ski Hi Language Development Scale.

ERIC Educational Resources Information Center

Tonelson, Stephen W.

The purpose of the study was to assess the reliability and the validity of the Ski Hi Language Development Scale which was designed to determine the receptive and the expressive language levels of hearing impaired children from birth to age 5. The reliability of the instrument was estimated through: (1) internal consistency, (2) inter-rater…

Establishing the Validity of the Task-Based English Speaking Test (TBEST) for International Teaching Assistants

ERIC Educational Resources Information Center

Witt, Autumn Song

2010-01-01

This dissertation follows an oral language assessment tool from initial design and implementation to validity analysis. The specialized variables of this study are the population: international teaching assistants and the purpose: spoken assessment as a hiring prerequisite. However, the process can easily be applied to other populations and…

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

Validity and reliability of the Utrecht Work Engagement Scale-Student Version in Sri Lanka.

PubMed

Wickramasinghe, Nuwan Darshana; Dissanayake, Devani Sakunthala; Abeywardena, Gihan Sajiwa

2018-05-04

The present study was aimed at assessing the validity and the reliability of the Sinhala version of the Utrecht Work Engagement Scale-Student Version (UWES-S) among collegiate cycle students in Sri Lanka. The 17-item UWES-S was translated to Sinhala and the judgmental validity was assessed by a multi-disciplinary panel of experts. Construct validity of the UWES-S was appraised by using multi-trait scaling analysis and exploratory factor analysis (EFA) on data obtained from a sample of 194 grade thirteen students in the Kurunegala district, Sri Lanka. Reliability of the UWES-S was assessed by using internal consistency and test-retest reliability. Except for item 13, all other items showed good psychometric properties in judgemental validity, item-convergent validity and item-discriminant validity. EFA using principal component analysis with Oblimin rotation, suggested a three-factor solution (including vigor, dedication and absorption subscales) explaining 65.4% of the total variance for the 16-item UWES-S (with item 13 deleted). All three subscales show high internal consistency with Cronbach's α coefficient values of 0.867, 0.819, and 0.903 and test-retest reliability was high (p < 0.001). Hence, the Sinhala version of the 16-item UWES-S is a valid and a reliable instrument to assess work engagement among collegiate cycle students in Sri Lanka.

Validation of a Social Networks and Support Measurement Tool for Use in International Aging Research: The International Mobility in Aging Study.

PubMed

Ahmed, Tamer; Belanger, Emmanuelle; Vafaei, Afshin; Koné, Georges K; Alvarado, Beatriz; Béland, François; Zunzunegui, Maria Victoria

2018-03-01

The purpose of this study was to develop and validate a new instrument to assess social networks and social support (IMIAS-SNSS) for different types of social ties in an international sample of older adults. The study sample included n = 1995 community dwelling older people aged between 65 and 74 years from the baseline of the longitudinal International Mobility in Aging Study (IMIAS). In order to measure social networks for each type of social tie, participants were asked about the number of contacts, the number of contacts they see at least once a month or have a very good relationship with, or speak with at least once a month. For social support, participants had to rate the level of social support provided by the four types of contacts for five Likert scale items. Confirmatory Factor Analysis was conducted to determine the goodness of fit of the measurement models. Satisfactory goodness-of-fit indices confirmed the satisfactory factorial structure of the IMIAS-SNSS instrument. Reliability coefficients were 0.80, 0.81, 0.85, and 0.88 for friends, children, family, and partner models, respectively. The models were confirmed by CFA for each type of social tie. Moreover, IMIAS-SNSS detected gender differences in the older adult populations of IMIAS. These results provide evidence supporting that IMIAS-SNSS is a psychometrically sound instrument and of its validity and reliability for international populations of older adults.

[Validity of the Child Psychiatric Hospital Teacher Questionnaire for the assessment of ADHD. Teacher's version].

PubMed

Ulloa, R E; Narváez, M R; Arroyo, E; del Bosque, J; de la Peña, F

2009-01-01

Teacher's rating scales for the evaluation of attention deficit and superactivity disorder (TDAH) and conduct disorders have been shown to be useful and valid tools. The Child Psychiatric Hospital Teacher Questionnaire (CPHTQ) of the Hospital Psiquiátrico Infantil Dr. Juan N. Navarro was designed for the assessment of ADHD symptoms, externalizing symptoms and school functioning difficulties of children and adolescents. Internal consistency, criterion validity, construct validity and sensitivity of the scale to changes in symptom severity were evaluated in this study. The scale was administered to 282 teachers of children and adolescents aged 5 to 17 years who came to a unit specialized in child psychiatry. The validity analysis of the instrument showed that the internal consistency measured by Cronbach's alpha was 0.94. The factorial analysis yielded 5 factors accounting for 59.1% of the variance: hyperactivity and conduct symptoms, predatory, conduct disorder, inattentive, poor functioning and motor disturbances. The CPHTQ scores on the scale showed positive correlation with the Clinical Global impression (CGI) scale in the patients' response to drug treatment. The CPHTQ shows adequate validity characteristics that demonstrate its utility in the evaluation of patients with ADHD and its comorbidity with other behavior disorders.

The self-consistency model of subjective confidence.

PubMed

Koriat, Asher

2012-01-01

How do people monitor the correctness of their answers? A self-consistency model is proposed for the process underlying confidence judgments and their accuracy. In answering a 2-alternative question, participants are assumed to retrieve a sample of representations of the question and base their confidence on the consistency with which the chosen answer is supported across representations. Confidence is modeled by analogy to the calculation of statistical level of confidence (SLC) in testing hypotheses about a population and represents the participant's assessment of the likelihood that a new sample will yield the same choice. Assuming that participants draw representations from a commonly shared item-specific population of representations, predictions were derived regarding the function relating confidence to inter-participant consensus and intra-participant consistency for the more preferred (majority) and the less preferred (minority) choices. The predicted pattern was confirmed for several different tasks. The confidence-accuracy relationship was shown to be a by-product of the consistency-correctness relationship: It is positive because the answers that are consistently chosen are generally correct, but negative when the wrong answers tend to be favored. The overconfidence bias stems from the reliability-validity discrepancy: Confidence monitors reliability (or self-consistency), but its accuracy is evaluated in calibration studies against correctness. Simulation and empirical results suggest that response speed is a frugal cue for self-consistency, and its validity depends on the validity of self-consistency in predicting performance. Another mnemonic cue-accessibility, which is the overall amount of information that comes to mind-makes an added, independent contribution. Self-consistency and accessibility may correspond to the 2 parameters that affect SLC: sample variance and sample size.

Development and validation of a cancer awareness questionnaire for Malaysian undergraduate students of Chinese ethnicity.

PubMed

Loo, Jo Lin; Ang, Yee Kwang; Yim, Hip Seng

2013-01-01

To describe the development and validation of a cancer awareness questionnaire (CAQ) based on a literature review of previous studies, focusing on cancer awareness and prevention. A total of 388 Chinese undergraduate students in a private university in Kuala Lumpur, Malaysia, were recruited to evaluate the developed self-administered questionnaire. The CAQ consisted of four sections: awareness of cancer warning signs and screening tests; knowledge of cancer risk factors; barriers in seeking medical advice; and attitudes towards cancer and cancer prevention. The questionnaire was evaluated for construct validity using principal component analysis and internal consistency using Cronbach's alpha (α) coefficient. Test-retest reliability was assessed with a 10-14 days interval and measured using Pearson product-moment correlation. The initial 77-item CAQ was reduced to 63 items, with satisfactory construct validity, and a high total internal consistency (Cronbach's α=0.77). A total of 143 students completed the questionnaire for the test-retest reliability obtaining a correlation of 0.72 (p<0.001) overall. The CAQ could provide a reliable and valid measure that can be used to assess cancer awareness among local Chinese undergraduate students. However, further studies among students from different backgrounds (e.g. ethnicity) are required in order to facilitate the use of the cancer awareness questionnaire among all university students.

Reliability and Validity of the Greek Migraine Disability Assessment (MIDAS) Questionnaire.

PubMed

Oikonomidi, Theodora; Vikelis, Michail; Artemiadis, Artemios; Chrousos, George P; Darviri, Christina

2018-03-01

The Migraine Disability Assessment (MIDAS) Questionnaire is a reliable and valid instrument for migraine-related disability. Such a tool is needed to quantify migraine-related disability in the Greek population. This validation study aims to assess the test-retest reliability, internal consistency, item discriminant and convergent validity of the Greek translation of the MIDAS. Adults diagnosed with migraine completed the MIDAS Questionnaire on two occasions 3 weeks apart to assess reliability, and completed the RAND-36 to assess validity. Participants (n = 152) had a median MIDAS score of 24 and mostly severe disability (58% were grade IV). The test-retest reliability analysis (N = 59) revealed excellent reliability for the total score. Internal consistency was α = 0.71 for initial and α = 0.82 for retest completion. For item discriminant validity, the correlations between each question and the total score were significant, with high correlations for questions 2-5 (range 0.67 ≤ r ≤ 0.79; p < 0.01). For convergent validity, there was significant negative correlation between the total score and all RAND-36 subscales except for 'emotional wellbeing'. The negative correlation indicates that patients with a lower degree of disability according to their MIDAS score tended to have better wellbeing. Psychometric properties are comparable with those of other published validation studies of the MIDAS and the original. Findings on question 1 show that missing work/school days may be closely related with increased affect issues. The Greek version of the MIDAS Questionnaire has good reliability and validity. This study allowed for cross-cultural comparability of research findings.

Validity and reliability assessment of the Brazilian version of the game addiction scale (GAS).

PubMed

Lemos, Igor Lins; Cardoso, Adriana; Sougey, Everton Botelho

2016-05-01

The uncontrolled use of video games can be addictive. The Game Addiction Scale (GAS) is an instrument that was developed to assess this type of addiction. The GAS consists of 21 items that are divided into the following seven factors: salience, tolerance, mood modification, relapse, withdrawal, conflict and problems. This study assessed the convergent validity and reliability of the GAS according to measures of internal consistency and test-retest stability. Three hundred and eighty four students completed the GAS, the Internet Addiction Test (IAT), the Liebowitz Social Anxiety Scale (LSAS), the Beck Depression Inventory (BDI) and the Video Game Addiction Test (VAT). A subgroup of the participants (n=76) completed the GAS again after 30days to determine test-retest stability. The GAS demonstrated excellent internal consistency (Cronbach's alpha=0.92), was highly correlated with the VAT (r=0.883) and was moderately correlated with the BDI (r=0.358), the LSAS (r=0.326) and the IAT (r=0.454). In the Brazilian Portuguese population, the GAS shows good internal consistency. These data indicate that the GAS can be used to assess video game addiction due to its demonstrated psychometric validity. Copyright © 2016 Elsevier Inc. All rights reserved.

Validity of the Mexican version of the combined Foot Care Confidence / Foot-Care Behavior scale for diabetes.

PubMed

García-Inzunza, Jaime A; Valles-Medina, Ana M; Muñoz, Fátima A; Delgadillo-Ramos, Guadalupe; Compean-Ortiz, Lidia G

2015-07-01

To 1) translate / transculturally adapt the original (English-language) combined Foot Care Confidence Scale / Foot-Care Behavior instrument (FCCS-FCB) to produce a Mexican-Spanish version and 2) determine its validity and reliability in a population with diabetes in Tijuana, Mexico. The original FCCS-FCB was translated (and back-translated), the content validated (by a group of health professional experts), and the instrument applied to 304 patients 23-78 years old in diabetes support groups in Tijuana, Mexico. Internal consistency for the study constructs ("self-efficacy," and risk / preventive foot self-care behaviors) was measured using Cronbach's alpha. The constructs were validated using principal component factor analysis. The Cronbach's alpha values for internal consistency were 0.782 for self-efficacy and 0.505 for behaviors. Based on the analysis, two factors explained 49.1% of the total variance for self-efficacy, and six factors explained 57.7% of the total variance for behaviors. The results were consistent with those for the original (English) version of the FCCS-FCB. The Mexican version of the FCCS-FCB is a reliable and valid instrument recommended for use with Mexican-Spanish-speaking patients with diabetes.

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validation of a Spanish version of the Spine Functional Index.

PubMed

Cuesta-Vargas, Antonio I; Gabel, Charles P

2014-06-27

The Spine Functional Index (SFI) is a recently published, robust and clinimetrically valid patient reported outcome measure. The purpose of this study was the adaptation and validation of a Spanish-version (SFI-Sp) with cultural and linguistic equivalence. A two stage observational study was conducted. The SFI was cross-culturally adapted to Spanish through double forward and backward translation then validated for its psychometric characteristics. Participants (n = 226) with various spine conditions of >12 weeks duration completed the SFI-Sp and a region specific measure: for the back, the Roland Morris Questionnaire (RMQ) and Backache Index (BADIX); for the neck, the Neck Disability Index (NDI); for general health the EQ-5D and SF-12. The full sample was employed to determine internal consistency, concurrent criterion validity by region and health, construct validity and factor structure. A subgroup (n = 51) was used to determine reliability at seven days. The SFI-Sp demonstrated high internal consistency (α = 0.85) and reliability (r = 0.96). The factor structure was one-dimensional and supported construct validity. Criterion specific validity for function was high with the RMQ (r = 0.79), moderate with the BADIX (r = 0.59) and low with the NDI (r = 0.46). For general health it was low with the EQ-5D and inversely correlated (r = -0.42) and fair with the Physical and Mental Components of the SF-12 and inversely correlated (r = -0.56 and r = -0.48), respectively. The study limitations included the lack of longitudinal data regarding other psychometric properties, specifically responsiveness. The SFI-Sp was demonstrated as a valid and reliable spine-regional outcome measure. The psychometric properties were comparable to and supported those of the English-version, however further longitudinal investigations are required.

Reliability, convergent validity and factor structure of the DASS-21 in a sample of Vietnamese adolescents.

PubMed

Le, Minh Thi Hong; Tran, Thach Duc; Holton, Sara; Nguyen, Huong Thanh; Wolfe, Rory; Fisher, Jane

2017-01-01

To assess the internal consistency, latent structure and convergent validity of the Depression, Anxiety and Stress Scale-21 (DASS-21) among adolescents in Vietnam. An anonymous, self-completed questionnaire was conducted among 1,745 high school students in Hanoi, Vietnam between October, 2013 and January, 2014. Confirmatory factor analyses were performed to assess the latent structure of the DASS-21. Factorial invariance between girls and boys was examined. Cronbach alphas and correlation coefficients between DASS-21 factor scores and the domain scores of the Duke Health Profile Adolescent Vietnamese validated version (ADHP-V) were calculated to assess DASS-21 internal consistency and convergent validity. A total of 1,606/ 1,745 (92.6%) students returned the questionnaire. Of those, 1,387 students provided complete DASS-21 data. The scale demonstrated adequate internal consistency (Cronbach α: 0.761 to 0.906). A four-factor model showed the best fit to the data. Items loaded significantly on a common general distress factor, the depression, and the anxiety factors, but few on the stress factor (p<0.05). DASS-21 convergent validity was confirmed with moderate correlation coefficients (-0.47 to -0.66) between its factor scores and the ADHP-V mental health related domains. The DASS-21 is reliable and suitable for use to assess symptoms of common mental health problems, especially depression and anxiety among Vietnamese adolescents. However, its ability in detecting stress among these adolescents may be limited. Further research is warrant to explore these results.

The SASSI-3 Face Valid other Drugs Scale: A Psychometric Investigation (Substance Abuse Subtle Screening Inventory-3)

ERIC Educational Resources Information Center

Laux, John M.; Perera-Diltz, Dilani; Smirnoff, Jennifer B.; Salyers, Kathleen M.

2005-01-01

The authors investigated the psychometric capabilities of the Face Valid Other Drugs (FVOD) scale of the Substance Abuse Subtle Screening Inventory-3 (SASSI-3; G. A. Miller, 1999). Internal consistency reliability estimates and construct validity factor analysis for 230 college students provided initial support for the psychometric properties of…

Spanish adaptation and validation of the supportive & palliative care indicators tool - SPICT-ESTM.

PubMed

Fachado, Alfonso Alonso; Martínez, Noemí Sansó; Roselló, Marisa Martín; Rial, José Javier Ventosa; Oliver, Enric Benito; García, Rafael Gómez; García, José Manuel Fernández

2018-01-01

OBJECTIVE To culturally adapt and validate the SPICTTM to Spanish, which is a brief and simple tool to support a better identification of chronic patients who have palliative care needs. METHODS For this study, we designed a multicenter and national project between the centers of Galicia, Balearic Islands, and Andalusia. For the process of translation and cross-cultural adaptation of the SPICTTM to Spanish, we followed the steps proposed by Beaton et al. with successive translations and subsequent consensus of experts using the debriefing methodology. After the content validation was completed, the psychometric properties were validated. A prospective longitudinal study was designed with 188 patients from Galicia, the Balearic Islands, and Andalusia. The internal consistency and reliability of the test and retest was analyzed for 10 days by the same researcher. RESULTS For more than 90% of the participants of the SPICT-ESTM, it seems simple to be filled out, and they consider it written in an understandable language. The average time to apply the questionnaire without prior knowledge was 4 minutes and 45 seconds. To evaluate the internal consistency of the instrument, we used the Kuder-Richardson formula 20. Internal consistency is 0.71. The agreement index of the Kappa test is between 0.983 and 0.797 for the different items. CONCLUSIONS In this study, we demonstrate the equivalence of content with the original. In addition, the validation of the psychometric properties establishes that the SPICT-ESTM maintains adequate reliability and stability. If we add the satisfaction shown by the professionals and the ease of use, the SPICT-ESTM is an adequate tool for the identification of palliative patients with chronic diseases and palliative care needs.

Development and validation of a smartphone addiction scale (SAS).

PubMed

Kwon, Min; Lee, Joon-Yeop; Won, Wang-Youn; Park, Jae-Woo; Min, Jung-Ah; Hahn, Changtae; Gu, Xinyu; Choi, Ji-Hye; Kim, Dai-Jin

2013-01-01

The aim of this study was to develop a self-diagnostic scale that could distinguish smartphone addicts based on the Korean self-diagnostic program for Internet addiction (K-scale) and the smartphone's own features. In addition, the reliability and validity of the smartphone addiction scale (SAS) was demonstrated. A total of 197 participants were selected from Nov. 2011 to Jan. 2012 to accomplish a set of questionnaires, including SAS, K-scale, modified Kimberly Young Internet addiction test (Y-scale), visual analogue scale (VAS), and substance dependence and abuse diagnosis of DSM-IV. There were 64 males and 133 females, with ages ranging from 18 to 53 years (M = 26.06; SD = 5.96). Factor analysis, internal-consistency test, t-test, ANOVA, and correlation analysis were conducted to verify the reliability and validity of SAS. Based on the factor analysis results, the subscale "disturbance of reality testing" was removed, and six factors were left. The internal consistency and concurrent validity of SAS were verified (Cronbach's alpha = 0.967). SAS and its subscales were significantly correlated with K-scale and Y-scale. The VAS of each factor also showed a significant correlation with each subscale. In addition, differences were found in the job (p<0.05), education (p<0.05), and self-reported smartphone addiction scores (p<0.001) in SAS. This study developed the first scale of the smartphone addiction aspect of the diagnostic manual. This scale was proven to be relatively reliable and valid.

Italian Validation of Homophobia Scale (HS).

PubMed

Ciocca, Giacomo; Capuano, Nicolina; Tuziak, Bogdan; Mollaioli, Daniele; Limoncin, Erika; Valsecchi, Diana; Carosa, Eleonora; Gravina, Giovanni L; Gianfrilli, Daniele; Lenzi, Andrea; Jannini, Emmanuele A

2015-09-01

The Homophobia Scale (HS) is a valid tool to assess homophobia. This test is self-reporting, composed of 25 items, which assesses a total score and three factors linked to homophobia: behavior/negative affect, affect/behavioral aggression, and negative cognition. The aim of this study was to validate the HS in the Italian context. An Italian translation of the HS was carried out by two bilingual people, after which an English native translated the test back into the English language. A psychologist and sexologist checked the translated items from a clinical point of view. We recruited 100 subjects aged18-65 for the Italian validation of the HS. The Pearson coefficient and Cronbach's α coefficient were performed to test the test-retest reliability and internal consistency. A sociodemographic questionnaire including the main information as age, geographic distribution, partnership status, education, religious orientation, and sex orientation was administrated together with the translated version of HS. The analysis of the internal consistency showed an overall Cronbach's α coefficient of 0.92. In the four domains, the Cronbach's α coefficient was 0.90 in behavior/negative affect, 0.94 in affect/behavioral aggression, and 0.92 in negative cognition, whereas in the total score was 0.86. The test-retest reliability showed the following results: the HS total score was r = 0.93 (P < 0.0001), behavior/negative affect was r = 0.79 (P < 0.0001), affect/behavioral aggression was r = 0.81 (P < 0.0001), and negative cognition was r = 0.75 (P < 0.0001). The Italian validation of the HS revealed the use of this self-report test to have good psychometric properties. This study offers a new tool to assess homophobia. In this regard, the HS can be introduced into the clinical praxis and into programs for the prevention of homophobic behavior.