Content validation: clarity/relevance, reliability and internal consistency of enunciative signs of language acquisition.

PubMed

Crestani, Anelise Henrich; Moraes, Anaelena Bragança de; Souza, Ana Paula Ramos de

2017-08-10

To analyze the results of the validation of building enunciative signs of language acquisition for children aged 3 to 12 months. The signs were built based on mechanisms of language acquisition in an enunciative perspective and on clinical experience with language disorders. The signs were submitted to judgment of clarity and relevance by a sample of six experts, doctors in linguistic in with knowledge of psycholinguistics and language clinic. In the validation of reliability, two judges/evaluators helped to implement the instruments in videos of 20% of the total sample of mother-infant dyads using the inter-evaluator method. The method known as internal consistency was applied to the total sample, which consisted of 94 mother-infant dyads to the contents of the Phase 1 (3-6 months) and 61 mother-infant dyads to the contents of Phase 2 (7 to 12 months). The data were collected through the analysis of mother-infant interaction based on filming of dyads and application of the parameters to be validated according to the child's age. Data were organized in a spreadsheet and then converted to computer applications for statistical analysis. The judgments of clarity/relevance indicated no modifications to be made in the instruments. The reliability test showed an almost perfect agreement between judges (0.8 ≤ Kappa ≥ 1.0); only the item 2 of Phase 1 showed substantial agreement (0.6 ≤ Kappa ≥ 0.79). The internal consistency for Phase 1 had alpha = 0.84, and Phase 2, alpha = 0.74. This demonstrates the reliability of the instruments. The results suggest adequacy as to content validity of the instruments created for both age groups, demonstrating the relevance of the content of enunciative signs of language acquisition.

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

The Multitheoretical List of Therapeutic Interventions - 30 items (MULTI-30).

PubMed

Solomonov, Nili; McCarthy, Kevin S; Gorman, Bernard S; Barber, Jacques P

2018-01-16

To develop a brief version of the Multitheoretical List of Therapeutic Interventions (MULTI-60) in order to decrease completion time burden by approximately half, while maintaining content coverage. Study 1 aimed to select 30 items. Study 2 aimed to examine the reliability and internal consistency of the MULTI-30. Study 3 aimed to validate the MULTI-30 and ensure content coverage. In Study 1, the sample included 186 therapist and 255 patient MULTI ratings, and 164 ratings of sessions coded by trained observers. Internal consistency (Chronbach's alpha and McDonald's omega) was calculated and confirmatory factor analysis was conducted. Psychotherapy experts rated content relevance. Study 2 included a sample of 644 patient and 522 therapist ratings, and 793 codings of psychotherapy sessions. In Study 3, the sample included 33 codings of sessions. A series of regression analyses was conducted to examine replication of previously published findings using the MULTI-30. The MULTI-30 was found valid, reliable, and internally consistent across 2564 ratings examined across the three studies presented. The MULTI-30 a brief and reliable process measure. Future studies are required for further validation.

Development of Islamic Spiritual Health Scale (ISHS).

PubMed

Khorashadizadeh, Fatemeh; Heydari, Abbas; Nabavi, Fatemeh Heshmati; Mazlom, Seyed Reza; Ebrahimi, Mahdi; Esmaili, Habibollah

2017-03-01

To develop and psychometrically assess spiritual health scale based on Islamic view in Iran. The cross-sectional study was conducted at Imam Ali and Quem hospitals in Mashhad and Imam Ali and Imam Reza hospitals in Bojnurd, Iran, from 2015 to 2016 In the first stage, an 81-item Likert-type scale was developed using a qualitative approach. The second stage comprised quantitative component. The scale's impact factor, content validity ratio, content validity index, face validity and exploratory factor analysis were calculated. Test-retest and internal consistency was used to examine the reliability of the instrument. Data analysis was done using SPSS 11. Of 81 items in the scale, those with impact factor above 1.5, content validity ratio above 0.62, and content validity index above 0.79 were considered valid and the rest were discarded, resulting in a 61-item scale. Exploratory factor analysis reduced the list of items to 30, which were divided into seven groups with a minimum eigen value of 1 for each factor. But according to scatter plot, attributes of the concept of spiritual health included love to creator, duty-based life, religious rationality, psychological balance, and attention to afterlife. Internal reliability of the scale was calculated by alpha Cronbach coefficient as 0.91. There was solid evidence of the strength factor structure and reliability of the Islamic Spiritual Health Scale which provides a unique way for spiritual health assessment of Muslims.

The cross-cultural adaptation of the DASH questionnaire in Thai (DASH-TH).

PubMed

Tongprasert, Siam; Rapipong, Jeeranan; Buntragulpoontawee, Montana

2014-01-01

Clinical measurement. Currently there are no self-report questionnaires in Thai to evaluate disability levels in patients suffering from upper extremity musculoskeletal disorders. To translate and cross-cultural adaptation the disabilities of the arm, shoulder and hand (DASH) questionnaire to Thai version and to evaluate content validity, construct validity and internal consistency of the questionnaire. The DASH-TH was produced by following cross-cultural adaptation guidelines stated by the Institute for Work and Health (IWH). Forty Thai patients with arm, shoulder or hand problems participated in field testing of the questionnaire. Content validity was determined by obtaining the item-objective congruence (IOC) value for each questionnaire item. Correlation between the DASH-TH score and numeric rating scale was used to assess construct validity. Internal consistency of DASH-TH was measured using Cronbach's alpha coefficient. Forty patients (14 males, 26 females) with arm, shoulder or hand problems enrolled in the present study. The average age of patients was 44.8 years. The index of item-objective congruence (IOC) of each item ranged from 0.7 to 1.0. The Cronbach's alpha coefficient of the questionnaire was 0.938. There was no correlation between DASH-TH score and numeric rating scale. The DASH-TH has high content validity and internal consistency. N/A. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Validation of the Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST) and association of PSST scores with health-related quality of life.

PubMed

Câmara, Rachel de A; Köhler, Cristiano A; Frey, Benicio N; Hyphantis, Thomas N; Carvalho, André F

2017-01-01

To develop and validate a Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST), a questionnaire used for the screening of premenstrual syndrome (PMS) and of the most severe form of PMS, premenstrual dysphoric disorder (PMDD). The PSST also rates the impact of premenstrual symptoms on daily activities. A consecutive sample of 801 women aged ≥ 18 years completed the study protocol. The internal consistency, test-retest reliability, and content validity of the Brazilian PSST were determined. The independent association of a positive screen for PMS or PMDD and quality of life determined by the World Health Organization Quality of Life instrument-Abbreviated version (WHOQOL-Bref) was also assessed. Of 801 participants, 132 (16.5%) had a positive screening for PMDD. The Brazilian PSST had adequate internal consistency (Cronbach's alpha = 0.91) and test-retest reliability. The PSST also had adequate convergent/discriminant validity, without redundancy. Content validity ratio and content validity index were 0.61 and 0.94 respectively. Finally, a positive screen for PMS/PMDD was associated with worse WHOQOL-Bref scores. These findings suggest that PSST is a reliable and valid instrument to screen for PMS/PMDD in Brazilian women.

Measuring Certified Registered Nurse Anesthetist Organizational Climate: Instrument Adaptation.

PubMed

Boyd, Donald; Poghosyan, Lusine

2017-08-01

No tool exists measuring certified registered nurse anesthetist (CRNA) organizational climate. The study's purpose is to adapt a validated tool to measure CRNA organizational climate. Content validity of the Certified Registered Nurse Anesthetist Organizational Climate Questionnaire (CRNA-OCQ) was established. Pilot testing was conducted to determine internal reliability consistency of the subscales. Experts rated the tool as content valid. The subscales had high internal consistency reliability (with respective Cronbach's alphas): CRNA-Anesthesiologist Relations (.753), CRNA-Physician Relations (.833), CRNA-Administration Relations (.895), Independent Practice (.830), Support for CRNA Practice (.683), and Professional Visibility (.772). Further refinement of the CRNA-OCQ is necessary. Measurement and assessment of CRNA organizational climate may produce evidence needed to improve provider and patient outcomes.

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations.

PubMed

Nyongesa, Moses K; Sigilai, Antipa; Hassan, Amin S; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J R; Newton, Charles R J C; Abubakar, Amina

2017-01-01

Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach's α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region.

Testing the validity of the International Atomic Energy Agency (IAEA) safety culture model.

PubMed

López de Castro, Borja; Gracia, Francisco J; Peiró, José M; Pietrantoni, Luca; Hernández, Ana

2013-11-01

This paper takes the first steps to empirically validate the widely used model of safety culture of the International Atomic Energy Agency (IAEA), composed of five dimensions, further specified by 37 attributes. To do so, three independent and complementary studies are presented. First, 290 students serve to collect evidence about the face validity of the model. Second, 48 experts in organizational behavior judge its content validity. And third, 468 workers in a Spanish nuclear power plant help to reveal how closely the theoretical five-dimensional model can be replicated. Our findings suggest that several attributes of the model may not be related to their corresponding dimensions. According to our results, a one-dimensional structure fits the data better than the five dimensions proposed by the IAEA. Moreover, the IAEA model, as it stands, seems to have rather moderate content validity and low face validity. Practical implications for researchers and practitioners are included. Copyright © 2013 Elsevier Ltd. All rights reserved.

Content validity across methods of malnutrition assessment in patients with cancer is limited.

PubMed

Sealy, Martine J; Nijholt, Willemke; Stuiver, Martijn M; van der Berg, Marit M; Roodenburg, Jan L N; van der Schans, Cees P; Ottery, Faith D; Jager-Wittenaar, Harriët

2016-08-01

To identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition. Systematic review of studies in cancer patients that operationalized malnutrition as a variable, published since 1998. Eleven key concepts, within the three domains reflected by the malnutrition definitions acknowledged by European Society for Clinical Nutrition and Metabolism (ESPEN) and the American Society for Parenteral and Enteral Nutrition (ASPEN): A: nutrient balance; B: changes in body shape, body area and body composition; and C: function, were used to classify content validity of methods to assess malnutrition. Content validity indices (M-CVIA-C) were calculated per assessment method. Acceptable content validity was defined as M-CVIA-C ≥ 0.80. Thirty-seven assessment methods were identified in the 160 included articles. Mini Nutritional Assessment (M-CVIA-C = 0.72), Scored Patient-Generated Subjective Global Assessment (M-CVIA-C = 0.61), and Subjective Global Assessment (M-CVIA-C = 0.53) scored highest M-CVIA-C. A large number of malnutrition assessment methods are used in cancer research. Content validity of these methods varies widely. None of these assessment methods has acceptable content validity, when compared against a construct based on ESPEN and ASPEN definitions of malnutrition. Copyright © 2016 Elsevier Inc. All rights reserved.

Assessment of International Students through the Medium of English: Ensuring Validity and Fairness in Content-Based Examinations

ERIC Educational Resources Information Center

Shaw, Stuart; Imam, Helen

2013-01-01

International assessments in a wide range of subjects are being prepared for and delivered through the medium of English in a variety of educational contexts. These assessments are taken by many candidates whose first language is not necessarily English. This raises important issues relating to assessment validity and fairness. This study…

What Counts as Validity Evidence? Examples and Prevalence in a Systematic Review of Simulation-Based Assessment

ERIC Educational Resources Information Center

Cook, David A.; Zendejas, Benjamin; Hamstra, Stanley J.; Hatala, Rose; Brydges, Ryan

2014-01-01

Ongoing transformations in health professions education underscore the need for valid and reliable assessment. The current standard for assessment validation requires evidence from five sources: content, response process, internal structure, relations with other variables, and consequences. However, researchers remain uncertain regarding the types…

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Motivators and barriers of a Healthy Lifestyle Scale: development and psychometric characteristics.

PubMed

Downes, Loureen

2008-01-01

Black individuals suffer disproportionately from diseases that are preventable by lifestyle choices. The purpose of this study was to test the internal consistency and construct validity of the newly devised instrument, Motivators and Barriers of a Healthy Lifestyle Scale (MABS). The MABS was administered to 109 community-dwelling, adult Blacks. Content validity was supported through review of the literature and the judgment of three content experts. Exploratory factor analysis supported the two dimensions, that is, motivators and barriers. The Cronbach's alphas for the motivators and barriers dimensions were .88 and .90, respectively. Results provide initial evidence that the MABS is a valid, internally consistent measure of factors that motivate or inhibit healthy lifestyle behaviors. Screening with the MABS could encourage more focused health promotion discussions between patients and practitioners.

Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reidunsdatter, Randi J.; Lund, Jo-Asmund; Department of Oncology, St. Olavs University Hospital, Trondheim

Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales weremore » constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.« less

Nurses' knowledge and attitudes towards aged sexuality: validity and internal consistency of the Dutch version of the Aging Sexual Knowledge and Attitudes Scale.

PubMed

Mahieu, Lieslot; de Casterlé, Bernadette Dierckx; Van Elssen, Kim; Gastmans, Chris

2013-11-01

This paper reports a study testing the content and face validity and internal consistency of the Dutch version of the Aging Sexual Knowledge and Attitudes Scale. The ability of older residents to sexually express themselves is known to be influenced by the knowledge and attitudes of nursing home staff towards later-life sexuality. Although the Aging Sexual Knowledge and Attitudes Scale is a widely used instrument to measure this, there is no validated, Dutch translation available. Instrument development. Following a standard forward/backward translation into Dutch, the scale was further adapted for use in Flemish nursing home settings. Content and face validity and user-friendliness were assessed. The psychometric properties were determined by means of an exploratory study. Data were collected from March-April 2011 at eight Flemish nursing homes. Reliability was assessed using internal consistency and item-total correlations. Both subscales of the Flemish adaptation showed acceptable content validity. The face validity and user-friendliness were deemed favourable with hardly any remarks given by the expert panel. The Cronbach's α was 0.80 and 0.88 for the knowledge and attitude subscales, respectively. The item-total correlations ranged from 0.21-0.48 for the knowledge section and from 0.09-0.68 for the attitude subscale. We conclude from our study that the Dutch version of the scale has acceptable to good psychometric properties. The Flemish adaptation therefore seems to be a valuable instrument for studying nursing staff's knowledge and attitudes towards aged sexuality in Flanders. © 2013 Blackwell Publishing Ltd.

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Construct validity of the Thai version of the job content questionnaire in a large population of heterogeneous occupations.

PubMed

Phakthongsuk, Pitchaya

2009-04-01

To test the construct validity of the Thai version of the job content questionnaire (TJCQ). The present descriptive study recruited 10415 participants from all occupations according to the International Standard Classification of Occupations. The instrument consisted of a 48-item of the job content questionnaire. Eight items newly developed by the authors from in-depth interviews were added. Exploratory factor analysis showed six factor models of work hazards, decision latitude, psychological demand, social support, physical demand, and job security. However, supervisor and co-worker support were not distinguished into two factors and some items distributed differently along the factors extracted. Confirmatory factor analysis supported the construct of six latent factors, although the overall fit was moderately acceptable. Cronbach's alpha coefficients higher than 0.7, supported the internal consistency of TJCQ scales except for job security (0.55). These findings suggest that TJCQ is valid and reliable for assessing job stress among Thai populations.

Furthering the Validity of a Tool to Assess Simulated Pregnancy Options Counseling Skills.

PubMed

Lupi, Carla; Ward-Peterson, Melissa; Coxe, Stefany; Minor, Suzanne; Eliacin, Irmanie; Obeso, Vivian

2016-10-01

To further the validity of a tool to assess nondirective pregnancy options counseling skills. Using a cross-sectional design, we explored four sources of construct validity evidence for an objective structured clinical examination for training and assessment of nondirective pregnancy options counseling: content, response process, internal structure, and relations to other variables. Content of the previously developed tool was enhanced through input from five family medicine educators. The objective structured clinical examination was implemented in a family medicine clerkship with third-year medical students from 2014 to 2015 using trained raters. Response process was addressed after a pilot round. Three new raters evaluated videotapes of 46 performances. Cronbach's alpha, intraclass correlation coefficients, and Spearman's rho were estimated with 95% confidence intervals. The content validity was affirmed. Cronbach's alpha was 0.71. According to Landis and Koch's criteria, all but two items unique to the clinical situation of pregnancy options counseling generated substantial to perfect agreement (0.62-1.00). Relations to other variables within the checklist were strong, ranging from 0.66 to 0.87. This tool for assessing pregnancy options counseling skills has excellent content and strong internal structure. Further work to improve the Global Rating Scale may be necessary for summative use.

Validation of the Malayalam version of the Internalized Stigma of Mental Illness (ISMI) scale.

PubMed

James, Tintu; Kutty, V Raman; Boyd, Jennifer; Brzoska, Patrick

2016-04-01

Little is known about internalized stigma of mental illness in India. A reason for this could be the lack of valid assessment instruments adapted for the diverse cultures and languages of the country. One of the most widely used and accepted questionnaires to assess internalized stigma is the 29-item Internalized Stigma of Mental Illness (ISMI) scale. The aim of the present study was to translate and adapt the ISMI to the Malayalam-speaking population of Kerala, India and to assess its content and factorial validity. The content validity of the Malayalam-language ISMI was studied through interviews with 7 experts on stigma in India. Factorial validity was examined by means of a confirmatory factor analysis (CFA) based on a cross-sectional survey among 290 patients with mental illness attending follow-up outpatient and primary care clinics in Kerala, India. The expert panel concluded that the items of the translated questionnaire adequately represent internalized stigma in the Malayalam-speaking population of Kerala. The theorized factor structure of the ISMI consisting of five factors showed a suboptimal model fit (WRMR=0.940; TLI=0.971, CFI=0.948; RMSEA=0.059) which improved considerably after removal of the stigma resistance factor and three items with poor factor loadings (WRMR=0.819; TLI=0.982, CFI=0.966; RMSEA=0.051). Although our study identifies some sources of model ill-fit, it shows that a reduced version of the Malayalam-language ISMI can be a valuable tool for the study of internalized stigma in this cultural setting. Copyright © 2016 Elsevier B.V. All rights reserved.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare.

PubMed

Squires, Janet E; Estabrooks, Carole A; Newburn-Cook, Christine V; Gierl, Mark

2011-05-19

There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale). We used the Standards for Educational and Psychological Testing as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression. Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression. The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.

Validation of the Sinhala translation of the International Consultation on Incontinence Modular Questionnaire for female lower urinary tract symptoms among women in Sri Lanka.

PubMed

de Silva, Gayan; Furukan, Rameez; Goonewardene, Malik

2017-12-01

The objective of this study was to translate the International Consultation on Incontinence Modular Questionnaire for female lower urinary tract symptoms (ICIQ-FLUTS) into Sinhala and validate the Sinhala translation for use in clinical practice. The ICIQ-FLUTS was translated into Sinhala in accordance with the ICIQ validation protocol. The Sinhala translation was validated by administering it to 133 women with FLUTS, mainly urinary incontinence and or urgency, and to 118 women with symptoms other than FLUTS during the period 25 October 2013 to 23 December 2016, in the Academic Obstetrics and Gynaecology Unit, Teaching Hospital Mahamodara, Galle, Sri Lanka. The Sinhala translation had good content validity (assessed by a panel of clinicians including a content specialist, and a group of women with and without FLUTS), good internal consistency (Cronbach's alpha coefficient in the range 0.69-0.75) was stable (no significant differences between median test-retest scores in a subgroup of 24 women with FLUTS), had good construct validity (marked difference between median scores in women presenting with and without FLUTS, p < 0.001), and good responsiveness (marked improvements between scores before and after treatment, p < 0.001). The Sinhala translation of the ICIQ-FLUTS is valid and reliable for assessing Sinhalese-speaking women with FLUTS, especially urinary incontinence and/or urgency.

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations

PubMed Central

Sigilai, Antipa; Hassan, Amin S.; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J. R.; Newton, Charles R. J. C.; Abubakar, Amina

2017-01-01

Background Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. Aims We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. Methods The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. Results In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach’s α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. Conclusion The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region. PMID:28380073

Cross-cultural adaptation of the international consultation incontinence questionnaire male lower urinary tract symptoms-long form (ICIQ-MLUTS-LF) in Persian.

PubMed

Pourmomeny, Abbas Ali; Mazdak, Hamid

2017-06-01

The purpose of this study was to translate male lower urinary tract symptoms long form (MLUTS-LF) questionnaire and determine its psychometric properties in Persian speaking subjects. Assessment instrument is essential for research, making diagnosis, and for evaluating the treatment outcomes in subjects with lower urinary tract disorders of either gender. Long form of MLUTS questionnaire is a robust self-report questionnaire that investigates the major aspects of lower urinary tract symptoms and their impact on quality of life. After getting permission from the International Consultation International Questionnaire website, the forward and backward translation MLUTS carried out by researcher team and assess content/face/construct validity, reliability in sample of MLUTS Iranian patients and, quality rating and pilot testing. The irritating and obstructing lower urinary disorders were categorized as mild, moderate, and severe in the study sample. Twenty two subjects were suffering from urinary incontinence and most of the participants had benign prostate hyperplasia (BPH). Cronbach's alpha coefficient was 0.819. Correlations between the MLUTS and International prostate symptom score (IPSS) was 0.753. The MLUTS Questionnaire showed good internal consistency, content validity, and construct validity, as measured by correlation with scores on the IPSS. The Iranian version of the MLUTS questionnaire is a valid and robust instrument that can be used in clinical settings and in research. © 2016 Wiley Periodicals, Inc.

Simulation-based training for prostate surgery.

PubMed

Khan, Raheej; Aydin, Abdullatif; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-10-01

To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes. A review of the literature between 1999 and 2014 was performed. The search terms included a combination of urology, prostate surgery, robotic prostatectomy, laparoscopic prostatectomy, transurethral resection of the prostate (TURP), simulation, virtual reality, animal model, human cadavers, training, assessment, technical skills, validation and learning curves. Furthermore, relevant abstracts from the American Urological Association, European Association of Urology, British Association of Urological Surgeons and World Congress of Endourology meetings, between 1999 and 2013, were included. Only studies related to prostate surgery simulators were included; studies regarding other urological simulators were excluded. A total of 22 studies that carried out a validation study were identified. Five validated models and/or simulators were identified for TURP, one for photoselective vaporisation of the prostate, two for holmium enucleation of the prostate, three for laparoscopic radical prostatectomy (LRP) and four for robot-assisted surgery. Of the TURP simulators, all five have demonstrated content validity, three face validity and four construct validity. The GreenLight laser simulator has demonstrated face, content and construct validities. The Kansai HoLEP Simulator has demonstrated face and content validity whilst the UroSim HoLEP Simulator has demonstrated face, content and construct validity. All three animal models for LRP have been shown to have construct validity whilst the chicken skin model was also content valid. Only two robotic simulators were identified with relevance to robot-assisted laparoscopic prostatectomy, both of which demonstrated construct validity. A wide range of different simulators are available for prostate surgery, including synthetic bench models, virtual-reality platforms, animal models, human cadavers, distributed simulation and advanced training programmes and modules. The currently validated simulators can be used by healthcare organisations to provide supplementary training sessions for trainee surgeons. Further research should be conducted to validate simulated environments, to determine which simulators have greater efficacy than others and to assess the cost-effectiveness of the simulators and the transferability of skills learnt. With surgeons investigating new possibilities for easily reproducible and valid methods of training, simulation offers great scope for implementation alongside traditional methods of training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

An international measure of awareness and beliefs about cancer: development and testing of the ABC

PubMed Central

Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J

2012-01-01

Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874

Satisfaction with Daily Occupations for Elderly People (SDO-E)—Adaptation and Psychometric Testing

PubMed Central

Wästberg, Birgitta; Eklund, Mona

2017-01-01

Satisfaction with everyday occupations has been shown to be important for health and well-being in various populations. Research into satisfaction with everyday occupations among elderly persons is, however, lacking. The aim was to investigate the psychometric properties of an adapted test version of the Satisfaction with Daily Occupations instrument (SDO) for elderly people, called SDO-E. Five hospital-based occupational therapists working with elderly people evaluated the content validity and usability of the SDO-E. The elderly participants consisted of 50 people from outside of the health services and 42 inpatients at an internal medicine clinic. They completed the SDO-E and rated their perceived health, activity level, and general satisfaction with daily occupations. The SDO-E showed fair content validity and utility, acceptable internal consistency, good preliminary construct validity and relevant known-groups validity. The SDO-E thus appears to be a useful screening tool for assessing activity level and satisfaction with daily occupations among elderly people, and a complement to other self-report instruments concerning factors connected with health and well-being. Future research should further explore the content validity of the SDO-E, particularly the views of the elderly themselves, and investigate the SDO-E in terms of sensitivity to change. PMID:28946667

Development and validation of a knowledge test for health professionals regarding lifestyle modification.

PubMed

Talip, Whadi-ah; Steyn, Nelia P; Visser, Marianne; Charlton, Karen E; Temple, Norman

2003-09-01

We wanted to develop and validate a test that assesses the knowledge and practices of health professionals (HPs) with regard to the role of nutrition, physical activity, and smoking cessation (lifestyle modification) in chronic diseases of lifestyle. A descriptive cross-sectional validation study was carried out. The validation design consisted of two phases, namely 1) test planning and development and 2) test evaluation. The study sample consisted of five groups of HPs: dietitians, dietetic interns, general practitioners, medical students, and nurses. The overall response rate was 58%, resulting in a sample size of 186 participants. A test was designed to evaluate the knowledge and practices of HPs. The test was first evaluated by an expert group to ensure content, construct, and face validity. Thereafter, the questionnaire was tested on five groups of HPs to test for criterion validity. Internal consistency was evaluated by Cronbach's alpha. An expert panel ensured content, construct, and face validity of the test. Groups with the most training and exposure to nutrition (dietitians and dietetic interns) had the highest group mean score, ranging from 61% to 88%, whereas those with limited nutrition training (general practitioners, medical students, and nurses) had significantly lower scores, ranging from 26% to 80%. This result demonstrated criterion validity. Internal consistency of the overall test demonstrated a Cronbach's alpha of 0.99. Most HPs identified the mass media as their main source of information on lifestyle modification. These HPs also identified lack of time, lack of patient compliance, and lack of knowledge as barriers that prevent them from providing counseling on lifestyle modification. The results of this study showed that this test instrument identifies groups of health professionals with adequate training (knowledge) in lifestyle modification and those who require further training (knowledge).

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Validity and reliability of a scale to measure genital body image.

PubMed

Zielinski, Ruth E; Kane-Low, Lisa; Miller, Janis M; Sampselle, Carolyn

2012-01-01

Women's body image dissatisfaction extends to body parts usually hidden from view--their genitals. Ability to measure genital body image is limited by lack of valid and reliable questionnaires. We subjected a previously developed questionnaire, the Genital Self Image Scale (GSIS) to psychometric testing using a variety of methods. Five experts determined the content validity of the scale. Then using four participant groups, factor analysis was performed to determine construct validity and to identify factors. Further construct validity was established using the contrasting groups approach. Internal consistency and test-retest reliability was determined. Twenty one of 29 items were considered content valid. Two items were added based on expert suggestions. Factor analysis was undertaken resulting in four factors, identified as Genital Confidence, Appeal, Function, and Comfort. The revised scale (GSIS-20) included 20 items explaining 59.4% of the variance. Women indicating an interest in genital cosmetic surgery exhibited significantly lower scores on the GSIS-20 than those who did not. The final 20 item scale exhibited internal reliability across all sample groups as well as test-retest reliability. The GSIS-20 provides a measure of genital body image demonstrating reliability and validity across several populations of women.

Psychometric Properties of Korean Version of the Second Victim Experience and Support Tool (K-SVEST).

PubMed

Kim, Eun-Mi; Kim, Sun-Aee; Lee, Ju-Ry; Burlison, Jonathan D; Oh, Eui Geum

2018-02-13

"Second victims" are defined as healthcare professionals whose wellness is influenced by adverse clinical events. The Second Victim Experience and Support Tool (SVEST) was used to measure the second-victim experience and quality of support resources. Although the reliability and validity of the original SVEST have been validated, those for the Korean tool have not been validated. The aim of the study was to evaluate the psychometric properties of the Korean version of the SVEST. The study included 305 clinical nurses as participants. The SVEST was translated into Korean via back translation. Content validity was assessed by seven experts, and test-retest reliability was evaluated by 30 clinicians. Internal consistency and construct validity were assessed via confirmatory factor analysis. The analyses were performed using SPSS 23.0 and STATA 13.0 software. The content validity index value demonstrated validity; item- and scale-level content validity index values were both 0.95. Test-retest reliability and internal consistency reliability were satisfactory: the intraclass consistent coefficient was 0.71, and Cronbach α values ranged from 0.59 to 0.87. The CFA showed a significantly good fit for an eight-factor structure (χ = 578.21, df = 303, comparative fit index = 0.92, Tucker-Lewis index = 0.90, root mean square error of approximation = 0.05). The K-SVEST demonstrated good psychometric properties and adequate validity and reliability. The results showed that the Korean version of SVEST demonstrated the extent of second victimhood and support resources in Korean healthcare workers and could aid in the development of support programs and evaluation of their effectiveness.

Translation and validation of the Rhinosinusitis Disability Index for use in Nigeria.

PubMed

Asoegwu, C N; Nwawolo, C C; Okubadejo, N U

2017-07-01

The Rhinosinusitis Disability Index (RSDI) is a validated and reliable measure of severity of chronic rhinosinusitis. The objective of this study was to translate and validate the instrument for use in Nigeria. This is a methodological study. 71 patients with chronic rhinosinusitis attending two Otolaryngology clinics in Lagos, Nigeria. Using standardized methods and trained translators, the RSDI was translated to vernacular (Yoruba language) and back-translated to culturally appropriate English. Data analysis comprised of assessment of the item quality, content validity and internal consistency of the back-translated Rhinosinusitis Disability Index (bRSDI), and correlation to the original RSDI. Content validity (floor and ceiling effects) showed 0% floor and ceiling effects for the total scores, 0% ceiling effects for all domains and floor effect for physical domain, and 9.9 and 8.5% floor effects for functional and emotional domains, respectively. The mean item-own correlation for physical domain was 0.54 ± 0.08, 0.72 ± 0.08 for functional domain and 0.74 ± 0.07 for emotional domain. All domain item-own correlations were higher than item-other domain correlations. The total Cronbach's alpha was 0.936 and was higher than 0.70 for all the domains representing good internal consistency. Pearson correlation analysis showed strong correlation of RSDI to bRSDI (total score 0.881; p = 0.000, and domain subscores-physical: 0.788; p = 0.000, functional: 0.830; p = 0.000, and emotional: 0.888; p = 0.000). The back-translated Rhinosinusitis Disability Index shows good face and content validity with good internal consistency while correlating linearly and significantly with the original Rhinosinusitis Disability Index and is recommended for use in Nigeria.

Construct Validity of the Nutrition and Activity Knowledge Scale in a French Sample of Adolescents with Mild to Moderate Intellectual Disability

ERIC Educational Resources Information Center

Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Garbarino, Jean-Marie; Ninot, Gregory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual…

Measuring engagement in nurses: the psychometric properties of the Persian version of Utrecht Work Engagement Scale

PubMed Central

Torabinia, Mansour; Mahmoudi, Sara; Dolatshahi, Mojtaba; Abyaz, Mohamad Reza

2017-01-01

Background: Considering the overall tendency in psychology, researchers in the field of work and organizational psychology have become progressively interested in employees’ effective and optimistic experiments at work such as work engagement. This study was conducted to investigate 2 main purposes: assessing the psychometric properties of the Utrecht Work Engagement Scale, and finding any association between work engagement and burnout in nurses. Methods: The present methodological study was conducted in 2015 and included 248 females and 34 males with 6 months to 30 years of job experience. After the translation process, face and content validity were calculated by qualitative and quantitative methods. Moreover, content validation ratio, scale-level content validity index and item-level content validity index were measured for this scale. Construct validity was determined by factor analysis. Moreover, internal consistency and stability reliability were assessed. Factor analysis, test-retest, Cronbach’s alpha, and association analysis were used as statistical methods. Results: Face and content validity were acceptable. Exploratory factor analysis suggested a new 3- factor model. In this new model, some items from the construct model of the original version were dislocated with the same 17 items. The new model was confirmed by divergent Copenhagen Burnout Inventory as the Persian version of UWES. Internal consistency reliability for the total scale and the subscales was 0.76 to 0.89. Results from Pearson correlation test indicated a high degree of test-retest reliability (r = 0. 89). ICC was also 0.91. Engagement was negatively related to burnout and overtime per month, whereas it was positively related with age and job experiment. Conclusion: The Persian 3– factor model of Utrecht Work Engagement Scale is a valid and reliable instrument to measure work engagement in Iranian nurses as well as in other medical professionals. PMID:28955665

Developing and testing a measurement tool for assessing predictors of breakfast consumption based on a health promotion model.

PubMed

Dehdari, Tahereh; Rahimi, Tahereh; Aryaeian, Naheed; Gohari, Mahmood Reza; Esfeh, Jabiz Modaresi

2014-01-01

To develop an instrument for measuring Health Promotion Model constructs in terms of breakfast consumption, and to identify the constructs that were predictors of breakfast consumption among Iranian female students. A questionnaire on Health Promotion Model variables was developed and potential predictors of breakfast consumption were assessed using this tool. One hundred female students, mean age 13 years (SD ± 1.2 years). Two middle schools from moderate-income areas in Qom, Iran. Health Promotion Model variables were assessed using a 58-item questionnaire. Breakfast consumption was also measured. Internal consistency (Cronbach alpha), content validity index, content validity ratio, multiple linear regression using stepwise method, and Pearson correlation. Content validity index and content validity ratio scores of the developed scale items were 0.89 and 0.93, respectively. Internal consistencies (range, .74-.91) of subscales were acceptable. Prior related behaviors, perceived barriers, self-efficacy, and competing demand and preferences were 4 constructs that could predict 63% variance of breakfast frequency per week among subjects. The instrument developed in this study may be a useful tool for researchers to explore factors affecting breakfast consumption among students. Students with a high level of self-efficacy, more prior related behavior, fewer perceived barriers, and fewer competing demands were most likely to regularly consume breakfast. Copyright © 2014 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

[Development of an instrument to measure psychosocial determinants of physical activity behavior among coronary heart disease patients].

PubMed

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Cornélio, Marilia Estevam; Gallani, Maria Cecília Bueno Jayme; Godin, Gaston

2010-09-01

The aim of this study was to report the development and the analysis of content validity and reliability of the Psychosocial Determinants of Physical Activity among Coronary Heart Disease Patients Questionnaire, based on an extension of the Theory of Planned Behavior. In the content validity step, three experts evaluated the instrument which was, afterwards, pre-tested with five subjects in order to obtain a conceptually appropriate and easily understood instrument. Fifty-one patients participated in the evaluation of internal consistency of the reviewed instrument. Cronbach's alpha coefficients above 0.75 were observed for the constructs: Intention, Attitude, Subjective Norm, Self-efficacy and Habit. The new instrument demonstrated acceptable evidence of content validity and reliability.

Content validation of the nursing diagnosis acute pain in the Czech Republic and Slovakia.

PubMed

Zeleníková, Renáta; Žiaková, Katarína; Čáp, Juraj; Jarošová, Darja

2014-10-01

The main purpose of the study was to validate the defining characteristics of the nursing diagnosis acute pain in the Czech Republic and Slovakia. This is a descriptive study. The validation process involved was based on Fehring's diagnostic content validity model. Four defining characteristics were classified as major by Slovak nurses and eight defining characteristics were classified as major by Czech nurses. Validation of the nursing diagnosis acute pain in the Czech and Slovak sociocultural context has shown that nurses prioritize characteristics that are behavioral in nature as well as patients' verbal reports of pain. Verbal reports of pain and behavioral indicators are important for arriving at the nursing diagnosis acute pain. © 2014 NANDA International, Inc.

Content validity of critical success factors for e-Government implementation in Indonesia

NASA Astrophysics Data System (ADS)

Napitupulu, D.; Syafrullah, M.; Rahim, R.; Amar, A.; Sucahyo, YG

2018-05-01

The purpose of this research is to validate the Critical Success Factors (CSFs) of e-Government implementation in Indonesia. The e-Government initiative conducted only to obey the regulation but ignoring the quality. Defining CSFs will help government agencies to avoid failure of e-Government projects. A survey with the questionnaire was used to validate the item of CSF based on expert judgment through two round of Delphi. The result showed from 67 subjects in instrument tested; there are 11 invalid items deleted and remain only 56 items that had good content validity and internal reliability. Therefore, all 56 CSFs should be adopted by government agencies in Indonesia to support e-Government implementation.

Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare

PubMed Central

2011-01-01

Background There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale). Methods We used the Standards for Educational and Psychological Testing as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression. Results Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression. Conclusions The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change. PMID:21595888

Validation of a Survey Questionnaire on Organ Donation: An Arabic World Scenario

PubMed Central

Agarwal, Tulika Mehta; Al-Thani, Hassan; Al Maslamani, Yousuf

2018-01-01

Objective To validate a questionnaire for measuring factors influencing organ donation and transplant. Methods The constructed questionnaire was based on the theory of planned behavior by Ajzen Icek and had 45 questions including general inquiry and demographic information. Four experts on the topic, Arabic culture, and the Arabic and English languages established content validity through review. It was quantified by content validity index (CVI). Construct validity was established by principal component analysis (PCA), whereas internal consistency was checked by Cronbach's Alpha and intraclass correlation coefficient (ICC). Statistical analysis was performed by SPSS 22.0 statistical package. Results Content validity in the form of S-CVI/Average and S-CVI/UA was 0.95 and 0.82, respectively, suggesting adequate relevance content of the questionnaire. Factor analysis indicated that the construct validity for each domain (knowledge, attitudes, beliefs, and intention) was 65%, 71%, 77%, and 70%, respectively. Cronbach's Alpha and ICC coefficients were 0.90, 0.67, 0.75, and 0.74 and 0.82, 0.58, 0.61, and 0.74, respectively, for the domains. Conclusion The questionnaire consists of 39 items on knowledge, attitudes, beliefs, and intention domains which is valid and reliable tool to use for organ donation and transplant survey. PMID:29593894

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.

PubMed

Zendejas, Benjamin; Ruparel, Raaj K; Cook, David A

2016-02-01

The Fundamentals of Laparoscopic Surgery (FLS) program uses five simulation stations (peg transfer, precision cutting, loop ligation, and suturing with extracorporeal and intracorporeal knot tying) to teach and assess laparoscopic surgery skills. We sought to summarize evidence regarding the validity of scores from the FLS assessment. We systematically searched for studies evaluating the FLS as an assessment tool (last search update February 26, 2013). We classified validity evidence using the currently standard validity framework (content, response process, internal structure, relations with other variables, and consequences). From a pool of 11,628 studies, we identified 23 studies reporting validity evidence for FLS scores. Studies involved residents (n = 19), practicing physicians (n = 17), and medical students (n = 8), in specialties of general (n = 17), gynecologic (n = 4), urologic (n = 1), and veterinary (n = 1) surgery. Evidence was most common in the form of relations with other variables (n = 22, most often expert-novice differences). Only three studies reported internal structure evidence (inter-rater or inter-station reliability), two studies reported content evidence (i.e., derivation of assessment elements), and three studies reported consequences evidence (definition of pass/fail thresholds). Evidence nearly always supported the validity of FLS total scores. However, the loop ligation task lacks discriminatory ability. Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.

Reliability and Validation of the International Consultation on Incontinence Questionnaire in Over Active Bladder to Persian Language.

PubMed

Sari Motlagh, Reza; Hajebrahimi, Sakineh; Sadeghi-Bazargani, Homayoun; Joodi Tutunsaz, Javad

2015-05-01

Overactive bladder syndrome is a common syndrome in the world in both men and women. Correct diagnosis and accurate measurement of symptoms severity and also quality of life of patients is necessary to ensure proper treatment and to facilitate sound relationships among patients, researchers and doctors. The International Consultation on Incontinence Questionnaire in Over Active Bladder (ICIQ-OAB) questionnaire is a concise and strong tool to evaluate the symptoms of OAB and their effects on patients' quality of life and treatment results. The objective of this study was to translate and validate a simple and strong tool that could be used in clinics and research. First, the original British English questionnaire was translated into Persian by two bilingual and originally Persian-speaking translators. Then the Persian version was back translated to English and a native English speaker studied and compared the questionnaire with the original version. At the end, the translated and corrected Persian version was finalized by a research team. Content validity of the items and ensuring that the questions could convey the main concept to readers was assessed through Modified Content Validity Index (MCVI). Reliability was calculated by Cronbach's α coefficient. Internal Consistency of the questionnaire with the calculation of Kendall correlation coefficient were evaluated by performing test-retest in 50 participants. The modified content validity index was > 0.78 for all of the questions. Cronbach's α coefficient was calculated 0.76 for all of the participants. Kendall correlation coefficient was calculated for test-re-test assessment 0.66. Both of which indicates the reliability of this questionnaire. Persian version of ICIQ-OAB questionnaire is a simple and strong tool for research, treatment and screening purposes. © 2014 Wiley Publishing Asia Pty Ltd.

Translation and Validation of the Korean Version of the International Knee Documentation Committee Subjective Knee Form

PubMed Central

Kim, Jin Goo; Lee, Joong Yub; Seo, Seung Suk; Choi, Choong Hyeok; Lee, Myung Chul

2013-01-01

Purpose To perform a cross-cultural adaptation and to test the measurement properties of the Korean version of International Knee Documentation Committee (K-IKDC) Subjective Knee Form. Materials and Methods According to the guidelines for cross-cultural adaptation, translation and backward translation of the English version of the IKDC Subjective Knee Form were performed. After translation into the Korean version, 150 patients who had knee-related problems were asked to complete the K-IKDC, Lysholm score, and Short Form-36 (SF-36). Of these patients, 126 were retested 2 weeks later to evaluate test-retest reliability, and 104 were recruited 3 months later to evaluate responsiveness. Construct validity was analyzed by investigating the correlation with Lysholm score and SF-36; content validity was also evaluated. Standardized mean response was calculated for evaluating responsiveness. Results The test-retest reliability proved excellent with a high value for the intraclass correlation coefficient (r=0.94). The internal consistency was strong (Cronbach's α=0.91). Good content validity with absence of floor not ceiling effects and good convergent and divergent validity were observed. Moderate responsiveness was shown (standardized mean response=0.689). Conclusions The K-IKDC demonstrated good measurement properties. We suggest that this instrument is an excellent evaluation instrument that can be used for Korean patients with knee-related injuries. PMID:24032098

Content validation of the operational definitions of the nursing diagnoses of activity intolerance, excess fluid volume, and decreased cardiac output in patients with heart failure.

PubMed

de Souza, Vanessa; Zeitoun, Sandra Salloum; Lopes, Camila Takao; de Oliveira, Ana Paula Dias; Lopes, Juliana de Lima; de Barros, Alba Lucia Botura Leite

2014-06-01

To consensually validate the operational definitions of the nursing diagnoses activity intolerance, excessive fluid volume, and decreased cardiac output in patients with decompensated heart failure. Consensual validation was performed in two stages: analogy by similarity of defining characteristics, and development of operational definitions and validation with experts. A total of 38 defining characteristics were found. Operational definitions were developed and content-validated. One hundred percent of agreement was achieved among the seven experts after five rounds. "Ascites" was added in the nursing diagnosis excessive fluid volume. The consensual validation improves interpretation of human response, grounding the selection of nursing interventions and contributing to improved nursing outcomes. Support the assessment of patients with decompensated heart failure. © 2013 NANDA International.

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

Psychometric properties of belief measures about osteoporosis and its control.

PubMed

Alexander, Lacey; Wajanatinapart, Piyaorn; Lauver, Diane

2017-12-01

Osteoporosis (OP) is a chronic health condition with potentially serious consequences. Although preventive behaviors are important to control OP, many people do not engage in such behaviors. Although beliefs about preventive behaviors for OP influence such behaviors, we could not find psychometrically strong measures of such beliefs for use in planned research. Our initial study was done to assess the content validity, clarity, and internal consistency of belief measures regarding behaviors to control OP: perceived competence, perceived susceptibility, and perceived severity, based on relevant theories. Using a descriptive design, we recruited five clinicians to rate proposed measures for content validity. We also recruited fifty-one older adults from five different counties in a Midwestern state to respond to proposed measures so we could assess clarity and internal consistency reliability. The content validity indices of items varied from 0.60-1.00. The content validity indices of scales varied from 0.73-1.00. For reliability, the final Cronbach's alphas were 0.79-0.96. Addressing a gap in research, we have documented good psychometric properties of belief measures regarding OP and its control. In describing our search for psychometrically sound measures, we have raised issues for future researchers to consider prior to adopting use of existing measures. Nurses can use these measures to assess and address the accuracy of patients' beliefs either individually or in groups. Researchers can use these measures to examine whether or not psycho-educational interventions influence beliefs about OP and its control. Published by Elsevier Inc.

Chronic Pain: Content Validation of Nursing Diagnosis in Slovakia and the Czech Republic.

PubMed

Zeleníková, Renáta; Maniaková, Lenka

2015-10-01

The main purpose of the study was to validate the defining characteristics and related factors of the nursing diagnosis "chronic pain" in Slovakia and the Czech Republic. This is a descriptive study. The validation process involved was based on Fehring's Diagnostic Content Validity Model. Three defining characteristics (reports pain, altered ability to continue previous activities, and depression) were classified as major by Slovak nurses, and one defining characteristic (reports pain) was classified as major by Czech nurses. The results of the study provide guidance in devising strategies of pain assessment and can aid in the formulation of accurate nursing diagnoses. The defining characteristic "reports pain" is important for arriving at the nursing diagnosis "chronic pain." © 2014 NANDA International, Inc.

Robustness of near-infrared calibration models for the prediction of milk constituents during the milking process.

PubMed

Melfsen, Andreas; Hartung, Eberhard; Haeussermann, Angelika

2013-02-01

The robustness of in-line raw milk analysis with near-infrared spectroscopy (NIRS) was tested with respect to the prediction of the raw milk contents fat, protein and lactose. Near-infrared (NIR) spectra of raw milk (n = 3119) were acquired on three different farms during the milking process of 354 milkings over a period of six months. Calibration models were calculated for: a random data set of each farm (fully random internal calibration); first two thirds of the visits per farm (internal calibration); whole datasets of two of the three farms (external calibration), and combinations of external and internal datasets. Validation was done either on the remaining data set per farm (internal validation) or on data of the remaining farms (external validation). Excellent calibration results were obtained when fully randomised internal calibration sets were used for milk analysis. In this case, RPD values of around ten, five and three for the prediction of fat, protein and lactose content, respectively, were achieved. Farm internal calibrations achieved much poorer prediction results especially for the prediction of protein and lactose with RPD values of around two and one respectively. The prediction accuracy improved when validation was done on spectra of an external farm, mainly due to the higher sample variation in external calibration sets in terms of feeding diets and individual cow effects. The results showed that further improvements were achieved when additional farm information was added to the calibration set. One of the main requirements towards a robust calibration model is the ability to predict milk constituents in unknown future milk samples. The robustness and quality of prediction increases with increasing variation of, e.g., feeding and cow individual milk composition in the calibration model.

Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia.

PubMed

Kadar, Masne; Ibrahim, Suhaili; Razaob, Nor Afifi; Chai, Siaw Chui; Harun, Dzalani

2018-02-01

The Lawton Instrumental Activities of Daily Living Scale is a tool often used to assess independence among elderly at home. Its suitability to be used with the elderly population in Malaysia has not been validated. This current study aimed to assess the validity and reliability of the Lawton Instrumental Activities of Daily Living Scale - Malay Version to Malay speaking elderly in Malaysia. This study was divided into three phases: (1) translation and linguistic validity involving both forward and backward translations; (2) establishment of face validity and content validity; and (3) establishment of reliability involving inter-rater, test-retest and internal consistency analyses. Data used for these analyses were obtained by interviewing 65 elderly respondents. Percentages of Content Validity Index for 4 criteria were from 88.89 to 100.0. The Cronbach α coefficient for internal consistency was 0.838. Intra-class Correlation Coefficient of inter-rater reliability and test-retest reliability was 0.957 and 0.950 respectively. The result shows that the Lawton Instrumental Activities of Daily Living Scale - Malay Version has excellent reliability and validity for use with the Malay speaking elderly people in Malaysia. This scale could be used by professionals to assess functional ability of elderly who live independently in community. © 2018 Occupational Therapy Australia.

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

Reliability and validity of the Chinese CECA10 questionnaire for Chinese patients with condyloma acuminata

PubMed Central

Guo, Xinying; Wu, Xinjuan; Guo, Aimin; Zhao, Yanwei

2018-01-01

Abstract Condyloma acuminata (CA) is a sexually transmitted disease that affects quality of life (QOL). CECA10 is an English-language questionnaire for assessing QOL in patients with CA, but there is no equivalent in China. This study aimed to develop a validated and reliable Chinese version of CECA10. The Chinese CECA10 was developed from the English version by forward translation, back translation, comparison with the original, cultural adjustments, and a pre-test (5 patients). The Chinese CECA10 and EuroQol Five Dimensions Three Level Questionnaire (EQ-5D-3L) was administered to patients with CA. Content validity (item/scale content validity indexes, I-CVI/S-CVI), test–retest reliability (intraclass coefficient, ICC), internal consistency (Cronbach α), criterion validity (comparison with the Dermatology Life Quality Index, DLQL, using Spearman correlation analysis), construct validity (exploratory factor analysis), and discriminant validity (between subgroups based on number of warts, number of recurrences, or number of sites involved) were assessed. The Chinese CECA10 had good test–retest reliability (ICC = 0.98, P < .001), internal consistency (Cronbach α values of 0.88, 0.84, and 0.83 for the total questionnaire, psychological dimension, and sexual dimension, respectively), content validity (I-CVI = 1 for all items), and criterion validity (r = -0.50, P < .001). Exploratory factor analysis extracted 2 factors with a cumulative contribution of 61.75%; the factor loading with each item was >0.4. Discriminant validity was not high. The mean CECA10 and EQ-VAS scores of 211 patients with CA (28.19 ± 7.16 years; 139 males) were 34.56 ± 19.01 and 64.64 ± 19.28, respectively. The Chinese CECA10 has good reliability and validity for evaluating the QOL of Chinese patients with CA. PMID:29489693

Concept analysis and validation of the nursing diagnosis, delayed surgical recovery.

PubMed

Appoloni, Aline Helena; Herdman, T Heather; Napoleão, Anamaria Alves; Campos de Carvalho, Emilia; Hortense, Priscilla

2013-10-01

To analyze the human response of delayed surgical recovery, approved by NANDA-I, and to validate its defining characteristics (DCs) and related factors (RFs). This was a two-part study using a concept analysis based on the method of Walker and Avant, and diagnostic content validation based on Fehring's model. Three of the original DCs, and three proposed DCs identified from the concept analysis, were validated in this study; five of the original RFs and four proposed RFs were validated. A revision of the concept studied is suggested, incorporating the validation of some of the DCs and RFs presented by NANDA-I, and the insertion of new, validated DCs and RFs. This study may enable the extension of the use of this diagnosis and contribute to quality surgical care of clients. © 2013, The Authors. International Journal of Nursing Knowledge © 2013, NANDA International.

Is the Berg Balance Scale an effective tool for the measurement of early postural control impairments in patients with Parkinson's disease? Evidence from Rasch analysis.

PubMed

La Porta, F; Giordano, A; Caselli, S; Foti, C; Franchignoni, F

2015-12-01

It is unclear whether the BBS is an effective tool for the measurement of early postural control impairments in patients with Parkinson's disease (PD). The aim of this paper was to evaluate BBS' content validity, internal construct validity, reliability and targeting in patients with PD within the Rasch analysis framework. Observational, cross-sectional study. Outpatient Rehabilitation Unit. A sample of 285 outpatients with PD. The content validity of the BBS was assessed using standard linking techniques. The BBS was administered by trained physiotherapists. The data collected then underwent Rasch analysis. Content validity analysis showed a lack of items assessing postural responses to tripping and slips and stability during walking. On Rasch analysis, the BBS failed the requirements of monotonicity, local independence, unidimensionality and invariance. After rescoring 7 items, grouping of locally dependent items into testlets, and deletion of the static sitting balance item because mistargeted and underdiscriminating, the Rasch-modified BBS for PD (BBS-PD) showed adequate internal construct validity (χ(2)24=39.693; P=0.023), including absence of differential item functioning (DIF) across gender and age, and was, as a whole, sufficiently precise for individual person measurement (PSI=0.894). However, the scale was not well targeted to the sample in view of the prevalence of higher scores. This study demonstrated the internal construct validity and reliability of the BBS-PD as a measurement tool for patients with PD within the Rasch analysis framework. However, the lack of items critical to the assessment of postural control impairments typical of PD, affected negatively the targeting, so that a significant percentage of patients was located in the higher ability range of the measurement continuum, where precision of measurement is reduced. These findings suggest that the BBS, even if modified, may not be an effective tool for the measurement of early postural control in patients with PD.

Center for Epidemiologic Studies Depression Scale for Children: psychometric testing of the Chinese version.

PubMed

Li, Ho Cheung William; Chung, Oi Kwan Joyce; Ho, Ka Yan

2010-11-01

This paper is a report of psychometric testing of the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children. The availability of a valid and reliable instrument that accurately detects depressive symptoms in children is crucial before any psychological intervention can be appropriately planned and evaluated. There is no such an instrument for Chinese children. A test-retest, within-subjects design was used. A total of 313 primary school students between the ages of 8 and 12 years were invited to participate in the study in 2009. Participants were asked to respond to the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children, short form of the State Anxiety Scale for Children and Rosenberg's Self-Esteem Scale. The internal consistency, content validity and construct validity and test-retest reliability of the Chinese version of the Center for Epidemiologic Studies Depression Scale for Children were assessed. The newly-translated scale demonstrated adequate internal consistency, good content validity and appropriate convergent and discriminant validity. Confirmatory factor analysis added further evidence of the construct validity of the scale. Results suggest that the newly-translated scale can be used as a self-report assessment tool in detecting depressive symptoms of Chinese children aged between 8 and 12 years. © 2010 Blackwell Publishing Ltd.

Herth hope index: psychometric testing of the Chinese version.

PubMed

Chan, Keung Sum; Li, Ho Cheung William; Chan, Sally Wai-Chi; Lopez, Violeta

2012-09-01

This article is a report on psychometric testing of the Chinese version of the herth hope index. The availability of a valid and reliable instrument that accurately measures the level of hope in patients with heart failure is crucial before any hope-enhancing interventions can be appropriately planned and evaluated. There is no such instrument for Chinese people. A test-retest, within-subjects design was used. A purposive sample of 120 Hong Kong Chinese patients with heart failure between the ages of 60 and 80 years admitted to two medical wards was recruited during an 8-month period in 2009. Participants were asked to respond to the Chinese version of the herth hope index, Hamilton depression rating scale and Rosenberg's self-esteem scale. The internal consistency, content validity and construct validity and test-retest reliability of the Chinese version of the herth hope index were assessed. The newly translated scale demonstrated adequate internal consistency, good content validity and appropriate convergent and discriminant validity. Confirmatory factor analysis added further evidence of the construct validity of the scale. Results suggest that the newly translated scale can be used as a self-report assessment tool in assessing the level of hope in Hong Kong Chinese patients with heart failure. © 2011 Blackwell Publishing Ltd.

Psychometric properties of the parent́s perception uncertainty in illness scale, spanish version.

PubMed

Suarez-Acuña, C E; Carvajal-Carrascal, G; Serrano-Gómez, M E

2018-03-27

To analyze the psychometric properties of the Parents' Perception of Uncertainty in Illness Scale, parents/children, adapted to Spanish. A descriptive methodological study involving the translation into Spanish of the Parents' Perception of Uncertainty in Illness Scale, parents/children, and analysis of their face validity, content validity, construct validity and internal consistency. The original version of the scale in English was translated into Spanish, and approved by its author. Six face validity items with comprehension difficulty were reported; which were reviewed and adapted, keeping its structure. The global content validity index with expert appraisal was 0.94. In the exploratory analysis of factors, 3 dimensions were identified: ambiguity and lack of information, unpredictability and lack of clarity, with a KMO=0.846, which accumulated 91.5% of the explained variance. The internal consistency of the scale yielded a Cronbach alpha of 0.86 demonstrating a good level of correlation between items. The Spanish version of "Parent's Perception of Uncertainty in Illness Scale" is a valid and reliable tool that can be used to determine the level of uncertainty of parents facing the illness of their children. Copyright © 2018 Sociedad Española de Enfermería Intensiva y Unidades Coronarias (SEEIUC). Publicado por Elsevier España, S.L.U. All rights reserved.

Content validity of the Comprehensive ICF Core Set for multiple sclerosis from the perspective of speech and language therapists.

PubMed

Renom, Marta; Conrad, Andrea; Bascuñana, Helena; Cieza, Alarcos; Galán, Ingrid; Kesselring, Jürg; Coenen, Michaela

2014-11-01

The Comprehensive International Classification of Functioning, Disability and Health (ICF) Core Set for Multiple Sclerosis (MS) is a comprehensive framework to structure the information obtained in multidisciplinary clinical settings according to the biopsychosocial perspective of the International Classification of Functioning, Disability and Health (ICF) and to guide the treatment and rehabilitation process accordingly. It is now undergoing validation from the user perspective for which it has been developed in the first place. To validate the content of the Comprehensive ICF Core Set for MS from the perspective of speech and language therapists (SLTs) involved in the treatment of persons with MS (PwMS). Within a three-round e-mail-based Delphi Study 34 SLTs were asked about PwMS' problems, resources and aspects of the environment treated by SLTs. Responses were linked to ICF categories. Identified ICF categories were compared with those included in the Comprehensive ICF Core Set for MS to examine its content validity. Thirty-four SLTs named 524 problems and resources, as well as aspects of environment. Statements were linked to 129 ICF categories (60 Body-functions categories, two Body-structures categories, 42 Activities-&-participation categories, and 25 Environmental-factors categories). SLTs confirmed 46 categories in the Comprehensive ICF Core Set. Twenty-one ICF categories were identified as not-yet-included categories. This study contributes to the content validity of the Comprehensive ICF Core Set for MS from the perspective of SLTs. Study participants agreed on a few not-yet-included categories that should be further discussed for inclusion in a revised version of the Comprehensive ICF Core Set to strengthen SLTs' perspective in PwMS' neurorehabilitation. © 2014 Royal College of Speech and Language Therapists.

Exploring the use of the Dementia Management Strategies Scale in caregivers of persons with dementia in Singapore.

PubMed

Tan, Louisa; Yap, Philip; Ng, Wai Yee; Luo, Nan

2013-01-01

Well-being in persons with dementia (PWD) depends much on the quality and type of care received. The Dementia Management Strategies Scale (DMSS) is a useful instrument to appraise care styles of caregivers. The present study expanded on previous research by refining and establishing the scale's content validity and psychometric properties in the Singapore context. Five family caregivers and four dementia care professionals (nurse, occupational therapist, social worker and doctor) reviewed the DMSS for content validity. Two hundred and forty-six family caregivers completed questionnaires which assessed caregiver and patient characteristics, and dementia management strategies with DMSS. Internal consistency reliability was assessed and construct validity was evaluated through Pearson's correlation with extant instruments. Eight items from the 28-item DMSS were omitted after content review as they were deemed inappropriate in our socio-cultural setting. A factor analysis with Varimax rotation confirmed a two-factor structure (positive and negative dimensions) for the revised DMSS (rDMSS). The two subscales showed good internal consistency (Cronbach's alpha .89 and .87). Moderate to strong correlations (.35-.53) with the scales, Zarit Burden Instrument, Revised Memory and Behavioural Problems Checklist, General Health Questionnaire, Short Sense of Competence Scale, Gains in Alzheimer's Care Instrument and Positive Aspects of Caregiving established convergent and divergent construct validity of rDMSS. The shortened 20-item rDMSS is a psychometrically valid instrument which can serve as a measure of dementia care strategy from the perspective of the caregiver in Singapore.

Evaluation of the spoken knowledge in low literacy in diabetes scale for use with Mexican Americans.

PubMed

Garcia, Alexandra A; Zuniga, Julie; Reynolds, Raquel; Cairampoma, Laura; Sumlin, Lisa

2015-05-01

This article evaluates the Spoken Knowledge in Low Literacy in Diabetes (SKILLD) questionnaire, a measure of essential knowledge for type 2 diabetes self-management, after it was modified for English- and Spanish-speaking Mexican Americans. We collected surveys (SKILLD, demographic, acculturation) and blood for A1C analysis from 72 community-recruited participants to analyze the SKILLD's internal consistency, interrater reliability, item analysis, and construct validity. Clinical experts evaluated content validity. The SKILLD demonstrated low internal consistency but high interrater reliability and content and construct validity. There were significant correlations in expected directions between SKILLD scores and acculturation, education, and A1C and significant differences in SKILLD scores between and within groups after an educational intervention and between high- and low-acculturated participants. The SKILLD generates useful information about Mexican Americans' diabetes knowledge. Lower SKILLD scores suggest less diabetes knowledge, lower health literacy, and participants' difficulties understanding items. Further modifications should improve use with low-acculturated Mexican Americans. © The Author(s) 2014.

Content Validity of the Comprehensive ICF Core Set for Multiple Sclerosis from the Perspective of Speech and Language Therapists

ERIC Educational Resources Information Center

Renom, Marta; Conrad, Andrea; Bascuñana, Helena; Cieza, Alarcos; Galán, Ingrid; Kesselring, Jürg; Coenen, Michaela

2014-01-01

Background: The Comprehensive International Classification of Functioning, Disability and Health (ICF) Core Set for Multiple Sclerosis (MS) is a comprehensive framework to structure the information obtained in multidisciplinary clinical settings according to the biopsychosocial perspective of the International Classification of Functioning,…

Validation of a diabetes numeracy test in Arabic.

PubMed

Alghodaier, Hussah; Jradi, Hoda; Mohammad, Najwa Samantha; Bawazir, Amen

2017-01-01

The prevalence of diabetes Mellitus in Saudi Arabia is 24%, ranking it among the top ten Worldwide. Diabetes education focuses on self-management and relies on numeracy skills. Poor numeracy may go unrecognized and it is important to have an assessment tool in Arabic to measure such a skill in diabetes care. To validate a 15-item Diabetes Numeracy Test (DNT-15) in the Arabic Language as a tool to assess the numeracy skills of patients with diabetes and to test its properties among Saudi patients with diabetes. A 15-question Arabic-language test to assess diabetes numeracy among patients with diabetes on the basis of the diabetes numeracy test (DNT-15) was validated among a sample Arabic speaking Saudi patients with diabetes. Data collection included patients' demographics, long-term glycemic control, diabetes type, duration, co-morbidities, and diabetes related knowledge questions. Internal reliability was assessed using Kuder-Richardson Formula 20 (KR-20). The average score of Arabic DNT-15 was 53.3% and took an average of 30 minutes to complete. The scores significantly correlated with education, income, HbA1c, and diabetes knowledge (p<0.05). Content Validity Ratio (CVR) of 0.75 and Content Validity Index (CVI) of 0.89 supported good content validity. The Arabic DNT-15 also had good internal reliability (KR20 = 0.90). Patients with diabetes need numeracy skills to manage their disease. Level of education does not reflect level of numeracy, and low numeracy skills might be unnoticed by health care providers. The Arabic DNT-15 is a valid and reliable scale to identify Arabic speaking patients with difficulties in certain diabetes-related numeracy skills.

Psychometric Properties of the Persian Translation of the Sexual Quality of Life–Male Questionnaire

PubMed Central

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2016-01-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life–Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward–backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test–retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M (p < .001). Reliability evaluation indicated a high internal consistency and test–retest reliability. The Cronbach’s alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men. PMID:26856758

Psychometric Properties of the Persian Translation of the Sexual Quality of Life-Male Questionnaire.

PubMed

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2017-05-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life-Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward-backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test-retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M ( p < .001). Reliability evaluation indicated a high internal consistency and test-retest reliability. The Cronbach's alpha coefficient and intraclass correlation coefficients were .96 and .95, respectively. Results indicated that the Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men.

The Student Actions Coding Sheet (SACS): An Instrument for Illuminating the Shifts toward Student-Centered Science Classrooms

ERIC Educational Resources Information Center

Erdogan, Ibrahim; Campbell, Todd; Abd-Hamid, Nor Hashidah

2011-01-01

This study describes the development of an instrument to investigate the extent to which student-centered actions are occurring in science classrooms. The instrument was developed through the following five stages: (1) student action identification, (2) use of both national and international content experts to establish content validity, (3)…

Development and psychometric evaluation of supportive leadership scales.

PubMed

McGilton, Katherine S

2003-12-01

The purpose of this study was to develop and evaluate the psychometric properties of 2 supportive leadership scales, the Charge Nurse Support Scale and the Unit Manager Support Scale, designed for long-term-care environments. These 6-item self-report scales were administered to 70 nursing staff and their internal consistency reliability, test-retest reliability, content validity, factor structure, and construct validity investigated. Content validity was established with the assistance of experts. Both scales were deemed reliable. As hypothesized, a significant relationship was found between the measure of how nursing staff related to residents and measures of charge nurses' supportive behaviours (r = .42, p = .05). Reliable and valid measures of supportive leadership could be developed for use in identifying the quality of support provided to staff in long-term-care environments.

Knee Injury and Osteoarthritis Outcome Score (KOOS): systematic review and meta-analysis of measurement properties.

PubMed

Collins, N J; Prinsen, C A C; Christensen, R; Bartels, E M; Terwee, C B; Roos, E M

2016-08-01

To conduct a systematic review and meta-analysis to synthesize evidence regarding measurement properties of the Knee injury and Osteoarthritis Outcome Score (KOOS). A comprehensive literature search identified 37 eligible papers evaluating KOOS measurement properties in participants with knee injuries and/or osteoarthritis (OA). Methodological quality was evaluated using the COSMIN checklist. Where possible, meta-analysis of extracted data was conducted for all studies and stratified by age and knee condition; otherwise narrative synthesis was performed. KOOS has adequate internal consistency, test-retest reliability and construct validity in young and old adults with knee injuries and/or OA. The ADL subscale has better content validity for older patients and Sport/Rec for younger patients with knee injuries, while the Pain subscale is more relevant for painful knee conditions. The five-factor structure of the original KOOS is unclear. There is some evidence that the KOOS subscales demonstrate sufficient unidimensionality, but this requires confirmation. Although measurement error requires further evaluation, the minimal detectable change for KOOS subscales ranges from 14.3 to 19.6 for younger individuals, and ≥20 for older individuals. Evidence of responsiveness comes from larger effect sizes following surgical (especially total knee replacement) than non-surgical interventions. KOOS demonstrates adequate content validity, internal consistency, test-retest reliability, construct validity and responsiveness for age- and condition-relevant subscales. Structural validity, cross-cultural validity and measurement error require further evaluation, as well as construct validity of KOOS Physical function Short form. Suggested order of subscales for different knee conditions can be applied in hierarchical testing of endpoints in clinical trials. PROSPERO (CRD42011001603). Copyright © 2016 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

Development of a job stressor scale for nurses caring for patients with intractable neurological diseases.

PubMed

Ando, Yukako; Kataoka, Tsuyoshi; Okamura, Hitoshi; Tanaka, Katsutoshi; Kobayashi, Toshio

2013-12-01

The purpose of this research is to verify the reliability and validity of a job stressor scale for nurses caring for patients with intractable neurological diseases. A mail survey was conducted using a self-report questionnaire. The subjects were 263 nurses and assistant nurses working in wards specializing in intractable neurological diseases. The response rate was 71.9% (valid response rate, 66.2%). With regard to reliability, internal consistency and stability were assessed. Internal consistency was examined via Cronbach's alpha. For stability, the test-retest method was performed and stability was examined via intraclass correlation coefficients. With regard to validity, factor validity, criterion-related validity, and content validity were assessed. Exploratory factor analysis was used for factor validity. For criterion-related validity, an existing scale was used as an external criterion; concurrent validity was examined via Spearman's rank correlation coefficients. As a result of analysis, there were 26 items in the scale created with an eight factor structure. Cronbach's a for the 26 items was 0.90; with the exception of two factors, alpha for all of the individual sub-factors was high at 0.7 or higher. The intraclass correlation coefficient for the 26 items was 0.89 (p < 0.001). With regard to criterion-related validity, concurrent validity was confirmed and the correlation coefficient with an external criterion was 0.73 (p < 0.001). For content validity, subjects who responded that "The questionnaire represents a stressor well or to a degree" accounted for 81% of the total responses. Reliability and validity were confirmed, so the scale created in the current research is a usable scale.

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

Psychometric evaluation of the Swedish adaptation of the Inventory for Assessing the Process of Cultural Competence Among Healthcare Professionals--Revised (IAPCC-R).

PubMed

Olt, Helen; Jirwe, Maria; Gustavsson, Petter; Emami, Azita

2010-01-01

The purpose of this study was to describe the translation, adaption, and psychometric evaluation process in relation to validity and reliability of the Swedish version of the instrument, Inventory for Assessing The Process of Cultural Competence Among Healthcare Professionals-Revised (IAPCC-R) following the translation, adaptation, and psychometric evaluation process. Validity tests were conducted on the response processes (N = 15), the content (N = 7), and the internal structure of the instrument (N = 334). Reliability (alpha = .65 for the total scale varying between -.01 and .65 for the different subscales) was evaluated in terms of internal consistency. Results indicated weak validity and reliability though it is difficult to conclude whether this is related to adaptation issues or the original construction.The testing of the response process identified problems in relation to respondents' conceptualization of cultural competence. The test of the content identified a weak correspondence between the items and the underlying model. In addition, a confirmatory factor analysis did not confirm the proposed structure of the instrument. This study concludes that this instrument is not valid and reliable for use with a Swedish population of practicing nurses or nursing students.

Full immersion simulation: validation of a distributed simulation environment for technical and non-technical skills training in Urology.

PubMed

Brewin, James; Tang, Jessica; Dasgupta, Prokar; Khan, Muhammad S; Ahmed, Kamran; Bello, Fernando; Kneebone, Roger; Jaye, Peter

2015-07-01

To evaluate the face, content and construct validity of the distributed simulation (DS) environment for technical and non-technical skills training in endourology. To evaluate the educational impact of DS for urology training. DS offers a portable, low-cost simulated operating room environment that can be set up in any open space. A prospective mixed methods design using established validation methodology was conducted in this simulated environment with 10 experienced and 10 trainee urologists. All participants performed a simulated prostate resection in the DS environment. Outcome measures included surveys to evaluate the DS, as well as comparative analyses of experienced and trainee urologist's performance using real-time and 'blinded' video analysis and validated performance metrics. Non-parametric statistical methods were used to compare differences between groups. The DS environment demonstrated face, content and construct validity for both non-technical and technical skills. Kirkpatrick level 1 evidence for the educational impact of the DS environment was shown. Further studies are needed to evaluate the effect of simulated operating room training on real operating room performance. This study has shown the validity of the DS environment for non-technical, as well as technical skills training. DS-based simulation appears to be a valuable addition to traditional classroom-based simulation training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

Turkish Version of the Student Nurse Stress Index: Validity and Reliability.

PubMed

Sarikoc, Gamze; Bayram Demiralp, Meral; Oksuz, Emine; Pazar, Berrin

2017-06-01

This study aimed to adapt the Student Nurse Stress Index (SNSI) for the Turkish nursing students and investigate its psychometric properties. Research was conducted with 152 volunteer female students who attended a university college in Ankara, Turkey. Test-retest reliability was investigated for the scale internal consistency (Cronbach α) and stability. Also, content validity and construct validity of the SNSI were assessed. In order to determine the construct validity of SNSI, Uygulamalı Çok Değişkenli İstatistiksel Yöntemler and confirmatory factor analysis was conducted. The Turkish version of SNSI with 15 items comprised four factors (academic load, clinical concerns, personal problems, interface worries). The content validity index (CVI) score was .97. Factor loadings of Turkish version of SNSI varied between .532 and .868. The "personal problems" subscale explained 19.01% of the variance; "clinical concerns" explained 18.51%; "interface worries" explained 15.32%; "academic load" explained 14.14%. The total variance explained was 66.99%. CFA results (χ 2 /SD, GFI, CFI, TLI, IFI, RMSEA and SRMR) were acceptable and in good agreement. The internal consistency coefficient of the SNSI was .86. Results showed that the SNSI had a satisfactory level of reliability and validity in nursing students in Turkey. Multicenter studies including nursing students from different nursing schools are recommended for the SNSI to be generalized. Copyright © 2017. Published by Elsevier B.V.

Translation and Validation of the Dutch Western Ontario Meniscal Evaluation Tool.

PubMed

van der Wal, Robert J P; Heemskerk, Bastiaan T J; van Arkel, Ewoud R A; Mokkink, Lidwine B; Thomassen, Bregje J W

2017-05-01

The aim of this study was to translate the Western Ontario Meniscal Evaluation Tool (WOMET) into Dutch, to evaluate the content validity, construct validity, reliability, and responsiveness, and to determine the minimal important change (MIC) of the Dutch version. The WOMET was translated into Dutch according to a standardized forward-backward translation protocol. A total of 86 patients (51 males, 35 females, median age 52 years [interquartile range, 43-60 years]) with isolated meniscal pathology were included. The WOMET was completed three times; at baseline, around 2 weeks, and after 3 months from the baseline. Knee injury and osteoarthritis outcome score, International Knee Documentation Committee subjective knee form, short-form 36, and an anchor question were also answered. There were good results for content validity (floor and ceiling effects [< 15%]), construct validity (79% of the predefined hypotheses were confirmed), internal consistency (Cronbach α = 0.87, 0.79, and 0.86 for each subscale score), test-retest reliability (intraclass correlation coefficient = 0.78 for total WOMET score), and responsiveness (79% of the predefined hypotheses were confirmed). The smallest detectable change and MIC for the Dutch WOMET are 20.5 and 14.7, respectively. The Dutch version of the WOMET is valid and reliable for assessing health-related quality of life in patients with meniscal pathology. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Development and validation of a questionnaire to evaluate infection control in oral radiology.

PubMed

da Costa, Eliana D; Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-04-01

To create and validate a questionnaire to evaluate infection control in oral radiology. The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test-retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722-1.000) and good to great for the yes/no questions (kappa = 0.662-0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology.

What does it cost to prevent on-duty firefighter cardiac events? A content valid method for calculating costs.

PubMed

Patterson, P Daniel; Suyama, Joe; Reis, Steven E; Weaver, Matthew D; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters.

What Does It Cost to Prevent On-Duty Firefighter Cardiac Events? A Content Valid Method for Calculating Costs

PubMed Central

Patterson, P. Daniel; Suyama, Joe; Reis, Steven E.; Weaver, Matthew D.; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters. PMID:24455288

Reliability and construct validity of the Malay version of the Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan, Malaysia.

PubMed

Hadi, Azlihanis Abdul; Naing, Nyi Nyi; Daud, Aziah; Nordin, Rusli

2006-11-01

This study was conducted to assess the reliability and construct validity of the Malay version of Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan. A total of 68 teachers consented to participate in the study and were administered the Malay version of JCQ. Reliability was determined using Cronbach's alpha for internal consistency whilst construct validity was assessed using factor analysis. The results indicated that Cronbach's alpha coefficients revealed decision latitude (0.75), psychological job demand (0.50) and social support (0.84). Factor analysis showed three meaningful common factors that could explain the construct of Karasek's demand-control-social support model. The study suggests the JCQ scales are reliable and valid tools for assessing job stress in school teachers.

Development and validation of a nutrition knowledge questionnaire for a Canadian population.

PubMed

Bradette-Laplante, Maude; Carbonneau, Élise; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-05-01

The present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines. A thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test-retest reliability were evaluated through a validation study. Online survey. Six nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated. Content validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RD v. non-RD (21·5 (sd 2·1) v. 15·7 (sd 3·0) out of 24, P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach's α=0·73). Assessment of test-retest reliability resulted in significant associations for the total knowledge score (r=0·59, P<0·001). This nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Face, Content, and Construct Validations of Endoscopic Needle Injection Simulator for Transurethral Bulking Agent in Treatment of Stress Urinary Incontinence.

PubMed

Farhan, Bilal; Soltani, Tandis; Do, Rebecca; Perez, Claudia; Choi, Hanul; Ghoniem, Gamal

2018-05-02

Endoscopic injection of urethral bulking agents is an office procedure that is used to treat stress urinary incontinence secondary to internal sphincteric deficiency. Validation studies important part of simulator evaluation and is considered important step to establish the effectiveness of simulation-based training. The endoscopic needle injection (ENI) simulator has not been formally validated, although it has been used widely at University of California, Irvine. We aimed to assess the face, content, and construct validity of the UC, Irvine ENI simulator. Dissected female porcine bladders were mounted in a modified Hysteroscopy Diagnostic Trainer. Using routine endoscopic equipment for this procedure with video monitoring, 6 urologists (experts group) and 6 urology trainee (novice group) completed urethral bulking agents injections on a total of 12 bladders using ENI simulator. Face and content validities were assessed by using structured quantitative survey which rating the realism. Construct validity was assessed by comparing the performance, time of the procedure, and the occlusive (anatomical and functional) evaluations between the experts and novices. Trainees also completed a postprocedure feedback survey. Effective injections were evaluated by measuring the retrograde urethral opening pressure, visual cystoscopic coaptation, and postprocedure gross anatomic examination. All 12 participants felt the simulator was a good training tool and should be used as essential part of urology training (face validity). ENI simulator showed good face and content validity with average score varies between the experts and the novices was 3.9/5 and 3.8/5, respectively. Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.9-3.8/5). However, the bladder does not bleed, and sometimes thin. Experts significantly outperformed novices (p < 001) across all measure of performance therefore establishing construct validity. The ENI simulator shows face, content and construct validities, although few aspects of simulator were not very realistic (e.g., bleeding).This study provides a base for the future formal validation for this simulator and for continuing use of this simulator in endourology training. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Reliability and validity of the Wolfram Unified Rating Scale (WURS)

PubMed Central

2012-01-01

Background Wolfram syndrome (WFS) is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS) to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS). Methods A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease). WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age). Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated. Results The WURS had high inter-rater reliability (ICCs>.93), moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91) and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, p<.03), between the WURS Behavioral Scale and reports of mood and behavior (rs>.76, p<.04) and between WURS Total scores and quality of life (rs=-.86, p=.001). The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83). Conclusions These preliminary findings demonstrate that the WURS has acceptable reliability and validity and captures individual differences in disease severity in children and young adults with WFS. PMID:23148655

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire.

PubMed

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II ( r s = -0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (-0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702-0.828 ( P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses.

Psychometric properties of the Chinese version of the attitudes towards cardiopulmonary resuscitation with defibrillation (ACPRD-C) among female hospital nurses in Taiwan.

PubMed

Lin, Hsing-Long; Lin, Mei-Hsiang; Ho, Chao-Chung; Fu, Chin-Hua; Koo, Malcolm

2017-07-01

Nurses are often the first responders to in-hospital cardiac emergencies. A positive attitude towards cardiopulmonary resuscitation with defibrillation may contribute to early cardiopulmonary resuscitation and rapid defibrillation, which are associated with enhanced long-term survival. The aim of this study was to translate and adapt the 31-item attitudes towards cardiopulmonary resuscitation with defibrillation and the national resuscitation guidelines (ACPRD) instrument into Chinese and to evaluate its psychometric properties in a sample of Taiwanese hospital nurses. The ACPRD instrument was translated into Chinese using professional translation services. Content validity index based on five experts to refine the translated instrument. The final instrument was applied to a sample of 290 female nurses, recruited from a regional hospital in southern Taiwan, to assess its internal consistency, factor structure, and discriminative validity. The Chinese ACPRD instrument showed good internal consistency (Cronbach's alpha=0.87). Seven factors emerged from the factor analysis. The instrument showed good discriminative validity and were able to differentiate the attitudes of nurses with more experience of defibrillation or cardiopulmonary resuscitation from those with less experience. Nurses working in emergency ward or intensive care unit also showed significantly higher overall scores compared to those working in other units. The Chinese ACPRD demonstrated adequate content validity, internal consistency, sensible factor structure, and good discriminative validity. Among Chinese-speaking nurses, it may be used as a tool for assessing the effectiveness of educational programs that aim to improve their confidence in performing cardiopulmonary resuscitation with defibrillation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Elders Health Empowerment Scale: Spanish adaptation and psychometric analysis.

PubMed

Serrani Azcurra, Daniel Jorge Luis

2014-01-01

Empowerment refers to patient skills that allow them to become primary decision-makers in control of daily self-management of health problems. As important the concept as it is, particularly for elders with chronic diseases, few available instruments have been validated for use with Spanish speaking people. Translate and adapt the Health Empowerment Scale (HES) for a Spanish-speaking older adults sample and perform its psychometric validation. The HES was adapted based on the Diabetes Empowerment Scale-Short Form. Where "diabetes" was mentioned in the original tool, it was replaced with "health" terms to cover all kinds of conditions that could affect health empowerment. Statistical and Psychometric Analyses were conducted on 648 urban-dwelling seniors. The HES had an acceptable internal consistency with a Cronbach's α of 0.89. The convergent validity was supported by significant Pearson's Coefficient correlations between the HES total and item scores and the General Self Efficacy Scale (r= 0.77), Swedish Rheumatic Disease Empowerment Scale (r= 0.69) and Making Decisions Empowerment Scale (r= 0.70). Construct validity was evaluated using item analysis, half-split test and corrected item to total correlation coefficients; with good internal consistency (α> 0.8). The content validity was supported by Scale and Item Content Validity Index of 0.98 and 1.0, respectively. HES had acceptable face validity and reliability coefficients; which added to its ease administration and users' unbiased comprehension, could set it as a suitable tool in evaluating elder's outpatient empowerment-based medical education programs.

Elders Health Empowerment Scale

PubMed Central

2014-01-01

Introduction: Empowerment refers to patient skills that allow them to become primary decision-makers in control of daily self-management of health problems. As important the concept as it is, particularly for elders with chronic diseases, few available instruments have been validated for use with Spanish speaking people. Objective: Translate and adapt the Health Empowerment Scale (HES) for a Spanish-speaking older adults sample and perform its psychometric validation. Methods: The HES was adapted based on the Diabetes Empowerment Scale-Short Form. Where "diabetes" was mentioned in the original tool, it was replaced with "health" terms to cover all kinds of conditions that could affect health empowerment. Statistical and Psychometric Analyses were conducted on 648 urban-dwelling seniors. Results: The HES had an acceptable internal consistency with a Cronbach's α of 0.89. The convergent validity was supported by significant Pearson's Coefficient correlations between the HES total and item scores and the General Self Efficacy Scale (r= 0.77), Swedish Rheumatic Disease Empowerment Scale (r= 0.69) and Making Decisions Empowerment Scale (r= 0.70). Construct validity was evaluated using item analysis, half-split test and corrected item to total correlation coefficients; with good internal consistency (α> 0.8). The content validity was supported by Scale and Item Content Validity Index of 0.98 and 1.0, respectively. Conclusions: HES had acceptable face validity and reliability coefficients; which added to its ease administration and users' unbiased comprehension, could set it as a suitable tool in evaluating elder's outpatient empowerment-based medical education programs. PMID:25767307

A tool to assess sex-gender when selecting health research projects.

PubMed

Tomás, Concepción; Yago, Teresa; Eguiluz, Mercedes; Samitier, M A Luisa; Oliveros, Teresa; Palacios, Gemma

2015-04-01

To validate the questionnaire "Gender Perspective in Health Research" (GPIHR) to assess the inclusion of gender perspective in research projects. Validation study in two stages. Feasibility was analysed in the first, and reliability, internal consistence and validity in the second. Aragón Institute of Health Science, Aragón, Spain. GPIHR was applied to 118 research projects funded in national and international competitive tenders from 2003 to 2012. Analysis of inter- and intra-observer reliability with Kappa index and internal consistency with Cronbach's alpha. Content validity analysed through literature review and construct validity with an exploratory factor analysis. Validated GPIHR has 10 questions: 3 in the introduction, 1 for objectives, 3 for methodology and 3 for research purpose. Average time of application was 13min Inter-observer reliability (Kappa) varied between 0.35 and 0.94 and intra-observer between 0.40 and 0.94. Theoretical construct is supported in the literature. Factor analysis identifies three levels of GP inclusion: "difference by sex", "gender sensitive" and "feminist research" with an internal consistency of 0.64, 0.87 and 0.81, respectively, which explain 74.78% of variance. GPIHR questionnaire is a valid tool to assess GP and useful for those researchers who would like to include GP in their projects. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Design and Evaluation of the Psychometric Properties of a Paternal Adaptation Questionnaire.

PubMed

Eskandari, Narges; Simbar, Masoumeh; Vadadhir, AbouAli; Baghestani, Ahmad Reza

2016-07-25

The present study aimed to design and evaluate the psychometric properties of the Paternal Adaptation Questionnaire (PAQ). The study was a mixed (qualitative and quantitative) sequential exploratory study. In the qualitative phase, a preliminary questionnaire with 210 items emerged from in-depth interviews with 17 fathers and 15 key informants. In the quantitative phase, psychometric properties of the PAQ were assessed. Considering cutoff points as 1.5 for item impact, 0.49 for content validity ratio (CVR), and 0.7 for content validity index (CVI), items of the questionnaire were reduced from 210 to 132. Assessment of the content validity of the questionnaire demonstrated S-CVR = 0.68 and S-CVI = 0.92. Exploratory factor analysis resulted in the development of a PAQ with 38 items classified under five factors (ability in performing the roles and responsibilities; perceiving the parental development; stabilization in paternal position; spiritual stability and internal satisfaction; and challenges and concerns), which explained 52.19% of cumulative variance. Measurement of internal consistency reported a Cronbach's α of .89 for PAQ (.61-.86 for subscales), and stability assessment of the PAQ through the test-retest demonstrated Spearman's correlation coefficients and intraclass correlation coefficient of .96 (.81-.97 for subscales). It was identified that the PAQ is a valid and reliable instrument that could be used to assess fatherhood adaptation with the paternal roles and fathers' needs, as well as to design appropriate interventions and to evaluate their effectiveness. © The Author(s) 2016.

Review and Content Analysis of the "International Review of Research in Open and Distance/Distributed Learning" (2000-2015)

ERIC Educational Resources Information Center

Zawacki-Richter, Olaf; Alturki, Uthman; Aldraiweesh, Ahmed

2017-01-01

This paper presents a review of distance education literature published in the "International Review of Research in Open and Distance/Distributed Learning" (IRRODL) to describe the status thereof and to identify gaps and priority areas in distance education research based on a validated classification of research areas. All articles (N =…

[Research on Resistant Starch Content of Rice Grain Based on NIR Spectroscopy Model].

PubMed

Luo, Xi; Wu, Fang-xi; Xie, Hong-guang; Zhu, Yong-sheng; Zhang, Jian-fu; Xie, Hua-an

2016-03-01

A new method based on near-infrared reflectance spectroscopy (NIRS) analysis was explored to determine the content of rice-resistant starch instead of common chemical method which took long time was high-cost. First of all, we collected 62 spectral data which have big differences in terms of resistant starch content of rice, and then the spectral data and detected chemical values are imported chemometrics software. After that a near-infrared spectroscopy calibration model for rice-resistant starch content was constructed with partial least squares (PLS) method. Results are as follows: In respect of internal cross validation, the coefficient of determination (R2) of untreated, pretreatment with MSC+1thD, pretreatment with 1thD+SNV were 0.920 2, 0.967 0 and 0.976 7 respectively. Root mean square error of prediction (RMSEP) were 1.533 7, 1.011 2 and 0.837 1 respectively. In respect of external validation, the coefficient of determination (R2) of untreated, pretreatment with MSC+ 1thD, pretreatment with 1thD+SNV were 0.805, 0.976 and 0.992 respectively. The average absolute error was 1.456, 0.818, 0.515 respectively. There was no significant difference between chemical and predicted values (Turkey multiple comparison), so we think near infrared spectrum analysis is more feasible than chemical measurement. Among the different pretreatment, the first derivation and standard normal variate (1thD+SNV) have higher coefficient of determination (R2) and lower error value whether in internal validation and external validation. In other words, the calibration model has higher precision and less error by pretreatment with 1thD+SNV.

European validation of The Comprehensive International Classification of Functioning, Disability and Health Core Set for Osteoarthritis from the perspective of patients with osteoarthritis of the knee or hip.

PubMed

Weigl, Martin; Wild, Heike

2017-09-15

To validate the International Classification of Functioning, Disability and Health Comprehensive Core Set for Osteoarthritis from the patient perspective in Europe. This multicenter cross-sectional study involved 375 patients with knee or hip osteoarthritis. Trained health professionals completed the Comprehensive Core Set, and patients completed the Short-Form 36 questionnaire. Content validity was evaluated by calculating prevalences of impairments in body function and structures, limitations in activities and participation and environmental factors, which were either barriers or facilitators. Convergent construct validity was evaluated by correlating the International Classification of Functioning, Disability and Health categories with the Short-Form 36 Physical Component Score and the SF-36 Mental Component Score in a subgroup of 259 patients. The prevalences of all body function, body structure and activities and participation categories were >40%, >32% and >20%, respectively, and all environmental factors were relevant for >16% of patients. Few categories showed relevant differences between knee and hip osteoarthritis. All body function categories and all but two activities and participation categories showed significant correlations with the Physical Component Score. Body functions from the ICF chapter Mental Functions showed higher correlations with the Mental Component Score than with the Physical Component Score. This study supports the validity of the International Classification of Functioning, Disability and Health Comprehensive Core Set for Osteoarthritis. Implications for Rehabilitation Comprehensive International Classification of Functioning, Disability and Health Core Sets were developed as practical tools for application in multidisciplinary assessments. The validity of the Comprehensive International Classification of Functioning, Disability and Health Core Set for Osteoarthritis in this study supports its application in European patients with osteoarthritis. The differences in results between this Europe validation study and a previous Singaporean validation study underscore the need to validate the International Classification of Functioning, Disability and Health Core Sets in different regions of the world.

The Utrecht questionnaire (U-CEP) measuring knowledge on clinical epidemiology proved to be valid.

PubMed

Kortekaas, Marlous F; Bartelink, Marie-Louise E L; de Groot, Esther; Korving, Helen; de Wit, Niek J; Grobbee, Diederick E; Hoes, Arno W

2017-02-01

Knowledge on clinical epidemiology is crucial to practice evidence-based medicine. We describe the development and validation of the Utrecht questionnaire on knowledge on Clinical epidemiology for Evidence-based Practice (U-CEP); an assessment tool to be used in the training of clinicians. The U-CEP was developed in two formats: two sets of 25 questions and a combined set of 50. The validation was performed among postgraduate general practice (GP) trainees, hospital trainees, GP supervisors, and experts. Internal consistency, internal reliability (item-total correlation), item discrimination index, item difficulty, content validity, construct validity, responsiveness, test-retest reliability, and feasibility were assessed. The questionnaire was externally validated. Internal consistency was good with a Cronbach alpha of 0.8. The median item-total correlation and mean item discrimination index were satisfactory. Both sets were perceived as relevant to clinical practice. Construct validity was good. Both sets were responsive but failed on test-retest reliability. One set took 24 minutes and the other 33 minutes to complete, on average. External GP trainees had comparable results. The U-CEP is a valid questionnaire to assess knowledge on clinical epidemiology, which is a prerequisite for practicing evidence-based medicine in daily clinical practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Cross-cultural differences in the conceptualisation of patients' satisfaction with psychiatric services--content validity of the English version of the Verona Service Satisfaction Scale.

PubMed

Henderson, Claire; Hales, Heidi; Ruggeri, Mirella

2003-03-01

The VSSS is a multi-dimensional questionnaire developed to address methodological concerns about measurement of satisfaction with services on the part of psychiatric patients. The acceptability, sensitivity, content validity and test-retest reliability of the original version of the VSSS, in Italian, have already been demonstrated [1, 2]. The internal consistency [3] and test-retest reliability [4] of the English translation have been shown to be within acceptable ranges. The content validity of the original 82-item and the 54-item English version has not yet been assessed. The aims of this study were to assess the content validity of the English translation of the VSSS and to compare it with that of the original version in Italian. We used data collected as part of the first wave (T1) of the PRiSM Psychosis Study [5] and repeated the methods used to assess the content validity of the original Italian version of the VSSS [1, 2]. Content elements derived from answers to four open questions were rated independently by CH and HH in terms of their equivalence to VSSS items or dimensions. were compared to those from the content validity study of the Italian version. Results Inter-rater agreement was very high. The largest proportion of the content elements of the answers were rated as equivalent or related to a questionnaire item or a dimension of the VSSS. The dimension 'Professionals' Skills and Behaviour' appears the most significant contributor to satisfaction, as it was most often related to content elements in answers to all four key questions (39.1 %). The second most frequently mentioned dimension was that of 'Types of Intervention' for three out of four open questions, while 'Access' was second most frequent for the fourth. Of the content elements, 17.2 % did not include items or dimensions covered by the VSSS; the three most frequently mentioned were other patients, food and security. The 82-item English version of the VSSS captures sharply most contents relevant to patients' satisfaction. Consideration of contributors to satisfaction so far neglected may refine the conceptualisation of satisfaction.

Cross-cultural adaptation and validation of the Protective Nursing Advocacy Scale for Brazilian nurses 1

PubMed Central

Tomaschewski-Barlem, Jamila Geri; Lunardi, Valéria Lerch; Barlem, Edison Luiz Devos; da Silveira, Rosemary Silva; Dalmolin, Graziele de Lima; Ramos, Aline Marcelino

2015-01-01

Abstract Objective: to adapt culturally and validate the Protective Nursing Advocacy Scale for Brazilian nurses. Method: methodological study carried out with 153 nurses from two hospitals in the South region of Brazil, one public and the other philanthropic. The cross-cultural adaptation of the Protective Nursing Advocacy Scale was performed according to international standards, and its validation was carried out for use in the Brazilian context, by means of factor analysis and Cronbach's alpha as measure of internal consistency. Results: by means of evaluation by a committee of experts and application of pre-test, face validity and content validity of the instrument were considered satisfactory. From the factor analysis, five constructs were identified: negative implications of the advocacy practice, advocacy actions, facilitators of the advocacy practice, perceptions that favor practice advocacy and barriers to advocacy practice. The instrument showed satisfactory internal consistency, with Cronbach's alpha values ranging from 0.70 to 0.87. Conclusion: it was concluded that the Protective Nursing Advocacy Scale - Brazilian version, is a valid and reliable instrument for use in the evaluation of beliefs and actions of health advocacy, performed by Brazilian nurses in their professional practice environment. PMID:26444169

Interest in Aesthetic Rhinoplasty Scale.

PubMed

Naraghi, Mohsen; Atari, Mohammad

2017-04-01

Interest in cosmetic surgery is increasing, with rhinoplasty being one of the most popular surgical procedures. It is essential that surgeons identify patients with existing psychological conditions before any procedure. This study aimed to develop and validate the Interest in Aesthetic Rhinoplasty Scale (IARS). Four studies were conducted to develop the IARS and to evaluate different indices of validity (face, content, construct, criterion, and concurrent validities) and reliability (internal consistency, split-half coefficient, and temporal stability) of the scale. The four study samples included a total of 463 participants. Statistical analysis revealed satisfactory psychometric properties in all samples. Scores on the IARS were negatively correlated with self-esteem scores ( r  = -0.296; p  < 0.01) and positively associated with scores for psychopathologic symptoms ( r  = 0.164; p  < 0.05), social dysfunction ( r  = 0.268; p  < 0.01), and depression ( r  = 0.308; p  < 0.01). The internal and test-retest coefficients of consistency were found to be high (α = 0.93; intraclass coefficient = 0.94). Rhinoplasty patients were found to have significantly higher IARS scores than nonpatients ( p  < 0.001). Findings of the present studies provided evidence for face, content, construct, criterion, and concurrent validities and internal and test-retest reliability of the IARS. This evidence supports the use of the scale in clinical and research settings. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Cross-cultural adaptation and psychometric testing of the Quality of Dying and Death Questionnaire for the Spanish population.

PubMed

Gutiérrez Sánchez, Daniel; Cuesta-Vargas, Antonio I

2018-04-01

Many measurements have been developed to assess the quality of death (QoD). Among these, the Quality of Dying and Death Questionnaire (QODD) is the most widely studied and best validated. Informal carers and health professionals who care for the patient during their last days of life can complete this assessment tool. The aim of the study is to carry out a cross-cultural adaptation and a psychometric analysis of the QODD for the Spanish population. The translation was performed using a double forward and backward method. An expert panel evaluated the content validity. The questionnaire was tested in a sample of 72 Spanish-speaking adult carers of deceased cancer patients. A psychometric analysis was performed to evaluate internal consistency, divergent criterion-related validity with the Mini-Suffering State Examination (MSSE) and concurrent criterion-related validity with the Palliative Outcome Scale (POS). Some items were deleted and modified to create the Spanish version of the QODD (QODD-ESP-26). The instrument was readable and acceptable. The content validity index was 0.96, suggesting that all items are relevant for the measure of the QoD. This questionnaire showed high internal consistency (Cronbach's α coefficient = 0.88). Divergent validity with MSSE (r = -0.64) and convergent validity with POS (r = -0.61) were also demonstrated. The QODD-ESP-26 is a valid and reliable instrument for the assessment of the QoD of deceased cancer patients that can be used in a clinical and research setting. Copyright © 2018 Elsevier Ltd. All rights reserved.

Translation and validation of the Cardiac Depression Scale to Arabic.

PubMed

Papasavvas, T; Al-Amin, H; Ghabrash, H F; Micklewright, D

2016-08-01

The Cardiac Depression Scale (CDS) has been designed to measure depressive symptoms in patients with heart disease. There is no Arabic version of the CDS. We translated and validated the CDS in an Arabic sample of patients with heart disease. Forward and back translation of the CDS was followed by assessment of cultural relevance and content validity. The Arabic version of the CDS (A-CDS) and the Arabic version of the Hospital Anxiety and Depression Scale (A-HADS) were then administered to 260 Arab in-patients with heart disease from 18 Arabic countries. Construct validity was assessed using exploratory factor analysis with polychoric correlations. Internal consistency was assessed using ordinal reliability alpha and item-to-factor polychoric correlations. Concurrent validity was assessed using Pearson's correlation coefficient between the A-CDS and the depression subscale of the A-HADS (A-HADS-D). Cultural relevance and content validity of the A-CDS were satisfactory. Exploratory factor analysis revealed three robust factors, without cross-loadings, that formed a single dimension. Internal consistency was high (ordinal reliability alpha for the total scale and the three factors were .94, .91, .86, and .87, respectively; item-to-factor correlations ranged from .77 to .91). Concurrent validity was high (r=.72). The A-CDS demonstrated a closer to normal distribution of scores than the A-HADS-D. Sensitivity and specificity of the A-CDS were not objectively assessed. The A-CDS appears to be a valid and reliable instrument to measure depressive symptoms in a representative sample of Arab in-patients with heart disease. Copyright © 2016 Elsevier B.V. All rights reserved.

PRO development: rigorous qualitative research as the crucial foundation.

PubMed

Lasch, Kathryn Eilene; Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-10-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.

PRO development: rigorous qualitative research as the crucial foundation

PubMed Central

Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-01-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity. PMID:20512662

Validation of the MMPI-2 Low Self-Esteem Content Scale.

PubMed

Brems, C; Lloyd, P

1995-12-01

We explored the concurrent validity of the MMPI-2 Low Self-Esteem (LSE) Content scale by asking 216 undergraduate students to complete the Minnesota Multiphasic Personality Inventory-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1991), Harter Adult Self-Perception Profile (Harter, 1986a) and Rosenberg Self-Esteem Scale (Rosenberg, 1965). Results suggest the LSE renders a good assessment of global self-esteem as well as being a measure of three distinct components of self-esteem. These specific subscales, identified by factor analysis, were labeled Ineptitude, Negative Self-Value, and Negative Comparison with Others. The LSE and its subscales produced good internal consistency (alpha and Gutman Split Half) coefficients.

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

PubMed

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Development and validation of a questionnaire to evaluate infection control in oral radiology

PubMed Central

Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-01-01

Objectives: To create and validate a questionnaire to evaluate infection control in oral radiology. Methods: The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test–retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. Results: The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722–1.000) and good to great for the yes/no questions (kappa = 0.662–0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. Conclusions: The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology. PMID:28112553

Developing a model of competence in the operating theatre: psychometric validation of the perceived perioperative competence scale-revised.

PubMed

Gillespie, Brigid M; Polit, Denise F; Hamlin, Lois; Chaboyer, Wendy

2012-01-01

This paper describes the development and validation of the Revised Perioperative Competence Scale (PPCS-R). There is a lack of a psychometrically tested sound self-assessment tools to measure nurses' perceived competence in the operating room. Content validity was established by a panel of international experts and the original 98-item scale was pilot tested with 345 nurses in Queensland, Australia. Following the removal of several items, a national sample that included all 3209 nurses who were members of the Australian College of Operating Room Nurses was surveyed using the 94-item version. Psychometric testing assessed content validity using exploratory factor analysis, internal consistency using Cronbach's alpha, and construct validity using the "known groups" technique. During item reduction, several preliminary factor analyses were performed on two random halves of the sample (n=550). Usable data for psychometric assessment were obtained from 1122 nurses. The original 94-item scale was reduced to 40 items. The final factor analysis using the entire sample resulted in a 40 item six-factor solution. Cronbach's alpha for the 40-item scale was .96. Construct validation demonstrated significant differences (p<.0001) in perceived competence scores relative to years of operating room experience and receipt of specialty education. On the basis of these results, the psychometric properties of the PPCS-R were considered encouraging. Further testing of the tool in different samples of operating room nurses is necessary to enable cross-cultural comparisons. Copyright © 2011 Elsevier Ltd. All rights reserved.

Preliminary validation and reliability of the Short Form Chronic Respiratory Disease Questionnaire in a lung cancer population.

PubMed

Charalambous, A; Molassiotis, A

2017-01-01

The Short Form Chronic Respiratory Questionnaire (SF-CRQ) is frequently used in patients with obstructive pulmonary disease and it has demonstrated excellent psychometric properties. Since there is no psychometric information for its use with lung cancer patients, this study explored its validity and reliability in this population. Forty-six patients were assessed at two time points (with a 4-week interval) using the SF-CRQ, the modified Borg Scale, five numerical rating scales related to Perceived Severity of Breathlessness, and the Hospital Anxiety and Depression Scale. Internal consistency reliability was investigated by Cronbach's alpha reliability coefficient, test-retest reliability by Spearman-Brown reliability coefficient (P), content validity as well as convergent validity by Pearson's correlation coefficient between the SF-CRQ, and the conceptual similar scales mentioned above were explored. A principal component factor analysis was performed. The internal consistency was high [α = 0.88 (baseline) and 0.91 (after 1 month)]. The SF-CRQ had good stability with test-retest reliability ranging from r = 0.64 to 0.78, P < 0.001. Factor analysis suggests a single construct in this population. The preliminary data analyses supported the convergent, content, and construct validity of the SF-CRQ providing promising evidence that this can be a valid and reliable instrument for the assessment of quality of life related to breathlessness in lung cancer patients. © 2015 John Wiley & Sons Ltd.

Validation of an instrument to measure quality of life in British children with inflammatory bowel disease.

PubMed

Ogden, C A; Akobeng, A K; Abbott, J; Aggett, P; Sood, M R; Thomas, A G

2011-09-01

To validate IMPACT-III (UK), a health-related quality of life (HRQoL) instrument, in British children with inflammatory bowel disease (IBD). One hundred six children and parents were invited to participate. IMPACT-III (UK) was validated by inspection by health professionals and children to assess face and content validity, factor analysis to determine optimum domain structure, use of Cronbach alpha coefficients to test internal reliability, ANOVA to assess discriminant validity, correlation with the Child Health Questionnaire to assess concurrent validity, and use of intraclass correlation coefficients to assess test-retest reliability. The independent samples t test was used to measure differences between sexes and age groups, and between paper and computerised versions of IMPACT-III (UK). IMPACT-III (UK) had good face and content validity. The most robust factor solution was a 5-domain structure: body image, embarrassment, energy, IBD symptoms, and worries/concerns about IBD, all of which demonstrated good internal reliability (α = 0.74-0.88). Discriminant validity was demonstrated by significant (P  < 0.05, P < 0.01) differences in HRQoL scores between the severe, moderate, and inactive/mild symptom severity groups for the embarrassment scale (63.7 vs 81.0 vs 81.2), IBD symptom scale (45.0 vs 64.2 vs 80.6), and the energy scale (46.4 vs 62.1 vs 77.7). Concurrent validity of IMPACT-III (UK) with comparable domains of the Child Health Questionnaire was confirmed. Test-retest reliability was confirmed with good intraclass correlation coefficients of 0.66 to 0.84. Paper and computer versions of IMPACT-III (UK) collected comparable scores, and there were no differences between the sexes and age groups. IMPACT-III (UK) appears to be a useful tool to measure HRQoL in British children with IBD.

Psychometric properties of the Portuguese version of place attachment scale for youth in residential care.

PubMed

Magalhães, Eunice; Calheiros, María M

2015-01-01

Although the significant scientific advances on place attachment literature, no instruments exist specifically developed or adapted to residential care. 410 adolescents (11 - 18 years old) participated in this study. The place attachment scale evaluates five dimensions: Place identity, Place dependence, Institutional bonding, Caregivers bonding and Friend bonding. Data analysis included descriptive statistics, content validity, construct validity (Confirmatory Factor Analysis), concurrent validity with correlations with satisfaction with life and with institution, and reliability evidences. The relationship with individual characteristics and placement length was also verified. Content validity analysis revealed that more than half of the panellists perceive all the items as relevant to assess the construct in residential care. The structure with five dimensions revealed good fit statistics and concurrent validity evidences were found, with significant correlations with satisfaction with life and with the institution. Acceptable values of internal consistence and specific gender differences were found. The preliminary psychometric properties of this scale suggest it potential to be used with youth in care.

Military Families' Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure.

PubMed

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families.

Military Families’ Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure

PubMed Central

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families. PMID:28936370

Inventory of Determinants of Obesity-Related Behaviors in Adolescents: Development and Psychometric Characteristics.

PubMed

Amiri, Parisa; Ghofranipour, Fazlollah; Jalali-Farahani, Sara; Ahmadi, Fazlollah; Hosseinpanah, Farhad; Hooman, Haidar Ali; Parvin, Parnian; Ghasemi, Mohammadreza

2015-07-01

The rising prevalence of childhood obesity is a major health problem worldwide. Hence, there is a growing need for health professionals to become capable of assessing the factors that determine lifestyle in a culturally relevant manner. This study aimed to develop and assess a questionnaire for measuring determinants of obesity-related behaviors in Tehranian adolescents. Based on the results of a qualitative study and an extensive literature review, the 44-item "Inventory of determinants of obesity-related behaviors in adolescents (IDOBA)" with eight subscales was developed: 1) unhealthy nutrition and physical inactivity; 2) stress-related eating; 3) perceived inability; 4) perceived lack of threat; 5) perceived priority of educational achievement; 6) perceived acceptability; 7) motivation loss; and 8) lack of support. Validity of IDOBA was assessed, utilizing face, content, and construct validity methods. To confirm face validity, ten overweight/obese adolescents completed the questionnaire. To calculate content validity ratio (CVR) and content validity index (CVI), a different panel of ten experts commented independently on the necessity, relevance, clarity, and simplicity of each item. To assess construct validity using exploratory factor analysis (EFA), a total of 478 adolescents (57.7% male) aged 13 to 18 years, who were recruited from schools, participated in the study. Confirmatory factor analysis (CFA) was used to test whether the data fit the hypothesized measurement model that was derived from EFA. Test-retest and internal consistency methods were used to assess reliability of the IDOBA scale. All items were perceived as relevant and comprehendible by adolescents. Content validity was confirmed by the panel of experts. The internal consistency, as measured by Cronbach's alpha coefficients, exceeded the minimum reliability standard of 0.60 for eight subscales. No ceiling effects were observed. Detected floor effects ranged from 0.2% for perceived acceptability subscale score to 18.8% for lack of threat subscale score. The EFA suggested an eight-factor construct and the results of the CFA indicated acceptable fit indices for the proposed model. All subscales demonstrated satisfactory test-retest reliability (intra-class correlation coefficient, 0.42 - 0.91) over one month. Results provided initial evidence that the IDOBA is a valid and reliable instrument for measuring determinants of obesity-related behaviors in Iranian adolescents, indicating that the questionnaire can be used in future weight management programs for Tehranian adolescents.

Spanish adaptation and validation of the supportive & palliative care indicators tool – SPICT-ESTM

PubMed Central

Fachado, Alfonso Alonso; Martínez, Noemí Sansó; Roselló, Marisa Martín; Rial, José Javier Ventosa; Oliver, Enric Benito; García, Rafael Gómez; García, José Manuel Fernández

2018-01-01

ABSTRACT OBJECTIVE To culturally adapt and validate the SPICTTM to Spanish, which is a brief and simple tool to support a better identification of chronic patients who have palliative care needs. METHODS For this study, we designed a multicenter and national project between the centers of Galicia, Balearic Islands, and Andalusia. For the process of translation and cross-cultural adaptation of the SPICTTM to Spanish, we followed the steps proposed by Beaton et al. with successive translations and subsequent consensus of experts using the debriefing methodology. After the content validation was completed, the psychometric properties were validated. A prospective longitudinal study was designed with 188 patients from Galicia, the Balearic Islands, and Andalusia. The internal consistency and reliability of the test and retest was analyzed for 10 days by the same researcher. RESULTS For more than 90% of the participants of the SPICT-ESTM, it seems simple to be filled out, and they consider it written in an understandable language. The average time to apply the questionnaire without prior knowledge was 4 minutes and 45 seconds. To evaluate the internal consistency of the instrument, we used the Kuder-Richardson formula 20. Internal consistency is 0.71. The agreement index of the Kappa test is between 0.983 and 0.797 for the different items. CONCLUSIONS In this study, we demonstrate the equivalence of content with the original. In addition, the validation of the psychometric properties establishes that the SPICT-ESTM maintains adequate reliability and stability. If we add the satisfaction shown by the professionals and the ease of use, the SPICT-ESTM is an adequate tool for the identification of palliative patients with chronic diseases and palliative care needs. PMID:29364358

Spanish adaptation and validation of the supportive & palliative care indicators tool - SPICT-ESTM.

PubMed

Fachado, Alfonso Alonso; Martínez, Noemí Sansó; Roselló, Marisa Martín; Rial, José Javier Ventosa; Oliver, Enric Benito; García, Rafael Gómez; García, José Manuel Fernández

2018-01-01

OBJECTIVE To culturally adapt and validate the SPICTTM to Spanish, which is a brief and simple tool to support a better identification of chronic patients who have palliative care needs. METHODS For this study, we designed a multicenter and national project between the centers of Galicia, Balearic Islands, and Andalusia. For the process of translation and cross-cultural adaptation of the SPICTTM to Spanish, we followed the steps proposed by Beaton et al. with successive translations and subsequent consensus of experts using the debriefing methodology. After the content validation was completed, the psychometric properties were validated. A prospective longitudinal study was designed with 188 patients from Galicia, the Balearic Islands, and Andalusia. The internal consistency and reliability of the test and retest was analyzed for 10 days by the same researcher. RESULTS For more than 90% of the participants of the SPICT-ESTM, it seems simple to be filled out, and they consider it written in an understandable language. The average time to apply the questionnaire without prior knowledge was 4 minutes and 45 seconds. To evaluate the internal consistency of the instrument, we used the Kuder-Richardson formula 20. Internal consistency is 0.71. The agreement index of the Kappa test is between 0.983 and 0.797 for the different items. CONCLUSIONS In this study, we demonstrate the equivalence of content with the original. In addition, the validation of the psychometric properties establishes that the SPICT-ESTM maintains adequate reliability and stability. If we add the satisfaction shown by the professionals and the ease of use, the SPICT-ESTM is an adequate tool for the identification of palliative patients with chronic diseases and palliative care needs.

Psychometric properties of the Anxiety Inventory for Respiratory Disease in patients with COPD in China.

PubMed

Dong, Xiao-Yan; Wang, Lan; Tao, Yan-Xia; Suo, Xiu-Li; Li, Yue-Chuan; Liu, Fang; Zhao, Yue; Zhang, Qing

2017-01-01

Anxiety is a common comorbidity in patients with COPD in China, and it can significantly decrease patients' quality of life. Almost all anxiety measurements contain somatic items that can overlap with symptoms of COPD and side effects of medicines, which can lead to bias in measuring anxiety in patients with COPD. Therefore, a brief and disease-specific non-somatic anxiety measurement scale, the Anxiety Inventory for Respiratory Disease (AIR), which has been developed and validated in its English version, is needed for patients with COPD in China. A two-center study was conducted in two tertiary hospitals in Tianjin, China. A total of 181 outpatients with COPD (mean age 67.21±8.10 years, 32.6% women), who met the inclusion and exclusion criteria, were enrolled in the study. Test-retest reliability was examined using intraclass correlation coefficients. The internal consistency was calculated by Cronbach's α . Content validity was examined using the Content Validity Index (CVI), scale-level CVI/universal agreement, and scale-level CVI/average agreement (S-CVI/Ave). Besides, convergent validity and construct validity were also examined. The AIR-C (AIR-Chinese version) scale had high test-retest reliability (intraclass correlation coefficient =0.904) and internal consistency (Cronbach's α =0.914); the content validity of the AIR-C scale was calculated by CVI, scale-level CVI/universal agreement, and S-CVI/Ave at values of 0.89-1, 0.90, and 0.98, respectively. Meanwhile, the AIR-C scale had good convergent validity, correlating with the Hospital Anxiety and Depression Scale-Anxiety ( r =0.81, P <0.01), and there were significant correlations between the AIR-C and Clinical COPD Questionnaire (CCQ; r =0.44, P <0.01) and Activities of Daily Living Scale (ADLS; r =0.36, P <0.01). A two-factor model of general anxiety and panic symptoms in the AIR-C scale had the best fit according to Confirmatory Factor Analysis (CFA). The AIR-C scale had a good reliability and validity for patients with COPD and can be used as a user-friendly and valid tool for measuring anxiety symptoms among patients with COPD in China.

Psychological Flexibility of Nurses in a Cancer Hospital: Preliminary Validation of a Chinese Version of the Work-related Acceptance and Action Questionnaire

PubMed Central

Xu, Xianghua; Liu, Xiangyu; Ou, Meijun; Xie, Chanjuan; Chen, Yongyi

2018-01-01

Objective: To translate the English work-related acceptance and action questionnaire (WAAQ), make cross-cultural adaptations, and examine its psychometric properties when used by Chinese oncology nurses. Methods: After translation, the psychometric properties of the Chinese WAAQ were analyzed among 417 nurses, and content validity was determined by six experts. Results: Item-level content validity index (CVI) values were between 0.83 and 1.00; scale-level CVI/universal agreement (S-CVI/UA) and S-CVI/average were 0.86 and 0.98, respectively, which implicated a good content validity. The correlation of the Chinese WAAQ with AAQ-II (rs = −0.247, P < 0.001) suggested criterion validity, and those with General Health Questionnaire-12 (−0.250, <0.001) and general self-efficacy scale (0.491, <0.001) and Utrecht work engagement scale (UWES) (0.439, <0.001) suggested convergent validity. Exploratory factor analysis identified a seven-item, one-factor structure of WAAQ. The Chinese version of WAAQ had high internal consistency (Cronbach's α = 0.920), with an item-total correlation coefficient of 0.702–0.828 (P < 0.05), split-half reliability of 0.933, and test-retest reliability of 0.772. Conclusions: The Chinese WAAQ is a reliable and valid tool for assessing psychological flexibility in Chinese oncology nurses. PMID:29379839

[Examination of the criterion validity of the MMPI-2 Depression, Anxiety, and Anger Content scales].

PubMed

Uluç, Sait

2008-01-01

Examination of the psychometric properties and content areas of the revised MMPI's (MMPI-2 [Minnesota Multiphasic Personality Inventory-2]) content scales is required. In this study the criterion-related validity of the MMPI-2 Depression, Anxiety, and Anger Content scales was examined using the following conceptually relevant scales: The Beck Depression Inventory (BDI), Beck Anxiety Inventory (BAI), and State Triad Anger Scale (STAS). MMPI-2 Depression, Anxiety, and Anger Content scales, and BDI, BAI, and STAS were administered to a sample of 196 students at Middle East Technical University (n= 196; 122 female, 74 male). Regression analyses were performed to determine if these conceptually relevant scales contributed significantly beyond the content scales. The MMPI-2 Depression Content Scale was compared to BDI, the MMPI-2 Anxiety Scale was compared to BAI, and the MMPI-2 Anger Content Scale was compared to STAS. The internal consistency of the MMPI-2 Depression Content Scale (alpha = 0.82), the MMPI-2 Anxiety Content Scale (alpha = 0.73), and the MMPI-2 Anger Content Scale (alpha = 0.72) was obtained. Criterion validity of the 3 analyzed content scales was demonstrated for both males and females. The findings indicated that (1) the MMPI-2 Depression Content Scale provides information about the general level of depression, (2) the MMPI-2 Anxiety Content Scale assesses subjective anxiety rather than somatic anxiety, and (3) the MMPI-2 Anger Content Scale may provide information about the potential to act out. The findings also provide further evidence that the 3 conceptually relevant scales aid in the interpretation of MMPI-2 scores by contributing additional information beyond the clinical scales.

Validation of environmental content in the Young Children's Participation and Environment Measure.

PubMed

Khetani, Mary A

2015-02-01

To evaluate the concurrent validity of the environment content in the newly developed Young Children's Participation and Environment Measure (YC-PEM). Cross-sectional study. Data were collected online. Convenience and snowball sampling methods were used to survey caregivers of children (N=381; 85 children with developmental disabilities and delays and 296 children without developmental disabilities and delays) aged 0 and 5 years (mean age, 36.49±20.18 mo). Not applicable. The YC-PEM includes an assessment of the effect of environment on children's participation for 3 settings: home, daycare/preschool, and community. Pearson and Spearman correlational analyses were used to examine the concurrent validity of the YC-PEM environmental content according to a criterion measure, the Craig Hospital Inventory of Environmental Factors-Child and Parent Version (CHIEF-CP). The YC-PEM and the CHIEF-CP items were first mapped to the International Classification of Functioning, Disability, and Health-Children and Youth Version to identify items for pairwise comparison. We found small to moderate negative associations for 51 of 66 pairwise comparisons involving CHIEF-CP and YC-PEM environment items (r=-.13 to -.39; P<.01). Significant associations were found for items in all 5 International Classification of Functioning, Disability and Health-Children and Youth Version environmental domains. Results lend further support for the use of the YC-PEM for valid caregiver assessment of the physical, social, attitudinal, and institutional features of environments in terms of their effect on young children's participation within the home, daycare/preschool, and community settings. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of the Chinese version of Meaning in Life Scale for cancer patients and psychometric evaluation.

PubMed

Xia, Hao-Zhi; Gao, Lei; Wang, Yang; Song, Hui; Shi, Bao-Xin

2017-11-01

To develop a Meaning in Life Scale for cancer patients in Chinese version and to test the validity and reliability. Meaning in life is a protective factor of psychological well-being and is negatively related to depression and demoralisation among cancer patients. The existing scales measuring meaning in life are mostly designed in English and there is no scale designed for Chinese cancer patients based on Chinese cultural background. Process of instrument development and psychometric evaluation were used. Items were generated from literature review and a focus group interview. Delphi technique was used to test the content validity. Item analysis and exploratory factor analysis were performed with data from 251 cancer patients. The internal consistency of the scale was tested by Cronbach's alpha. A 25-item Meaning in Life Scale in Chinese version with five domains was developed. The five factors explained 62·686% of the variance. The Cronbach's alpha for the total scale was 0·897. The Meaning in Life Scale in Chinese version has acceptable internal consistency reliability and good content validity and acceptable construct validity. The content of the scale reflected the attitudes of cancer patients towards meaning in life based on Chinese cultural background. The Chinese version of Meaning in Life Scale for Cancer Patients appears to be a new scale to assess meaning in life among Chinese cancer patients exactly and the concept of meaning in life presented in this scale provides new ideas of meaning intervention in routine clinical practice. © 2016 John Wiley & Sons Ltd.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions.

PubMed

Damschroder, Laura J; Goodrich, David E; Kim, Hyungjin Myra; Holleman, Robert; Gillon, Leah; Kirsh, Susan; Richardson, Caroline R; Lutes, Lesley D

2016-09-01

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Certification of the reference material of water content in water saturated 1-octanol by Karl Fischer coulometry, Karl Fischer volumetry and quantitative nuclear magnetic resonance.

PubMed

Wang, Haifeng; Ma, Kang; Zhang, Wei; Li, Jia; Sun, Guohua; Li, Hongmei

2012-10-15

Certified reference materials (CRMs) of water content are widely used in the calibration and validation of Karl Fischer coulometry and volumetry. In this study, the water content of the water saturated 1-octanol (WSO) CRM was certified by Karl Fischer coulometry, volumetry and quantitative nuclear magnetic resonance (Q NMR). The water content recovery by coulometry was 99.76% with a diaphragm-less electrode and Coulomat AG anolyte. The relative bias between the coulometry and volumetry results was 0.06%. In Q NMR, the water content of WSO is traceable to the International System (SI) of units through the purity of internal standard. The relative bias of water content in WSO between Q NMR and volumetry was 0.50%. The consistency of results for these three independent methods improves the accuracy of the certification of the RM. The certified water content of the WSO CRM was 4.76% with an expanded uncertainty of 0.09%. Copyright © 2012 Elsevier Ltd. All rights reserved.

Translation, validity, and reliability of a persian version of the iowa tinnitus handicap questionnaire.

PubMed

Arian Nahad, Homa; Rouzbahani, Masomeh; Jarollahi, Farnoush; Jalaie, Shohreh; Pourbakht, Akram; Mokrian, Helnaz; Mahdi, Parvane; Amali, Amin; Nodin Zadeh, Abdolmajid

2014-04-01

Tinnitus is a common otologic symptom that can seriously affect a patient's quality of life. The purpose of the present study was to translate and validate the Iowa Tinnitus Handicap Questionnaire (THQ) into the Persian language, and to make it applicable as a tool for determining the effects of tinnitus on a patient's life. The main version of the THQ was translated into the Persian language. The agreed Persian version was administered to 150 tinnitus patients. The validity of the Persian THQ was evaluated and internal reliability was confirmed using Cronbach's α-coefficient. Finally, the effect of independent variables such as age, mean patient threshold, gender, and duration of tinnitus were considered in order to determine the psychometric properties of tinnitus. After an exact translation process, the Persian THQ was found to exhibit face validity. In terms of content validity, content validity index in total questionnaire was 0.93. Further, in structural validity measurements, intermediate correlation with annoyance from tinnitus (r=0.49), low correlation with duration of tinnitus (r=0.34) and high correlation with the Tinnitus Handicap Inventory (THI) questionnaire (r=0.84) were demonstrated. Additionally, a negligible effect of gender and age was noted on degree of tinnitus handicap (P= 0.754, P= 0.573, respectively). In the internal reliability assessment for Factors 1, 2, 3, and the whole questionnaire, Cronbach`s α-coefficient was 0.95, 0.92, 0.25 and 0.88, respectively. The Persian version of the Iowa THQ demonstrates high validity and reliability and can be used for the determination of tinnitus handicap and for following-up in the intervention process in Persian tinnitus patients.

Revision, Criterion Validity, and Multi-group Assessment of the Reactions to Homosexuality Scale

PubMed Central

Smolenski, Derek J.; Diamond, Pamela M.; Ross, Michael W.; Simon Rosser, B. R.

2010-01-01

Internalized homonegativity encompasses negative attitudes toward one’s own sexual orientation, and is associated with negative mental and physical health outcomes. The Reactions to Homosexuality scale (Ross & Rosser, 1996), an instrument used to measure internalized homonegativity, has been criticized for including content irrelevant to the construct of internalized homonegativity. We revised the scale using exploratory and confirmatory factor analyses, and identified a seven-item, three-factor reduced version that demonstrated measurement invariance across racial/ethnic categorizations and between English and Spanish versions. We also investigated criterion validity by estimating correlations with hypothesized outcomes associated with outness, relationship status, sexual orientation, and gay community affiliation. The evidence of measurement invariance suggests that this scale is appropriate for pluralistic treatment or study groups. PMID:20954058

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

PubMed

Mokkink, Lidwine B; Terwee, Caroline B; Patrick, Donald L; Alonso, Jordi; Stratford, Paul W; Knol, Dirk L; Bouter, Lex M; de Vet, Henrica C W

2010-05-01

Aim of the COSMIN study (COnsensus-based Standards for the selection of health status Measurement INstruments) was to develop a consensus-based checklist to evaluate the methodological quality of studies on measurement properties. We present the COSMIN checklist and the agreement of the panel on the items of the checklist. A four-round Delphi study was performed with international experts (psychologists, epidemiologists, statisticians and clinicians). Of the 91 invited experts, 57 agreed to participate (63%). Panel members were asked to rate their (dis)agreement with each proposal on a five-point scale. Consensus was considered to be reached when at least 67% of the panel members indicated 'agree' or 'strongly agree'. Consensus was reached on the inclusion of the following measurement properties: internal consistency, reliability, measurement error, content validity (including face validity), construct validity (including structural validity, hypotheses testing and cross-cultural validity), criterion validity, responsiveness, and interpretability. The latter was not considered a measurement property. The panel also reached consensus on how these properties should be assessed. The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational purposes.

Critical thinking evaluation in reflective writing: Development and testing of Carter Assessment of Critical Thinking in Midwifery (Reflection).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-11-01

develop and test a tool designed for use by academics to evaluate pre-registration midwifery students' critical thinking skills in reflective writing. a descriptive cohort design was used. a random sample (n = 100) of archived student reflective writings based on a clinical event or experience during 2014 and 2015. a staged model for tool development was used to develop a fifteen item scale involving item generation; mapping of draft items to critical thinking concepts and expert review to test content validity; inter-rater reliability testing; pilot testing of the tool on 100 reflective writings; and psychometric testing. Item scores were analysed for mean, range and standard deviation. Internal reliability, content and construct validity were assessed. expert review of the tool revealed a high content validity index score of 0.98. Using two independent raters to establish inter-rater reliability, good absolute agreement of 72% was achieved with a Kappa coefficient K = 0.43 (p<0.0001). Construct validity via exploratory factor analysis revealed three factors: analyses context, reasoned inquiry, and self-evaluation. The mean total score for the tool was 50.48 (SD = 12.86). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of .93. this study establishedthe reliability and validity of the CACTiM (reflection) for use by academics to evaluate midwifery students' critical thinking in reflective writing. Validation with large diverse samples is warranted. reflective practice is a key learning and teaching strategy in undergraduate Bachelor of Midwifery programmes and essential for safe, competent practice. There is the potential to enhance critical thinking development by assessingreflective writing with the CACTiM (reflection) tool to provide formative and summative feedback to students and inform teaching strategies. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Development and initial validation of an endoscopic part-task training box.

PubMed

Thompson, Christopher C; Jirapinyo, Pichamol; Kumar, Nitin; Ou, Amy; Camacho, Andrew; Lengyel, Balazs; Ryan, Michele B

2014-09-01

There is currently no objective and validated methodology available to assess the progress of endoscopy trainees or to determine when technical competence has been achieved. The aims of the current study were to develop an endoscopic part-task simulator and to assess scoring system validity. Fundamental endoscopic skills were determined via kinematic analysis, literature review, and expert interviews. Simulator prototypes and scoring systems were developed to reflect these skills. Validity evidence for content, internal structure, and response process was evaluated. The final training box consisted of five modules (knob control, torque, retroflexion, polypectomy, and navigation and loop reduction). A total of 5 minutes were permitted per module with extra points for early completion. Content validity index (CVI)-realism was 0.88, CVI-relevance was 1.00, and CVI-representativeness was 0.88, giving a composite CVI of 0.92. Overall, 82 % of participants considered the simulator to be capable of differentiating between ability levels, and 93 % thought the simulator should be used to assess ability prior to performing procedures in patients. Inter-item assessment revealed correlations from 0.67 to 0.93, suggesting that tasks were sufficiently correlated to assess the same underlying construct, with each task remaining independent. Each module represented 16.0 % - 26.1 % of the total score, suggesting that no module contributed disproportionately to the composite score. Average box scores were 272.6 and 284.4 (P = 0.94) when performed sequentially, and average score for all participants with proctor 1 was 297.6 and 308.1 with proctor 2 (P = 0.94), suggesting reproducibility and minimal error associated with test administration. A part-task training box and scoring system were developed to assess fundamental endoscopic skills, and validity evidence regarding content, internal structure, and response process was demonstrated. © Georg Thieme Verlag KG Stuttgart · New York.

Development and validation of the Geriatric In-hospital Nursing Care Questionnaire.

PubMed

Persoon, Anke; Bakker, Franka C; van der Wal-Huisman, Hanneke; Olde Rikkert, Marcel G M

2015-02-01

To develop a questionnaire, the Geriatric In-hospital Nursing Care Questionnaire (GerINCQ), to measure, in an integrated way, the care that older adults receive in the hospital and nurses' attitudes toward and perceptions about caring for older adults. Questionnaire development. Twelve university and teaching hospitals. Thirteen experienced geriatric nurses and three geriatricians from 12 hospitals evaluated an initial version of the questionnaire. Two hundred seventy-one nurses, primarily registered nurses from 11 geriatric, medical, and surgical departments in six hospitals, validated the final questionnaire. Items from two published instruments were extracted for use in the questionnaire. Content validity was confirmed using the Delphi technique with an expert panel. Internal consistency was measured by calculating Cronbach alpha; intrarater reliability was measured using test-retest correlations and intraclass correlation coefficients (ICCs); differences between hospital departments were analyzed using analysis of variance. Sensitivity to detect before-and-after changes with implementation of a geriatric care program was determined using the Student t-test. Consensus was reached after three Delphi rounds. The GerINCQ is a self-administered questionnaire to be filled out by hospital nurses that comprises five subscales with 67 items. It has good content validity (each item content validity index >0.9) and good internal consistency (Cronbach alpha = 0.86). Intrarater reliability revealed high test-retest results (ICC = 0.87). The questionnaire detected significant differences between nurses in three types of hospital departments (medical, surgical, and geriatric (P < .01). The GerINCQ was sensitive to changes after an educational program (P < .02) and had a large effect size (0.5). The GerINCQ is a reliable and valid tool and is sensitive to change over time. It is clinically relevant because it provides a quantitative measure of hospital nurses' geriatric practices, attitudes, and perceptions. Moreover, the GerINCQ is suitable for monitoring progress after implementation of geriatric improvement programs. © 2015, Copyright the Authors Journal compilation © 2015, The American Geriatrics Society.

Developing an instrument to measure effective factors on Clinical Learning.

PubMed

Dadgaran, Ideh; Shirazi, Mandana; Mohammadi, Aeen; Ravari, Ali

2016-07-01

Although nursing students spend a large part of their learning period in the clinical environment, clinical learning has not been perceived by its nature yet. To develop an instrument to measure effective factors on clinical learning in nursing students. This is a mixed methods study performed in 2 steps. First, the researchers defined "clinical learning" in nursing students through qualitative content analysis and designed items of the questionnaire based on semi-structured individual interviews with nursing students. Then, as the second step, psychometric properties of the questionnaire were evaluated using the face validity, content validity, construct validity, and internal consistency evaluated on 227 students from fourth or higher semesters. All the interviews were recorded and transcribed, and then, they were analyzed using Max Qualitative Data Analysis and all of qualitative data were analyzed using SPSS 14. To do the study, we constructed the preliminary questionnaire containing 102 expressions. After determination of face and content validities by qualitative and quantitative approaches, the expressions of the questionnaire were reduced to 45. To determine the construct validity, exploratory factor analysis was applied. The results indicated that the maximum variance percentage (40.55%) was defined by the first 3 factors while the rest of the total variance percentage (59.45%) was determined by the other 42 factors. Results of exploratory factor analysis of this questionnaire indicated the presence of 3 instructor-staff, students, and educational related factors. Finally, 41 expressions were kept in 3 factor groups. The α-Cronbach coefficient (0.93) confirmed the high internal consistency of the questionnaire. Results indicated that the prepared questionnaire was an efficient instrument in the study of the effective factors on clinical learning as viewed by nursing students since it involves 41 expressions and properties such as instrument design based on perception and experiences of the nursing students about effective factors on clinical learning, definition of facilitator and preventive factors of the clinical learning, simple scoring, suitable validity and reliability, and applicability in different occasions.

Development of a self-report questionnaire designed for population-based surveillance of gingivitis in adolescents: assessment of content validity and reliability.

PubMed

Quiroz, Viviana; Reinero, Daniela; Hernández, Patricia; Contreras, Johanna; Vernal, Rolando; Carvajal, Paola

2017-01-01

This study aimed to develop and assess the content validity and reliability of a cognitively adapted self-report questionnaire designed for surveillance of gingivitis in adolescents. Ten predetermined self-report questions evaluating early signs and symptoms of gingivitis were preliminary assessed by a panel of clinical experts. Eight questions were selected and cognitively tested in 20 adolescents aged 12 to 18 years from Santiago de Chile. The questionnaire was then conducted and answered by 178 Chilean adolescents. Internal consistency was measured using the Cronbach's alpha and temporal stability was calculated using the Kappa-index. A reliable final self-report questionnaire consisting of 5 questions was obtained, with a total Cronbach's alpha of 0.73 and a Kappa-index ranging from 0.41 to 0.77 between the different questions. The proposed questionnaire is reliable, with an acceptable internal consistency and a temporal stability from moderate to substantial, and it is promising for estimating the prevalence of gingivitis in adolescents.

Validating an Agency-based Tool for Measuring Women's Empowerment in a Complex Public Health Trial in Rural Nepal.

PubMed

Gram, Lu; Morrison, Joanna; Sharma, Neha; Shrestha, Bhim; Manandhar, Dharma; Costello, Anthony; Saville, Naomi; Skordis-Worrall, Jolene

2017-01-02

Despite the rising popularity of indicators of women's empowerment in global development programmes, little work has been done on the validity of existing measures of such a complex concept. We present a mixed methods validation of the use of the Relative Autonomy Index for measuring Amartya Sen's notion of agency freedom in rural Nepal. Analysis of think-aloud interviews ( n  = 7) indicated adequate respondent understanding of questionnaire items, but multiple problems of interpretation including difficulties with the four-point Likert scale, questionnaire item ambiguity and difficulties with translation. Exploratory Factor Analysis of a calibration sample ( n  = 511) suggested two positively correlated factors ( r  = 0.64) loading on internally and externally motivated behaviour. Both factors increased with decreasing education and decision-making power on large expenditures and food preparation. Confirmatory Factor Analysis on a validation sample ( n  = 509) revealed good fit (Root Mean Square Error of Approximation 0.05-0.08, Comparative Fit Index 0.91-0.99). In conclusion, we caution against uncritical use of agency-based quantification of women's empowerment. While qualitative and quantitative analysis revealed overall satisfactory construct and content validity, the positive correlation between external and internal motivations suggests the existence of adaptive preferences. High scores on internally motivated behaviour may reflect internalized oppression rather than agency freedom.

Validating an Agency-based Tool for Measuring Women’s Empowerment in a Complex Public Health Trial in Rural Nepal

PubMed Central

Gram, Lu; Morrison, Joanna; Sharma, Neha; Shrestha, Bhim; Manandhar, Dharma; Costello, Anthony; Saville, Naomi; Skordis-Worrall, Jolene

2017-01-01

Abstract Despite the rising popularity of indicators of women’s empowerment in global development programmes, little work has been done on the validity of existing measures of such a complex concept. We present a mixed methods validation of the use of the Relative Autonomy Index for measuring Amartya Sen’s notion of agency freedom in rural Nepal. Analysis of think-aloud interviews (n = 7) indicated adequate respondent understanding of questionnaire items, but multiple problems of interpretation including difficulties with the four-point Likert scale, questionnaire item ambiguity and difficulties with translation. Exploratory Factor Analysis of a calibration sample (n = 511) suggested two positively correlated factors (r = 0.64) loading on internally and externally motivated behaviour. Both factors increased with decreasing education and decision-making power on large expenditures and food preparation. Confirmatory Factor Analysis on a validation sample (n = 509) revealed good fit (Root Mean Square Error of Approximation 0.05–0.08, Comparative Fit Index 0.91–0.99). In conclusion, we caution against uncritical use of agency-based quantification of women’s empowerment. While qualitative and quantitative analysis revealed overall satisfactory construct and content validity, the positive correlation between external and internal motivations suggests the existence of adaptive preferences. High scores on internally motivated behaviour may reflect internalized oppression rather than agency freedom. PMID:28303173

Cross-cultural adaptation and validation of the Japanese version of the new Knee Society Scoring System for osteoarthritic knee with total knee arthroplasty.

PubMed

Hamamoto, Yosuke; Ito, Hiromu; Furu, Moritoshi; Ishikawa, Masahiro; Azukizawa, Masayuki; Kuriyama, Shinichi; Nakamura, Shinichiro; Matsuda, Shuichi

2015-09-01

The purposes of this study were to translate the new Knee Society Score (KSS) into Japanese and to evaluate the construct and content validity, test-retest reliability, and internal consistency of the Japanese version of the new KSS. The Japanese version of the KSS was developed according to cross-cultural guidelines by using the "translation-back translation" method to ensure content validity. KSS data were then obtained from patients who had undergone total knee arthroplasty (TKA). The psychometric properties evaluated were as follows: for feasibility, response rate, and floor and ceiling effects; for construct validity, internal consistency using Cronbach's alpha, and correlations with quality of life. Construct validity was evaluated by using Spearman's correlation coefficient to quantify the correlation between the KSS and the Japanese version of the Oxford 12-item Knee Score or Short Form 36 Health Survey (SF-36) questionnaires. The Japanese version of the KSS was sent to 93 consecutive osteoarthritic patients who underwent primary TKA in our institution. Fifty-five patients completed the questionnaires and were included in this study. Neither a floor nor ceiling effect was observed. The reliability proved excellent in the majority of domains, with intraclass correlation coefficients of 0.65-0.88. Internal consistency, assessed by Cronbach's alpha, was good to excellent for all domains (0.78-0.94). All of the four domains of the KSS correlated significantly with the Oxford 12-item Knee Score. The activity and satisfaction domains of the KSS correlated significantly with all and the majority of subscales of the SF-36, respectively, whereas symptoms and expectation domains showed significant correlations only with bodily pain and vitality subscales and with the physical function, bodily pain, and vitality subscales, respectively. The Japanese version of the new KSS is a valid, reliable, and responsive instrument to capture subjective aspects of the functional symptoms and abilities of patients who undergo TKA.

Adaptation of the osteoarthritis-specific quality of life scale (the OAQoL) for use in Germany, Hungary, Italy, Spain and Turkey.

PubMed

Wilburn, Jeanette; McKenna, Stephen P; Kutlay, Şehim; Bender, Tamas; Braun, Jürgen; Castillo-Gallego, Concepcion; Favero, Marta; Geher, Pal; Kiltz, Uta; Martin-Mola, Emilio; Ramonda, Roberta; Rouse, Matthew; Tennant, Alan; Küçükdeveci, Ayşe A

2017-05-01

The Osteoarthritis Quality of Life scale (OAQoL) is specific to individuals with osteoarthritis. The present study describes the adaptation of the OAQoL for use in the following five European languages: German, Hungarian, Italian, Spanish and Turkish. The study involved three stages in each language; translation, cognitive debriefing (face and content validity) and validation. The validation stage assessed internal consistency (Cronbach's alpha), reproducibility (test-retest reliability using Spearman's rank correlations), convergent and divergent validity (correlations with the Health Assessment Questionnaire, The Western Ontario and McMaster Universities Index of osteoarthritis and Nottingham Health Profile) and known group validity. The OAQoL was successfully translated into the target languages with minimal problems. Cognitive debriefing interviewees found the measures easy to complete and identified few problems with content. Internal consistency ranged from 0.94 to 0.97 and test-retest reliability (reproducibility) from 0.87 to 0.98. These values indicate that the new language versions produce very low levels of measurement error. Median OAQoL scores were higher for patients reporting a current flare of osteoarthritis in all countries. Scores were also related, as expected, to perceived severity of osteoarthritis. The OAQoL was successfully adapted for use in Germany, Hungary, Italy, Spain and Turkey. The addition of these new language versions will prove valuable to multinational clinical trials and to clinical practice in the respective countries.

Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information

PubMed Central

Shoemaker, Sarah J.; Wolf, Michael S.; Brach, Cindy

2016-01-01

Objective To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. Methods We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. Results The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K = 0.57) and strong agreement per Gwet’s AC1 (Average = 0.74). Internal consistency was strong (α = 0.71; Average Item-Total Correlation = 0.62). For construct validation with consumers (n = 47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p < 0.05) and ratings (8.9 vs. 7.7, p < 0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. Conclusions The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. Practice implications The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). PMID:24973195

Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information.

PubMed

Shoemaker, Sarah J; Wolf, Michael S; Brach, Cindy

2014-09-01

To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K=0.57) and strong agreement per Gwet's AC1 (Average=0.74). Internal consistency was strong (α=0.71; Average Item-Total Correlation=0.62). For construct validation with consumers (n=47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p<0.05) and ratings (8.9 vs. 7.7, p<0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Development of the insight scale for affective disorders (ISAD): modification from the scale to assess unawareness of mental disorder.

PubMed

Olaya, Beatriz; Marsà, Ferran; Ochoa, Susana; Balanzá-Martínez, Vicent; Barbeito, Sara; García-Portilla, Mari Paz; González-Pinto, Ana; Lobo, Antonio; López-Antón, Raúl; Usall, Judith; Arranz, Belén; Haro, Josep Maria

2012-12-15

Research on insight in patients with mood disorders has grown in recent years. Several instruments to assess insight have been used, but most of them have been specifically designed for psychosis and may not appear relevant to mood disorders. The aim of the present study is to develop a short, multidimensional, reliable and valid scale to measure insight in patients with mood disorders, based on the Amador's Scale to Assess Unawareness of Mental Disorders (SUMD). A Delphi method was used to facilitate expert participation and ensure face and content validity. The SUMD structure and items were used as a reference in the scale development. A new scale with 17 items was obtained. Internal consistency, test-retest and inter-rater reliability and validity were studied in a sample of 76 outpatients with a DSM-IV diagnosis of major depression or bipolar disorder (type I or II). Internal consistency of the general items was moderate, and high for the symptoms awareness subscale. Scores on ISAD correlated with other measures of insight and with some clinical measures, thus supporting its validity. The majority of the sample came from community services. Future studies should use inpatients or patients with severe symptoms to broaden the range of responses. Moreover, the rating of insight and other measures by the same clinician might introduce a methodological bias. The ISAD, with a multidimensional approach, appears as a short, reliable and valid measure of insight in mood disorders. Expert consensus ensures its face and content validity. Copyright © 2012 Elsevier B.V. All rights reserved.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Validity and Reliability of General Nutrition Knowledge Questionnaire for Adults in Uganda

PubMed Central

Bukenya, Richard; Ahmed, Abhiya; Andrade, Jeanette M.; Grigsby-Toussaint, Diana S.; Muyonga, John; Andrade, Juan E.

2017-01-01

This study sought to develop and validate a general nutrition knowledge questionnaire (GNKQ) for Ugandan adults. The initial draft consisted of 133 items on five constructs associated with nutrition knowledge; expert recommendations (16 items), food groups (70 items), selecting food (10 items), nutrition and disease relationship (23 items), and food fortification in Uganda (14 items). The questionnaire validity was evaluated in three studies. For the content validity (study 1), a panel of five content matter nutrition experts reviewed the GNKQ draft before and after face validity. For the face validity (study 2), head teachers and health workers (n = 27) completed the questionnaire before attending one of three focus groups to review the clarity of the items. For the construct and test-rest reliability (study 3), head teachers (n = 40) from private and public primary schools and nutrition (n = 52) and engineering (n = 49) students from Makerere University took the questionnaire twice (two weeks apart). Experts agreed (content validity index, CVI > 0.9; reliability, Gwet’s AC1 > 0.85) that all constructs were relevant to evaluate nutrition knowledge. After the focus groups, 29 items were identified as unclear, requiring major (n = 5) and minor (n = 24) reviews. The final questionnaire had acceptable internal consistency (Cronbach α > 0.95), test-retest reliability (r = 0.89), and differentiated (p < 0.001) nutrition knowledge scores between nutrition (67 ± 5) and engineering (39 ± 11) students. Only the construct on nutrition recommendations was unreliable (Cronbach α = 0.51, test-retest r = 0.55), which requires further optimization. The final questionnaire included topics on food groups (41 items), selecting food (2 items), nutrition and disease relationship (14 items), and food fortification in Uganda (22 items) and had good content, construct, and test-retest reliability to evaluate nutrition knowledge among Ugandan adults. PMID:28230779

DOE Office of Scientific and Technical Information (OSTI.GOV)

Winston, Philip Lon

Prior to performing an internal visual inspection, samples of the headspace gas of the GNS Castor V/21 cask were taken on June 12, 2014. These samples were taken in support of the CREIPI/Japanese nuclear industry effort to validate fuel integrity without visual inspection by measuring the 85Kr content of the cask headspace

Psychometric analyses and internal consistency of the PHEEM questionnaire to measure the clinical learning environment in the clerkship of a Medical School in Chile.

PubMed

Riquelme, Arnoldo; Herrera, Cristian; Aranis, Carolina; Oporto, Jorge; Padilla, Oslando

2009-06-01

The Spanish version of the Postgraduate Hospital Educational Environment Measure (PHEEM) was evaluated in this study to determine its psychometric properties, validity and internal consistency to measure the clinical learning environment in the hospital setting of Pontificia Universidad Católica de Chile Medical School's Internship. The 40-item PHEEM questionnaire was translated from English to Spanish and retranslated to English. Content validity was tested by a focus group and minor differences in meaning were adjusted. The PHEEM was administered to clerks in years 6 and 7. Construct validity was carried out using exploratory factor analysis followed by a Varimax rotation. Internal consistency was measured using Cronbach's alpha. A total of 125 out of 220 students responded to the PHEEM. The overall response rate was 56.8% and compliances with each item ranged from 99.2% to 100%. Analyses indicate that five factors instrument accounting for 58% of the variance and internal consistency of the 40-item questionnaire is 0.955 (Cronbach's alpha). The 40-item questionnaire had a mean score of 98.21 +/- 21.2 (maximum score of 160). The Spanish version of PHEEM is a multidimensional, valid and highly reliable instrument measuring the educational environment among undergraduate medical students working in hospital-based clerkships.

[Psychometric Characteristics of the Clinical Nursing Mentors' Behavior Scale].

PubMed

Zhao, Rong; Chen, Yan-Hua; Yu, Hui-Ting; Xiao, Lu; Wen, Jing; Yeh, Tzu-Pei

2017-08-01

The behavior of mentors impacts the quality and experience of nursing students who are studying in clinical placement. Accurately assessing the behavior of mentors is fundamental to training, regulating, guiding, and improving their behavior and quality of teaching. To test the validity and reliability of the Clinical Nursing Mentors' Behavior Scale (CNMBS) among mentors. This study included three stages. During the first stage, seven Chinese experts were invited to evaluate content validity. During the second stage, the test-retest reliability was examined with 63 mentors. During the third stage, a cross-sectional study was conducted. Seven hundred and sixty-six nursing mentors from five hospitals in Beijing, Shenzhen, and Sichuan completed the survey either online or in hard copy form. The data collected from the questionnaire were analyzed using item analysis, construct validity, internal consistency and discriminant validity, with the results used to determine the psychometric characteristics of the CNMBS. The content validity index for the CNMBS was .91. The intra-class correlation coefficient was .89; the range of the item discrimination critical ratio was 9.42-22.43 (p < .001), and the item-total correlation was .35- .70 (p < .001). The three factors of "guiding personal growth", "promoting professional development", and "providing psychosocial support" and a total of 23 items were identified, with item factor loadings ranging from .51 to .79. The three factors explained 50.99% of total variance. The internal consistency of the CNMBS earned a Cronbach's α coefficient of .92, while those of the three subscales were .89, .86 and .75, respectively. The Clinical Nursing Mentors' Behavior Scale demonstrated high validity and reliability, supporting the CNMBS as a valid tool for assessing the teaching behavior of mentors.

Development of an instrument based on the protection motivation theory to measure factors influencing women's intention to first pap test practice.

PubMed

Hassani, Lale; Dehdari, Tahereh; Hajizadeh, Ebrahim; Shojaeizadeh, Davoud; Abedini, Mehrandokht; Nedjat, Saharnaz

2014-01-01

Given that there are many Iranian women who have never had a Pap smear, this study was designed to develop and validate a measurement tool based on the Protection Motivation Theory to assess factors influencing the Iranian women's intention to perform first Pap testing. In this psychometric research, to determine the Content Validity Index (CVI) and the Content Validity Ratio (CVR), a panel of experts (n=10) reviewed scale items. Reliability was estimated through the Intraclass Correlation Coefficient (n=30) and internal consistency (n=240). Also, factor analysis (exploratory and conformity) was performed on the data of the sample women who had never had a Pap smear test (n=240). A 26-item questionnaire was developed. The CVI and CVR scores of the scale were 0.89 and 0.90, respectively. Exploratory factor analysis loaded a 26-item with seven factors questionnaire (perceived vulnerability and severity, fear, response costs, response efficacy, self-efficacy, and protection motivation (or intention)) that jointly accounted for 72.76% of the observed variance. Confirmatory factor analysis indicated a good fit for the data. Internal consistency (range 0.70-0.93) and test-retest reliability (range 0.72-0.96) of sub-scales were acceptable. This study showed that the designed instrument was a valid and reliable tool for measuring the factors influencing the women's intention to perform their first Pap testing.

Reliability and validity of the Turkish version of the situational self-efficacy scale for fruit and vegetable consumption in adolescents.

PubMed

Kadioglu, Hasibe; Erol, Saime; Ergun, Ayse

2015-01-01

The purpose of this research was to examine the psychometric properties of the Turkish version of the situational self-efficacy scale for vegetable and fruit consumption in adolescents. This was a methodological study. The study was conducted in four public secondary schools in Istanbul, Turkey. Subjects were 1586 adolescents. Content and construct validity were assessed to test the validity of the scale. The reliability was assessed in terms of internal consistency and test-retest reliability. For confirmatory factor analysis, χ(2) statistics plus other fit indices were used, including the goodness-of-fit index, the adjusted goodness-of-fit index, the nonnormed fit index, the comparative fit index, the standardized root mean residual, and the root mean square error of approximation. Pearson's correlation was used for test-retest reliability and item total correlation. The internal consistency was assessed by using Cronbach α. Confirmatory factor analysis strongly supported the three-component structure representing positive social situations (α = .81), negative effect situations (α = .93), and difficult situations (α = .78). Psychometric analyses of the Turkish version of the situational self-efficacy scale indicate high reliability and good content and construct validity. Researchers and health professionals will find it useful to employ the Turkish situational self-efficacy scale in evaluating situational self-efficacy for fruit and vegetable consumption in Turkish adolescents.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

Life-Space Assessment questionnaire: Novel measurement properties for Brazilian community-dwelling older adults.

PubMed

Simões, Maria do Socorro Mp; Garcia, Isabel Ff; Costa, Lucíola da Cm; Lunardi, Adriana C

2018-05-01

The Life-Space Assessment (LSA) assesses mobility from the spaces that older adults go, and how often and how independent they move. Despite its increased use, LSA measurement properties remain unclear. The aim of the present study was to analyze the content validity, reliability, construct validity and interpretability of the LSA for Brazilian community-dwelling older adults. In this clinimetric study we analyzed the measurement properties (content validity, reliability, construct validity and interpretability) of the LSA administered to 80 Brazilian community-dwelling older adults. Reliability was analyzed by Cronbach's alpha (internal consistency), intraclass correlation coefficients and 95% confidence interval (reproducibility), and standard error of measurement (measurement error). Construct validity was analyzed by Pearson's correlations between the LSA and accelerometry (time in inactivity and moderate-to-vigorous activities), and interpretability was analyzed by determination of the minimal detectable change, and floor and ceiling effects. The LSA met the criteria for content validity. The Cronbach's alpha was 0.92, intraclass correlation coefficient was 0.97 (95% confidence interval 0.95-0.98) and standard error of measurement was 4.12. The LSA showed convergence with accelerometry (negative correlation with time in inactivity and positive correlation with time in moderate to vigorous activities), the minimal detectable change was 0.36 and we observed no floor or ceiling effects. The LSA showed adequate reliability, validity and interpretability for life-space mobility assessment of Brazilian community-dwelling older adults. Geriatr Gerontol Int 2018; 18: 783-789. © 2018 Japan Geriatrics Society.

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL): reliability and validity.

PubMed

Devoogdt, Nele; De Groef, An; Hendrickx, Ad; Damstra, Robert; Christiaansen, Anke; Geraerts, Inge; Vervloesem, Nele; Vergote, Ignace; Van Kampen, Marijke

2014-05-01

Patients may develop primary (congenital) or secondary (acquired) lymphedema, causing significant physical and psychosocial problems. To plan treatment for lymphedema and monitor a patient's progress, swelling, and problems in functioning associated with lymphedema development should be assessed at baseline and follow-up. The purpose of this study was to investigate the reliability (test-retest, internal consistency, and measurement variability) and validity (content and construct) of data obtained with the Lymphoedema Functioning, Disability and Health Questionnaire for Lower Limb Lymphoedema (Lymph-ICF-LL). This was a multicenter, cross-sectional study. The Lymph-ICF-LL is a descriptive, evaluative tool containing 28 questions about impairments in function, activity limitations, and participation restrictions in patients with lower limb lymphedema. The questionnaire has 5 domains: physical function, mental function, general tasks/household activities, mobility activities, and life domains/social life. The reliability and validity of the Lymph-ICF-LL were examined in 30 participants with objective lower limb lymphedema. Intraclass correlation coefficients for test-retest reliability ranged from .69 to .94, and Cronbach alpha coefficients for internal consistency ranged from .82 to .97. Measurement variability was acceptable (standard error of measurement=5.9-12.6). Content validity was good because all questions were understandable for 93% of participants, the scoring system (visual analog scale) was clear, and the questionnaire was comprehensive for 90% of participants. Construct validity was good. All hypotheses for assessing convergent validity and divergent validity were accepted. The known-groups validity and responsiveness of the Dutch Lymph-ICF-LL and the cross-cultural validity of the English version of the Lymph-ICF-LL were not investigated. The Lymph-ICF-LL is a Dutch questionnaire with evidence of reliability and validity for assessing impairments in function, activity limitations, and participation restrictions in people with primary or secondary lower limb lymphedema.

Psychometric Validation of the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT®) Questionnaire: Results of the SYMPHONY Trial.

PubMed

Chin, Kelly M; Gomberg-Maitland, Mardi; Channick, Richard N; Cuttica, Michael J; Fischer, Aryeh; Frantz, Robert P; Hunsche, Elke; Kleinman, Leah; McConnell, John W; McLaughlin, Vallerie V; Miller, Chad E; Zamanian, Roham T; Zastrow, Michael S; Badesch, David B

2018-04-26

Disease-specific patient-reported outcome (PRO) instruments are important in assessing the impact of disease and treatment. PAH-SYMPACT ® is the first questionnaire for quantifying pulmonary arterial hypertension (PAH) symptoms and impacts developed following the 2009 FDA PRO guidance; previous qualitative research with PAH patients supported its initial content validity. Content finalization and psychometric validation were conducted using data from SYMPHONY, a single-arm, 16-week study with macitentan 10mg in US patients with PAH. Item performance, Rasch, and factor analyses were used to select final item content of the PRO and define its domain structure. Internal consistency, test-retest reliability, known-group and construct validity, sensitivity to change, and influence of oxygen on item performance were evaluated. Data from 278 patients (79% female, mean age 60 years) were analyzed. Following removal of redundant/misfitting items, the final questionnaire has 11 symptom items across 2 domains (cardiopulmonary and cardiovascular symptoms) and 11 impact items across 2 domains (physical and cognitive/emotional impacts). Differential item function analysis confirmed PRO scoring is unaffected by oxygen use. For all 4 domains, internal consistency reliability was high (Cronbach's alpha >0.80) and scores were highly reproducible in stable patients (intra-class correlation coefficient 0.84-0.94). Correlations with CAMPHOR and SF-36 were moderate-to-high ([r]=0.34-0.80). The questionnaire differentiated well between patients with different disease severity levels, and was sensitive to improvements in clinician- and patient-reported disease severity. The PAH-SYMPACT ® is a brief, disease-specific PRO instrument possessing good psychometric properties which can be administered in clinical practice and clinical studies. Copyright © 2018. Published by Elsevier Inc.

myTREEHOUSE Self-Concept Assessment: preliminary psychometric analysis of a new self-concept assessment for children with cerebral palsy.

PubMed

Cheong, Sau Kuan; Lang, Cathryne P; Hemphill, Sheryl A; Johnston, Leanne M

2017-06-01

To evaluate the preliminary validity and reliability of the myTREEHOUSE Self-Concept Assessment for children with cerebral palsy (CP) aged 8 to 12 years. The myTREEHOUSE Self-Concept Assessment includes 26 items divided into eight domains, assessed across three Performance Perspectives (Personal, Social, and Perceived) and an additional Importance Rating. Face and content validity was assessed by semi-structured interviews with seven expert professionals regarding the assessment construct, content, and clinical utility. Reliability was assessed with 50 children aged 8 to 12 years with CP (29 males, 21 females; mean age 10y 2mo; Gross Motor Function Classification System [GMFCS] level I=35, II=8, III=5, IV=1; mean Wechsler Intelligence Scale for Children - Fourth Edition [WISC-IV]=104), whose data was used to calculate internal consistency of the scale, and a subset of 35 children (20 males, 15 females; mean age 10y 5mo; GMFCS level I=26, II=4, III=4, IV=1; mean WISC-IV=103) who participated in test-retest reliability within 14 to 28 days. Face and content validity was supported by positive expert feedback, with only minor adjustments suggested to clarify the wording of some items. After these amendments, strong internal consistency (Cronbach's α 0.84-0.91) and moderate to good test-retest reliability (intraclass correlation coefficient 0.64-0.75) was found for each component. The myTREEHOUSE Self-Concept Assessment is a valid and reliable assessment of self-concept for children with CP aged 8 to 12 years. © 2017 Mac Keith Press.

Measuring the impact of burn scarring on health-related quality of life: Development and preliminary content validation of the Brisbane Burn Scar Impact Profile (BBSIP) for children and adults.

PubMed

Tyack, Zephanie; Ziviani, Jenny; Kimble, Roy; Plaza, Anita; Jones, Amber; Cuttle, Leila; Simons, Megan

2015-11-01

No burn-scar specific, health-related quality of life (HRQOL) measure exists. This study aimed to develop a patient-reported, evaluative HRQOL measure to assess the impact of burn scarring in children and adults. Semi-structured interviews, content validation surveys, and cognitive interviews were used to develop and test content validity of a new measure - the Brisbane Burn Scar Impact Profile (BBSIP). Participants comprised Australian adults (n=23) and children (n=19) with burn scarring; caregivers of children with burn scarring (n=28); and international scar management experts (n=14). Items distinct from other burn scar measures emerged. Four versions of the BBSIP were developed; one for children aged 8-18 years, one for adults, one for caregivers (as proxies for children aged less than 8-years), and one for caregivers of children aged 8-18 years. Preliminary content validity of the BBSIP was supported. Final items covered physical and sensory symptoms; emotional reactions; impact on social functioning and daily activities; impact of treatment; and environmental factors. The BBSIP was developed to assess burn-scar specific HRQOL and will be available at http://www.coolburns.com.au under a creative commons license. Further testing is underway. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.

Can we use social media to support content validity of patient-reported outcome instruments in medical product development?

PubMed

Rothman, Margaret; Gnanaskathy, Ari; Wicks, Paul; Papadopoulos, Elektra J

2015-01-01

We report a panel designed to open a dialog between pharmaceutical sponsors, regulatory reviewers, and other stakeholders regarding the use of social media to collect data to support the content validity of patient-reported outcome instruments in the context of medical product labeling. Multiple stakeholder perspectives were brought together to better understand the issues encountered in pursuing social media as a form of data collection to support content validity. Presenters represented a pharmaceutical sponsor of clinical trials, a regulatory reviewer from the Food and Drug Administration, and an online data platform provider. Each presenter shared its perspective on the advantages and disadvantages of using social media to collect this type of information. There was consensus that there is great potential for using social media for this purpose. There remain, however, unanswered questions that need to be addressed such as identifying which type of social media is most appropriate for data collection and ensuring that participants are representative of the target population while maintaining the advantages of anonymity provided by online platforms. The use of social media to collect evidence of content validity holds much promise. Clarification of issues that need to be addressed and accumulation of empirical evidence to address these questions are essential to moving forward. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Psychometric Evaluation of the Revised Michigan Diabetes Knowledge Test (V.2016) in Arabic: Translation and Validation

PubMed Central

Alhaiti, Ali Hassan; Alotaibi, Alanod Raffa; Jones, Linda Katherine; DaCosta, Cliff

2016-01-01

Objective. To translate the revised Michigan Diabetes Knowledge Test into the Arabic language and examine its psychometric properties. Setting. Of the 139 participants recruited through King Fahad Medical City in Riyadh, Saudi Arabia, 34 agreed to the second-round sample for retesting purposes. Methods. The translation process followed the World Health Organization's guidelines for the translation and adaptation of instruments. All translations were examined for their validity and reliability. Results. The translation process revealed excellent results throughout all stages. The Arabic version received 0.75 for internal consistency via Cronbach's alpha test and excellent outcomes in terms of the test-retest reliability of the instrument with a mean of 0.90 infraclass correlation coefficient. It also received positive content validity index scores. The item-level content validity index for all instrument scales fell between 0.83 and 1 with a mean scale-level index of 0.96. Conclusion. The Arabic version is proven to be a reliable and valid measure of patient's knowledge that is ready to be used in clinical practices. PMID:27995149

Determination of Ethanol in Kombucha Products: Single-Laboratory Validation, First Action 2016.12.

PubMed

Ebersole, Blake; Liu, Ying; Schmidt, Rich; Eckert, Matt; Brown, Paula N

2017-05-01

Kombucha is a fermented nonalcoholic beverage that has drawn government attention due to the possible presence of excess ethanol (≥0.5% alcohol by volume; ABV). A validated method that provides better precision and accuracy for measuring ethanol levels in kombucha is urgently needed by the kombucha industry. The current study validated a method for determining ethanol content in commercial kombucha products. The ethanol content in kombucha was measured using headspace GC with flame ionization detection. An ethanol standard curve ranging from 0.05 to 5.09% ABV was used, with correlation coefficients greater than 99.9%. The method detection limit was 0.003% ABV and the LOQ was 0.01% ABV. The RSDr ranged from 1.62 to 2.21% and the Horwitz ratio ranged from 0.4 to 0.6. The average accuracy of the method was 98.2%. This method was validated following the guidelines for single-laboratory validation by AOAC INTERNATIONAL and meets the requirements set by AOAC SMPR 2016.001, "Standard Method Performance Requirements for Determination of Ethanol in Kombucha."

INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD): development and validation.

PubMed

Juneja, Monica; Mishra, Devendra; Russell, Paul S S; Gulati, Sheffali; Deshmukh, Vaishali; Tudu, Poma; Sagar, Rajesh; Silberberg, Donald; Bhutani, Vinod K; Pinto, Jennifer M; Durkin, Maureen; Pandey, Ravindra M; Nair, M K C; Arora, Narendra K

2014-05-01

To develop and validate INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD). Diagnostic test evaluation by cross sectional design. Four tertiary pediatric neurology centers in Delhi and Thiruvanthapuram, India. Children aged 2-9 years were enrolled in the study. INDT-ASD and Childhood Autism Rating Scale (CARS) were administered in a randomly decided sequence by trained psychologist, followed by an expert evaluation by DSM-IV TR diagnostic criteria (gold standard). Psychometric parameters of diagnostic accuracy, validity (construct, criterion and convergent) and internal consistency. 154 children (110 boys, mean age 64.2 mo) were enrolled. The overall diagnostic accuracy (AUC=0.97, 95% CI 0.93, 0.99; P<0.001) and validity (sensitivity 98%, specificity 95%, positive predictive value 91%, negative predictive value 99%) of INDT-ASD for Autism spectrum disorder were high, taking expert diagnosis using DSM-IV-TR as gold standard. The concordance rate between the INDT-ASD and expert diagnosis for 'ASD group' was 82.52% [Cohen's k=0.89; 95% CI (0.82, 0.97); P=0.001]. The internal consistency of INDT-ASD was 0.96. The convergent validity with CARS (r = 0.73, P= 0.001) and divergent validity with Binet-Kamat Test of intelligence (r = -0.37; P=0.004) were significantly high. INDT-ASD has a 4-factor structure explaining 85.3% of the variance. INDT-ASD has high diagnostic accuracy, adequate content validity, good internal consistency high criterion validity and high to moderate convergent validity and 4-factor construct validity for diagnosis of Autistm spectrum disorder.

Development and validation of the goal content for exercise questionnaire.

PubMed

Sebire, Simon J; Standage, Martyn; Vansteenkiste, Maarten

2008-08-01

Self-determination theory (SDT; Deci & Ryan, 2000) proposes that intrinsic, relative to extrinsic, goal content is a critical predictor of the quality of an individual's behavior and psychological well-being. Through three studies, we developed and psychometrically tested a measure of intrinsic and extrinsic goal content in the exercise context: the Goal Content for Exercise Questionnaire (GCEQ). In adults, exploratory (N = 354; Study 1) and confirmatory factor analyses (N = 312; Study 2) supported a 20-item solution consisting of 5 lower order factors (i.e., social affiliation, health management, skill development, image and social recognition) that could be subsumed within a 2-factor higher order structure (i.e., intrinsic and extrinsic). Evidence for external validity, temporal stability, gender invariance, and internal consistency of the GCEQ was found. An independent sample (N = 475; Study 3) provided further support for the lower order structure of the GCEQ and some support for the higher order structure. The GCEQ was supported as a measure of exercise-based goal content, which may help understand how intrinsic and extrinsic goals can motivate exercise behavior.

Validation studies of Karl Fisher reference method for moisture in cotton

USDA-ARS?s Scientific Manuscript database

With current international standard oven drying (SOD) techniques lacking precision and accuracy statements, a new standard reference method is needed. Volumetric Karl Fischer Titration (KFT) is a widely used measure of moisture content. The method is used in many ASTM methods, 14 NIST SRMs, and te...

Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

PubMed

Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

2016-12-11

The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

Development of the Mini-Assisting Hand Assessment: evidence for content and internal scale validity.

PubMed

Greaves, Susan; Imms, Christine; Dodd, Karen; Krumlinde-Sundholm, Lena

2013-11-01

To describe the development of the Mini-Assisting Hand Assessment (Mini-AHA) for children with signs of unilateral cerebral palsy (CP) aged 8 to 18 months, and evaluate aspects of content and internal scale validity. The ability of the video-recorded Mini-AHA play session to provoke bimanual performance in children with unilateral CP and typical development was evaluated. Original AHA test items were examined for their suitability for younger children and possible new items were generated. Data from 108 assessments of children with unilateral CP (86 children, 53 males, 33 females; mean age 13 mo, SD 3 mo, range 8-18 mo) were entered into a Rasch measurement model analysis to evaluate internal scale validity. A Spearman's correlation analysis explored the relationship between age and ability measures for children with unilateral CP. The frequency of maximum scores in 40 children with typical development (22 males, 18 females; mean age 12 mo, SD 3 mo) was examined. The Mini-AHA play session provoked bimanual responses in typically developing children 99% of the time. Person and item fit criteria established 20 items for the scale. The resultant unidimensional scale also demonstrated excellent discriminative features through high separation reliability. The item calibration values covered the range of person ability measures well. Age was not related to the ability measures for children with unilateral CP (rs =0.178). All children with typical development achieved maximum scores. Accumulated evidence shows that the Mini-AHA validly measures use of the affected hand during bimanual performance for children with unilateral CP aged 8 to 18 months. The Mini-AHA has the potential to be a useful assessment to evaluate functional hand use and the effects of intervention in an age group when potential for change is high. © 2013 Mac Keith Press.

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

Cross-cultural adaptation, validity, and reliability of the Parenting Styles and Dimensions Questionnaire - Short Version (PSDQ) for use in Brazil.

PubMed

Oliveira, Thaís D; Costa, Danielle de S; Albuquerque, Maicon R; Malloy-Diniz, Leandro F; Miranda, Débora M; de Paula, Jonas J

2018-06-11

The Parenting Styles and Dimensions Questionnaire (PSDQ) is used worldwide to assess three styles (authoritative, authoritarian, and permissive) and seven dimensions of parenting. In this study, we adapted the short version of the PSDQ for use in Brazil and investigated its validity and reliability. Participants were 451 mothers of children aged 3 to 18 years, though sample size varied with analyses. The translation and adaptation of the PSDQ followed a rigorous methodological approach. Then, we investigated the content, criterion, and construct validity of the adapted instrument. The scale content validity index (S-CVI) was considered adequate (0.97). There was evidence of internal validity, with the PSDQ dimensions showing strong correlations with their higher-order parenting styles. Confirmatory factor analysis endorsed the three-factor, second-order solution (i.e., three styles consisting of seven dimensions). The PSDQ showed convergent validity with the validated Brazilian version of the Parenting Styles Inventory (Inventário de Estilos Parentais - IEP), as well as external validity, as it was associated with several instruments measuring sociodemographic and behavioral/emotional-problem variables. The PSDQ is an effective and reliable psychometric instrument to assess childrearing strategies according to Baumrind's model of parenting styles.

[Turkish validity and reliability study of fear of pain questionnaire-III].

PubMed

Ünver, Seher; Turan, Fatma Nesrin

2018-01-01

This study aimed to develop a Turkish version of the Fear of Pain Questionnaire-III developed by McNeil and Rainwater (1998) and examine its validity and reliability indicators. The study was conducted with 459 university students studying in the nursing department. The Turkish translation of the scale was conducted by language experts and the original scale owner. Expert opinions were taken for language validity, and the Lawshe's content validity ratio formula was used to calculate the content validity. Exploratory factor analysis was used to assess the construct validity. The factors were rotated using the Varimax rotation (orthogonal) method. For reliability indicators of the questionnaire, the internal consistency coefficient and test re-test reliability were utilized. Explanatory factor analyses using the three-factor model (explaining 50.5% of the total variance) revealed that the item factor loads varied were above the limit value of 0.30 which indicated that the questionnaire had good construct validity. The Cronbach's alpha value for the total questionnaire was 0.938, and test re-test value was 0.846 for the total scale. The Turkish version of the Fear of Pain Questionnaire-III had sufficiently high reliability and validity to be used as a tool in evaluating the fear of pain among the young Turkish population.

Examining perceptions of academic stress and its sources among university students: The Perception of Academic Stress Scale

PubMed Central

Bedewy, Dalia

2015-01-01

The development of a scale to measure perceived sources of academic stress among university students. Based on empirical evidence and recent literature review, we developed an 18-item scale to measure perceptions of academic stress and its sources. Experts (n = 12) participated in the content validation process of the instrument before it was administered to (n = 100) students. The developed instrument has internal consistency reliability of 0.7 (Cronbach’s alpha), there was evidence for content validity, and factor analysis resulted in four correlated and theoretically meaningful factors. We developed and tested a scale to measure academic stress and its sources. This scale takes 5 minutes to complete. PMID:28070363

Validation of cell-based fluorescence assays: practice guidelines from the ICSH and ICCS - part II - preanalytical issues.

PubMed

Davis, Bruce H; Dasgupta, Amar; Kussick, Steven; Han, Jin-Yeong; Estrellado, Annalee

2013-01-01

Flow cytometry and other technologies of cell-based fluorescence assays are as a matter of good laboratory practice required to validate all assays, which when in clinical practice may pass through regulatory review processes using criteria often defined with a soluble analyte in plasma or serum samples in mind. Recently the U.S. Food and Drug Administration (FDA) has entered into a public dialogue in the U.S. regarding their regulatory interest in laboratory developed tests (LDTs) or so-called "home brew" assays performed in clinical laboratories. The absence of well-defined guidelines for validation of cell-based assays using fluorescence detection has thus become a subject of concern for the International Council for Standardization of Haematology (ICSH) and International Clinical Cytometry Society (ICCS). Accordingly, a group of over 40 international experts in the areas of test development, test validation, and clinical practice of a variety of assay types using flow cytometry and/or morphologic image analysis were invited to develop a set of practical guidelines useful to in vitro diagnostic (IVD) innovators, clinical laboratories, regulatory scientists, and laboratory inspectors. The focus of the group was restricted to fluorescence reporter reagents, although some common principles are shared by immunohistochemistry or immunocytochemistry techniques and noted where appropriate. The work product of this two year effort is the content of this special issue of this journal, which is published as 5 separate articles, this being Validation of Cell-based Fluorescence Assays: Practice Guidelines from the ICSH and ICCS - Part II - Preanalytical issues. © 2013 International Clinical Cytometry Society. © 2013 International Clinical Cytometry Society.

Safer Conception Methods and Counseling: Psychometric Evaluation of New Measures of Attitudes and Beliefs Among HIV Clients and Providers.

PubMed

Woldetsadik, Mahlet Atakilt; Goggin, Kathy; Staggs, Vincent S; Wanyenze, Rhoda K; Beyeza-Kashesya, Jolly; Mindry, Deborah; Finocchario-Kessler, Sarah; Khanakwa, Sarah; Wagner, Glenn J

2016-06-01

With data from 400 HIV clients with fertility intentions and 57 HIV providers in Uganda, we evaluated the psychometrics of new client and provider scales measuring constructs related to safer conception methods (SCM) and safer conception counselling (SCC). Several forms of validity (i.e., content, face, and construct validity) were examined using standard methods including exploratory and confirmatory factor analysis. Internal consistency was established using Cronbach's alpha correlation coefficient. The final scales consisted of measures of attitudes towards use of SCM and delivery of SCC, including measures of self-efficacy and motivation to use SCM, and perceived community stigma towards childbearing. Most client and all provider measures had moderate to high internal consistency (alphas 0.60-0.94), most had convergent validity (associations with other SCM or SCC-related measures), and client measures had divergent validity (poor associations with depression). These findings establish preliminary psychometric properties of these scales and should facilitate future studies of SCM and SCC.

Development and psychometric testing of the Mariani Nursing Career Satisfaction Scale.

PubMed

Mariani, Bette; Allen, Lois Ryan

2014-01-01

The Mariani Nursing Career Satisfaction Scale (MNCSS) was developed to explore the influence of mentoring on career satisfaction of registered nurses (RNs). A review of the literature revealed no contemporary valid and reliable measure of career satisfaction. The MNCSS is a semantic differential of 16 opposite adjective pairs on which participants rate feelings about their nursing career. The MNCSS was used in a pilot study and three major studies exploring career satisfaction of RNs. Validity, reliability, and exploratory factor analysis (FA) were computed to explore the internal structure of the instrument. The newly developed instrument had a content validity index (CVI) of .84 and Cronbach's alpha internal consistency reliabilities of .93-.96 across three major studies. Exploratory FA (N = 496) revealed a univocal instrument with one factor that explains 57.8% of the variance in career satisfaction scores. The MNCSS is a valid and reliable instrument for measuring career satisfaction. FA of the combined data from three studies yielded one factor that measures the concept of career satisfaction.

Validity and reliability of Persian version of Listening Styles Profile-Revised (LSP- R) in Iranian students.

PubMed

Fatehi, Zahra; Baradaran, Hamid Reza; Asadpour, Mohamad; Rezaeian, Mohsen

2017-01-01

Background: Individuals' listening styles differs based on their characters, professions and situations. This study aimed to assess the validity and reliability of Listening Styles Profile- Revised (LSP- R) in Iranian students. Methods: After translating into Persian, LSP-R was employed in a sample of 240 medical and nursing Persian speaking students in Iran. Statistical analysis was performed to test the reliability and validity of the LSP-R. Results: The study revealed high internal consistency and good test-retest reliability for the Persian version of the questionnaire. The Cronbach's alpha coefficient was 0.72 and intra-class correlation coefficient 0.87. The means for the content validity index and the content validity ratio (CVR) were 0.90 and 0.83, respectively. Exploratory factor analysis (EFA) yielded a four-factor solution accounted for 60.8% of the observed variance. Majority of medical students (73%) as well as majority of nursing students (70%) stated that their listening styles were task-oriented. Conclusion: In general, the study finding suggests that the Persian version of LSP-R is a valid and reliable instrument for assessing listening styles profile in the studied sample.

IMatter: validation of the NHS Scotland Employee Engagement Index.

PubMed

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus.

PubMed

McElhone, Kathleen; Abbott, Janice; Shelmerdine, Joanna; Bruce, Ian N; Ahmad, Yasmeen; Gordon, Caroline; Peers, Kate; Isenberg, David; Ferenkeh-Koroma, Ada; Griffiths, Bridget; Akil, Mohamed; Maddison, Peter; Teh, Lee-Suan

2007-08-15

To develop and validate a disease-specific health-related quality of life (HRQOL) instrument for adults with systemic lupus erythematosus (SLE). The work consisted of 6 stages. Stage 1 included item generation for questionnaire content from semistructured interviews with SLE patients. In stage 2 item selection for the draft questionnaire was performed by thematic analysis of the patient interview transcripts and expert panel agreement. In stage 3 the content validity of the draft questionnaire was assessed by patients completing the questionnaire and providing critical feedback. In stages 4 and 5 construct validity and internal reliability of the 3 versions of the LupusQoL were evaluated using principal component analysis with varimax rotation and Cronbach's alpha coefficients, respectively. In stage 6 discriminatory validity, concurrent validity, and test-retest reliability were evaluated. Stages 1, 2, and 3 resulted in a preliminary instrument containing 63 items. In stage 4, 8 domains were identified. This factor structure, accounting for 82% of the variance, was confirmed in stage 5. The domains and Cronbach's alpha coefficients were physical health (0.94), emotional health (0.94), body image (0.89), pain (0.92), planning (0.93), fatigue (0.88), intimate relationships (0.96), and burden to others (0.94). Discriminant validity was demonstrated for different levels of disease activity (British Isles Lupus Assessment Group Index) and damage (Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index). High correlations (r = 0.71-0.79) between comparable domains of the Short Form 36 and the LupusQoL assured acceptable concurrent validity. Good test-retest reliability (r = 0.72-0.93) was demonstrated. The LupusQoL is a validated SLE-specific HRQOL instrument with 34 items across 8 domains defined by patients as being important.

Development of a survey instrument to investigate the primary care factors related to differences in cancer diagnosis between international jurisdictions

PubMed Central

2014-01-01

Background Survival rates following a diagnosis of cancer vary between countries. The International Cancer Benchmarking Partnership (ICBP), a collaboration between six countries with primary care led health services, was set up in 2009 to investigate the causes of these differences. Module 3 of this collaboration hypothesised that an association exists between the readiness of primary care physicians (PCP) to investigate for cancer – the ‘threshold’ risk level at which they investigate or refer to a specialist for consideration of possible cancer – and survival for that cancer (lung, colorectal and ovarian). We describe the development of an international survey instrument to test this hypothesis. Methods The work was led by an academic steering group in England. They agreed that an online survey was the most pragmatic way of identifying differences between the jurisdictions. Research questions were identified through clinical experience and expert knowledge of the relevant literature. A survey comprising a set of direct questions and five clinical scenarios was developed to investigate the hypothesis. The survey content was discussed and refined concurrently and repeatedly with international partners. The survey was validated using an iterative process in England. Following validation the survey was adapted to be relevant to the health systems operating in other jurisdictions and translated into Danish, Norwegian and Swedish, and into Canadian and Australian English. Results This work has produced a survey with face, content and cross cultural validity that will be circulated in all six countries. It could also form a benchmark for similar surveys in countries with similar health care systems. Conclusions The vignettes could also be used as educational resources. This study is likely to impact on healthcare policy and practice in participating countries. PMID:24938306

Assessing institutional support for Hispanic nursing student retention: a study to evaluate the psychometric properties of two self-assessment inventories.

PubMed

Bond, Mary Lou; Cason, Carolyn L

2014-01-01

To assess the content validity and internal consistency reliability of the Healthcare Professions Education Program Self-Assessment (PSA) and the Institutional Self-Assessment for Factors Supporting Hispanic Student Retention (ISA). Health disparities among vulnerable populations are among the top priorities demanding attention in the United States. Efforts to recruit and retain Hispanic nursing students are essential. Based on a sample of provosts, deans/directors, and an author of the Model of Institutional Support, participants commented on the perceived validity and usefulness of each item of the PSA and ISA. Internal consistency reliability was calculated by Cronbach's alpha using responses from nursing schools in states with large Hispanic populations. The ISA and PSA were found to be reliable and valid tools for assessing institutional friendliness. The instruments highlight strengths and identify potential areas of improvement at institutional and program levels.

Rasch analysis and impact factor methods both yield valid and comparable measures of health status in interstitial lung disease.

PubMed

Patel, Amit S; Siegert, Richard J; Bajwah, Sabrina; Brignall, Kate; Gosker, Harry R; Moxham, John; Maher, Toby M; Renzoni, Elisabetta A; Wells, Athol U; Higginson, Irene J; Birring, Surinder S

2015-09-01

Rasch analysis has largely replaced impact factor methodology for developing health status measures. The aim of this study was to develop a health status questionnaire for patients with interstitial lung disease (ILD) using impact factor methodology and to compare its validity with that of another version developed using Rasch analysis. A preliminary 71-item questionnaire was developed and evaluated in 173 patients with ILD. Items were reduced by the impact factor method (King's Brief ILD questionnaire, KBILD-I) and Rasch analysis (KBILD-R). Both questionnaires were validated by assessing their relationship with forced vital capacity (FVC) and St Georges Respiratory Questionnaire (SGRQ) and by evaluating internal reliability, repeatability, and longitudinal responsiveness. The KBILD-R and KBILD-I comprised 15 items each. The content of eight items differed between the KBILD-R and KBILD-I. Internal and test-retest reliability was good for total scores of both questionnaires. There was a good relationship with SGRQ and moderate relationship with FVC for both questionnaires. Effect sizes were comparable. Both questionnaires discriminated patients with differing disease severity. Despite considerable differences in the content of retained items, both KBILD-R and KBILD-I questionnaires demonstrated acceptable measurement properties and performed comparably in a clinical setting. Copyright © 2015 Elsevier Inc. All rights reserved.

Validity and Reliability of Malay Version of the Job Content Questionnaire among Public Hospital Female Nurses in Malaysia.

PubMed

Amin, N A; Quek, K F; Oxley, J A; Noah, R M; Nordin, R

2015-10-01

The Job Content Questionnaire (M-JCQ) is an established self-reported instrument used across the world to measure the work dimensions based on the Karasek's demand-control-support model. To evaluate the psychometrics properties of the Malay version of M-JCQ among nurses in Malaysia. This cross-sectional study was carried out on nurses working in 4 public hospitals in Klang Valley area, Malaysia. M-JCQ was used to assess the perceived psychosocial stressors and physical demands of nurses at their workplaces. Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Cronbach's α values were used to estimate the reliability (internal consistency) of the M-JCQ. EFA showed that 34 selected items were loaded in 4 factors. Except for psychological job demand (Cronbach's α 0.51), the remaining 3 α values for 3 subscales (job control, social support, and physical demand) were greater than 0.70, indicating acceptable internal consistency. However, an item was excluded due to poor item-total correlation (r<0.3). The final M-JCQ was consisted of 33 items. The M-JCQ is a reliable and valid instrument to measure psychosocial and physical stressors in the workplace of public hospital nurses in Malaysia.

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS): An observation-based tool for assessing cognitive behavioral therapy competence.

PubMed

Muse, Kate; McManus, Freda; Rakovshik, Sarah; Thwaites, Richard

2017-05-01

This article outlines the development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS) rating scale. The ACCS aims to provide a novel assessment framework to deliver formative and summative feedback regarding therapists' performance within observed cognitive-behavioral treatment sessions, and for therapists to rate and reflect on their own performance. Findings from 3 studies are outlined: (a) a feedback study (n = 66) examining content validity, face validity and usability; (b) a focus group (n = 9) evaluating usability and utility; and (c) an evaluation of the psychometric properties of the ACCS in real world cognitive behavioral therapy (CBT) training and routine clinical practice contexts. Results suggest that the ACCS has good face validity, content validity, and usability and provides a user-friendly tool that is useful for promoting self-reflection and providing formative feedback. Scores on both the self and assessor-rated versions of the ACCS demonstrate good internal consistency, interrater reliability, and discriminant validity. In addition, ACCS scores were found to be correlated with, but distinct from, the Revised Cognitive Therapy Scale (CTS-R) and were comparable to CTS-R scores in terms of internal consistency and discriminant validity. In addition, the ACCS may have advantages over the CTS-R in terms of interrater reliability of scores. The studies also provided insight into areas for refinement and a number of modifications were undertaken to improve the scale. In summary, the ACCS is an appropriate and useful measure of CBT competence that can be used to promote self-reflection and provide therapists with formative and summative feedback. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Validation of the GreenLight™ Simulator and development of a training curriculum for photoselective vaporisation of the prostate.

PubMed

Aydin, Abdullatif; Muir, Gordon H; Graziano, Manuela E; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-06-01

To assess face, content and construct validity, and feasibility and acceptability of the GreenLight™ Simulator as a training tool for photoselective vaporisation of the prostate (PVP), and to establish learning curves and develop an evidence-based training curriculum. This prospective, observational and comparative study, recruited novice (25 participants), intermediate (14) and expert-level urologists (seven) from the UK and Europe at the 28th European Association of Urological Surgeons Annual Meeting 2013. A group of novices (12 participants) performed 10 sessions of subtask training modules followed by a long operative case, whereas a second group (13) performed five sessions of a given case module. Intermediate and expert groups performed all training modules once, followed by one operative case. The outcome measures for learning curves and construct validity were time to task, coagulation time, vaporisation time, average sweep speed, average laser distance, blood loss, operative errors, and instrument cost. Face and content validity, feasibility and acceptability were addressed through a quantitative survey. Construct validity was demonstrated in two of five training modules (P = 0.038; P = 0.018) and in a considerable number of case metrics (P = 0.034). Learning curves were seen in all five training modules (P < 0.001) and significant reduction in case operative time (P < 0.001) and error (P = 0.017) were seen. An evidence-based training curriculum, to help trainees acquire transferable skills, was produced using the results. This study has shown the GreenLight Simulator to be a valid and useful training tool for PVP. It is hoped that by using the training curriculum for the GreenLight Simulator, novice trainees can acquire skills and knowledge to a predetermined level of proficiency. © 2014 The Authors. BJU International © 2014 BJU International.

Measuring the reliability and validity of the Greek edition of the Diabetes Quality of Life Brief Clinical Inventory.

PubMed

Rekleiti, Maria; Souliotis, Kyriakos; Sarafis, Pavlos; Kyriazis, Ioannis; Tsironi, Maria

2018-06-01

The present study focuses on studying the validity and reliability of the Greek edition of DQOL-BCI. DQOL-BCI includes 15 questions-elements that are evaluated on a 5-grade scale like Likert and two general form-shapes. The translation process was conducted in conformity with the guidelines of EuroQol group. A non-random sample of 65 people-patients diagnosed with diabetes I and II was selected. The questionnaire that was used to collect the data was the translated version of DQOL-BCI, and included the demographic characteristics of the interviewees. The content validity of DQOL-BCI was re-examined from a team of five experts (expert panel) for qualitative and quantitative performance. The completion of the questionnaire was done via a personal interview. The sample consisted of 58 people (35 men and 23 women, 59.9 ± 10.9 years). The translation of the questionnaire was found appropriate in accordance to the peculiarities of the Greek language and culture. The largest deviation of values is observed in QOL1 (1.71) in comparison to QOL6 (2.98). The difference between the standard deviations is close to 0.6. The statistics results of the tests showed satisfactory content validity and high construct validity, while the high values for Cronbach alpha index (0.95) reveal high reliability and internal consistency. The Greek version of DQOL-BCI has acceptable psychometric properties and appears to demonstrate high internal reliability and satisfactory construct validity, which allows its use as an important tool in evaluating the quality of life of diabetic patients in relation to their health. Copyright © 2018. Published by Elsevier B.V.

Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN): evolution of a content management system for point-of-care clinical decision support.

PubMed

Barwise, Amelia; Garcia-Arguello, Lisbeth; Dong, Yue; Hulyalkar, Manasi; Vukoja, Marija; Schultz, Marcus J; Adhikari, Neill K J; Bonneton, Benjamin; Kilickaya, Oguz; Kashyap, Rahul; Gajic, Ognjen; Schmickl, Christopher N

2016-10-03

The Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) is an international collaborative project with the overall objective of standardizing the approach to the evaluation and treatment of critically ill patients world-wide, in accordance with best-practice principles. One of CERTAIN's key features is clinical decision support providing point-of-care information about common acute illness syndromes, procedures, and medications in an index card format. This paper describes 1) the process of developing and validating the content for point-of-care decision support, and 2) the content management system that facilitates frequent peer-review and allows rapid updates of content across different platforms (CERTAIN software, mobile apps, pdf-booklet) and different languages. Content was created based on survey results of acute care providers and validated using an open peer-review process. Over a 3 year period, CERTAIN content expanded to include 67 syndrome cards, 30 procedure cards, and 117 medication cards. 127 (59 %) cards have been peer-reviewed so far. Initially MS Word® and Dropbox® were used to create, store, and share content for peer-review. Recently Google Docs® was used to make the peer-review process more efficient. However, neither of these approaches met our security requirements nor has the capacity to instantly update the different CERTAIN platforms. Although we were able to successfully develop and validate a large inventory of clinical decision support cards in a short period of time, commercially available software solutions for content management are suboptimal. Novel custom solutions are necessary for efficient global point of care content system management.

Validity and reliability of the Cohen 10-item Perceived Stress Scale in patients with chronic headache: Persian version.

PubMed

Khalili, Robabe; Sirati Nir, Masoud; Ebadi, Abbas; Tavallai, Abbas; Habibi, Mehdi

2017-04-01

The Cohen Perceived Stress Scale is being used widely in various countries. The present study evaluated the validity and reliability of the Cohen 10-item Perceived Stress Scale (PSS-10) in assessing tension headache, migraine, and stress-related diseases in Iran. This study is a methodological and cross-sectional descriptive investigation of 100 patients with chronic headache admitted to the pain clinic of Baqiyatallah Educational and Therapeutic Center. Convenience sampling was used for subject selection. PSS psychometric properties were evaluated in two stages. First, the standard scale was translated. Then, the face validity, content, and construct of the translated version were determined. The average age of participants was 38 years with a standard deviation (SD) of 13.2. As for stress levels, 12% were within the normal range, 36% had an intermediate level, and 52% had a high level of stress. The face validity and scale content were remarkable, and the KMO coefficient was 0.82. Bartlett's test yielded 0.327 which was statistically significant (p<0.0001) representing the quality of the sample. In factor analysis of the scale, the two elements of "coping" and "distress" were determined. A Cronbach's Alpha coefficient of 0.72 was obtained. This confirmed the remarkable internal consistency and stability of the scale through repeated measure tests (0.93). The Persian PSS-10 has good internal consistency and reliability. The availability of a validated Persian PSS-10 would indicate a link between stress and chronic headache. Copyright © 2017 Elsevier B.V. All rights reserved.

Validity and reliability of a short questionnaire for assessing the impact of cooking skills interventions.

PubMed

Barton, K L; Wrieden, W L; Anderson, A S

2011-12-01

Food skills programmes are widely used as a means to improve confidence in food preparation, the use of basic food skills and food selections amongst low income communities. However, the impact of such interventions are rarely evaluated as a result of a lack of validated assessment tools appropriate for use within this target group. A two-page questionnaire utilising a closed-question format was designed based on key domains known to be influenced by cooking skills programmes. Content validity was assessed by a panel of public health experts and face validity by individuals, typical of those who may attend cooking skills classes. Internal and repeat reliability were assessed with groups of adults attending community-based classes. The feasibility of using the tool in community settings was also assessed. The draft questionnaire was amended as appropriate subsequent to content and face validity testing. Cronbach's alpha for confidence and knowledge sections was 0.86 and 0.84, respectively, indicating good internal consistency. Spearman correlation coefficients for repeat reliability testing between time 1 and time 2 for each item were in the range 0.46-0.91 (all significant at P < 0.001), indicating that the questionnaire elicited stable responses for repeated use. Feasibility testing highlighted the need for detailed instructions for course tutors on how to distribute and check questionnaires for completion. This tool provides a standardised method of evaluating cooking skills interventions that could be utilised in the development and evaluation of multicentre cooking skills interventions. © 2011 The Authors. Journal of Human Nutrition and Dietetics © 2011 The British Dietetic Association Ltd.

The N2N instrument to evaluate healthy work environments: an Italian validation.

PubMed

Palese, Alvisa; Dante, Angelo; Tonzar, Laura; Balboni, Bernardo

2014-02-01

The aims of the study were to (a) validate N2N Healthy Work Environment tool, (b) assess the healthiness of work environments as perceived by nurses themselves and (c) identify the factors associated with Italian nurses' perception of work environment healthiness. The linguistic and cultural adaptation of USA-N2N Healthy Work Environments was achieved through a process of forward/backward translation. Content validity was assessed by three expert nurses. The stability of the instrument was checked with a test/retest evaluation. The instrument psychometric properties, the confirmatory factor analysis as well the healthiness of the work environment and its determinant factors were evaluated with a sample of 294 nurses. The content and face validity of the N2N Healthy Work Environment instrument was confirmed. The instrument demonstrated good internal consistency (α of 0.82), excellent stability values (ρ > 0.70) and high levels of acceptability (response rate: 96.4 %). The confirmatory factor analysis has corroborated the existence of two factors as documented in the original instrument (Mays et al. in J Nurs Manag 19:18-26, 2011). Eighty-seven (29.6 %) nurses perceived the work environment where they work as "healthy". Working under a functional model of care delivery (χ(2) 24.856, p 0.000) and being responsible for one project or more (χ(2) 5.256, p 0.021) were associated with healthy environments. The instrument--valid and reliable, short in the number of items, easy to understand and based on international standards--allows a systematic assessment of the healthiness of the environment and might provide not only the opportunity to evaluate the effects of new organizational models and interventions, but also the possibility to activate a process of self-analysis and a process of ongoing review. The instrument can be used to systematically check the healthiness of Italian working environments, allowing for organizational diagnosis, targeted interventions and international comparisons.

Development and content validity testing of a comprehensive classification of diagnoses for pediatric nurse practitioners.

PubMed

Burns, C

1991-01-01

Pediatric nurse practitioners (PNPs) need an integrated, comprehensive classification that includes nursing, disease, and developmental diagnoses to effectively describe their practice. No such classification exists. Further, methodologic studies to help evaluate the content validity of any nursing taxonomy are unavailable. A conceptual framework was derived. Then 178 diagnoses from the North American Nursing Diagnosis Association (NANDA) 1986 list, selected diagnoses from the International Classification of Diseases, the Diagnostic and Statistical Manual, Third Revision, and others were selected. This framework identified and listed, with definitions, three domains of diagnoses: Developmental Problems, Diseases, and Daily Living Problems. The diagnoses were ranked using a 4-point scale (4 = highly related to 1 = not related) and were placed into the three domains. The rating scale was assigned by a panel of eight expert pediatric nurses. Diagnoses that were assigned to the Daily Living Problems domain were then sorted into the 11 Functional Health patterns described by Gordon (1987). Reliability was measured using proportions of agreement and Kappas. Content validity of the groups created was measured using indices of content validity and average congruency percentages. The experts used a new method to sort the diagnoses in a new way that decreased overlaps among the domains. The Developmental and Disease domains were judged reliable and valid. The Daily Living domain of nursing diagnoses showed marginally acceptable validity with acceptable reliability. Six Functional Health Patterns were judged reliable and valid, mixed results were determined for four categories, and the Coping/Stress Tolerance category was judged reliable but not valid using either test. There were considerable differences between the panel's, Gordon's (1987), and NANDA's clustering of NANDA diagnoses. This study defines the diagnostic practice of nurses from a holistic, patient-centered perspective. It is the first study to use quantitative methods to test a diagnostic classification system for nursing. The classification model could also be adapted for other nurse specialties.

Validation of the "Security Needs Assessment Profile" for measuring the profiles of security needs of Chinese forensic psychiatric inpatients.

PubMed

Siu, B W M; Au-Yeung, C C Y; Chan, A W L; Chan, L S Y; Yuen, K K; Leung, H W; Yan, C K; Ng, K K; Lai, A C H; Davies, S; Collins, M

Mapping forensic psychiatric services with the security needs of patients is a salient step in service planning, audit and review. A valid and reliable instrument for measuring the security needs of Chinese forensic psychiatric inpatients was not yet available. This study aimed to develop and validate the Chinese version of the Security Needs Assessment Profile for measuring the profiles of security needs of Chinese forensic psychiatric inpatients. The Security Needs Assessment Profile by Davis was translated into Chinese. Its face validity, content validity, construct validity and internal consistency reliability were assessed by measuring the security needs of 98 Chinese forensic psychiatric inpatients. Principal factor analysis for construct validity provided a six-factor security needs model explaining 68.7% of the variance. Based on the Cronbach's alpha coefficient, the internal consistency reliability was rated as acceptable for procedural security (0.73), and fair for both physical security (0.62) and relational security (0.58). A significant sex difference (p=0.002) in total security score was found. The Chinese version of the Security Needs Assessment Profile is a valid and reliable instrument for assessing the security needs of Chinese forensic psychiatric inpatients. Copyright © 2017 Elsevier Ltd. All rights reserved.

[The Use of FTIR Coupled with Partial Least Square for Quantitative Analysis of the Main Composition of Bamboo/Polypropylene Composites].

PubMed

Lao, Wan-li; He, Yu-chan; Li, Gai-yun; Zhou, Qun

2016-01-01

The biomass to plastic ratio in wood plastic composites (WPCs) greatly affects the physical and mechanical properties and price. Fast and accurate evaluation of the biomass to plastic ratio is important for the further development of WPCs. Quantitative analysis of the WPC main composition currently relies primarily on thermo-analytical methods. However, these methods have some inherent disadvantages, including time-consuming, high analytical errors and sophisticated, which severely limits the applications of these techniques. Therefore, in this study, Fourier Transform Infrared (FTIR) spectroscopy in combination with partial least square (PLS) has been used for rapid prediction of bamboo and polypropylene (PP) content in bamboo/PP composites. The bamboo powders were used as filler after being dried at 105 degrees C for 24 h. PP was used as matrix materials, and some chemical regents were used as additives. Then 42 WPC samples with different ratios of bamboo and PP were prepared by the methods of extrusion. FTIR spectral data of 42 WPC samples were collected by means of KBr pellets technique. The model for bamboo and PP content prediction was developed by PLS-2 and full cross validation. Results of internal cross validation showed that the first derivative spectra in the range of 1 800-800 cm(-1) corrected by standard normal variate (SNV) yielded the optimal model. For both bamboo and PP calibration, the coefficients of determination (R2) were 0.955. The standard errors of calibration (SEC) were 1.872 for bamboo content and 1.848 for PP content, respectively. For both bamboo and PP validation, the R2 values were 0.950. The standard errors of cross validation (SECV) were 1.927 for bamboo content and 1.950 for PP content, respectively. And the ratios of performance to deviation (RPD) were 4.45 for both biomass and PP examinations. The results of external validation showed that the relative prediction deviations for both biomass and PP contents were lower than ± 6%. FTIR combined with PLS can be used for rapid and accurate determination of bamboo and PP content in bamboo/PP composites.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder.

PubMed

Alavi, Seyyed Salman; Mohammadi, Mohammad Reza; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-04-01

The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under "impulse control disorder not elsewhere classified". This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. The content validity of the semi- structured clinical interview matched the DSM-IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including "SMS pathological use" and "High monthly cost of using the mobile phone" were added to promote its validity. Internal reliability (Kappa) and test-retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder.

Validation of a pregnancy planning measure for Arabic-speaking women.

PubMed

Almaghaslah, Eman; Rochat, Roger; Farhat, Ghada

2017-01-01

The prevalence of unplanned pregnancy in Saudi Arabia has not been thoroughly investigated. To conduct a psychometric evaluation study of the Arabic version of the London Measure of Unplanned Pregnancy (LMUP). To evaluate the psychometric properties of the LMUP, we conducted a self-administered online survey among 796 ever-married Saudi women aged 20-49 years, and a re-test survey among 24 women. The psychometric properties evaluated included content validity measured by content validity index (CVI), structural validity assessed by exploratory factor analysis (EFA), substantive validity assessed by hypothesis testing, contextual stability for the test-retest assessed by weighted Kappa, and internal consistency assessed by Cronbach's alpha. The psychometric analysis of the Arabic version of LMUP exhibited valid and reliable properties. The CVIs for individual items and at the scale level were >0.7. EFA confirmed a unidimensional extraction of the scale item. Hypothesis testing confirmed expected associations. The tool was stable with weighted kappa = 0.78 and Cronbach's alpha = 0.88. In this study, the validity and reliability of the Arabic version of the LMUP were confirmed according to well-known psychometric criteria. This LMUP version can be used in research studies among Arabic-speaking women to measure unplanned pregnancy and investigate correlates and outcomes related to unplanned pregnancy.

Reliability and validity of a scale to measure consumer attitudes regarding the private food safety certification of restaurants.

PubMed

Uggioni, Paula Lazzarin; Salay, Elisabete

2012-04-01

Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development and study of self-efficacy scale in medication adherence among Iranian patients with hypertension

PubMed Central

Najimi, Arash; Mostafavi, Firoozeh; Sharifirad, Gholamreza; Golshiri, Parastoo

2017-01-01

BACKGROUND: This study was aimed at developing and studying the scale of self-efficacy in adherence to treatment in Iranian patients with hypertension. METHODS: A mix-method study was conducted on the two stages: in the first phase, a qualitative study was done using content analysis through deep and semi-structured interviews. After data analysis, the draft of tool was prepared. Items in the draft were selected based on the extracted concepts. In the second phase, validity and reliability of the instrument were implemented using a quantitative study. The prepared instrument in the first phase was studied among 612 participants. To test the construct validity and internal consistency, exploratory factor analysis and Cronbach's alpha were used, respectively. To study the validity of the final scale, the average score of self-efficacy in patients with controlled hypertension were compared with patients with uncontrolled hypertension. RESULTS: In overall, 16 patients were interviewed. Twenty-six items were developed to assess different concepts of self-efficacy. Concept-related items were extracted from interviews to study the face validity of the tool from patient's point of view. Four items were deleted because scored 0.79 in content validity. The mean of questionnaire content validity was 0.85. Items were collected in two factors with an eigenvalue >1. Four items were deleted with load factor <0.4. Reliability was 0.84 for the entire instrument. CONCLUSION: Self-efficacy scale in patients with hypertension is a valid and reliable instrument that can effectively evaluate the self-efficacy in medication adherence in the management of hypertension. PMID:29114551

Validation and cross cultural adaptation of the Italian version of the Harris Hip Score.

PubMed

Dettoni, Federico; Pellegrino, Pietro; La Russa, Massimo R; Bonasia, Davide E; Blonna, Davide; Bruzzone, Matteo; Castoldi, Filippo; Rossi, Roberto

2015-01-01

The Harris Hip Score (HHS) is one of the most widely used health related quality of life (HRQOL) measures for the assessment of hip pathology: in spite of this, a validation study, and an official Italian version have not been provided yet. The aim of this study was to create an Italian valid and reliable version of the HHS. The score was translated and modified in Italian; then 103 patients with different hip pathologies were evaluated using this HHS version and also with the WOMAC and the SF-12 questionnaires. Content, construct and criterion validities were tested, such as interobserver reliability, test-retest reliability and internal consistency. Cross-cultural adaptation was easy, and only minor adaptation was required in the translation process. Construct and criterion validity of the HHS Italian Version were confirmed by satisfactory values of Spearman's Rho for correlation between specific domains of HHS and Womac and SF12 scores. Interobserver and test-retest reliabilities obtained values of 0.996 and 0.975 respectively; Cronbach's alpha for internal consistency was 0.816. Statistical and clinical analysis showed that HHS is highly valid and reliable in this new Italian version.

Ethinylestradiol and levonorgestrel preparations on the Belgian market: a comparative study.

PubMed

Vanheusden, V; De Braekeleer, K; Corthout, J

2012-03-01

Preparations formulated as coated or film-coated tablets, containing levonorgestrel and the combination ethinylestradiol/levonorgestrel, were evaluated in a comparative study. This study comprised in vitro dissolution, assay and content uniformity. The analytical methods were previously validated according to international guidelines. All examined products complied with the postulated requirements.

An Empirical Validation of the Instrument: Student Perceptions of Teaching Effectiveness.

ERIC Educational Resources Information Center

West, Sandra S.; Denton, Jon J.

An assessment of the Student Perception of Teaching Effectiveness instrument (SPTE) is presented. The SPTE was developed to assess teaching interns' performance from the student's viewpoint. The Texas Teacher Appraisal System was selected as the content base for the development of the SPTE. The Texas system covers instructional strategies,…

How to Measure Elementary Teachers' Interest in Teaching Chemistry?

ERIC Educational Resources Information Center

Herranen, Jaana Kristiina; Vesterinen, Veli-Matti; Aksela, Maija Katariina

2015-01-01

The aim of this study was to create an instrument to measure elementary teachers' interest in teaching chemistry. The interest in chemistry teaching instrument (ICTI) was created to measure both the affective and cognitive components of interest. After establishing the face and content validity of the instrument, the internal consistency of the…

The Smartphone Addiction Scale: Development and Validation of a Short Version for Adolescents

PubMed Central

Kwon, Min; Kim, Dai-Jin; Cho, Hyun; Yang, Soo

2013-01-01

Objective This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. Method A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. Results The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001) and self-evaluation of smartphone addiction (p<.001) showed significant difference. The ROC analysis results showed an area under a curve (AUC) value of 0.963(0.888–1.000), a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887–1.000), a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls. Conclusions The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas. PMID:24391787

The smartphone addiction scale: development and validation of a short version for adolescents.

PubMed

Kwon, Min; Kim, Dai-Jin; Cho, Hyun; Yang, Soo

2013-01-01

This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001) and self-evaluation of smartphone addiction (p<.001) showed significant difference. The ROC analysis results showed an area under a curve (AUC) value of 0.963(0.888-1.000), a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887-1.000), a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls. The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas.

Developing an instrument to measure effective factors on Clinical Learning

PubMed Central

DADGARAN, IDEH; SHIRAZI, MANDANA; MOHAMMADI, AEEN; RAVARI, ALI

2016-01-01

Introduction Although nursing students spend a large part of their learning period in the clinical environment, clinical learning has not been perceived by its nature yet. To develop an instrument to measure effective factors on clinical learning in nursing students. Methods This is a mixed methods study performed in 2 steps. First, the researchers defined “clinical learning” in nursing students through qualitative content analysis and designed items of the questionnaire based on semi-structured individual interviews with nursing students. Then, as the second step, psychometric properties of the questionnaire were evaluated using the face validity, content validity, construct validity, and internal consistency evaluated on 227 students from fourth or higher semesters. All the interviews were recorded and transcribed, and then, they were analyzed using Max Qualitative Data Analysis and all of qualitative data were analyzed using SPSS 14. Results To do the study, we constructed the preliminary questionnaire containing 102 expressions. After determination of face and content validities by qualitative and quantitative approaches, the expressions of the questionnaire were reduced to 45. To determine the construct validity, exploratory factor analysis was applied. The results indicated that the maximum variance percentage (40.55%) was defined by the first 3 factors while the rest of the total variance percentage (59.45%) was determined by the other 42 factors. Results of exploratory factor analysis of this questionnaire indicated the presence of 3 instructor-staff, students, and educational related factors. Finally, 41 expressions were kept in 3 factor groups. The α-Cronbach coefficient (0.93) confirmed the high internal consistency of the questionnaire. Conclusion Results indicated that the prepared questionnaire was an efficient instrument in the study of the effective factors on clinical learning as viewed by nursing students since it involves 41 expressions and properties such as instrument design based on perception and experiences of the nursing students about effective factors on clinical learning, definition of facilitator and preventive factors of the clinical learning, simple scoring, suitable validity and reliability, and applicability in different occasions. PMID:27382579

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

European Portuguese Adaptation of Glasgow Content of Thoughts Inventory (GCTI): Psychometric Characterization in Higher Education Students.

PubMed

Marques, Daniel R; Meia-Via, Mariana S; Espie, Colin A; da Silva, Carlos F; Allen Gomes, Ana

2018-01-01

Persistent cognitive activity is an important factor in disturbing sleep-onset both during bedtime and when attempting to get back to sleep after nocturnal awakenings. One of the most specific self-report measures designed to assess this feature is the Glasgow Content of Thoughts Inventory (GCTI). In this study, we investigated the preliminary psychometric properties of GCTI in a large sample of higher education European Portuguese students (N = 2995). Our results suggest that there is evidence of good internal consistency (α = 0.93) and validity indicators. Moreover, we found an interpretable factorial structure comprising 5 correlated factors that needs to be confirmed in future studies. The European Portuguese version of the GCTI appears to be a reliable and valid instrument for measurement of sleep-onset disturbing cognitions.

Cross-cultural validation of the St. Louis Inventory of Community Living Skills for Chinese patients with schizophrenia in Hong Kong.

PubMed

Au, Raymond Wing Cheong; Tam, Peter Wai Chung; Tam, Gladys Wai Chi; Ungvari, Gabor Sander

2005-01-01

The study validated a culturally sensitive community living skills rating scale for Chinese patients by adapting the St. Louis Inventory of Community Living Skills (SLICLS). The Chinese version (SLICLS-C) was produced by forward and backward translation. An expert panel evaluated its content validity. Its internal consistency, inter-rater reliability, construct and concurrent validity were tested on 80 DSM-IV schizophrenia inpatients in a long-term facility. For predictive validity, the above sample was extended to ensure at least 20 subjects discharged to each of three levels of community care were included in the study sample. The SLICLS-C was psychometrically sound and could be used for predicting level of community care, program evaluation and measuring outcome.

Development and validation of an asthma first aid knowledge questionnaire.

PubMed

Luckie, Kate; Pang, Tsz Chun; Kritikos, Vicky; Saini, Bandana; Moles, Rebekah Jane

2018-05-01

There is no gold standard outcome assessment for asthma first-aid knowledge. We therefore aimed to develop and validate an asthma first-aid knowledge questionnaire (AFAKQ) to be used before and after educational interventions. The AFAKQ was developed based on a content analysis of existing asthma knowledge questionnaires and current asthma management guidelines. Content and face validity was performed by a review panel consisting of expert respiratory physicians, researchers and parents of school aged children. A 21 item questionnaire was then pilot tested among a sample of caregivers, health professionals and pharmacy students. Exploratory Factor analysis was performed to determine internal consistency. The initial 46 item version of the AFAKQ, was reduced to 21 items after revision by the expert panel. This was then pilot tested amongst 161 participants and further reduced to 14 items. The exploratory factor analysis revealed a parsimonious one factor solution with a Cronbach's Alpha of 0.77 with the 14 item AFAKQ. The AFAKQ is a valid tool ready for application in evaluating the impact of educational interventions on asthma first-aid knowledge. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of cell-based fluorescence assays: practice guidelines from the ICSH and ICCS - part I - rationale and aims.

PubMed

Davis, Bruce H; Wood, Brent; Oldaker, Teri; Barnett, David

2013-01-01

Flow cytometry and other technologies of cell-based fluorescence assays are as a matter of good laboratory practice required to validate all assays, which when in clinical practice may pass through regulatory review processes using criteria often defined with a soluble analyte in plasma or serum samples in mind. Recently the U.S. Food and Drug Administration (FDA) has entered into a public dialogue in the U.S. regarding their regulatory interest in laboratory developed tests (LDTs) or so-called "home brew" assays performed in clinical laboratories. The absence of well-defined guidelines for validation of cell-based assays using fluorescence detection has thus become a subject of concern for the International Council for Standardization of Haematology (ICSH) and International Clinical Cytometry Society (ICCS). Accordingly, a group of over 40 international experts in the areas of test development, test validation, and clinical practice of a variety of assay types using flow cytometry and/or morphologic image analysis were invited to develop a set of practical guidelines useful to in vitro diagnostic (IVD) innovators, clinical laboratories, regulatory scientists, and laboratory inspectors. The focus of the group was restricted to fluorescence reporter reagents, although some common principles are shared by immunohistochemistry or immunocytochemistry techniques and noted where appropriate. The work product of this two year effort is the content of this special issue of this journal, which is published as 5 separate articles, this being Validation of Cell-based Fluorescence Assays: Practice Guidelines from the ICSH and ICCS - Part I - Rationale and aims. © 2013 International Clinical Cytometry Society. © 2013 International Clinical Cytometry Society.

[Development of skill scale for communication skill measurement of pharmacist].

PubMed

Teramachi, Hitomi; Komada, Natsuki; Tanizawa, Katsuya; Kuzuya, Yumi; Tsuchiya, Teruo

2011-04-01

To purpose of this study was to develop a pharmacist communication skill scale. A 38 items scale was made and 283 pharmacists responded. The original questionnaire consisted of 38 items, with 1-5 graded Likert scale. Completed responses of 228 pharmacists data were used for testing the reliability and the validity of this scale. The first group of items from the original questionnaire were 38, and finally 38 original items were chosen for investigation of content validity, correlation coefficient and commonality. From factor analysis, four factors were chosen among the 31 items as follows: patient respect reception skill, problem discovery and solution skill, positive approach skill, feelings processing skill. The correlation coefficient between this original scale and the KiSS-18 (Social Skill) received high score (r=0.694). The reliability of this scale showed high internal consistency (Cronbach α coefficient=0.951), so the result of test for the validity of this scale supports high content validity. Thus we propose adoption of pharmacist communication skill scale to carry a brief eponymous name as TePSS-31. The above findings indicate that this developed scale possess adequate validity and reliability for practical use.

[MISSCARE Survey - Italian Version: findings from an Italian validation study].

PubMed

Sist, Luisa; Contini, Carla; Bandini, Anna; Bandini, Stefania; Massa, Licia; Zanin, Roberta; Maricchio, Rita; Gianesini, Gloria; Bassi, Erika; Tartaglini, Daniela; Palese, Alvisa; Ferraresi, Annamaria

2017-01-01

The Missed Nursing Care (MNC) refers to nursing interventions that are not completed, partially completed, or postponed. Despite the relevance of MNC, no assessment tools are available in the Italian context, and no data regarding the occurrence of this phenomenon has been documented on a large scale to date. The study aims were: (1) to validate the Italian version of the MISSCARE Survey tool; (2) to measure the prevalence of missed interventions and reasons for missed care as perceived by clinical nurses working in Italian health care settings. After having conducted the forward and backward translation, pre-pilot and pilot phases were developed to ensure face and content validity as well as semantic and conceptual equivalence of the Italian version with the original version. The MISSCARE survey questionnaire was then distributed to 1,233 clinical nurses of whom 1,003 completed the questionnaire. Overall, 979 questionnaires were analysed. The questionnaires were completed from January to March 2012, by nurses working in medical and surgical hospital departments in the Emilia Romagna region of Italy. Construct validity and internal consistency of the instrument were assessed. The face and content validity were ascertained by a group of experts. The instrument acceptability was good given that 79.4% of respondents replied to all items. Construct validity was investigated by an Exploratory Factor Analysis. Four factors explaining 64.18% of variance emerged: communication, lack of facilities/supplies, lack of staff, and unexpected events. Internal consistency, evaluated with Cronbach a, was 0.94. The nursing interventions omitted with greater frequency were, in order: ambulation (74.8%), passive mobilization (69.6%) and oral care (51.3%). The three main reasons for missed interventions were: an unexpected increase in the number of patients (90.5%), increased instability of the clinical condition (86.1%) and insufficient human resources (85.5%). The Italian version of the MISSCARE Survey was shown to have good psychometric properties. Therefore, it can be used to evaluate the missed nursing care phenomenon in Italy and will allow for international comparisons.

Reliability and Validity of the Turkish Version of the Gastrointestinal Symptom Rating Scale.

PubMed

Turan, Nuray; Aşt, Türkinaz Atabek; Kaya, Nurten

The purpose of this methodological study is to investigate the validity and reliability of the Turkish version of the Gastrointestinal Symptom Rating Scale (GSRS). The scale was adapted to the Turkish language via backward translation. Content validity was examined by referring to experts. Reliability was examined via test-retest reliability and internal consistency, and validity was examined with divergent and convergent validity. The Epworth Sleepiness Scale (ESS) and the Marlowe-Crowne Social Desirability Scale (MCSDS) were used for divergent validity. As for convergent validity, the Constipation Severity Instrument (CSI) and the Patient Assessment of Constipation Quality of Life Scale (PAC-QOLQ) were utilized. The relationship between the GSRS and the health-related quality of life (36-item short-form health survey [SF-36]) was also analyzed. The study population consisted of patients in orthopedic clinic who volunteered to participate. Test-retest reliability was examined with the participation of 30 patients; internal consistency and validity were examined with 150 patients. Test-retest reliability correlation coefficients of the GSRS varied from 0.39 to 0.87 for all items. For internal consistency, the GSRS's item total correlation was found to be 0.17-0.67, and Cronbach α was 0.82 for all items. There was a positive linear significant correlation between the GSRS, CSI, and PAC-QOLQ. There was no significant correlation between the GSRS, MCSDS, and ESS. Higher GSRS scores inversely correlated with general quality of life (SF-36). The Turkish version of the GSRS has been found to be a reliable and valid instrument for assessing patients' gastrointestinal symptoms. Therefore, this instrument can be confidently used with Turkish individuals.

Design, Realization, and First Validation of an Immersive Web-Based Virtual Patient Simulator for Training Clinical Decisions in Surgery.

PubMed

Kleinert, Robert; Heiermann, Nadine; Wahba, Roger; Chang, De-Huan; Hölscher, Arnulf H; Stippel, Dirk L

2015-01-01

Immersive patient simulators (IPS) allow an illusionary immersion into a synthetic world where the user can freely navigate through a 3-dimensional environment similar to computer games. Playful learning with IPS allows internalization of medical workflows without harming real patients. Ideally, IPS show high student acceptance and can have positive effect on knowledge gain. Development of IPS with high technical quality is resource intensive. Therefore most of the "high-fidelity" IPS are commercially driven. Usage of IPS in the daily curriculum is still rare. There is no academic-driven simulator that is freely accessible to every student and combines high immersion grade with a profound amount of medical content. Therefore it was our aim to develop an academic-driven IPS prototype that is free to use and combines a high immersion grade with profound medical content. In addition, a first validation of the prototype was conducted. The conceptual design included definition of the following parameters: amount of curricular content, grade of technical quality, availability, and level of validation. A preliminary validation was done with 25 students. Students' opinion about acceptance was evaluated by a Likert-scale questionnaire. Effect on knowledge gain was determined by testing concordance and predictive validity. A custom-made simulator prototype (Artificial learning interface for clinical education [ALICE]) displays a virtual clinic environment that can be explored from a first-person view similar to a video game. By controlling an avatar, the user navigates through the environment, is able to treat virtual patients, and faces the consequence of different decisions. ALICE showed high students' acceptance. There was positive correlation for concordance validity and predictive validity. Simulator usage had positive effect on reproduction of trained content and declarative knowledge. We successfully developed a university-based, IPS prototype (ALICE) with profound medical content. ALICE is a nonprofit simulator, easy to use, and showed high students' acceptance; thus it potentially provides an additional tool for supporting student teaching in the daily clinical curriculum. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A psychometric evaluation of an advanced pharmacy practice experience clinical competency framework.

PubMed

Douglas Ried, L; Doty, Randell E; Nemire, Ruth E

2015-03-25

To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.

An Inventory for Measuring Student Teachers' Knowledge of Chemical Representations: Design, Validation, and Psychometric Analysis

ERIC Educational Resources Information Center

Taskin, V.; Bernholt, S.; Parchmann, I.

2015-01-01

Chemical representations play an important role in helping learners to understand chemical contents. Thus, dealing with chemical representations is a necessity for learning chemistry, but at the same time, it presents a great challenge to learners. Due to this great challenge, it is not surprising that numerous national and international studies…

76 FR 74118 - Proposed Collection; Comment Request for Revenue Procedure 97-15

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-30

... 1995, Public Law 104-13 (44 U.S.C. 3506(c)(2)(A)). Currently, the IRS is soliciting comments concerning... displays a valid OMB control number. Books or records relating to a collection of information must be retained as long as their contents may become material in the administration of any internal revenue law...

Continuity and Change in Teacher Education in Scotland--Back to the Future

ERIC Educational Resources Information Center

McCall, James

2017-01-01

The paper examines the changes which have taken place in the delivery, content and validation and accreditation of teacher education in Scotland. Particular attention is paid to the impact of external and internal changes on the development of new course structures and the strengthening of linkages between the initial stage of a teacher's…

Idiographic measurement of depressive thinking: development and preliminary validation of the Sentence Completion Test for Chronic Pain (SCP).

PubMed

Rusu, Adina C; Hallner, Dirk

2018-06-06

Depression is a common feature of chronic pain, but there is only limited research into the content and frequency of depressed cognitions in pain patients. This study describes the development of the Sentence Completion Test for Chronic Pain (SCP), an idiographic measure for assessing depressive thinking in chronic pain patients. The sentence completion task requires participants to finish incomplete sentences using their own words to a set of predefined stems that include negative, positive and neutral valenced self-referenced words. In addition, the stems include past, future and world stems, which reflect the theoretical negative triad typical to depression. Complete responses are coded by valence (negative, positive and neutral), pain and health-related content. A total of 89 participants were included in this study. Forty seven adult out-patients formed the depressed pain group and were compared to a non-clinical control sample of 42 healthy control participants. This study comprised several phases: (1) theory-driven generation of coding rules; (2) the development of a coding manual by a panel of experts (3) comparing reliability of coding by expert raters without the use of the coding manual and with the use of the coding manual; (4) preliminary analyses of the construct validity of the SCP. The internal consistency of the SCP was tested using the Kuder-Richardson coefficient (KR-20). Inter-rater agreement was assessed by intra-class correlations (ICC). The content and construct validity of the SCP was investigated by correlation coefficients between SCP negative completions, the Hospital Anxiety and Depression Scale (HADS) depression scores and the number of symptoms on the Structured Clinical Interview for DSM-IV-TR (SCID). As predicted for content validity, the number of SCP negative statements was significantly greater in the depressed pain group and this group also produced significantly fewer positive statements, compared to the healthy control group. The number of negative pain completions and negative health completions was significantly greater in the depressed pain group. As expected, in the depressed pain group, the correlation between SCP negatives and the HADS Depression score was r=0.60 and the correlation between SCP negatives and the number of symptoms on the SCID was r=0.56. The SCP demonstrated good content validity, internal consistency and inter-rater reliability. Uses for this measure, such as complementing questionnaire measures by an idiographic assessment of depressive thinking and generating hypotheses about key problems within a cognitive-behavioural case-formulation, are suggested.

Validation of cell-based fluorescence assays: practice guidelines from the ICSH and ICCS - part IV - postanalytic considerations.

PubMed

Barnett, David; Louzao, Raaul; Gambell, Peter; De, Jitakshi; Oldaker, Teri; Hanson, Curtis A

2013-01-01

Flow cytometry and other technologies of cell-based fluorescence assays are as a matter of good laboratory practice required to validate all assays, which when in clinical practice may pass through regulatory review processes using criteria often defined with a soluble analyte in plasma or serum samples in mind. Recently the U.S. Food and Drug Administration (FDA) has entered into a public dialogue in the U.S. regarding their regulatory interest in laboratory developed tests (LDTs) or so-called home brew assays performed in clinical laboratories. The absence of well-defined guidelines for validation of cell-based assays using fluorescence detection has thus become a subject of concern for the International Council for Standardization of Haematology (ICSH) and International Clinical Cytometry Society (ICCS). Accordingly, a group of over 40 international experts in the areas of test development, test validation, and clinical practice of a variety of assay types using flow cytometry and/or morphologic image analysis were invited to develop a set of practical guidelines useful to in vitro diagnostic (IVD) innovators, clinical laboratories, regulatory scientists, and laboratory inspectors. The focus of the group was restricted to fluorescence reporter reagents, although some common principles are shared by immunohistochemistry or immunocytochemistry techniques and noted where appropriate. The work product of this two year effort is the content of this special issue of this journal, which is published as 5 separate articles, this being Validation of Cell-based Fluorescence Assays: Practice Guidelines from the ICSH and ICCS - Part IV - Postanalytic considerations. © 2013 International Clinical Cytometry Society.

Development and Validation of Attitude toward Gestational Surrogacy Scale in Iranian Infertile Couples

PubMed Central

Rahimi Kian, Fatemeh; Zandi, Afsaneh; Omani Samani, Reza; Maroufizadeh, Saman; Mehran, Abbas

2016-01-01

Background Surrogacy is one of the most challenging infertility treatments engaging ethical, psychological and social issues. Attitudes survey plays an important role to disclosure variant aspects of surrogacy, to help meeting legislative gaps and ambiguities, and to convert controversial dimensions surrounding surrogacy to a normative concept that eliminates stigma. The aim of this study is to develop a comprehensive scale for gestational surrogacy attitudes. Materials and Methods Development process of gestational surrogacy attitudes scale (GSAS) performed based on a descriptive cross-sectional study and included a rich data pool gathered from literature reviews, a qualitative pilot study on 15 infertile couples (n=30), use of expert advisory panel (EAP) consisting of 20 members, as well as use of content validity through qualitative and quantitative study by the means of content validity ratio (CVR) and content validity index (CVI). Also internal consistence using Cronbach’s alpha and test-retest reliability using intracalss correlation coefficient (ICC) were evaluated. Application of GSAS was tested in a cross-sectional study that was conducted on 200 infertile couples (n=400) at Royan Institute, Tehran, Iran, during 2014. Results Final version of GSAS had 30 items within five subscales including "acceptance of surrogacy", "Surrogacy and public attitudes", "Child born through surrogacy", "Surrogate mother", and "Intentional attitude and surrogacy future attempt". Content validity was represented with values of CVR=0.73 and CVI =0.98. Cronbach’s alpha value was 0.91 for the overall scale, while ICC value due to test-retest responses was 0.89. Conclusion Acceptable level of competency and capability of GSAS is significantly indicated; therefore, it seems to be an appropriate tool for the evaluation of gestational surrogacy attitudes in Iranian infertile couples. PMID:27123208

Development and Validation of Attitude toward Gestational Surrogacy Scale in Iranian Infertile Couples.

PubMed

Rahimi Kian, Fatemeh; Zandi, Afsaneh; Omani Samani, Reza; Maroufizadeh, Saman; Mehran, Abbas

2016-01-01

Surrogacy is one of the most challenging infertility treatments engaging ethical, psychological and social issues. Attitudes survey plays an important role to disclosure variant aspects of surrogacy, to help meeting legislative gaps and ambiguities, and to convert controversial dimensions surrounding surrogacy to a normative concept that eliminates stigma. The aim of this study is to develop a comprehensive scale for gestational surrogacy attitudes. Development process of gestational surrogacy attitudes scale (GSAS) performed based on a descriptive cross-sectional study and included a rich data pool gathered from literature reviews, a qualitative pilot study on 15 infertile couples (n=30), use of expert advisory panel (EAP) consisting of 20 members, as well as use of content validity through qualitative and quantitative study by the means of content validity ratio (CVR) and content validity index (CVI). Also internal consistence using Cronbach's alpha and test-retest reliability using intracalss correlation coefficient (ICC) were evaluated. Application of GSAS was tested in a cross-sectional study that was conducted on 200 infertile couples (n=400) at Royan Institute, Tehran, Iran, during 2014. Final version of GSAS had 30 items within five subscales including "acceptance of surrogacy", "Surrogacy and public attitudes", "Child born through surrogacy", "Surrogate mother", and "Intentional attitude and surrogacy future attempt". Content validity was represented with values of CVR=0.73 and CVI =0.98. Cronbach's alpha value was 0.91 for the overall scale, while ICC value due to test-retest responses was 0.89. Acceptable level of competency and capability of GSAS is significantly indicated; therefore, it seems to be an appropriate tool for the evaluation of gestational surrogacy attitudes in Iranian infertile couples.

Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

PubMed

Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

2018-06-04

To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

An Adaptation of the Original Fresno Test to Measure Evidence-Based Practice Competence in Pediatric Bedside Nurses.

PubMed

Laibhen-Parkes, Natasha; Kimble, Laura P; Melnyk, Bernadette Mazurek; Sudia, Tanya; Codone, Susan

2018-06-01

Instruments used to assess evidence-based practice (EBP) competence in nurses have been subjective, unreliable, or invalid. The Fresno test was identified as the only instrument to measure all the steps of EBP with supportive reliability and validity data. However, the items and psychometric properties of the original Fresno test are only relevant to measure EBP with medical residents. Therefore, the purpose of this paper is to describe the development of the adapted Fresno test for pediatric nurses, and provide preliminary validity and reliability data for its use with Bachelor of Science in Nursing-prepared pediatric bedside nurses. General adaptations were made to the original instrument's case studies, item content, wording, and format to meet the needs of a pediatric nursing sample. The scoring rubric was also modified to complement changes made to the instrument. Content and face validity, and intrarater reliability of the adapted Fresno test were assessed during a mixed-methods pilot study conducted from October to December 2013 with 29 Bachelor of Science in Nursing-prepared pediatric nurses. Validity data provided evidence for good content and face validity. Intrarater reliability estimates were high. The adapted Fresno test presented here appears to be a valid and reliable assessment of EBP competence in Bachelor of Science in Nursing-prepared pediatric nurses. However, further testing of this instrument is warranted using a larger sample of pediatric nurses in diverse settings. This instrument can be a starting point for evaluating the impact of EBP competence on patient outcomes. © 2018 Sigma Theta Tau International.

Non-Invasive Methodology to Estimate Polyphenol Content in Extra Virgin Olive Oil Based on Stepwise Multilinear Regression.

PubMed

Martínez Gila, Diego Manuel; Cano Marchal, Pablo; Gómez Ortega, Juan; Gámez García, Javier

2018-03-25

Normally the olive oil quality is assessed by chemical analysis according to international standards. These norms define chemical and organoleptic markers, and depending on the markers, the olive oil can be labelled as lampante, virgin, or extra virgin olive oil (EVOO), the last being an indicator of top quality. The polyphenol content is related to EVOO organoleptic features, and different scientific works have studied the positive influence that these compounds have on human health. The works carried out in this paper are focused on studying relations between the polyphenol content in olive oil samples and its spectral response in the near infrared spectra. In this context, several acquisition parameters have been assessed to optimize the measurement process within the virgin olive oil production process. The best regression model reached a mean error value of 156.14 mg/kg in leave one out cross validation, and the higher regression coefficient was 0.81 through holdout validation.

Non-Invasive Methodology to Estimate Polyphenol Content in Extra Virgin Olive Oil Based on Stepwise Multilinear Regression

PubMed Central

Cano Marchal, Pablo; Gómez Ortega, Juan; Gámez García, Javier

2018-01-01

Normally the olive oil quality is assessed by chemical analysis according to international standards. These norms define chemical and organoleptic markers, and depending on the markers, the olive oil can be labelled as lampante, virgin, or extra virgin olive oil (EVOO), the last being an indicator of top quality. The polyphenol content is related to EVOO organoleptic features, and different scientific works have studied the positive influence that these compounds have on human health. The works carried out in this paper are focused on studying relations between the polyphenol content in olive oil samples and its spectral response in the near infrared spectra. In this context, several acquisition parameters have been assessed to optimize the measurement process within the virgin olive oil production process. The best regression model reached a mean error value of 156.14 mg/kg in leave one out cross validation, and the higher regression coefficient was 0.81 through holdout validation. PMID:29587403

Development and psychometric testing of a Clinical Reasoning Evaluation Simulation Tool (CREST) for assessing nursing students' abilities to recognize and respond to clinical deterioration.

PubMed

Liaw, Sok Ying; Rashasegaran, Ahtherai; Wong, Lai Fun; Deneen, Christopher Charles; Cooper, Simon; Levett-Jones, Tracy; Goh, Hongli Sam; Ignacio, Jeanette

2018-03-01

The development of clinical reasoning skills in recognising and responding to clinical deterioration is essential in pre-registration nursing education. Simulation has been increasingly used by educators to develop this skill. To develop and evaluate the psychometric properties of a Clinical Reasoning Evaluation Simulation Tool (CREST) for measuring clinical reasoning skills in recognising and responding to clinical deterioration in a simulated environment. A scale development with psychometric testing and mixed methods study. Nursing students and academic staff were recruited at a university. A three-phase prospective study was conducted. Phase 1 involved the development and content validation of the CREST; Phase 2 included the psychometric testing of the tool with 15 second-year and 15 third-year nursing students who undertook the simulation-based assessment; Phase 3 involved the usability testing of the tool with nine academic staff through a survey questionnaire and focus group discussion. A 10-item CREST was developed based on a model of clinical reasoning. A content validity of 0.93 was obtained from the validation of 15 international experts. The construct validity was supported as the third-year students demonstrated significantly higher (p<0.001) clinical reasoning scores than the second-year students. The concurrent validity was also supported with significant positive correlations between global rating scores and almost all subscale scores, and the total scores. The predictive validity was supported with an existing tool. The internal consistency was high with a Cronbach's alpha of 0.92. A high inter-rater reliability was demonstrated with an intraclass correlation coefficient of 0.88. The usability of the tool was rated positively by the nurse educators but the need to ease the scoring process was highlighted. A valid and reliable tool was developed to measure the effectiveness of simulation in developing clinical reasoning skills for recognising and responding to clinical deterioration. Copyright © 2017. Published by Elsevier Ltd.

"Blue flags", development of a short clinical questionnaire on work-related psychosocial risk factors - a validation study in primary care.

PubMed

Post Sennehed, Charlotte; Gard, Gunvor; Holmberg, Sara; Stigmar, Kjerstin; Forsbrand, Malin; Grahn, Birgitta

2017-07-24

Working conditions substantially influence health, work ability and sick leave. Useful instruments to help clinicians pay attention to working conditions are lacking in primary care (PC). The aim of this study was to test the validity of a short "Blue flags" questionnaire, which focuses on work-related psychosocial risk factors and any potential need for contacts and/or actions at the workplace. From the original"The General Nordic Questionnaire" (QPS Nordic ) the research group identified five content areas with a total of 51 items which were considered to be most relevant focusing on work-related psychosocial risk factors. Fourteen items were selected from the identified QPS Nordic content areas and organised in a short questionnaire "Blue flags". These 14 items were validated towards the 51 QPS Nordic items. Content validity was reviewed by a professional panel and a patient panel. Structural and concurrent validity were also tested within a randomised clinical trial. The two panels (n = 111) considered the 14 psychosocial items to be relevant. A four-factor model was extracted with an explained variance of 25.2%, 14.9%, 10.9% and 8.3% respectively. All 14 items showed satisfactory loadings on all factors. Concerning concurrent validity the overall correlation was very strong r s  = 0.87 (p < 0.001).). Correlations were moderately strong for factor one, r s  = 0.62 (p < 0.001) and factor two, r s  = 0.74 (p < 0.001). Factor three and factor four were weaker, bur still fair and significant at r s  = 0.53 (p < 0.001) and r s  = 0.41 (p < 0.001) respectively. The internal consistency of the whole "Blue flags" was good with Cronbach's alpha of 0.76. The content, structural and concurrent validity were satisfactory in this first step of development of the "Blue flags" questionnaire. In summary, the overall validity is considered acceptable. Testing in clinical contexts and in other patient populations is recommended to ensure predictive validity and usefulness.

Promoting the Quality of Health Research-based News: Introduction of a Tool

PubMed Central

Ashoorkhani, Mahnaz; Majdzadeh, Reza; Nedjat, Saharnaz; Gholami, Jaleh

2017-01-01

Introduction: While disseminating health research findings to the public, it is very important to present appropriate and accurate information to give the target audience a correct understanding of the subject matter. The objective of this study was to design and psychometrically evaluate a checklist for health journalists to help them prepare news of appropriate accuracy and authenticity. Methods: The study consisted of two phases, checklist design and psychometrics. Literature review and expert opinion were used to extract the items of the checklist in the first phase. In the second phase, to assess content and face validity, the judgment of 38 persons (epidemiologists with a tool production history, editors-in-chief, and health journalists) was used to check the items’ understandability, nonambiguity, relevancy, and clarity. Reliability was assessed by the test–retest method using intra-cluster correlation (ICC) indices in the two phases. Cronbach's alpha was used to assess internal validity of the checklist. Results: Based on the participants’ opinions, the items were reduced from 20 to 14 in number. The items were categorized into the following three domains: (a) items assessing the source of news and its validity, (b) items addressing the presentation of complete and accurate information on research findings, and (c) items which if adhered to lead to the target audiences’ better understanding. The checklist was approved for content and face validity. The reliability of the checklist was assessed in the last stage; the ICC was 1 for 12 items and above 0.8 for the other two. Internal consistency (Cronbach's alpha) was 0.98. Discussion and Conclusions: The resultant indices of the study indicate that the checklist has appropriate validity and reliability. Hence, it can be used by health journalists to develop health research-based news. PMID:29184638

Survey Development to Assess College Students' Perceptions of the Campus Environment.

PubMed

Sowers, Morgan F; Colby, Sarah; Greene, Geoffrey W; Pickett, Mackenzie; Franzen-Castle, Lisa; Olfert, Melissa D; Shelnutt, Karla; Brown, Onikia; Horacek, Tanya M; Kidd, Tandalayo; Kattelmann, Kendra K; White, Adrienne A; Zhou, Wenjun; Riggsbee, Kristin; Yan, Wangcheng; Byrd-Bredbenner, Carol

2017-11-01

We developed and tested a College Environmental Perceptions Survey (CEPS) to assess college students' perceptions of the healthfulness of their campus. CEPS was developed in 3 stages: questionnaire development, validity testing, and reliability testing. Questionnaire development was based on an extensive literature review and input from an expert panel to establish content validity. Face validity was established with the target population using cognitive interviews with 100 college students. Concurrent-criterion validity was established with in-depth interviews (N = 30) of college students compared to surveys completed by the same 30 students. Surveys completed by college students from 8 universities (N = 1147) were used to test internal structure (factor analysis) and internal consistency (Cronbach's alpha). After development and testing, 15 items remained from the original 48 items. A 5-factor solution emerged: physical activity (4 items, α = .635), water (3 items, α = .773), vending (2 items, α = .680), healthy food (2 items, α = .631), and policy (2 items, α = .573). The mean total score for all universities was 62.71 (±11.16) on a 100-point scale. CEPS appears to be a valid and reliable tool for assessing college students' perceptions of their health-related campus environment.

Validity of the Mexican version of the combined Foot Care Confidence / Foot-Care Behavior scale for diabetes.

PubMed

García-Inzunza, Jaime A; Valles-Medina, Ana M; Muñoz, Fátima A; Delgadillo-Ramos, Guadalupe; Compean-Ortiz, Lidia G

2015-07-01

To 1) translate / transculturally adapt the original (English-language) combined Foot Care Confidence Scale / Foot-Care Behavior instrument (FCCS-FCB) to produce a Mexican-Spanish version and 2) determine its validity and reliability in a population with diabetes in Tijuana, Mexico. The original FCCS-FCB was translated (and back-translated), the content validated (by a group of health professional experts), and the instrument applied to 304 patients 23-78 years old in diabetes support groups in Tijuana, Mexico. Internal consistency for the study constructs ("self-efficacy," and risk / preventive foot self-care behaviors) was measured using Cronbach's alpha. The constructs were validated using principal component factor analysis. The Cronbach's alpha values for internal consistency were 0.782 for self-efficacy and 0.505 for behaviors. Based on the analysis, two factors explained 49.1% of the total variance for self-efficacy, and six factors explained 57.7% of the total variance for behaviors. The results were consistent with those for the original (English) version of the FCCS-FCB. The Mexican version of the FCCS-FCB is a reliable and valid instrument recommended for use with Mexican-Spanish-speaking patients with diabetes.

Hypertension Knowledge-Level Scale (HK-LS): a study on development, validity and reliability.

PubMed

Erkoc, Sultan Baliz; Isikli, Burhanettin; Metintas, Selma; Kalyoncu, Cemalettin

2012-03-01

This study was conducted to develop a scale to measure knowledge about hypertension among Turkish adults. The Hypertension Knowledge-Level Scale (HK-LS) was generated based on content, face, and construct validity, internal consistency, test re-test reliability, and discriminative validity procedures. The final scale had 22 items with six sub-dimensions. The scale was applied to 457 individuals aged ≥ 18 years, and 414 of them were re-evaluated for test-retest reliability. The six sub-dimensions encompassed 60.3% of the total variance. Cronbach alpha coefficients were 0.82 for the entire scale and 0.92, 0.59, 0.67, 0.77, 0.72, and 0.76 for the sub-dimensions of definition, medical treatment, drug compliance, lifestyle, diet, and complications, respectively. The scale ensured internal consistency in reliability and construct validity, as well as stability over time. Significant relationships were found between knowledge score and age, gender, educational level, and history of hypertension of the participants. No correlation was found between knowledge score and working at an income-generating job. The present scale, developed to measure the knowledge level of hypertension among Turkish adults, was found to be valid and reliable.

Development, linguistic and clinimetric validation of the WOMAC VA3.01 Bangla for Bangladesh Index.

PubMed

Rabbani, M G; Haq, S A; Bellamy, N; Islam, M N; Choudhury, M R; Naheed, A; Ahmed, S; Shahin, A

2015-06-01

The aim of this study was to develop and to validate a Bengali version of the Western Ontario and McMaster Osteoarthritis (WOMAC) index in Bangladesh. The WOMAC was translated into the local language of Bangladesh (Bengali) and adapted in the local sociocultural context, following the standard guidelines by Beaton et al. Content validity of the preliminary Bengali version was assessed by using the index of content validity (ICV) and floor and ceiling effects. Patients were assessed at the Department of Rheumatology of Bangabandhu Sheikh Mujib Medical University and were diagnosed to have knee OA by American College of Rheumatology criteria and recruited according to the requirements of the validation study. Convergent and divergent validity were measured by comparing with Health Assessment Questionnaire (HAQ) and the Short Form-36 (SF-36), and internal consistency was assessed using Cronbach's alpha coefficient. The questionnaire was readministered to 40 patients within a week for assessing reliability by using intra-class correlation coefficient (ICC) and Spearman's rank correlation coefficient. In addition, factor analysis of Bengali WOMAC questionnaire was performed to examine the number of factors influencing a common set of items. A Bengali version was developed with changes in three items to suit local practices. The ICV of the content validity was 1 for all items. The Bengali WOMAC had similar construct validity when compared to the HAQ (ρ 0.74, n = 70) and SF-36 bodily pain and physical functioning. It had dissimilar construct validity to SF-36 mental health domain except WOMAC pain. Factor analysis revealed five factors with eigenvalues of more than 1.0. Cronbach's alpha and ICC exceeded 0.7 in all domains. In the test-retest reliability testing, Spearman's ρ for all items exceeded 0.4 (n = 40). This study has demonstrated that the Bengali version of WOMAC is a valid tool for assessing quality of life of patients with knee osteoarthritis in Bangladesh and is reliable.

Disruptive behavior scale for adolescents (DISBA): development and psychometric properties.

PubMed

Karimy, Mahmood; Fakhri, Ahmad; Vali, Esmaeel; Vali, Farzaneh; Veiga, Feliciano H; Stein, L A R; Araban, Marzieh

2018-01-01

Growing evidence indicates that if disruptive behavior is left unidentified and untreated, a significant proportion of these problems will persist and may develop into problems linked with delinquency, substance abuse, and violence. Research is needed to develop valid and reliable measures of disruptive behavior to assist recognition and impact of treatments on disruptive behavior. The aim of this study was to develop and evaluate the psychometric properties of a scale for disruptive behavior in adolescents. Six hundred high school students (50% girls), ages ranged 15-18 years old, selected through multi stage random sampling. Psychometrics of the disruptive behavior scale for adolescents (DISBA) (Persian version) was assessed through content validity, explanatory factor analysis (EFA) using Varimax rotation and confirmatory factor analysis (CFA). The reliability of this scale was assessed via internal consistency and test-retest reliability. EFA revealed four factors accounting for 59% of observed variance. The final 29-item scale contained four factors: (1) aggressive school behavior, (2) classroom defiant behavior, (3) unimportance of school, and (4) defiance to school authorities. Furthermore, CFA produced a sufficient Goodness of Fit Index > 0.90. Test-retest and internal consistency reliabilities were acceptable at 0.85 and 0.89, respectively. The findings from this study suggest that the Iranian version of DISBA questionnaire has content validity. Further studies are needed to evaluate stronger psychometric properties for DISBA.

The development of the PARENTS: a tool for parents to assess residents' non-technical skills in pediatric emergency departments.

PubMed

Moreau, Katherine A; Eady, Kaylee; Tang, Kenneth; Jabbour, Mona; Frank, Jason R; Campbell, Meaghan; Hamstra, Stanley J

2017-11-14

Parents can assess residents' non-technical skills (NTS) in pediatric emergency departments (EDs). There are no assessment tools, with validity evidence, for parental use in pediatric EDs. The purpose of this study was to develop the Parents' Assessment of Residents Enacting Non-Technical Skills (PARENTS) educational assessment tool and collect three sources of validity evidence (i.e., content, response process, internal structure) for it. We established content evidence for the PARENTS through interviews with physician-educators and residents, focus groups with parents, a literature review, and a modified nominal group technique with experts. We collected response process evidence through cognitive interviews with parents. To examine the internal structure evidence, we administered the PARENTS and performed exploratory factor analysis. Initially, a 20-item PARENTS was developed. Cognitive interviews led to the removal of one closed-ended item, the addition of resident photographs, and wording/formatting changes. Thirty-seven residents and 434 parents participated in the administration of the resulting 19-item PARENTS. Following factor analysis, a one-factor model prevailed. The study presents initial validity evidence for the PARENTS. It also highlights strategies for potentially: (a) involving parents in the assessment of residents, (b) improving the assessment of NTS in pediatric EDs, and (c) capturing parents' perspectives to improve the preparation of future physicians.

Development and psychometric properties of a belief-based Physical Activity Questionnaire for Diabetic Patients (PAQ-DP).

PubMed

Ghazanfari, Zeinab; Niknami, Shamsaddin; Ghofranipour, Fazlollah; Hajizadeh, Ebrahim; Montazeri, Ali

2010-11-09

This study carried out to develop a scale for assessing diabetic patients' perceptions about physical activity and to test its psychometric properties (The Physical Activity Questionnaire for Diabetic Patients-PAQ-DP). An item pool extracted from the Theory of Planned Behavior literature was generated. Then an expert panel evaluated the items by assessing content validity index and content validity ratio. Consequently exploratory factor analysis (EFA) was performed to indicate the scale constructs. In addition reliability analyses including internal consistency and test-retest analysis were carried out. In all a sample of 127 women with diabetes participated in the study. Twenty-two items were initially extracted from the literature. A six-factor solution (containing 19 items) emerged as a result of an exploratory factor analysis namely: instrumental attitude, subjective norm, perceived behavioral control, affective attitude, self-identity, and intention explaining 60.30% of the variance observed. Additional analyses indicated satisfactory results for internal consistency (Cronbach's alpha ranging from 0.54 to 0.8) and intraclass correlation coefficients (ranging from 0.40 to 0.92). The Physical Activity Questionnaire for Diabetic Patients (PAQ-DP) is the first instrument that applies the Theory of Planned Behavior in its constructs. The findings indicated that the PAQ-DP is a reliable and valid measure for assessing physical activity perceptions and now is available and can be used in future studies.

Development and psychometric properties of a belief-based Physical Activity Questionnaire for Diabetic Patients (PAQ-DP)

PubMed Central

2010-01-01

Background This study carried out to develop a scale for assessing diabetic patients' perceptions about physical activity and to test its psychometric properties (The Physical Activity Questionnaire for Diabetic Patients-PAQ-DP). Methods An item pool extracted from the Theory of Planned Behavior literature was generated. Then an expert panel evaluated the items by assessing content validity index and content validity ratio. Consequently exploratory factor analysis (EFA) was performed to indicate the scale constructs. In addition reliability analyses including internal consistency and test-retest analysis were carried out. Results In all a sample of 127 women with diabetes participated in the study. Twenty-two items were initially extracted from the literature. A six-factor solution (containing 19 items) emerged as a result of an exploratory factor analysis namely: instrumental attitude, subjective norm, perceived behavioral control, affective attitude, self-identity, and intention explaining 60.30% of the variance observed. Additional analyses indicated satisfactory results for internal consistency (Cronbach's alpha ranging from 0.54 to 0.8) and intraclass correlation coefficients (ranging from 0.40 to 0.92). Conclusions The Physical Activity Questionnaire for Diabetic Patients (PAQ-DP) is the first instrument that applies the Theory of Planned Behavior in its constructs. The findings indicated that the PAQ-DP is a reliable and valid measure for assessing physical activity perceptions and now is available and can be used in future studies. PMID:21062466

[The added value of information summaries supporting clinical decisions at the point-of-care.

PubMed

Banzi, Rita; González-Lorenzo, Marien; Kwag, Koren Hyogene; Bonovas, Stefanos; Moja, Lorenzo

2016-11-01

Evidence-based healthcare requires the integration of the best research evidence with clinical expertise and patients' values. International publishers are developing evidence-based information services and resources designed to overcome the difficulties in retrieving, assessing and updating medical information as well as to facilitate a rapid access to valid clinical knowledge. Point-of-care information summaries are defined as web-based medical compendia that are specifically designed to deliver pre-digested, rapidly accessible, comprehensive, and periodically updated information to health care providers. Their validity must be assessed against marketing claims that they are evidence-based. We periodically evaluate the content development processes of several international point-of-care information summaries. The number of these products has increased along with their quality. The last analysis done in 2014 identified 26 products and found that three of them (Best Practice, Dynamed e Uptodate) scored the highest across all evaluated dimensions (volume, quality of the editorial process and evidence-based methodology). Point-of-care information summaries as stand-alone products or integrated with other systems, are gaining ground to support clinical decisions. The choice of one product over another depends both on the properties of the service and the preference of users. However, even the most innovative information system must rely on transparent and valid contents. Individuals and institutions should regularly assess the value of point-of-care summaries as their quality changes rapidly over time.

Predictive and External Validity of a Pre-Market Study to Determine the Most Effective Pictorial Health Warning Label Content for Cigarette Packages

PubMed Central

Thrasher, James F.; Reid, Jessica L.; Hammond, David

2016-01-01

Abstract Introduction: Studies examining cigarette package pictorial health warning label (HWL) content have primarily used designs that do not allow determination of effectiveness after repeated, naturalistic exposure. This research aimed to determine the predictive and external validity of a pre-market evaluation study of pictorial HWLs. Methods: Data were analyzed from: (1) a pre-market convenience sample of 544 adult smokers who participated in field experiments in Mexico City before pictorial HWL implementation (September 2010); and (2) a post-market population-based representative sample of 1765 adult smokers in the Mexican administration of the International Tobacco Control Policy Evaluation Survey after pictorial HWL implementation. Participants in both samples rated six HWLs that appeared on cigarette packs, and also ranked HWLs with four different themes. Mixed effects models were estimated for each sample to assess ratings of relative effectiveness for the six HWLs, and to assess which HWL themes were ranked as the most effective. Results: Pre- and post-market data showed similar relative ratings across the six HWLs, with the least and most effective HWLs consistently differentiated from other HWLs. Models predicting rankings of HWL themes in post-market sample indicated: (1) pictorial HWLs were ranked as more effective than text-only HWLs; (2) HWLs with both graphic and “lived experience” content outperformed symbolic content; and, (3) testimonial content significantly outperformed didactic content. Pre-market data showed a similar pattern of results, but with fewer statistically significant findings. Conclusions: The study suggests well-designed pre-market studies can have predictive and external validity, helping regulators select HWL content. PMID:26377516

Predictive and External Validity of a Pre-Market Study to Determine the Most Effective Pictorial Health Warning Label Content for Cigarette Packages.

PubMed

Huang, Li-Ling; Thrasher, James F; Reid, Jessica L; Hammond, David

2016-05-01

Studies examining cigarette package pictorial health warning label (HWL) content have primarily used designs that do not allow determination of effectiveness after repeated, naturalistic exposure. This research aimed to determine the predictive and external validity of a pre-market evaluation study of pictorial HWLs. Data were analyzed from: (1) a pre-market convenience sample of 544 adult smokers who participated in field experiments in Mexico City before pictorial HWL implementation (September 2010); and (2) a post-market population-based representative sample of 1765 adult smokers in the Mexican administration of the International Tobacco Control Policy Evaluation Survey after pictorial HWL implementation. Participants in both samples rated six HWLs that appeared on cigarette packs, and also ranked HWLs with four different themes. Mixed effects models were estimated for each sample to assess ratings of relative effectiveness for the six HWLs, and to assess which HWL themes were ranked as the most effective. Pre- and post-market data showed similar relative ratings across the six HWLs, with the least and most effective HWLs consistently differentiated from other HWLs. Models predicting rankings of HWL themes in post-market sample indicated: (1) pictorial HWLs were ranked as more effective than text-only HWLs; (2) HWLs with both graphic and "lived experience" content outperformed symbolic content; and, (3) testimonial content significantly outperformed didactic content. Pre-market data showed a similar pattern of results, but with fewer statistically significant findings. The study suggests well-designed pre-market studies can have predictive and external validity, helping regulators select HWL content. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Objectifying Content Validity: Conducting a Content Validity Study in Social Work Research.

ERIC Educational Resources Information Center

Rubio, Doris McGartland; Berg-Weger, Marla; Tebb, Susan S.; Lee, E. Suzanne; Rauch, Shannon

2003-01-01

The purpose of this article is to demonstrate how to conduct a content validity study. Instructions on how to calculate a content validity index, factorial validity index, and an interrater reliability index and guide for interpreting these indices are included. Implications regarding the value of conducting a content validity study for…

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

The 11-item Medication Adherence Reasons Scale: reliability and factorial validity among patients with hypertension in Malaysian primary healthcare settings

PubMed Central

Shima, Razatul; Farizah, Hairi; Majid, Hazreen Abdul

2015-01-01

INTRODUCTION The aim of this study was to assess the reliability and validity of a modified Malaysian version of the Medication Adherence Reasons Scale (MAR-Scale). METHODS In this cross-sectional study, the 15-item MAR-Scale was administered to 665 patients with hypertension who attended one of the four government primary healthcare clinics in the Hulu Langat and Klang districts of Selangor, Malaysia, between early December 2012 and end-March 2013. The construct validity was examined in two phases. Phase I consisted of translation of the MAR-Scale from English to Malay, a content validity check by an expert panel, a face validity check via a small preliminary test among patients with hypertension, and exploratory factor analysis (EFA). Phase II involved internal consistency reliability calculations and confirmatory factor analysis (CFA). RESULTS EFA verified five existing factors that were previously identified (i.e. issues with medication management, multiple medications, belief in medication, medication availability, and the patient’s forgetfulness and convenience), while CFA extracted four factors (medication availability issues were not extracted). The final modified MAR-Scale model, which had 11 items and a four-factor structure, provided good evidence of convergent and discriminant validities. Cronbach’s alpha coefficient was > 0.7, indicating good internal consistency of the items in the construct. The results suggest that the modified MAR-Scale has good internal consistencies and construct validity. CONCLUSION The validated modified MAR-Scale (Malaysian version) was found to be suitable for use among patients with hypertension receiving treatment in primary healthcare settings. However, the comprehensive measurement of other factors that can also lead to non-adherence requires further exploration. PMID:25902719

The 11-item Medication Adherence Reasons Scale: reliability and factorial validity among patients with hypertension in Malaysian primary healthcare settings.

PubMed

Shima, Razatul; Farizah, Hairi; Majid, Hazreen Abdul

2015-08-01

The aim of this study was to assess the reliability and validity of a modified Malaysian version of the Medication Adherence Reasons Scale (MAR-Scale). In this cross-sectional study, the 15-item MAR-Scale was administered to 665 patients with hypertension who attended one of the four government primary healthcare clinics in the Hulu Langat and Klang districts of Selangor, Malaysia, between early December 2012 and end-March 2013. The construct validity was examined in two phases. Phase I consisted of translation of the MAR-Scale from English to Malay, a content validity check by an expert panel, a face validity check via a small preliminary test among patients with hypertension, and exploratory factor analysis (EFA). Phase II involved internal consistency reliability calculations and confirmatory factor analysis (CFA). EFA verified five existing factors that were previously identified (i.e. issues with medication management, multiple medications, belief in medication, medication availability, and the patient's forgetfulness and convenience), while CFA extracted four factors (medication availability issues were not extracted). The final modified MAR-Scale model, which had 11 items and a four-factor structure, provided good evidence of convergent and discriminant validities. Cronbach's alpha coefficient was > 0.7, indicating good internal consistency of the items in the construct. The results suggest that the modified MAR-Scale has good internal consistencies and construct validity. The validated modified MAR-Scale (Malaysian version) was found to be suitable for use among patients with hypertension receiving treatment in primary healthcare settings. However, the comprehensive measurement of other factors that can also lead to non-adherence requires further exploration.

The 2002 NIMH Provisional Diagnostic Criteria for Depression of Alzheimer's Disease (PDC-dAD): Gauging their Validity over a Decade Later.

PubMed

Sepehry, Amir A; Lee, Philip E; Hsiung, Ging-Yuek R; Beattie, B Lynn; Feldman, Howard H; Jacova, Claudia

2017-01-01

Presented herein is evidence for criterion, content, and convergent/discriminant validity of the NIMH-Provisional Diagnostic Criteria for depression of Alzheimer's Disease (PDC-dAD) that were formulated to address depression in Alzheimer's disease (AD). Using meta-analytic and systematic review methods, we examined criterion validity evidence in epidemiological and clinical studies comparing the PDC-dAD to Diagnostic and Statistical Manual of Mental Disorders fourth edition (DSM-IV), and International Classification of Disease (ICD 9) depression diagnostic criteria. We estimated prevalence of depression by PDC, DSM, and ICD with an omnibus event rate effect-size. We also examined diagnostic agreement between PDC and DSM. To gauge content validity, we reviewed rates of symptom endorsement for each diagnostic approach. Finally, we examined the PDC's relationship with assessment scales (global cognition, neuropsychiatric, and depression definition) for convergent validity evidence. The aggregate evidence supports the validity of the PDC-dAD. Our findings suggest that depression in AD differs from other depressive disorders including Major Depressive Disorder (MDD) in that dAD is more prevalent, with generally a milder presentation and with unique features not captured by the DSM. Although the PDC are the current standard for diagnosis of depression in AD, we identified the need for their further optimization based on predictive validity evidence.

Assessment of Semi-Structured Clinical Interview for Mobile Phone Addiction Disorder

PubMed Central

Alavi, Seyyed Salman; Jannatifard, Fereshteh; Mohammadi Kalhori, Soroush; Sepahbodi, Ghazal; BabaReisi, Mohammad; Sajedi, Sahar; Farshchi, Mojtaba; KhodaKarami, Rasul; Hatami Kasvaee, Vahid

2016-01-01

Objective: The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) classified mobile phone addiction disorder under “impulse control disorder not elsewhere classified”. This study surveyed the diagnostic criteria of DSM-IV-TR for the diagnosis of mobile phone addiction in correspondence with Iranian society and culture. Method: Two hundred fifty students of Tehran universities were entered into this descriptive-analytical and cross-sectional study. Quota sampling method was used. At first, semi- structured clinical interview (based on DSM-IV-TR) was performed for all the cases, and another specialist reevaluated the interviews. Data were analyzed using content validity, inter-scorer reliability (Kappa coefficient) and test-retest via SPSS18 software. Results: The content validity of the semi- structured clinical interview matched the DSM–IV-TR criteria for behavioral addiction. Moreover, their content was appropriate, and two items, including “SMS pathological use” and “High monthly cost of using the mobile phone” were added to promote its validity. Internal reliability (Kappa) and test–retest reliability were 0.55 and r = 0.4 (p<0. 01) respectively. Conclusion: The results of this study revealed that semi- structured diagnostic criteria of DSM-IV-TR are valid and reliable for diagnosing mobile phone addiction, and this instrument is an effective tool to diagnose this disorder. PMID:27437008

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Validation and adaptation of the hospital consumer assessment of healthcare providers and systems in Arabic context: Evidence from Saudi Arabia.

PubMed

Alanazi, Mohammed R; Alamry, Ahmed; Al-Surimi, Khaled

One of the main purposes of healthcare organizations is to serve patients by providing safe and high-quality patient-centered care. Patients are considered the most appropriate source to assess the quality level of healthcare services. The objectives of this paper were to describe the translation and adaptation process of the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey for Arabic speaking populations, examine the degree of equivalence between the original English version and the Arabic translated version, and estimate and report the validity and reliability of the translated Arabic HCAHPS version. The translation process had four main steps: (1) qualified bilingual translators translated the HCAHPS from English to Arabic; (2) the Arabic version was translated back to English and reviewed by experts to ensure content accuracy (content equivalence); (3) both Arabic and English versions were verified for accuracy and validity of the translation, checking for the similarities and differences (semantic equivalence); (4) finally, two independent bilinguals reviewed and made the final revision of both the Arabic and English versions separately and agreed on one final version that is similar and equivalent to the original English version in terms of content and meaning. The study findings showed that the overall Cronbach's α for the Arabic HCAHPS version was 0.90, showing good internal consistency across the 9 separate domains, which ranged from 0.70 to 0.97 Cronbach's α. The correlation coefficient between each statement for each separate domain revealed a highly positive significant correlation ranging from 0.72 to 0.89. The results of the study show empirical evidence of validity and reliability of HCAHPS in its Arabic version. Moreover, the Arabic version of HCAHPS in our study presented good internal consistency and it is highly recommended to be replicated and applied in the context of other Arab countries. Copyright © 2017. Published by Elsevier Ltd.

Mobility care in nursing homes: development and psychometric evaluation of the kinaesthetics competence self-evaluation (KCSE) scale.

PubMed

Gattinger, Heidrun; Senn, Beate; Hantikainen, Virpi; Köpke, Sascha; Ott, Stefan; Leino-Kilpi, Helena

2017-01-01

Impaired mobility is a prevalent condition among care-dependent persons living in nursing homes. Therefore, competence development of nursing staff in mobility care is important. This study aimed to develop and initially test the Kinaesthetics Competence Self-Evaluation (KCSE) scale for assessing nursing staff's competence in mobility care. The KCSE scale was developed based on an analysis of the concept of nurses' competence in kinaesthetics. Kinaesthetics is a training concept that provides theory and practice about movement foundations that comprise activities of daily living. The scale contains 28 items and four subscales (attitude, dynamic state, knowledge and skills). Content validity was assessed by determining the content validity index within two expert panels. Internal consistency and construct validity were tested within a cross-sectional study in three nursing homes in the German-speaking region of Switzerland between September and November 2015. The content validity index for the entire scale was good (0.93). Based on a sample of nursing staff ( n  = 180) the internal consistency results were good for the whole scale (Cronbach's alpha = 0.91) and for the subscales knowledge and skills (α = 0.91, 0.86), acceptable for the subscale attitude (α = 0.63) and weak for the subscale dynamic state (α = 0.54). Most items showed acceptable inter-item and item-total correlations. Based on the exploratory factor analysis, four factors explaining 52% of the variance were extracted. The newly developed KCSE scale is a promising instrument for measuring nursing staff's attitude, dynamic state, knowledge, and skills in mobility care based on kinaesthetics. Despite the need for further psychometric evaluation, the KCSE scale can be used in clinical practice to evaluate competence in mobility care based on kinaesthetics and to identify educational needs for nursing staff.

Development of a brief instrument for assessing healthcare employee satisfaction in a low-income setting.

PubMed

Alpern, Rachelle; Canavan, Maureen E; Thompson, Jennifer T; McNatt, Zahirah; Tatek, Dawit; Lindfield, Tessa; Bradley, Elizabeth H

2013-01-01

Ethiopia is one of 57 countries identified by the World Health Report 2006 as having a severely limited number of health care professionals. In recognition of this shortage, the Ethiopian Federal Ministry of Health, through the Ethiopian Hospital Management Initiative, prioritized the need to improve retention of health care workers. Accordingly, we sought to develop the Satisfaction of Employees in Health Care (SEHC) survey for use in hospitals and health centers throughout Ethiopia. Literature reviews and cognitive interviews were used to generate a staff satisfaction survey for use in the Ethiopian healthcare setting. We pretested the survey in each of the six hospitals and four health centers across Ethiopia (98% response rate). We assessed content validity and convergent validity using factor analysis and examined reliability using the Cronbach alpha coefficients to assess internal consistency. The final survey was comprised of 18 questions about specific aspects of an individual's work and two overall staff satisfaction questions. We found support for content validity, as data from the 18 responses factored into three factors, which we characterized as 1) relationship with management and supervisors, 2) job content, and 3) relationships with coworkers. Summary scores for two factors (relationship with management and supervisors and job content) were significantly associated (P-value, <0.001) with the two overall satisfaction items. Cronbach's alpha coefficients showed good to excellent internal consistency (Cronbach alpha coefficients >0.70) for the items in the three summary scores. The introduction of consistent and reliable measures of staff satisfaction is crucial to understand and improve employee retention rates, which threaten the successful achievement of the Millennium Development Goals in low-income countries. The use of the SEHC survey in Ethiopian healthcare facilities has ample leadership support, which is essential for addressing problems that reduce staff satisfaction and exacerbate excessive workforce shortages.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Development and Psychometric Testing of a Novel Food Service Satisfaction Questionnaire for Food Service Staff of Aged Care Homes.

PubMed

Miller, M; Hamilton, J; Scupham, R; Matwiejczyk, L; Prichard, I; Farrer, O; Yaxley, A

2018-01-01

Food service staff are integral to delivery of quality food in aged care homes yet measurement of their satisfaction is unable to be performed due to an absence of a valid and reliable questionnaire. The aim of this study was to develop and perform psychometric testing for a new Food Service Satisfaction Questionnaire developed in Australia specifically for use by food service staff working in residential aged care homes (Flinders FSSQFSAC). A mixed methods design utilizing both a qualitative (in-depth interviews, focus groups) and a quantitative approach (cross sectional survey) was used. Content validity was determined from focus groups and interviews with food service staff currently working in aged care homes, related questionnaires from the literature and consultation with an expert panel. The questionnaire was tested for construct validity and internal consistency using data from food service staff currently working in aged care homes that responded to an electronic invitation circulated to Australian aged care homes using a national database of email addresses. Construct validity was tested via principle components analysis and internal consistency through Cronbach's alpha. Temporal stability of the questionnaire was determined from food service staff undertaking the Flinders FSSQFSAC on two occasions, two weeks apart, and analysed using Pearson's correlations. Content validity for the Flinders FSSQFSAC was established from a panel of experts and stakeholders. Principle components analysis revealed food service staff satisfaction was represented by 61-items divided into eight domains: job satisfaction (α=0.832), food quality (α=0.871), staff training (α=0.922), consultation (α=0.840), eating environment (α=0.777), reliability (α=0.695), family expectations (α=0.781) and resident relationships (α=0.429), establishing construct validity in all domains, and internal consistency in all (α>0.5) except for "resident relationships" (α=0.429). Test-retest reliability coefficients ranged from 0.276 to 0.826 dependent on domain, with test-retest reliability established in seven domains at r>0.4; an exception was "reliability" at r=0.276. The newly developed Flinders FSSQFSAC has acceptable validity and reliability and thereby the potential to measure satisfaction of food service staff working in residential aged care homes, identify areas for strategic change, measure improvements and in turn, improve the satisfaction and quality of life of both food service staff and residents of aged care homes.

The Nurses Self-Concept Instrument (NSCI): assessment of psychometric properties for Australian domestic and international student nurses.

PubMed

Angel, Elizabeth; Craven, Rhonda; Denson, Nida

2012-07-01

Professional self-concept is a critical driver of job satisfaction. In Australia, as international nursing enrolments rise, nursing is increasingly characterised by a professional body of international nurses who may differ from domestic Australian nurses in their nursing self-concept. At present, no psychometrically sound instrument for assessing nursing self-concept for Australian domestic and international nursing students is available. The purpose of this study was to: (1) develop an instrument (the Nurses' Self-Concept Instrument (NSCI)) to measure the professional self-concept of domestic and international nursing students in Australia, and (2) test the psychometric properties of this newly developed instrument. A literature review was conducted to generate the initial dimension and item pools to measure nurses' professional self-concept (NSCI). Two stakeholders examined the content and face validity of dimensions and items. Analysis was performed on data collected from 253 undergraduate nursing students in a large public university in Sydney, Australia, and consisted of domestic (n=218) and international (n=35) nursing students. Internal reliability was assessed using Cronbach's Alpha. Confirmatory factor analysis (CFA) was used to assess the construct validity of the NSCI. The resulting NSCI consisted of 14 items across four self-concept domains: care, leadership, staff relations, and knowledge. The CFA supported the hypothesised factor structure of the self-concept model. All reliabilities were acceptable for both domestic and international students (ranging from r=.78 to .93). The NSCI was shown to be a valid and reliable tool for assessing Australian domestic and international student nurses' professional self-concept. This instrument may also enable those responsible for recruitment of students into nursing courses to assess students' professional self-concept and implement appropriate strategies to foster the growth of lifelong career development. Copyright © 2012 Elsevier Ltd. All rights reserved.

Measuring eating competence: psychometric properties and validity of the ecSatter Inventory.

PubMed

Lohse, Barbara; Satter, Ellyn; Horacek, Tanya; Gebreselassie, Tesfayi; Oakland, Mary Jane

2007-01-01

Assess validity of the ecSatter Inventory (ecSI) to measure eating competence (EC). Concurrent administration of ecSI with validated measures of eating behaviors using on-line and paper-pencil formats. The on-line survey was completed by 370 participants; 462 completed the paper version. Participants included 863 adults with 832 usable surveys from respondents (mean age 36.2 +/- 13.4 years) without eating disorders, mostly female, white, educated, overweight, physically active, and food secure. Of those indicating intent to complete the on-line survey, 80.3% did so; 54% of mailed surveys were returned. Eating and food behaviors compared among EC tertiles and between dichotomous EC categories; internal consistency of ecSI. Analysis of variance, independent t tests, chi-square, factor analysis, logistic regression. Significance level was P < .05. Mean ecSI score was 31.1 +/- 7.5. ecSI included 4 subscales with internal reliability and content validity. Construct validity was supported by specific behavioral profiles for ecSI tertiles and ecSI dichotomized categories. Persons unsatisfied with weight were 54% less likely to be EC; unit increase in the food like index was associated with nearly 3 times greater likelihood of being EC. The ecSatter Inventory is a valid measure of EC and can be used for descriptive and outcome measurements.

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS).

PubMed

Poon, Vickie Wan-kei; Lam, Linda Chiu-wa; Wong, Samuel Yeung-shan

2008-09-01

With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha=0.89 and alpha=0.94 respectively). High value of Cronbach's alpha (alpha=0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r=0.58 to r=0.78, p<0.01). The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation.

Validation of the Mandarin Chinese version of the Leicester Cough Questionnaire in bronchiectasis.

PubMed

Gao, Y-H; Guan, W-J; Xu, G; Gao, Y; Lin, Z-Y; Tang, Y; Lin, Z-M; Li, H-M; Luo, Q; Zhong, N-S; Birring, S S; Chen, R-C

2014-12-01

The Leicester Cough Questionnaire (LCQ) has been validated for assessing cough-specific health status in bronchiectasis. We translated the LCQ into Mandarin Chinese and investigated its validity, reliability and responsiveness. The LCQ was translated into Mandarin Chinese using the forward-backward translation procedure. A total of 144 out-patients completed the Mandarin Chinese version of the LCQ (LCQ-MC), the Hospital Anxiety and Depression Scale (HADS) and the St George's Respiratory Questionnaire. Reassessments were performed during exacerbations and at 6 months. Concurrent validation, internal consistency, repeatability and responsiveness were determined. Minor cultural adaptations were made to the wording of LCQ-MC. No other difficulties were found during the translation process, with all items easily adapted to acceptable Mandarin Chinese. The questionnaire was not changed in terms of content layout and the order of the questions. In cognitive debriefing interviews, participants reported that the questionnaire was acceptable, relevant, comprehensive and easy to complete. The LCQ-MC showed good concurrent validity, internal consistency and test-retest reliability. Responsiveness was shown by significant changes in LCQ-MC scores between steady state, the first exacerbation and following 2-week antibiotic treatment (both interval changes, P < 0.01) CONCLUSION: The LCQ-MC is a valid, reliable and responsive instrument for determining cough-specific health status in Chinese bronchiectasis patients.

Patient Reported Outcome Measure of Spiritual Care as Delivered by Chaplains.

PubMed

Snowden, Austyn; Telfer, Iain

2017-01-01

Chaplains are employed by health organizations around the world to support patients in recognizing and addressing their spiritual needs. There is currently no generalizable measure of the impact of these interventions and so the clinical and strategic worth of chaplaincy is difficult to articulate. This article introduces the Scottish PROM, an original five-item patient reported outcome measure constructed specifically to address this gap. It describes the validation process from its conceptual grounding in the spiritual care literature through face and content validity cycles. It shows that the Scottish PROM is internally consistent and unidimensional. Responses to the Scottish PROM show strong convergent validity with responses to the Warwick and Edinburgh Mental Well-Being Scale, a generic well-being scale often used as a proxy for spiritual well-being. In summary, the Scottish PROM is fit for purpose. It measures the outcomes of spiritual care as delivered by chaplains in this study. This novel project introduces an essential and original breakthrough; the possibility of generalizable international chaplaincy research.

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

PubMed

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

[Authorization, translation, back translation and language modification of the simplified Chinese adult comorbidity-27 index].

PubMed

Gao, L; Mao, C; Yu, G Y; Peng, X

2016-10-09

Objective: To translate the adult comorbidity evaluation-27(ACE-27) index authored by professor JF Piccirillo into Chinese and for the purpose of assessing the possible impact of comorbidity on survival of oral cancer patients and improving cancer staging. Methods: The translation included the following steps, obtaining permission from professor Piccirillo, translation, back translation, language modification, adjusted by the advice from the professors of oral and maxillofacial surgery. The test population included 154 patients who were admitted to Peking University of Stomatology during March 2011. Questionnaire survey was conducted on these patients. Retest of reliability, internal consistency reliability, content validity, and structure validity were performed. Results: The simplified Chinese ACE-27 index was established. The Cronbach's α was 0.821 in the internal consistency reliability test. The Kaiser-Meyer-Olkin (KMO) value of 8 items was 0.859 in the structure validity test. Conclusions: The simplified Chinese ACE-27 index has good feasibility and reliability. It is useful to assess the comorbidity of oral cancer patients.

[Preliminary construction of a questionnaire about knowledge of HIV/AIDS in Colombian veterans].

PubMed

Segura-Cardona, Angela; Berbesí-Fernández, Dedsy; Cardona-Arango, Doris; Ordóñez-Molina, Jaime

2011-01-01

In order to identify the level of knowledge about HIV/AIDS in Colombia veterans of war in the year 2009, a questionnaire was designed, built and validated, using a mixed design, for which three stages were followed: 1) Bibliographic review and construction of items of the questionnaire using a focus group, 2) Evaluation of content validity by a pannel of experts, 3) APLICACION of the final questionnaire, we selected non-randomly 323 people who were part of group of veterans in Colombia, and 4) Validation of the questionnaire through the evaluation of internal consistency and principal component analysis. We found that the questionnaire explored three factors: forms of infection, inadequate beliefs, and HIV prevention, which accounted for 52% of the variance. The survey showed adequate internal consistency values (Cronbach's α = 0.77). These results suggest the use of the questionnaire to assess knowledge level related to the form of infection, inaccurate beliefs and prevention of HIV-AIDS in this population.

Present status of the liquid lithium target facility in the international fusion materials irradiation facility (IFMIF)

NASA Astrophysics Data System (ADS)

Nakamura, Hiroo; Riccardi, B.; Loginov, N.; Ara, K.; Burgazzi, L.; Cevolani, S.; Dell'Orco, G.; Fazio, C.; Giusti, D.; Horiike, H.; Ida, M.; Ise, H.; Kakui, H.; Matsui, H.; Micciche, G.; Muroga, T.; Nakamura, Hideo; Shimizu, K.; Sugimoto, M.; Suzuki, A.; Takeuchi, H.; Tanaka, S.; Yoneoka, T.

2004-08-01

During the three year key element technology phase of the International Fusion Materials Irradiation Facility (IFMIF) project, completed at the end of 2002, key technologies have been validated. In this paper, these results are summarized. A water jet experiment simulating Li flow validated stable flow up to 20 m/s with a double reducer nozzle. In addition, a small Li loop experiment validated stable Li flow up to 14 m/s. To control the nitrogen content in Li below 10 wppm will require surface area of a V-Ti alloy getter of 135 m 2. Conceptual designs of diagnostics have been carried out. Moreover, the concept of a remote handling system to replace the back wall based on `cut and reweld' and `bayonet' options has been established. Analysis by FMEA showed safe operation of the target system. Recent activities in the transition phase, started in 2003, and plan for the next phase are also described.

Development and psychometric testing of the Nurse Practitioner Primary Care Organizational Climate Questionnaire.

PubMed

Poghosyan, Lusine; Nannini, Angela; Finkelstein, Stacey R; Mason, Emanuel; Shaffer, Jonathan A

2013-01-01

Policy makers and healthcare organizations are calling for expansion of the nurse practitioner (NP) workforce in primary care settings to assure timely access and high-quality care for the American public. However, many barriers, including those at the organizational level, exist that may undermine NP workforce expansion and their optimal utilization in primary care. This study developed a new NP-specific survey instrument, Nurse Practitioner Primary Care Organizational Climate Questionnaire (NP-PCOCQ), to measure organizational climate in primary care settings and conducted its psychometric testing. Using instrument development design, the organizational climate domain pertinent for primary care NPs was identified. Items were generated from the evidence and qualitative data. Face and content validity were established through two expert meetings. Content validity index was computed. The 86-item pool was reduced to 55 items, which was pilot tested with 81 NPs using mailed surveys and then field-tested with 278 NPs in New York State. SPSS 18 and Mplus software were used for item analysis, reliability testing, and maximum likelihood exploratory factor analysis. Nurse Practitioner Primary Care Organizational Climate Questionnaire had face and content validity. The content validity index was .90. Twenty-nine items loaded on four subscale factors: professional visibility, NP-administration relations, NP-physician relations, and independent practice and support. The subscales had high internal consistency reliability. Cronbach's alphas ranged from.87 to .95. Having a strong instrument is important to promote future research. Also, administrators can use it to assess organizational climate in their clinics and propose interventions to improve it, thus promoting NP practice and the expansion of NP workforce.

Development, content validity, and cross-cultural adaptation of a patient-reported outcome measure for real-time symptom assessment in irritable bowel syndrome.

PubMed

Vork, L; Keszthelyi, D; Mujagic, Z; Kruimel, J W; Leue, C; Pontén, I; Törnblom, H; Simrén, M; Albu-Soda, A; Aziz, Q; Corsetti, M; Holvoet, L; Tack, J; Rao, S S; van Os, J; Quetglas, E G; Drossman, D A; Masclee, A A M

2018-03-01

End-of-day questionnaires, which are considered the gold standard for assessing abdominal pain and other gastrointestinal (GI) symptoms in irritable bowel syndrome (IBS), are influenced by recall and ecological bias. The experience sampling method (ESM) is characterized by random and repeated assessments in the natural state and environment of a subject, and herewith overcomes these limitations. This report describes the development of a patient-reported outcome measure (PROM) based on the ESM principle, taking into account content validity and cross-cultural adaptation. Focus group interviews with IBS patients and expert meetings with international experts in the fields of neurogastroenterology & motility and pain were performed in order to select the items for the PROM. Forward-and-back translation and cognitive interviews were performed to adapt the instrument for the use in different countries and to assure on patients' understanding with the final items. Focus group interviews revealed 42 items, categorized into five domains: physical status, defecation, mood and psychological factors, context and environment, and nutrition and drug use. Experts reduced the number of items to 32 and cognitive interviewing after translation resulted in a few slight adjustments regarding linguistic issues, but not regarding content of the items. An ESM-based PROM, suitable for momentary assessment of IBS symptom patterns was developed, taking into account content validity and cross-cultural adaptation. This PROM will be implemented in a specifically designed smartphone application and further validation in a multicenter setting will follow. © 2017 John Wiley & Sons Ltd.

A serious game can be a valid method to train clinical decision-making in surgery.

PubMed

Graafland, Maurits; Vollebergh, Maarten F; Lagarde, Sjoerd M; van Haperen, M; Bemelman, Willem A; Schijven, Marlies P

2014-12-01

A serious game was developed to train surgical residents in clinical decision-making regarding biliary tract disease. Serious or applied gaming is a novel educational approach to postgraduate training, combining training and assessment of clinical decision-making in a fun and challenging way. Although interest for serious games in medicine is rising, evidence on its validity is lacking. This study investigates face, content, and construct validity of this serious game. Experts structurally validated the game's medical content. Subsequently, 41 participants played the game. Decision scores and decision speed were compared among surgeons, surgical residents, interns, and medical students, determining the game's discriminatory ability between different levels of expertise. After playing, participants completed a questionnaire on the game's perceived realism and teaching ability. Surgeons solved more cases correctly (mean 77 %) than surgical residents (67 %), interns (60 %), master-degree students (50 %), and bachelor-degree students (39 % (p < 0.01). Trainees performed significantly better in their second play session than in the first (median 72 vs. 48 %, p = 0.00). Questionnaire results showed that educators and surgical trainees found the game both realistic and useful for surgical training. The majority perceived the game as fun (91.2 %), challenging (85.3 %), and would recommend the game to educate their colleagues (81.8 %). This serious game showed clear discriminatory ability between different levels of expertise in biliary tract disease management and clear teaching capability. It was perceived as appealing and realistic. Serious gaming has the potential to increase adherence to training programs in surgical residency training and medical school.

Adaptation and validation of the Malayalam pediatric voice handicap index.

PubMed

Devadas, Usha; Dhanya, M; Gunjawate, Dhanshree

2015-09-01

The aim of the present study was to adapt and validate the English version of pediatric voice handicap index (pVHI) into Malayalam language. The English version of pediatric voice handicap index was translated into Malayalam language using parallel back translation. The translated version was content validated by three qualified speech language pathologists. The content familiarity was carried out by 10 parents of children with voice problems. This was distributed to 136 parents (57 parents of children with dysphonia, 79 parents of children with no voice problems). The internal consistency and test--retest reliability was determined using Cronbach's alpha and intraclass correlation coefficient. Independent sample t-test was used to assess the difference in means. Kappa coefficient was used to determine the correlation between overall severity of the problem and total pVHI. Discriminant analysis was used to identify thresholds for differentiating between normal and dysphonic participants. The results obtained revealed that the Malayalam version of pVHI has an excellent internal consistency; total (α=0.974), functional (α=0.922), physical (α=0.953), and emotional (α=0.923). There was an excellent test-retest reliability; total (r=0.937), functional (r=0.954), physical (r=0.95), and emotional (r=0.929). The prediction probability of the dysphonics is 98.2% using the discriminant score function. The translated and validated pVHI tool can be effectively used in the assessment of children with voice problems. It can provide a better insight into the parents' perception of their child's voice problems. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

German National Proficiency Scales in Biology: Internal Structure, Relations to General Cognitive Abilities and Verbal Skills

PubMed Central

KÖLLER, OLAF

2016-01-01

ABSTRACT National and international large‐scale assessments (LSA) have a major impact on educational systems, which raises fundamental questions about the validity of the measures regarding their internal structure and their relations to relevant covariates. Given its importance, research on the validity of instruments specifically developed for LSA is still sparse, especially in science and its subdomains biology, chemistry, and physics. However, policy decisions for the improvement of educational quality based on LSA can only be helpful if valid information on students’ achievement levels is provided. In the present study, the nature of the measurement instruments based on the German Educational Standards in Biology is examined. On the basis of data from 3,165 students in Grade 10, we present dimensional analyses and report the relationship between different subdimensions of biology literacy and cognitive covariates such as general cognitive abilities and verbal skills. A theory‐driven two‐dimensional model fitted the data best. Content knowledge and scientific inquiry, two subdimensions of biology literacy, are highly correlated and show differential correlational patterns to the covariates. We argue that the underlying structure of biology should be incorporated into curricula, teacher training and future assessments. PMID:27818532

German National Proficiency Scales in Biology: Internal Structure, Relations to General Cognitive Abilities and Verbal Skills.

PubMed

Kampa, Nele; Köller, Olaf

2016-09-01

National and international large-scale assessments (LSA) have a major impact on educational systems, which raises fundamental questions about the validity of the measures regarding their internal structure and their relations to relevant covariates. Given its importance, research on the validity of instruments specifically developed for LSA is still sparse, especially in science and its subdomains biology, chemistry, and physics. However, policy decisions for the improvement of educational quality based on LSA can only be helpful if valid information on students' achievement levels is provided. In the present study, the nature of the measurement instruments based on the German Educational Standards in Biology is examined. On the basis of data from 3,165 students in Grade 10, we present dimensional analyses and report the relationship between different subdimensions of biology literacy and cognitive covariates such as general cognitive abilities and verbal skills. A theory-driven two-dimensional model fitted the data best. Content knowledge and scientific inquiry, two subdimensions of biology literacy, are highly correlated and show differential correlational patterns to the covariates. We argue that the underlying structure of biology should be incorporated into curricula, teacher training and future assessments.

The Psychometric Properties and the Development of the Indicators of Quality Nursing Work Environments in Taiwan.

PubMed

Lin, Chiou-Fen; Lu, Meei-Shiow; Huang, Hsiu-Ying

2016-03-01

The nursing shortage in medical institutions in Taiwan averaged 9% in 2012, considerably higher than the 5% indicated in the literature. As a result, many hospitals have been forced to close wards or reduce beds. Despite the acute need, the percentage of registered nurses who are employed as nurses in Taiwan (60.4%) is considerably lower than those in Canada or the United States. This low rate may be because of the poor working environment for nurses in Taiwan. This study aimed to develop a set of nursing work environment quality indicators for Taiwan and to test the reliability and validity of the resulting survey tool. Multiple methods were used in this study. In Phase 1, we organized an expert panel, reviewed the literature, and conducted seven rounds of expert panel discussion and six focus group discussions with nursing directors. The goal was to draft indicators representing a quality nursing work environment to fit current conditions in Taiwan. In Phase 2, we conducted an expert review for content validity, held three public hearings, and conducted a survey. Four hundred twenty-seven questionnaires were sent out, with 381 returned. The goal was to test the content validity, construct validity, and internal consistency reliability. The study produced a set of indicators of a quality nursing work environment with eight dimensions and 65 items. The content validity index for importance and suitability dimensions were 1.0, whereas the internal consistency was 0.91. The eight dimensions were safe practice environment (16 items), quality and quantity of staff (four items), salary and welfare (seven items), professional specialization and teamwork (seven items), work simplification (five items), informatics (five items), career development (nine items), and support and caring (12 items). The overall load for the indicators was 77.57%. The developed indicators may be used to evaluate the quality of nursing work environments. Furthermore, the indicators may be used in hospital surveys to establish baseline conditions and for outcome research that measures improvement in nursing work environments after interventions.

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

Establishing Reliability and Validity of the Criterion Referenced Exam of GeoloGy Standards EGGS

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, S. J.; Slater, T. F.; Schleigh, S.; Burrows, A. C.

2016-12-01

Discipline-based geoscience education researchers have considerable need for a criterion-referenced, easy-to-administer and -score conceptual diagnostic survey for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing education research across the geosciences, we are continuing to rigorously and systematically work to firmly establish the reliability and validity of the recently released Exam of GeoloGy Standards, EGGS. In educational testing, reliability refers to the consistency or stability of test scores whereas validity refers to the accuracy of the inferences or interpretations one makes from test scores. There are several types of reliability measures being applied to the iterative refinement of the EGGS survey, including test-retest, alternate form, split-half, internal consistency, and interrater reliability measures. EGGS rates strongly on most measures of reliability. For one, Cronbach's alpha provides a quantitative index indicating the extent to which if students are answering items consistently throughout the test and measures inter-item correlations. Traditional item analysis methods further establish the degree to which a particular item is reliably assessing students is actually quantifiable, including item difficulty and item discrimination. Validity, on the other hand, is perhaps best described by the word accuracy. For example, content validity is the to extent to which a measurement reflects the specific intended domain of the content, stemming from judgments of people who are either experts in the testing of that particular content area or are content experts. Perhaps more importantly, face validity is a judgement of how representative an instrument is reflective of the science "at face value" and refers to the extent to which a test appears to measure a the targeted scientific domain as viewed by laypersons, examinees, test users, the public, and other invested stakeholders.

Building Better Courses: Examining the Content Validity of the iNACOL National Standards for Quality Online Courses

ERIC Educational Resources Information Center

Adelstein, David; Barbour, Michael

2016-01-01

In 2011, the International Association for K-12 Online Learning released the second iteration of the "National Standards for Quality Online Courses." These standards have been used by numerous institutions and states around the country to help design and create K-12 online courses. However, there has been no reported research on the…

Suicide Attempt Self-Injury Interview (SASII): Development, Reliability, and Validity of a Scale to Assess Suicide Attempts and Intentional Self-Injury

ERIC Educational Resources Information Center

Linehan, Marsha M.; Comtois, Katherine Anne; Brown, Milton Z.; Heard, Heidi L.; Wagner, Amy

2006-01-01

The authors describe the development of the Suicide Attempt Self-Injury Interview (SASII), an instrument designed to assess the factors involved in nonfatal suicide attempts and intentional self-injury. Using 4 cohorts of participants, authors generated SASII items and evaluated them with factor and content analyses and internal consistency…

Validation of the Comprehensive ICF Core Set for Vocational Rehabilitation From the Perspective of Physical Therapists: International Delphi Survey.

PubMed

Kaech Moll, Veronika M; Escorpizo, Reuben; Portmann Bergamaschi, Ruth; Finger, Monika E

2016-08-01

The Comprehensive ICF Core Set for vocational rehabilitation (VR) is a list of essential categories on functioning based on the World Health Organization (WHO) International Classification of Functioning, Disability and Health (ICF), which describes a standard for interdisciplinary assessment, documentation, and communication in VR. The aim of this study was to examine the content validity of the Comprehensive ICF Core Set for VR from the perspective of physical therapists. A 3-round email survey was performed using the Delphi method. A convenience sample of international physical therapists working in VR with work experience of ≥2 years were asked to identify aspects they consider as relevant when evaluating or treating clients in VR. Responses were linked to the ICF categories and compared with the Comprehensive ICF Core Set for VR. Sixty-two physical therapists from all 6 WHO world regions responded with 3,917 statements that were subsequently linked to 338 ICF categories. Fifteen (17%) of the 90 categories in the Comprehensive ICF Core Set for VR were confirmed by the physical therapists in the sample. Twenty-two additional ICF categories were identified that were not included in the Comprehensive ICF Core Set for VR. Vocational rehabilitation in physical therapy is not well defined in every country and might have resulted in the small sample size. Therefore, the results cannot be generalized to all physical therapists practicing in VR. The content validity of the ICF Core Set for VR is insufficient from solely a physical therapist perspective. The results of this study could be used to define a physical therapy-specific set of ICF categories to develop and guide physical therapist clinical practice in VR. © 2016 American Physical Therapy Association.

The development and validation of a multidimensional sum-scaling questionnaire to measure patient-reported outcomes in acute respiratory tract infections in primary care: the acute respiratory tract infection questionnaire.

PubMed

Aabenhus, Rune; Thorsen, Hanne; Siersma, Volkert; Brodersen, John

2013-01-01

Patient-reported outcomes are seldom validated measures in clinical trials of acute respiratory tract infections (ARTIs) in primary care. We developed and validated a patient-reported outcome sum-scaling measure to assess the severity and functional impacts of ARTIs. Qualitative interviews and field testing among adults with an ARTI were conducted to ascertain a high degree of face and content validity of the questionnaire. Subsequently, a draft version of the Acute Respiratory Tract Infection Questionnaire (ARTIQ) was statistically validated by using the partial credit Rasch model to test dimensionality, objectivity, and reliability of items. Test of known groups' validity was conducted by comparing participants with and without an ARTI. The final version of the ARTIQ consisted of 38 items covering five dimensions (Physical-upper, Physical-lower, Psychological, Sleep, and Medicine) and five single items. All final dimensions were confirmed to fit the Rasch model, thus enabling sum-scaling of responses. The ARTIQ scores in participants with an ARTI were significantly higher than in those without ARTI (known groups' validity). A self-administered, multidimensional, sum-scaling questionnaire with high face and content validity and adequate psychometric properties for assessing severity and functional impacts from ARTIs in adults is available to clinical trials and audits in primary care. Copyright © 2013, International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc.

Development and psychometric testing of the Protective Reasons Against Suicide Inventory for assessing older Chinese-speaking outpatients in primary care settings.

PubMed

Wang, Yi-Wen; Tsai, Yun-Fang; Lee, Shwu-Hua; Chen, Ying-Jen; Chen, Hsiu-Fang

2016-07-01

To develop and psychometrically test the Protective Reasons against Suicide Inventory among older Chinese-speaking outpatients. Tools currently exist to test reasons for living among individuals of all ages in western countries, but few are available to assess older adults' protective reasons against suicide in Asia. A cross-sectional survey to investigate protective reasons against suicide among older Chinese-speaking outpatients. The Protective Reasons against Suicide Inventory was developed based on individual interviews with 83 older outpatients in Taiwan, the literature and the authors' clinical experiences. The resulting Inventory was examined in 2013 for content validity, face validity, construct validity, criterion-related validity, internal consistency reliability and test-retest reliability. The Inventory had excellent content validity and face validity. Factor analysis yielded a seven-factor solution, accounting for 87·7% of the variance. Scores on the global Inventory and its subscales tended to be higher in outpatients diagnosed without suicidal ideation than in outpatients diagnosed with suicidal ideation, indicating good criterion validity. Inventory reliability and the intraclass correlation coefficient were satisfactory. The Protective Reasons against Suicide Inventory can be completed in 5 minutes and is perceived as easy to complete. Moreover, the Inventory yielded highly acceptable parameters for validity and reliability. The Protective Reasons against Suicide Inventory can be used to assess older Chinese-speaking outpatients for factors that protect them from attempting suicide. © 2016 John Wiley & Sons Ltd.

A Turkish version of myocardial infarction dimensional assessment scale (TR-MIDAS): reliability-validity assesment.

PubMed

Uysal, Hilal; Ozcan, Şeyda

2011-06-01

Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.

The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

PubMed

Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

2017-01-12

Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in Portugal. Further studies are needed to confirm its responsiveness.

Control mechanisms of circadian rhythms in body composition: Implications for manned spaceflight

NASA Technical Reports Server (NTRS)

Moore-Ede, M. C.

1976-01-01

The mechanisms underlying the internal synchronization of the circadian variations in electrolyte content in body compartments were investigated, and the significance of these oscillations for manned spaceflight were examined. The experiments were performed with a chair-acclimatized squirrel monkey system, in which the animal sits in a chair, restrained only around the waist. The following information was given: (1) experimental methodology description, (2) summary of results obtained during the first contract year, and (3) discussion of the research performed during the second contract year. This included the following topics: physiological mechanisms promoting normal circadian internal synchronization, factors precipitating internal desynchronization, pathophysiological consequences of internal desynchronization of particular relevance to spaceflight, and validation of a chair-acclimatized system.

Brazilian validation of the Alberta Infant Motor Scale.

PubMed

Valentini, Nadia Cristina; Saccani, Raquel

2012-03-01

The Alberta Infant Motor Scale (AIMS) is a well-known motor assessment tool used to identify potential delays in infants' motor development. Although Brazilian researchers and practitioners have used the AIMS in laboratories and clinical settings, its translation to Portuguese and validation for the Brazilian population is yet to be investigated. This study aimed to translate and validate all AIMS items with respect to internal consistency and content, criterion, and construct validity. A cross-sectional and longitudinal design was used. A cross-cultural translation was used to generate a Brazilian-Portuguese version of the AIMS. In addition, a validation process was conducted involving 22 professionals and 766 Brazilian infants (aged 0-18 months). The results demonstrated language clarity and internal consistency for the motor criteria (motor development score, α=.90; prone, α=.85; supine, α=.92; sitting, α=.84; and standing, α=.86). The analysis also revealed high discriminative power to identify typical and atypical development (motor development score, P<.001; percentile, P=.04; classification criterion, χ(2)=6.03; P=.05). Temporal stability (P=.07) (rho=.85, P<.001) was observed, and predictive power (P<.001) was limited to the group of infants aged from 3 months to 9 months. Limited predictive validity was observed, which may have been due to the restricted time that the groups were followed longitudinally. In sum, the translated version of AIMS presented adequate validity and reliability.

Development of a standardised training curriculum for robotic surgery: a consensus statement from an international multidisciplinary group of experts.

PubMed

Ahmed, Kamran; Khan, Reenam; Mottrie, Alexandre; Lovegrove, Catherine; Abaza, Ronny; Ahlawat, Rajesh; Ahlering, Thomas; Ahlgren, Goran; Artibani, Walter; Barret, Eric; Cathelineau, Xavier; Challacombe, Ben; Coloby, Patrick; Khan, Muhammad S; Hubert, Jacques; Michel, Maurice Stephan; Montorsi, Francesco; Murphy, Declan; Palou, Joan; Patel, Vipul; Piechaud, Pierre-Thierry; Van Poppel, Hendrik; Rischmann, Pascal; Sanchez-Salas, Rafael; Siemer, Stefan; Stoeckle, Michael; Stolzenburg, Jens-Uwe; Terrier, Jean-Etienne; Thüroff, Joachim W; Vaessen, Christophe; Van Der Poel, Henk G; Van Cleynenbreugel, Ben; Volpe, Alessandro; Wagner, Christian; Wiklund, Peter; Wilson, Timothy; Wirth, Manfred; Witt, Jörn; Dasgupta, Prokar

2015-07-01

To explore the views of experts about the development and validation of a robotic surgery training curriculum, and how this should be implemented. An international expert panel was invited to a structured session for discussion. The study was of a mixed design, including qualitative and quantitative components based on focus group interviews during the European Association of Urology (EAU) Robotic Urology Section (ERUS) (2012), EAU (2013) and ERUS (2013) meetings. After introduction to the aims, principles and current status of the curriculum development, group responses were elicited. After content analysis of recorded interviews generated themes were discussed at the second meeting, where consensus was achieved on each theme. This discussion also underwent content analysis, and was used to draft a curriculum proposal. At the third meeting, a quantitative questionnaire about this curriculum was disseminated to attendees to assess the level of agreement with the key points. In all, 150 min (19 pages) of the focus group discussion was transcribed (21 316 words). Themes were agreed by two raters (median agreement κ 0.89) and they included: need for a training curriculum (inter-rater agreement κ 0.85); identification of learning needs (κ 0.83); development of the curriculum contents (κ 0.81); an overview of available curricula (κ 0.79); settings for robotic surgery training ((κ 0.89); assessment and training of trainers (κ 0.92); requirements for certification and patient safety (κ 0.83); and need for a universally standardised curriculum (κ 0.78). A training curriculum was proposed based on the above discussions. This group proposes a multi-step curriculum for robotic training. Studies are in process to validate the effectiveness of the curriculum and to assess transfer of skills to the operating room. © 2015 The Authors BJU International © 2015 BJU International Published by John Wiley & Sons Ltd.

Validity and reliability of a modified english version of the physical activity questionnaire for adolescents.

PubMed

Aggio, Daniel; Fairclough, Stuart; Knowles, Zoe; Graves, Lee

2016-01-01

Adaptation of physical activity self-report questionnaires is sometimes required to reflect the activity behaviours of diverse populations. The processes used to modify self-report questionnaires though are typically underreported. This two-phased study used a formative approach to investigate the validity and reliability of the Physical Activity Questionnaire for Adolescents (PAQ-A) in English youth. Phase one examined test content and response process validity and subsequently informed a modified version of the PAQ-A. Phase two assessed the validity and reliability of the modified PAQ-A. In phase one, focus groups (n = 5) were conducted with adolescents (n = 20) to investigate test content and response processes of the original PAQ-A. Based on evidence gathered in phase one, a modified version of the questionnaire was administered to participants (n = 169, 14.5 ± 1.7 years) in phase two. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and intra-class correlations, respectively. Spearman correlations were used to assess associations between modified PAQ-A scores and accelerometer-derived physical activity, self-reported fitness and physical activity self-efficacy. Phase one revealed that the original PAQ-A was unrepresentative for English youth and that item comprehension varied. Contextual and population/cultural-specific modifications were made to the PAQ-A for use in the subsequent phase. In phase two, modified PAQ-A scores had acceptable internal consistency (α = 0.72) and test-retest reliability (ICC = 0.78). Modified PAQ-A scores were significantly associated with objectively assessed moderate-to-vigorous physical activity (r = 0.39), total physical activity (r = 0.42), self-reported fitness (r = 0.35), and physical activity self-efficacy (r = 0.32) (p ≤ 0.01). The modified PAQ-A had acceptable internal consistency and test-retest reliability. Modified PAQ-A scores displayed weak-to-moderate correlations with objectively measured physical activity, self-reported fitness, and self-efficacy providing evidence of satisfactory criterion and construct validity, respectively. Further testing with more diverse English samples is recommended to provide a more complete assessment of the tool.

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

NASA Astrophysics Data System (ADS)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2018-06-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

NASA Astrophysics Data System (ADS)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2017-04-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Development of a scale to measure consumer perception of the risks involved in consuming raw vegetable salad in full-service restaurants.

PubMed

Danelon, Mariana Schievano; Salay, Elisabete

2012-12-01

The importance of the number of meals taken away-from-home represents an opportunity to promote consumption of vegetables in this context. However, the perception of risk may interfere with the food consumption behavior. The objective of this research was to develop a scale to measure consumer perception of the risks involved in consuming raw vegetable salad in full-service restaurants. The following research steps were carried out: item elaboration; content validity; scale purification (item-total correlation, internal consistency and exploratory factor analysis); and construct validity (confirmatory factor analysis). Non-probabilistic samples of consumers were interviewed (a total of 672 individuals) in the city of Campinas, Brazil. Several analyses were carried out using the Predictive Analytics Software 18.0 and LISREL 8.80. The final scale contained 26 items with an adequate content validity index (0.97) and Cronbach's alpha coefficient (0.93). The confirmatory factor analysis validates a six risk type factor model: physical, psychological, social, time, financial and performance (chi-square/degrees of freedom=2.29, root mean square error of approximation - RMSEA=0.060 and comparative fit index - CFI=0.98). The scale developed presented satisfactory reliability and validity results and could therefore be employed in further studies. Copyright © 2012 Elsevier Ltd. All rights reserved.

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.

Immunization knowledge and practice among Malaysian parents: a questionnaire development and pilot-testing.

PubMed

Awadh, Ammar Ihsan; Hassali, Mohamed Azmi; Al-lela, Omer Qutaiba; Bux, Siti Halimah; Elkalmi, Ramadan M; Hadi, Hazrina

2014-10-27

Parents are the main decision makers for their children vaccinations. This fact makes parents' immunization knowledge and practices as predictor factors for immunization uptake and timeliness. The aim of this pilot study was to develop a reliable and valid instrument in Malaysian language to measure immunization knowledge and practice (KP) of Malaysian parents. A cross-sectional prospective pilot survey was conducted among 88 Malaysian parents who attended public health facilities that provide vaccinations. Translated immunization KP questionnaires (Bahasa Melayu version) were used. Descriptive statistics were applied, face and content validity were assessed, and internal consistency, test-retest reliability, and construct validity were determined. The mean ± standard deviation (SD) of the knowledge scores was 7.36 ± 2.29 and for practice scores was 7.13 ± 2.20. Good internal consistency was found for knowledge and practice items (Cronbach's alpha = 0.757 and 0.743 respectively); the test-retest reliability value was 0.740 (p = 0.014). A panel of three specialist pharmacists who are experts in this field judged the face and content validity of the final questionnaire. Parents with up-to-date immunized children had significantly better knowledge and practice scores than parents who did not (p < 0.001 and p = 0.001 respectively), suggesting a good construct validity. A significant difference was found in knowledge and practice scores among parents' age (p = 0.006 and p = 0.029 respectively) and place of living (p = 0.037 and p = 0.043). The parents' knowledge level was positively associated with their practice toward immunization (Spearman's rank correlation coefficient 0.310, p = 0.003). The pilot study concluded that the Bahasa Melayu version of the immunization KP questionnaire has good reliability and validity for measuring the knowledge and practices of Malaysian parents and therefore this version can be used in future research.

[Translation and cultural adaptation of the questionnaire on the reason for food choices (Food Choice Questionnaire - FCQ) into Portuguese].

PubMed

Heitor, Sara Franco Diniz; Estima, Camilla Chermont Prochnik; das Neves, Fabricia Junqueira; de Aguiar, Aline Silva; Castro, Sybelle de Souza; Ferreira, Julia Elba de Souza

2015-08-01

The Food Choice Questionnaire (FCQ) assesses the importance that subjects attribute to nine factors related to food choices: health, mood, convenience, sensory appeal, natural content, price, weight control, familiarity and ethical concern. This study sought to assess the applicability of the FCQ in Brazil; it describes the translation and cultural adaptation from English into Portuguese of the FCQ via the following steps: independent translations, consensus, back-translation, evaluation by a committee of experts, semantic validation and pre-test. The pre-test was run with a randomly sampled group of 86 male and female college students from different courses with a median age of 19. Slight differences between the versions were observed and adjustments were made. After minor changes in the translation process, the committee of experts considered that the Brazilian Portuguese version was semantically and conceptually equivalent to the English original. Semantic validation showed that the questionnaire is easily understood. The instrument presented a high degree of internal consistency. The study is the first stage in the process of validating an instrument, which consists of face and content validity. Further stages, already underway, are needed before other researchers can use it.

A content validated questionnaire for assessment of self reported venous blood sampling practices

PubMed Central

2012-01-01

Background Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. Findings We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. Conclusions The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward. PMID:22260505

A content validated questionnaire for assessment of self reported venous blood sampling practices.

PubMed

Bölenius, Karin; Brulin, Christine; Grankvist, Kjell; Lindkvist, Marie; Söderberg, Johan

2012-01-19

Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward.

Organizational member involvement in physical activity coalitions across the United States: development and testing of a novel survey instrument for assessing coalition functioning.

PubMed

Bornstein, Daniel B; Pate, Russell R; Beets, Michael W; Saunders, Ruth P; Blair, Steven N

2015-06-01

Coalitions are often composed of member organizations. Member involvement is thought to be associated with coalition success. No instrument currently exists for evaluating organizational member involvement in physical activity coalitions. This study aimed to develop a survey instrument for evaluating organizational member involvement in physical activity coalitions. The study was carried out in three phases: (a) developing a draft survey, (b) assessing the content validity of the draft survey, and (c) assessing the underlying factor structure, reliability, and validity of the survey. A cross-sectional design was employed. In Phase 1, a team of experts in survey development produced a draft survey. In Phase 2, the content validity of the draft survey was evaluated by a panel of individuals with expertise in physical activity coalitions. In Phase 3, the survey was administered to 120 individuals on local-, state-, and national-level physical activity coalitions. Responses were subjected to an exploratory factor analysis in order to determine the survey's underlying factor structure, reliability, and validity. Phases 1 and 2yielded a survey instrument with demonstrated content validity. Phase 3 yielded a three-factor model with three subscales: Strategic Alignment, Organizational Alignment, and Providing Input. Each subscale demonstrated high internal consistency reliability and construct validity. The survey instrument developed here demonstrated sound psychometric properties and provides new insight into organizational member involvement in physical activity coalitions. This instrument may be an important tool in developing a more complete picture of coalition functioning in physical activity coalitions specifically and health-based coalitions overall. © 2014 Society for Public Health Education.

Feed additive production by fermentation of herb Polygonum hydropiper L. and cassava pulp with simultaneous flavonoid dissolution.

PubMed

Song, Zhen-Tao; Zhu, Ming-Jun

2017-03-01

Fermentation of herb Polygonum hydropiper L. (PHL) and cassava pulp (CP) for feed additive production with simultaneous flavonoid dissolution was investigated, and a two-stage response surface methodology (RSM) based on Plackett-Burman factorial design (PB design) was used to optimize the flavonoid dissolution and protein content. Using the screening function of PB design, four different significant factors for the two response variables were acquired: factors A (CP) and B (PHL) for the flavonoid dissolution versus factors G (inoculum size) and H (fermentation time) for protein content. Then, two RSMs were used sequentially to improve the values of the two response variables separately. The mutual corroboration of the experimental results in the present study confirmed the validity of the associated experimental design. The validation experiment showed a flavonoid dissolution rate of 94.00%, and a protein content of 18.20%, gaining an increase in 21.20% and 199.10% over the control, respectively. The present study confirms the feasibility of feed additive production by Saccharomyces cerevisiae with CP and PHL and simultaneous optimization of flavonoid dissolution and protein content using a two-stage RSM. © 2016 International Union of Biochemistry and Molecular Biology, Inc.

Regular expansion solutions for small Peclet number heat or mass transfer in concentrated two-phase particulate systems

NASA Technical Reports Server (NTRS)

Yaron, I.

1974-01-01

Steady state heat or mass transfer in concentrated ensembles of drops, bubbles or solid spheres in uniform, slow viscous motion, is investigated. Convective effects at small Peclet numbers are taken into account by expanding the nondimensional temperature or concentration in powers of the Peclet number. Uniformly valid solutions are obtained, which reflect the effects of dispersed phase content and rate of internal circulation within the fluid particles. The dependence of the range of Peclet and Reynolds numbers, for which regular expansions are valid, on particle concentration is discussed.

Assessing communication skills of clinical call handlers working at an out-of-hours centre: development of the RICE rating scale.

PubMed

Derkx, Hay P; Rethans, Jan-Joost E; Knottnerus, J André; Ram, Paul M

2007-05-01

Out-of-hours centres provide telephone support to patients with medical problems. In most of these centres specially-trained nurses handle incoming telephone calls. They assess patients' needs, the degree of urgency, and determine the level of care required. Assessment of the medical problem and the quality of 'care-by-phone' depend on the medical and communication skills of the call handlers. To develop a valid, reliable, and practical rating scale to evaluate the communication skills of call handlers working at an out-of-hours centre and to improve quality of communication. Qualitative study with focus groups followed by validation of the rating scale and measurement of reliability (internal consistency). Out-of-hours centres in the Netherlands. A focus group developed the rating scale. Experts with experience in training and evaluating communication skills of medical students and GPs commented on the scale to ensure content validity. The reliability of the rating scale was tested in a pilot in which ten specially-trained assessors scored six telephone calls each. The scale, known as the RICE rating scale, has 17 items divided over four different phases of the telephone consultation: Reason for calling; Information gathering; Conclusion; and Evaluation (RICE). Content validity of the scale was assessed by two experts. Reliability of the scale tested in the pilot was 0.73 (Cronbach's alpha). Establishing a rating scale to assess the communication skills of call handlers which meets common scientific demands, such as content validity and reliability, proved successful. This instrument can be used to give feedback to call handlers.

Development and psychometric evaluation of a cardiovascular risk and disease management knowledge assessment tool.

PubMed

Rosneck, James S; Hughes, Joel; Gunstad, John; Josephson, Richard; Noe, Donald A; Waechter, Donna

2014-01-01

This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.

The development and psychometric testing of a Disaster Response Self-Efficacy Scale among undergraduate nursing students.

PubMed

Li, Hong-Yan; Bi, Rui-Xue; Zhong, Qing-Ling

2017-12-01

Disaster nurse education has received increasing importance in China. Knowing the abilities of disaster response in undergraduate nursing students is beneficial to promote teaching and learning. However, there are few valid and reliable tools that measure the abilities of disaster response in undergraduate nursing students. To develop a self-report scale of self-efficacy in disaster response for Chinese undergraduate nursing students and test its psychometric properties. Nursing students (N=318) from two medical colleges were chosen by purposive sampling. The Disaster Response Self-Efficacy Scale (DRSES) was developed and psychometrically tested. Reliability and content validity were studied. Construct validity was tested by exploratory and confirmatory factor analysis. Reliability was tested by internal consistency and test-retest reliability. The DRSES consisted of 3 factors and 19 items with a 5-point rating. The content validity was 0.91, Cronbach's alpha coefficient was 0.912, and the intraclass correlation coefficient for test-retest reliability was 0.953. The construct validity was good (χ 2 /df=2.440, RMSEA=0.068, NFI=0.907, CFI=0.942, IFI=0.430, p<0.001). The newly developed DRSES has proven good reliability and validity. It could therefore be used as an assessment tool to evaluate self-efficacy in disaster response for Chinese undergraduate nursing students. Copyright © 2017. Published by Elsevier Ltd.

Validating the Farsi version of the Pregnancy Worries and Stress Questionnaire (PWSQ): An exploratory factor analysis.

PubMed

Navidpour, Fariba; Dolatian, Mahrokh; Shishehgar, Sara; Yaghmaei, Farideh; Majd, Hamid Alavi; Hashemi, Seyed Saeed

2016-10-01

Biological, environmental, inter- and intrapersonal changes during the antenatal period can result in anxiety and stress in pregnant women. It is pivotal to identify potential stressors and prevent their foetal and maternal consequences. The present study was conducted to validate and examine the factor structure of the Farsi version of the Pregnancy Worries and Stress Questionnaire (PWSQ). In 2015, 502 Iranian healthy pregnant women, referred to selected hospitals in Tehran for prenatal care at 8-39 weeks of pregnancy, were recruited through a randomized cluster sampling. The PWSQ was translated into Farsi, and its validity and reliability were examined using exploratory factor analysis by SPSS version 21. The content validity of items on the PWSQ was between 0.63-1. The content validity index for relevance, clarity and simplicity were 0.92, 0.98, and 0.98, respectively, with a mean of 0.94. The Kaiser-Meyer-Olkin measure of sampling adequacy was 0.863. Test-retest reliability showed high internal consistency (α=0.89; p<0.0001). The psychometric evaluation and exploratory factor analysis showed that the translated questionnaire is a valid and reliable tool to identify stress in Iranian pregnant women. Application of the questionnaire can facilitate the diagnosis of stress in pregnant women and assist health care providers in providing timely support and minimizing negative outcomes of stress and anxiety in pregnant women and their infants.

Measuring Exposure to Direct-to-Consumer Advertising—A Validation Study in the Context of Cancer-Related Treatment Advertising

PubMed Central

Tan, Andy SL; Hornik, Robert C

2014-01-01

This research examines two recurrent conceptual issues of measuring media exposure in survey research in the context of cancer-related direct-to-consumer advertising (CR-DTCA)—the level of content specificity of survey items and the benefits of providing exemplars to aid recall. We evaluated three candidate measures of cancer patients’ self-reported exposure to CR-DTCA; these measures varied in content specificity and provision of ad exemplars. Using data from two distinct population-based surveys, we assessed the performance of each measure based on several reliability and validity criteria. Results across both surveys indicate that all three measures performed equally well in terms of internal consistency, convergent, nomological, and discriminant validity with a few minor differences between these measures. Increased content specificity or inclusion of ad exemplars did not result in better performance of the exposure measures. Participants were able to extrapolate from ad exemplars to report their exposure to broad categories of CR-DTCA. The briefest of the three measures posed the lowest level of survey costs among the three measures and was deployed successfully for both mailed and internet-based survey administration. We discussed future directions for application of these findings in DTCA research for other illness and for media exposure research more generally. PMID:24693332

The Perseverative Thinking Questionnaire (PTQ): validation of a content-independent measure of repetitive negative thinking.

PubMed

Ehring, Thomas; Zetsche, Ulrike; Weidacker, Kathrin; Wahl, Karina; Schönfeld, Sabine; Ehlers, Anke

2011-06-01

Repetitive negative thinking (RNT) has been found to be involved in the maintenance of several types of emotional problems and has therefore been suggested to be a transdiagnostic process. However, existing measures of RNT typically focus on a particular disorder-specific content. In this article, the preliminary validation of a content-independent self-report questionnaire of RNT is presented. The 15-item Perseverative Thinking Questionnaire was evaluated in two studies (total N = 1832), comprising non-clinical as well as clinical participants. Results of confirmatory factor analyses across samples supported a second-order model with one higher-order factor representing RNT in general and three lower-order factors representing (1) the core characteristics of RNT (repetitiveness, intrusiveness, difficulties with disengagement), (2) perceived unproductiveness of RNT and (3) RNT capturing mental capacity. High internal consistencies and high re-test reliability were found for the total scale and all three subscales. The validity of the Perseverative Thinking Questionnaire was supported by substantial correlations with existing measures of RNT and associations with symptom levels and clinical diagnoses of depression and anxiety. Results suggest the usefulness of the new measure for research into RNT as a transdiagnostic process. Copyright © 2010 Elsevier Ltd. All rights reserved.

Determination of zinc oxide content of mineral medicine calamine using near-infrared spectroscopy based on MIV and BP-ANN algorithm

NASA Astrophysics Data System (ADS)

Zhang, Xiaodong; Chen, Long; Sun, Yangbo; Bai, Yu; Huang, Bisheng; Chen, Keli

2018-03-01

Near-infrared (NIR) spectroscopy has been widely used in the analysis fields of traditional Chinese medicine. It has the advantages of fast analysis, no damage to samples and no pollution. In this research, a fast quantitative model for zinc oxide (ZnO) content in mineral medicine calamine was explored based on NIR spectroscopy. NIR spectra of 57 batches of calamine samples were collected and the first derivative (FD) method was adopted for conducting spectral pretreatment. The content of ZnO in calamine sample was determined using ethylenediaminetetraacetic acid (EDTA) titration and taken as reference value of NIR spectroscopy. 57 batches of calamine samples were categorized into calibration and prediction set using the Kennard-Stone (K-S) algorithm. Firstly, in the calibration set, to calculate the correlation coefficient (r) between the absorbance value and the ZnO content of corresponding samples at each wave number. Next, according to the square correlation coefficient (r2) value to obtain the top 50 wave numbers to compose the characteristic spectral bands (4081.8-4096.3, 4188.9-4274.7, 4335.4, 4763.6,4794.4-4802.1, 4809.9, 4817.6-4875.4 cm- 1), which were used to establish the quantitative model of ZnO content using back propagation artificial neural network (BP-ANN) algorithm. Then, the 50 wave numbers were operated by the mean impact value (MIV) algorithm to choose wave numbers whose absolute value of MIV greater than or equal to 25, to obtain the optimal characteristic spectral bands (4875.4-4836.9, 4223.6-4080.9 cm- 1). And then, both internal cross and external validation were used to screen the number of hidden layer nodes of BP-ANN. Finally, the number 4 of hidden layer nodes was chosen as the best. At last, the BP-ANN model was found to enjoy a high accuracy and strong forecasting capacity for analyzing ZnO content in calamine samples ranging within 42.05-69.98%, with relative mean square error of cross validation (RMSECV) of 1.66% and coefficient of determination (R2) of 95.75% in internal cross and relative mean square error of prediction (RMSEP) of 1.98%, R2 of 97.94% and ratio of performance to deviation (RPD) of 6.11 in external validation.

Measuring social alienation in adolescence: translation and validation of the Jessor and Jessor Social Alienation Scale.

PubMed

Safipour, Jalal; Tessma, Mesfin Kassaye; Higginbottom, Gina; Emami, Azita

2010-12-01

The objective of the study is to translate and examine the reliability and validity of the Jessor and Jessor Social Alienation Scale for use in a Swedish context. The study involved four phases of testing: (1) Translation and back-translation; (2) a pilot test to evaluate the translation; (3) reliability testing; and (4) a validity test. Main participants of this study were 446 students (Age = 15-19, SD = 1.01, Mean = 17). Results from the reliability test showed high internal consistency and stability. Face, content and construct validity were demonstrated using experts and confirmatory factor analysis. The results of testing the Swedish version of the alienation scale revealed an acceptable level of reliability and validity, and is appropriate for use in the Swedish context. © 2010 The Authors. Scandinavian Journal of Psychology © 2010 The Scandinavian Psychological Associations.

Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research.

PubMed

Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara

2010-03-01

This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Maternal sensitivity and attachment security in Thailand: cross-cultural validation of Western measures.

PubMed

Chaimongkol, Nujjaree N; Flick, Louise H

2006-01-01

The purpose of this study was to examine the psychometric properties of Thai versions of the Maternal Behavior Q-Sort (MBQS), Caldwell's HOME, and the Attachment Q-set (AQS). A sample of 110 Thai mother-infant dyads were studied. The Content Validity Index (CVIs) of the Thai MBQS, HOME and AQS were between 91% and 99%. Internal consistency of the HOME was .71. Interobserver reliability of the MBQS, HOME, and AQS were .95, .87, and .87, respectively. Convergent validity was supported by finding a positive correlation between the MBQS and the HOME (r = .29, p < .001). A positive correlation of .45 (p < .001) between the scores of the MBQS and the AQS indicated concurrent validity of these scales. Study findings indicate the Thai MBQS, HOME, and AQS are reliable and valid in this Thai sample and suggest that the Thai versions reflect concepts similar to those in the original English versions.

Assessment of the quality of simvastatin capsules from compounding pharmacies.

PubMed

Markman, Blanca Elena Ortega; Rosa, Paulo César Pires; Koschtschak, Maria Regina Walter

2010-12-01

To validate a method for determining the simvastatin content of compounded capsules, using high performance liquid chromatography. Eighteen samples of simvastatin 40 mg capsules from compounding pharmacies in the cities of São Paulo, Guarulhos, São Bernardo do Campo and Campinas, Southeastern Brazil, prescribed for fictitious patients were assessed. The analyses were based on the Brazilian Pharmacopoeia and on the high performance liquid chromatography method, optimized and validated in accordance with national and international standards for identification and quantification tests on compounded capsules. The mean weight of the capsules ranged from 70 mg to 316 mg; four samples presented weight variation outside of the specification. The simvastatin content in the capsules was within the specification in 11 samples. In six, the content ranged from 4% to 87% of the declared quantity, thereby not complying with the content requirements for the active agent. For one sample, no content or uniformity determinations were performed. In the content uniformity test, 15 samples presented indices of less than 85%, with relative standard deviations greater than 6%. Three pharmacies had met the specification in this test. In the dissolution test, eight samples presented unsatisfactory results in the first stage of the test, while the remainder presented inconclusive results. The method used was shown to be suitable for application to quality control, and it revealed the poor quality of the simvastatin capsules produced by some compounding pharmacies.

Development of a Home Food Safety Questionnaire Based on the PRECEDE Model: Targeting Iranian Women.

PubMed

Esfarjani, Fatemeh; Hosseini, Hedayat; Mohammadi-Nasrabadi, Fatemeh; Abadi, Alireza; Roustaee, Roshanak; Alikhanian, Haleh; Khalafi, Marjan; Kiaee, Mohammad Farhad; Khaksar, Ramin

2016-12-01

Food safety is an essential public health issue for all countries. This study was the first attempt to design and develop a home food safety questionnaire (HFSQ), in the conceptual framework of the PRECEDE (predisposing, reinforcing, and enabling constructs in educational diagnosis and evaluation) model, and to assess its validity and reliability. The HFSQ was developed by reviewing electronic databases and 12 focus group discussions with 96 women volunteers. Ten panel members reviewed the questionnaire, and the content validity ratio and content validity index were computed. Twenty women completed the HFSQ, and face validity was assessed. Women who were responsible for food handling in their households (n =320) were selected randomly from 10 health centers and completed the HFSQ based on the PRECEDE model. To examine the construct validity, a principal components factor analysis with varimax rotation was used. Internal consistency was determined with Cronbach's α. Reproducibility was checked by Kendall's τ after 4 weeks with 30 women. The developed HSFQ was considered acceptable with a content validity index of 0.88. Face validity revealed that 95% of the participants understood the questions and found them easy to answer, and 90% confirmed the appearance of the HFSQ and declared the layout acceptable. Principal component factor analysis revealed that the HFSQ could explain 33.7, 55.3, 34.8, and 60.0% of the total variance of the predisposing, reinforcing, practice, and enabling components, respectively. Cronbach's α was acceptable at 0.73. For Kendall's τ c , r = 0.89, with a 95% confidence interval of 0.85 to 0.93. The HFSQ developed based on the PRECEDE model met the standards of acceptable reliability and validity, which can be generalized to a wider population. These results can provide information for the development of effective communication strategies to promote home food safety.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

The Integral Theory System Questionnaire: an anatomically directed questionnaire to determine pelvic floor dysfunctions in women.

PubMed

Wagenlehner, Florian Martin Erich; Fröhlich, Oliver; Bschleipfer, Thomas; Weidner, Wolfgang; Perletti, Gianpaolo

2014-06-01

Anatomical damage to pelvic floor structures may cause multiple symptoms. The Integral Theory System Questionnaire (ITSQ) is a holistic questionnaire that uses symptoms to help locate damage in specific connective tissue structures as a guide to reconstructive surgery. It is based on the integral theory, which states that pelvic floor symptoms and prolapse are both caused by lax suspensory ligaments. The aim of the present study was to psychometrically validate the ITSQ. Established psychometric properties including validity, reliability, and responsiveness were considered for evaluation. Criterion validity was assessed in a cohort of 110 women with pelvic floor dysfunctions by analyzing the correlation of questionnaire responses with objective clinical data. Test-retest was performed with questionnaires from 47 patients. Cronbach's alpha and "split-half" reliability coefficients were calculated for inner consistency analysis. Psychometric properties of ITSQ were comparable to the ones of previously validated Pelvic Floor Questionnaires. Face validity and content validity were approved by an expert group of the International Collaboration of Pelvic Floor surgeons. Convergent validity assessed using Bayesian method was at least as accurate as the expert assessment of anatomical defects. Objective data measurement in patients demonstrated significant correlations with ITSQ domains fulfilling criterion validity. Internal consistency values ranked from 0.85 to 0.89 in different scenarios. The ITSQ proofed accurate and is able to serve as a holistic Pelvic Floor Questionnaire directing symptoms to site-specific pelvic floor reconstructive surgery.

Nursing diagnoses for the elderly using the International Classification for Nursing Practice and the activities of living model.

PubMed

de Medeiros, Ana Claudia Torres; da Nóbrega, Maria Miriam Lima; Rodrigues, Rosalina Aparecida Partezani; Fernandes, Maria das Graças Melo

2013-01-01

To develop nursing diagnosis statements for the elderly based on the Activities of Living Model and on the International Classification for Nursing Practice. Descriptive and exploratory study, put in practice in two stages: 1) collection of terms and concepts that are considered clinically and culturally relevant for nursing care delivered to the elderly, in order to develop a database of terms and 2) development of nursing diagnosis statements for the elderly in primary health care, based on the guidelines of the International Council of Nurses and on the database of terms for nursing practice involving the elderly. 414 terms were identified and submitted to the content validation process, with the participation of ten nursing experts, which resulted in 263 validated terms. These terms were submitted to cross mapping with the terms of the International Classification for Nursing Practice, resulting in the identification of 115 listed terms and 148 non-listed terms, which constituted the database of terms, from which 127 nursing diagnosis statements were prepared and classified into factors that affect the performance of the elderly's activities of living - 69 into biological factors, 19 into psychological, 31 into sociocultural, five into environmental, and three into political-economic factors. After clinical validation, these statements can serve as a guide for nursing consultations with elderly patients, without ignoring clinical experience, critical thinking and decision-making.

Validation of the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns

PubMed Central

da Silva, Fabiana Alves; Vidal, Cláudia Fernanda de Lacerda; de Araújo, Ednaldo Cavalcante

2015-01-01

Abstract Objective: to validate the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns. Method: a transversal, descriptive and methodological study, with a quantitative approach. The sample was composed of 15 judges, 8 obstetricians and 7 pediatricians. The validation occurred through the assessment of the content of the protocol by the judges that received the instrument for data collection - checklist - which contained 7 items that represent the requisites to be met by the protocol. The validation of the content was achieved by applying the Content Validity Index. Result: in the judging process, all the items that represented requirements considered by the protocol obtained concordance within the established level (Content Validity Index > 0.75). Of 7 items, 6 have obtained full concordance (Content Validity Index 1.0) and the feasibility item obtained a Content Validity Index of 0.93. The global assessment of the instruments obtained a Content Validity Index of 0.99. Conclusion: the validation of content that was done was an efficient tool for the adjustment of the protocol, according to the judgment of experienced professionals, which demonstrates the importance of conducting a previous validation of the instruments. It is expected that this study will serve as an incentive for the adoption of universal tracking by other institutions through validated protocols. PMID:26444165

EOS Reference Handbook 1999: A Guide to NASA's Earth Science Enterprise and the Earth Observing System

NASA Technical Reports Server (NTRS)

King, M. D. (Editor); Greenstone, R. (Editor)

2000-01-01

The content of this handbook includes Earth Science Enterprise; The Earth Observing System; EOS Data and Information System (EOSDIS); Data and Information Policy; Pathfinder Data Sets; Earth Science Information Partners and the Working Prototype-Federation; EOS Data Quality: Calibration and Validation; Education Programs; International Cooperation; Interagency Coordination; Mission Elements; EOS Instruments; EOS Interdisciplinary Science Investigations; and Points-of-Contact.

A Psychometric Study of the Bayley Scales of Infant and Toddler Development in Persian Language Children.

PubMed

Azari, Nadia; Soleimani, Farin; Vameghi, Roshanak; Sajedi, Firoozeh; Shahshahani, Soheila; Karimi, Hossein; Kraskian, Adis; Shahrokhi, Amin; Teymouri, Robab; Gharib, Masoud

2017-01-01

Bayley Scales of infant & toddler development is a well-known diagnostic developmental assessment tool for children aged 1-42 months. Our aim was investigating the validity & reliability of this scale in Persian speaking children. The method was descriptive-analytic. Translation- back translation and cultural adaptation was done. Content & face validity of translated scale was determined by experts' opinions. Overall, 403 children aged 1 to 42 months were recruited from health centers of Tehran, during years of 2013-2014 for developmental assessment in cognitive, communicative (receptive & expressive) and motor (fine & gross) domains. Reliability of scale was calculated through three methods; internal consistency using Cronbach's alpha coefficient, test-retest and interrater methods. Construct validity was calculated using factor analysis and comparison of the mean scores methods. Cultural and linguistic changes were made in items of all domains especially on communication subscale. Content and face validity of the test were approved by experts' opinions. Cronbach's alpha coefficient was above 0.74 in all domains. Pearson correlation coefficient in various domains, were ≥ 0.982 in test retest method, and ≥0.993 in inter-rater method. Construct validity of the test was approved by factor analysis. Moreover, the mean scores for the different age groups were compared and statistically significant differences were observed between mean scores of different age groups, that confirms validity of the test. The Bayley Scales of Infant and Toddler Development is a valid and reliable tool for child developmental assessment in Persian language children.

Measuring safety climate in health care.

PubMed

Flin, R; Burns, C; Mearns, K; Yule, S; Robertson, E M

2006-04-01

To review quantitative studies of safety climate in health care to examine the psychometric properties of the questionnaires designed to measure this construct. A systematic literature review was undertaken to study sample and questionnaire design characteristics (source, no of items, scale type), construct validity (content validity, factor structure and internal reliability, concurrent validity), within group agreement, and level of analysis. Twelve studies were examined. There was a lack of explicit theoretical underpinning for most questionnaires and some instruments did not report standard psychometric criteria. Where this information was available, several questionnaires appeared to have limitations. More consideration should be given to psychometric factors in the design of healthcare safety climate instruments, especially as these are beginning to be used in large scale surveys across healthcare organisations.

Validation of an instrument to measure older adults' expectations regarding movement (ERM).

PubMed

Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S

2012-01-01

Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.

[New questionnaire to assess self-efficacy toward physical activity in children].

PubMed

Aedo, Angeles; Avila, Héctor

2009-10-01

To design a questionnaire for assessment of self-efficacy toward physical activity in school children, as well as to measure its construct validity, test-retest reliability, and internal consistency. A four-stage multimethod approach was used: (1) bibliographic research followed by exploratory study and the formulation of questions and responses based on a dichotomous scale of 14 items; (2) validation of the content by a panel of experts; (3) application of the preliminary version of the questionnaire to a sample of 900 school-aged children in Mexico City; and (4) determination of the construct validity, test-retest reliability, and internal consistency (Cronbach's alpha). Three factors were identified that explain 64.15% of the variance: the search for positive alternatives to physical activity, ability to deal with possible barriers to exercising, and expectations of skill or competence. The model was validated using the goodness of fit, and the result of 65% less than 0.05 indicated that the estimated factor model fit the data. Cronbach's consistency alpha was 0.733; test-retest reliability was 0.867. The scale designed has adequate reliability and validity. These results are a good indicator of self-efficacy toward physical activity in school children, which is important when developing programs intended to promote such behavior in this age group.

Instruments to assess patients with rotator cuff pathology: a systematic review of measurement properties.

PubMed

Longo, Umile Giuseppe; Saris, Daniël; Poolman, Rudolf W; Berton, Alessandra; Denaro, Vincenzo

2012-10-01

The aims of this study were to obtain an overview of the methodological quality of studies on the measurement properties of rotator cuff questionnaires and to describe how well various aspects of the design and statistical analyses of studies on measurement properties are performed. A systematic review of published studies on the measurement properties of rotator cuff questionnaires was performed. Two investigators independently rated the quality of the studies using the Consensus-based Standards for the selection of health Measurement Instruments checklist. This checklist was developed in an international Delphi consensus study. Sixteen studies were included, in which two measurement instruments were evaluated, namely the Western Ontario Rotator Cuff Index and the Rotator Cuff Quality-of-Life Measure. The methodological quality of the included studies was adequate on some properties (construct validity, reliability, responsiveness, internal consistency, and translation) but need to be improved on other aspects. The most important methodological aspects that need to be developed are as follows: measurement error, content validity, structural validity, cross-cultural validity, criterion validity, and interpretability. Considering the importance of adequate measurement properties, it is concluded that, in the field of rotator cuff pathology, there is room for improvement in the methodological quality of studies measurement properties. II.

Development and Psychometric Evaluation of the HPV Clinical Trial Survey for Parents (CTSP-HPV) Using Traditional Survey Development Methods and Community Engagement Principles.

PubMed

Cunningham, Jennifer; Wallston, Kenneth A; Wilkins, Consuelo H; Hull, Pamela C; Miller, Stephania T

2015-12-01

This study describes the development and psychometric evaluation of HPV Clinical Trial Survey for Parents with Children Aged 9 to 15 (CTSP-HPV) using traditional instrument development methods and community engagement principles. An expert panel and parental input informed survey content and parents recommended study design changes (e.g., flyer wording). A convenience sample of 256 parents completed the final survey measuring parental willingness to consent to HPV clinical trial (CT) participation and other factors hypothesized to influence willingness (e.g., HPV vaccine benefits). Cronbach's a, Spearman correlations, and multiple linear regression were used to estimate internal consistency, convergent and discriminant validity, and predictively validity, respectively. Internal reliability was confirmed for all scales (a ≥ 0.70.). Parental willingness was positively associated (p < 0.05) with trust in medical researchers, adolescent CT knowledge, HPV vaccine benefits, advantages of adolescent CTs (r range 0.33-0.42), supporting convergent validity. Moderate discriminant construct validity was also demonstrated. Regression results indicate reasonable predictive validity with the six scales accounting for 31% of the variance in parents' willingness. This instrument can inform interventions based on factors that influence parental willingness, which may lead to the eventual increase in trial participation. Further psychometric testing is warranted. © 2015 Wiley Periodicals, Inc.

Shared decision making in Swedish community mental health services - an evaluation of three self-reporting instruments.

PubMed

Rosenberg, David; Schön, Ulla-Karin; Nyholm, Maria; Grim, Katarina; Svedberg, Petra

2017-04-01

Despite the potential impact of shared decision making on users satisfaction with care and quality in health care decisions, there is a lack of knowledge and skills regarding how to work with shared decision making among health care providers. The aim of this study was to evaluate the psychometric properties of three instruments that measure varied dimensions of shared decision making, based on self-reports by clients, in a Swedish community mental health context. The study sample consisted of 121 clients with experience of community mental health care, and involved in a wide range of decisions regarding both social support and treatment. The questionnaires were examined for face and content validity, internal consistency, test-retest reliability and construct validity. The instruments displayed good face and content validity, satisfactory internal consistency and a moderate to good level of stability in test-retest reliability with fair to moderate construct correlations, in a sample of clients with serious mental illness and experience of community mental health services in Sweden. The questionnaires are considered to be relevant to the decision making process, user-friendly and appropriate in a Swedish community mental health care context. They functioned well in settings where non-medical decisions, regarding social and support services, are the primary focus. The use of instruments that measure various dimensions of the self-reported experience of clients, can be a key factor in developing knowledge of how best to implement shared decision making in mental health services.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Transcultural adaptation of the Breast Cancer Awareness Measure.

PubMed

Al-Khasawneh, E M; Leocadio, M; Seshan, V; Siddiqui, S T; Khan, A N; Al-Manaseer, M M

2016-09-01

To overcome the lack of a validated and robust Arabic instrument to measure breast cancer awareness. Currently, there is no validated Arabic instrument for measuring breast cancer awareness levels. We adapted, translated and validated the Breast Cancer Awareness Measure developed by Cancer Research UK. The instrument was translated into Arabic and back-translated for validation. Validation and reliability tests were conducted using purposively sampled 972 Arab women older than 20 years, living in Oman. The adapted content was validated by a panel of medical, linguistic and cultural experts, followed by cognitive interviews (n = 10), behavioural coding (n = 30) and criterion validation (n = 646). The instrument was tested for acceptability and its subscales for internal consistency. Inter-rater reliability was estimated between two similar groups (n = 144 and n = 142) to test homogeneity. The adapted and translated instrument had a high acceptability (98.7% completed). The validation process shaped the adaptation, and resulted in strong criterion validity (R = 0.58, P < 0.01). The instrument subscales for risk factors and warning signs had high internal consistency (Cronbach's alpha 0.856 and 0.890, respectively), with all floor and ceiling effects less than 15%. The correlation measure for inter-rater reliability was 0.97 (P < 0.01). Through the incorporation of contextual characteristics and prevalent beliefs among Arab populations, the adapted Best Cancer Awareness Measure is a robust Arabic instrument for the measurement of breast cancer awareness and early detection practices among Arab women. The purposively selected sample may not be representative of the population. Improvement of awareness and early detection of breast cancer can contribute towards reducing mortality from the disease. The adapted instrument has policy implications, since measurement of awareness levels is essential towards breast health promotion policies in Arab countries. © 2016 International Council of Nurses.

Development and content validation of the power mobility training tool.

PubMed

Kenyon, Lisa K; Farris, John P; Cain, Brett; King, Emily; VandenBerg, Ashley

2018-01-01

This paper outlines the development and content validation of the power mobility training tool (PMTT), an observational tool designed to assist therapists in developing power mobility training programs for children who have multiple, severe impairments. Initial items on the PMTT were developed based on a literature review and in consultation with therapists experienced in the use of power mobility. Items were trialled in clinical settings, reviewed, and refined. Items were then operationalized and an administration manual detailing scoring for each item was created. Qualitative and quantitative methods were used to establish content validity via a 15 member, international expert panel. The content validity ratio (CVR) was determined for each possible item. Of the 19 original items, 10 achieved minimum required CVR values and were included in the final version of the PMTT. Items related to manoeuvring a power mobility device were merged and an item related to the number of switches used concurrently to operate a power mobility device were added to the PMTT. The PMTT may assist therapists in developing training programs that facilitate the acquisition of beginning power mobility skills in children who have multiple, severe impairments. Implications for Rehabilitation The Power Mobility Training Tool (PMTT) was developed to help guide the development of power mobility intervention programs for children who have multiple, severe impairments. The PMTT can be used with children who access a power mobility device using either a joystick or a switch. Therapists who have limited experience with power mobility may find the PMTT to be helpful in setting up and conducting power mobility training interventions as a feasible aspect of a plan of care for children who have multiple, severe impairments.

The Validity of the earth and space science learning materials with orientation on multiple intelligences and character education

NASA Astrophysics Data System (ADS)

Liliawati, W.; Utama, J. A.; Ramalis, T. R.; Rochman, A. A.

2018-03-01

Validation of the Earth and Space Science learning the material in the chapter of the Earth's Protector based on experts (media & content expert and practitioners) and junior high school students' responses are presented. The data came from the development phase of the 4D method (Define, Design, Develop, Dissemination) which consist of two steps: expert appraisal and developmental testing. The instrument employed is rubric of suitability among the book contents with multiple intelligences activities, character education, a standard of book assessment, a questionnaires and close procedure. The appropriateness of the book contents with multiple intelligences, character education and standard of book assessment is in a good category. Meanwhile, students who used the book in their learning process gave a highly positive response; the book was easy to be understood. In general, the result of cloze procedure indicates high readability of the book. As our conclusion is the book chapter of the Earth's Protector can be used as a learning material accommodating students’ multiple intelligences and character internalization.

Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

PubMed

Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

2016-06-01

To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

[Multicenter validation of an evaluation tool for clinical training activities (SVAT) of the nursing students].

PubMed

Finotto, Sergio; Gradellini, Cinzia; Bandini, Stefania; Burrai, Francesco; Lucchi Casadei, Sandra; Villani, Carolina; Vincenzi, Simone; Mecugni, Daniela

2017-01-01

To evaluate the psychometric characteristics of the Scheda di Valutazione delle Attività di Tirocinio (SVAT). The degree courses in Nursing of the University of Modena and Reggio Emilia, site of Reggio Emilia, the University of Bologna Formative Section BO1, Imola and training center of Cesena, the University of Ferrara training centers of Ferrara and Codigoro were all enrolled in the research. For the content validation the reactive Delphi method was chosen. The panel of experts expressed a qualitative-intuitive judgment on the adequacy of language and on the stimulus material (SVAT). For internal consistency Cronbach's alpha was calculated the. The test-retest method was used for the reliability of stability. all indicators of the SVAT have achieved a degree of consensus not less than 80% demonstrating its content validity. The face validity is demonstrated by an average score equal to or greater than 7 obtained by all indicators. The reliability of internal consistency of the SVAT was appraised by Cronbach's alpha that was 0.987 for the entire instrument. The reliability of the stability has been calculated through the correlation's coefficient expressed by Pearson's r that was 0.983 (p = 1.3E-198). in Italy there is no a "gold standard" tool to evaluate the clinical performance of nursing students during and at the end of their clinical training. The SVAT proves to be a valuable and reliable tool it furthermore could stimulate the discussion and the debate among educators and nurses, so that also in our country, it may be possible develop and refine tools that support the evaluation of clinical skills of nursing students.

Measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM)

PubMed Central

Sladek, Ruth M; Phillips, Paddy A; Bond, Malcolm J

2008-01-01

Background Understanding how doctors think may inform both undergraduate and postgraduate medical education. Developing such an understanding requires valid and reliable measurement tools. We examined the measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM), designed to tap this domain with specific reference to medicine, but with previously questionable measurement properties. Methods First year postgraduate entry medical students at Flinders University, and trainees (postgraduate doctors in any specialty) and consultants (N = 348) based at two teaching hospitals in Adelaide, Australia, completed the ICBM and a questionnaire measuring thinking styles (Rational Experiential Inventory). Results Questions with the lowest item-total correlation were deleted from the original 22 item ICBM, although the resultant 17 item scale only marginally improved internal consistency (Cronbach's α = 0.61 compared with 0.57). A factor analysis identified two scales, both achieving only α = 0.58. Construct validity was assessed by correlating Rational Experiential Inventory scores with the ICBM, with some positive correlations noted for students only, suggesting that those who are naïve to the knowledge base required to "successfully" respond to the ICBM may profit by a thinking style in tune with logical reasoning. Conclusion The ICBM failed to demonstrate adequate content validity, internal consistency and construct validity. It is unlikely that improvements can be achieved without considered attention to both the audience for which it is designed and its item content. The latter may need to involve both removal of some items deemed to measure multiple biases and the addition of new items in the attempt to survey the range of biases that may compromise medical decision making. PMID:18507864

Translation and cross-cultural adaptation of the Cardiff Wound Impact Schedule to Brazilian Portuguese.

PubMed

Augusto, Fabiana da Silva; Blanes, Leila; Nicodemo, Denise; Ferreira, Lydia Masako

2017-05-01

To translate into Brazilian Portuguese and cross-culturally adapt the Cardiff Wound Impact Schedule, a specific measure of health-related quality of life (HRQoL) for patients with chronic wounds. Chronic wounds have a relevant impact on the HRQoL of patients. However, there are few instruments cross-culturally adapted and validated in Brazil to assess HRQoL in patients with wounds. A descriptive cross-sectional study was conducted following six steps: (1) translation of the original instrument into Brazilian-Portuguese by two independent translators; (2) construction of a consensus version based on both translations; (3) two independent back-translations into English of the consensus version; (4) review by an expert committee and construction of the pre-final version; (5) testing of the pre-final version on patients with chronic wounds; and (6) construction of the final version. The psychometric properties of the instrument were tested on 30 patients with chronic wounds of the lower limb; 76.7% were men, 70.0% had traumatic wounds, and 43.3% had the wound for more than 1 year. Participants were recruited from an outpatient wound care clinic in São Paulo, Brazil. The final version approved by the expert committee was well understood by all patients who participate in the study and had satisfactory face validity, content validity, and internal consistency, with Cronbach's alpha coefficients ranging from 0.681 to 0.920. The cross-culturally adapted Brazilian-Portuguese version of the instrument showed satisfactory face and content validity, good internal consistency, and was named Cardiff Wound Impact Schedule-Federal University of São Paulo School of Medicine or CWIS-UNIFESP/EPM. Copyright © 2016 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Cultural adaptation to Spanish (Spain) of the "Overactive Bladder - Family Impact Measure (OAB-FIM)" questionnaire.

PubMed

Arlandis Guzmán, S; Martínez Cuenca, E; Martínez García, R; Bonillo García, M A; Rejas, J; Broseta-Rico, E

2017-06-01

The OAB-FIM was developed as a measure of the impact of an overactive bladder (OAB) on relatives who live with the patient. The objective of this study was conduct a cultural adaptation to Spanish (Spain) of the OAB-FIM questionnaire. The adaptation included a conceptual and linguistic validation phase, as well as a phase for measuring the psychometric properties in 25 relatives [mean age, 63.0 years (SD, 14.3); 44% women] who regularly live with patients with OAB, who are of either sex and 18 years of age or older. We measured conceptual and linguistic equivalence, internal reliability, construct validity and content validity. We assessed the applicability and administration load. The OAB-FIM was conceptually and linguistically equivalent to the original, maintaining its 6 domains: social, travel, worry, irritability, sleep and sex. The interagreement correctly placed all items in their domain, except for number 10, which was placed more in worry than in irritability, motivates its reformulation. Some 2.95% of the items were missing. The floor and ceiling effects of the items varied, respectively, between 20-28%, and 0-16%. The mean time for completing the questionnaire was 5.2minutes (SD, 2.8), and 24% of the participants required some type of assistance. The α-Cronbach coefficient varied between 0.948-0.839. The correlations with similar scales in the family were moderate-high (0.407-0.753) or small-moderate with those administered to the patient (0.004-0.423). We obtained a Spanish (Spain) version of the OAB-FIM that was conceptually and linguistically equivalent to the original. The questionnaire showed good internal consistency, content and construct validity and applicability. Copyright © 2017. Publicado por Elsevier España, S.L.U.

Development and psychometric properties of a new social support scale for self-care in middle-aged patients with type II diabetes (S4-MAD)

PubMed Central

2012-01-01

Background Social support has proved to be one of the most effective factors on the success of diabetic self-care. This study aimed to develop a scale for evaluating social support for self-care in middle-aged patients (30–60 years old) with type II diabetes. Methods This was a two-phase qualitative and quantitative study. The study was conducted during 2009 to 2011 in Tehran, Iran. In the qualitative part, a sample of diabetic patients participated in four focus group discussions in order to develop a preliminary item pool. Consequently, content and face validity were performed to provide a pre-final version of the questionnaire. Then, in a quantitative study, reliability (internal consistency and test-retest analysis), validity and factor analysis (both exploratory and confirmatory) were performed to assess psychometric properties of the scale. Results A 38-item questionnaire was developed through the qualitative phase. It was reduced to a 33-item after content validity. Exploratory factor analysis loaded a 30-item with a five-factor solution (nutrition, physical activity, self monitoring of blood glucose, foot care and smoking) that jointly accounted for 72.3% of observed variance. The confirmatory factor analysis indicated a good fit to the data. The Cronbach’s alpha coefficient showed excellent internal consistency (alpha=0.94), and test-retest of the scale with 2-weeks intervals indicated an appropriate stability for the scale (ICC=0.87). Conclusion The findings showed that the designed questionnaire was a valid and reliable instrument for measuring social support for self-care in middle-aged patients with type II diabetes. It is an easy to use questionnaire and contains the most significant diabetes related behaviors that need continuous support for self-care. PMID:23190685

Development, pilot testing and psychometric validation of a short version of the coronary artery disease education questionnaire: The CADE-Q SV.

PubMed

Ghisi, Gabriela Lima de Melo; Sandison, Nicole; Oh, Paul

2016-03-01

To develop, pilot test and psychometrically validate a shorter version of the coronary artery disease education questionnaire (CADE-Q), called CADE-Q SV. Based on previous versions of the CADE-Q, cardiac rehabilitation (CR) experts developed 20 items divided into 5 knowledge domains to comprise the first version of the CADE-Q SV. To establish content validity, they were reviewed by an expert panel (N=12). Refined items were pilot-tested in 20 patients, in which clarity was provided. A final version was generated and psychometrically-tested in 132CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity with regard to patients' education and duration in CR. All ICC coefficients meet the minimum recommended standard. All domains were considered internally consistent (α>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.01) and duration in CR (p<0.05). Knowledge about exercise and nutrition was higher than knowledge about medical condition. The CADE-Q SV was demonstrated to have good reliability and validity. This is a short, quick and appropriate tool for application in clinical and research settings, assessing patients' knowledge during CR and as part of education programming. Copyright © 2015. Published by Elsevier Ireland Ltd.

Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool.

PubMed

Ghisi, Gabriela Lima de Melo; Grace, Sherry L; Thomas, Scott; Evans, Michael F; Oh, Paul

2013-06-01

To develop and psychometrically validate a tool to assess information needs in cardiac rehabilitation (CR) patients. After a literature search, 60 information items divided into 11 areas of needs were identified. To establish content validity, they were reviewed by an expert panel (N=10). Refined items were pilot-tested in 34 patients on a 5-point Likert-scale from 1 "really not helpful" to 5 "very important". A final version was generated and psychometrically tested in 203 CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity was assessed with regard to patient's education and duration in CR. Five items were excluded after ICC analysis as well as one area of needs. All 10 areas were considered internally consistent (Cronbach's alpha>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.05) and duration in CR (p<0.001). The mean total score was 4.08 ± 0.53. Patients rated safety as their greatest information need. The INCR Tool was demonstrated to have good reliability and validity. This is an appropriate tool for application in clinical and research settings, assessing patients' needs during CR and as part of education programming. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Shea, Sandy; Brennan, Robert T

2017-07-01

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents. To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment. During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs. Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems. The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions. A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model. The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different contexts. Results could be used to facilitate and monitor improvements in the clinical learning environment and resident well-being.

Patient Assessment of Constipation Quality of Life Questionnaire: Translation, Cultural Adaptation, Reliability, and Validity of the Persian Version.

PubMed

Nikjooy, Afsaneh; Jafari, Hassan; Saba, Maryam A; Ebrahimi, Naghmeh; Mirzaei, Rezvan

2018-05-01

The Patient Assessment of Constipation Quality of Life (PAC-QOL) questionnaire is the most validated and the most specific tool for measuring the quality of life of patients with constipation. Over 120 million people live in countries whose official language is Persian. There is no reported Persian version of the PAC-QOL questionnaire yet. The aim of this study was to translate and culturally adapt the PAC-QOL questionnaire and to assess its reliability and validity among Persian patients with chronic constipation. Following the translation and cultural adaptation of the PAC-QOL questionnaire to Persian, 100 patients (mean±SD age=40.51±13.67) with constipation were recruited for validity measurement and 20 patients were re-examined for reliability. Content validity was assessed based on the opinions of an expert committee and the floor/ceiling effect. Construct validity was evaluated according to the hypothesis test. The SF-36 questionnaire was used for concurrent criterion validity, intra-class correlation coefficient for reliability, and Cronbach's alpha for internal consistency. The content validity of the PAC-QOL questionnaire was proven, and there was no floor/ceiling effect. Construct validity also was confirmed based on the hypothesis test. The overall Cronbach's alpha of the PAC-QOL questionnaire was 0.92 (range=0.72-0.92), and the overall intra-class correlation coefficient of the questionnaire was 0.88 (range=0.69-0.87). The correlation between the SF-36 and PAC-QOL questionnaires was moderate. The Persian version of the PAC-QOL questionnaire demonstrated good validity and reliability properties in chronic constipation. Accordingly, Persian researchers and clinicians can benefit from this questionnaire in further research and assessment of treatment outcomes.

[Spanish version of the Satisfaction With Decision scale: cross-cultural adaptation, validity and reliability].

PubMed

Chabrera, Carolina; Areal, Joan; Font, Albert; Caro, Mónica; Bonet, Marta; Zabalegui, Adelaida

2015-01-01

The aim of this study is to develop a Spanish version of the Satisfaction With Decision scale (SWDs) and analyse the psychometric properties of validity and reliability. An observational, descriptive study and validation of a tool to measure satisfaction with the decision. Urology, Radiation oncology, and Medical oncology Departments of the Hospital Universitari Germans Trias i Pujol, Institut Català d'Oncologia and the Institut Oncològic del Vallès - Hospital General de Catalunya. A total of 170 participants diagnosed with prostate cancer, and who could read and write in Spanish and gave their informed consent. A translation, back-translation and cross-cultural adaptation to Spanish was performed on the SWDs. The content validity, criterion validity, construct validity and reliability (internal consistency and stability) of the Spanish version were evaluated. The SWDs contains 6 items with 5-item Likert scales. A Spanish version (ESD) was obtained that was linguistically and conceptually equivalent to the original version. Criterion validity, the ESD correlated with "satisfaction with the decision" using a linear analogue scale, was significant (r=0.63, P<.01) for all items. The factorial analysis showed a unique dimension to explain 82.08% of the variance. The ESD showed excellent results in terms of internal consistency (Cronbach alpha=0.95) and good test-retest reliability with intraclass correlation coefficient of 0.711. The ESD is a validated Spanish scale to measure the satisfaction with the decisions taken in health, and demonstrates a correct validity and reliability. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish.

PubMed

Ulusoy, Hatice; Güler, Güngör; Yıldırım, Gülay; Demir, Ecem

2018-02-01

Developing professional values among nursing students is important because values are a significant predictor of the quality care that will be provided, the clients' recognition, and consequently the nurses' job satisfaction. The literature analysis showed that there is only one validated tool available in Turkish that examines both the personal and the professional values of nursing students. The aim of this study was to assess the reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish. This study was a Turkish linguistic and cultural adaptation of a research tool. Participants and research context: The sample of this study consisted of 627 undergraduate nursing students from different geographical areas of Turkey. Two questionnaires were used for data collection: a socio-demographic form and the Salford-Scott Nursing Values Questionnaire. For the Salford-Scott Nursing Values Questionnaire, construct validity was examined using factor analyses. Ethical considerations: The study was approved by the Cumhuriyet University Faculty of Medicine Research Ethics Board. Students were informed that participation in the study was entirely voluntary and anonymous. Item content validity index ranged from 0.66 to 1.0, and the total content validity index was 0.94. The Kaiser-Meyer-Olkin measure of sampling was 0.870, and Bartlett's test of sphericity was statistically significant (x 2 = 3108.714, p < 0.001). Construct validity was examined using factor analyses and the six factors were identified. Cronbach's alpha was used to assess the internal consistency reliability and the value of 0.834 was obtained. Our analyses showed that the Turkish version of Salford-Scott Nursing Values Questionnaire has high validity and reliability.

Assessment study of insight ARTHRO VR (®) arthroscopy virtual training simulator: face, content, and construct validities.

PubMed

Bayona, Sofía; Fernández-Arroyo, José Manuel; Martín, Isaac; Bayona, Pilar

2008-09-01

The aims of this study were to test the face, content, and construct validities of a virtual-reality haptic arthroscopy simulator and to validate four assessment hypothesis. The participants in our study were 94 arthroscopists attending an international conference on arthroscopy. The interviewed surgeons had been performing arthroscopies for a mean of 8.71 years (σ = 6.94 years). We explained the operation, functionality, instructions for use, and the exercises provided by the simulator. They performed a trial exercise and then an exercise in which performance was recorded. After having using it, the arthroscopists answered a questionnaire. The simulator was classified as one of the best training methods (over phantoms), and obtained a mark of 7.10 out of 10 as an evaluation tool. The simulator was considered more useful for inexperienced surgeons than for surgeons with experience (mean difference 1.88 out of 10, P value < 0.001). The participants valued the simulator at 8.24 as a tool for learning skills, its fidelity at 7.41, the quality of the platform at 7.54, and the content of the exercises at 7.09. It obtained a global score of 7.82. Of the subjects, 30.8% said they would practise with the simulator more than 6 h per week. Of the surgeons, 89.4% affirmed that they would recommend the simulator to their colleagues. The data gathered support the first three hypotheses, as well as face and content validities. Results show statistically significant differences between experts and novices, thus supporting the construct validity, but studies with a larger sample must be carried out to verify this. We propose concrete solutions and an equation to calculate economy of movement. Analogously, we analyze competence measurements and propose an equation to provide a single measurement that contains them all and that, according to the surgeons' criteria, is as reliable as the judgment of experts observing the performance of an apprentice.

Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Glas, Cees A W; Vonkeman, Harald E; Taal, Erik; Krishnan, Eswar; Bernelot Moens, Hein J; Boers, Maarten; Terwee, Caroline B; van Riel, Piet L C M; van de Laar, Mart A F J

2015-12-01

To evaluate the content validity and measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) physical function item bank and a 20-item short form in patients with RA in comparison with the HAQ disability index (HAQ-DI) and 36-item Short Form Health Survey (SF-36) physical functioning scale (PF-10). The content validity of the instruments was evaluated by linking their items to the International Classification of Functioning, Disability and Health (ICF) core set for RA. The measures were administered to 690 RA patients enrolled in the Dutch Rheumatoid Arthritis Monitoring registry. Measurement precision was evaluated using item response theory methods and construct validity was evaluated by correlating physical function scores with other clinical and patient-reported outcome measures. All 207 health concepts identified in the physical function measures referred to activities that are featured in the ICF. Twenty-three of 26 ICF RA core set domains are featured in the full PROMIS physical function item bank compared with 13 and 8 for the HAQ-DI and PF-10, respectively. As hypothesized, all three physical function instruments were highly intercorrelated (r 0.74-0.84), moderately correlated with disease activity measures (r 0.44-0.63) and weakly correlated with age (rs 0.07-0.14). Item response theory-based analysis revealed that a 20-item PROMIS physical function short form covered a wider range of physical function levels than the HAQ-DI or PF-10. The PROMIS physical function item bank demonstrated excellent measurement properties in RA. A content-driven 20-item short form may be a useful tool for assessing physical function in RA. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Development and evaluation of oral Cancer quality-of-life questionnaire (QOL-OC).

PubMed

Nie, Min; Liu, Chang; Pan, Yi-Chen; Jiang, Chen-Xi; Li, Bao-Ru; Yu, Xi-Jie; Wu, Xin-Yu; Zheng, Shu-Ning

2018-05-03

In this study scales and items for the Oral Cancer Quality-of-life Questionnaire (QOL-OC) were designed and the instrument was evaluated. The QOL-OC was developed and modified using the international definition of quality of life (QOL) promulgated by the European Organization for Research and Treatment of Cancer (EORTC) and analysis of the precedent measuring instruments. The contents of each item were determined in the context of the specific characteristics of oral cancer. Two hundred thirteen oral cancer patients were asked to complete both the EORTC core quality of life questionnaire (EORTC QLC-C30) and the QOL-OC. Data collected was used to conduct factor analysis, test-retest reliability, internal consistency, and construct validity. Questionnaire compliance was relatively high. Fourteen of the 213 subjects accepted the same tests after 24 to 48 h demonstrating a high test-retest reliability for all five scales. Overall internal consistency surpasses 0.8. The outcome of the factor analysis coincides substantially with our theoretical conception. Each item shows a higher correlation coefficient within its own scale than the others which indicates high construct validity. QOL-OC demonstrates fairly good statistical reliability, validity, and feasibility. However, further tests and modification are needed to ensure its applicability to the quality-of-life assessment of Chinese oral cancer patients.

Development and validation of an abbreviated version of the Trust in Oncologist Scale-the Trust in Oncologist Scale-short form (TiOS-SF).

PubMed

Hillen, Marij A; Postma, Rosa-May; Verdam, Mathilde G E; Smets, Ellen M A

2017-03-01

The original 18-item, four-dimensional Trust in Oncologist Scale assesses cancer patients' trust in their oncologist. The current aim was to develop and validate a short form version of the scale to enable more efficient assessment of cancer patients' trust. Existing validation data of the full-length Trust in Oncologist Scale were used to create a short form of the Trust in Oncologist Scale. The resulting short form was validated in a new sample of cancer patients (n = 92). Socio-demographics, medical characteristics, trust in the oncologist, satisfaction with communication, trust in healthcare, willingness to recommend the oncologist to others and to contact the oncologist in case of questions were assessed. Internal consistency, reliability, convergent and structural validity were tested. The five-item Trust in Oncologist Scale Short Form was created by selecting the statistically best performing item from each dimension of the original scale, to ensure content validity. Mean trust in the oncologist was high in the validation sample (response rate 86%, M = 4.30, SD = 0.98). Exploratory factor analyses supported one-dimensionality of the short form. Internal consistency was high, and temporal stability was moderate. Initial convergent validity was suggested by moderate correlations between trust scores with associated constructs. The Trust in Oncologist Scale Short Form appears to efficiently, reliably and validly measures cancer patients' trust in their oncologist. It may be used in research and as a quality indicator in clinical practice. More thorough validation of the scale is recommended to confirm this initial evidence of its validity.

Development and Validation of the Food Liking Questionnaire in a French-Canadian Population

PubMed Central

Carbonneau, Elise; Bradette-Laplante, Maude; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Corneau, Louise; Lemieux, Simone

2017-01-01

The purpose of this study was to develop and validate a questionnaire assessing food liking in a French-Canadian population. A questionnaire was developed, in which participants were asked to rate their degree of liking of 50 food items. An expert panel evaluated the content validity. For the validation study, 150 men and women completed the questionnaire twice. An Exploratory Factor Analysis (EFA) was performed to assess the number of subscales of the questionnaire. Internal consistency and test-retest reliability of the subscales were evaluated. Concurrent validity was assessed through correlations between liking scores and self-reported frequencies of consumption. Comments from the experts led to changes in the list of foods included in the questionnaire. The EFA revealed a two-factor structure for the questionnaire (i.e., savory and sweet foods) and led to the removal of nine items, resulting in a 32-item questionnaire. The two subscales revealed good internal consistency (Cronbach alphas: 0.85 and 0.89) and test-retest reliability (p = 0.84 and 0.86). The questionnaire demonstrated adequate concurrent validity, with moderate correlations between food liking and self-reported frequency of consumption (r = 0.19–0.39, ps < 0.05). This new Food Liking Questionnaire assessing liking of a variety of savory and sweet foods demonstrated good psychometric properties in every validation step. This questionnaire will be useful to explore the role of food liking and its interactions with other factors in predicting eating behaviors and energy intake. PMID:29292754

Development and Validation of the Food Liking Questionnaire in a French-Canadian Population.

PubMed

Carbonneau, Elise; Bradette-Laplante, Maude; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-12-08

The purpose of this study was to develop and validate a questionnaire assessing food liking in a French-Canadian population. A questionnaire was developed, in which participants were asked to rate their degree of liking of 50 food items. An expert panel evaluated the content validity. For the validation study, 150 men and women completed the questionnaire twice. An Exploratory Factor Analysis (EFA) was performed to assess the number of subscales of the questionnaire. Internal consistency and test-retest reliability of the subscales were evaluated. Concurrent validity was assessed through correlations between liking scores and self-reported frequencies of consumption. Comments from the experts led to changes in the list of foods included in the questionnaire. The EFA revealed a two-factor structure for the questionnaire (i.e., savory and sweet foods) and led to the removal of nine items, resulting in a 32-item questionnaire. The two subscales revealed good internal consistency (Cronbach alphas: 0.85 and 0.89) and test-retest reliability ( p = 0.84 and 0.86). The questionnaire demonstrated adequate concurrent validity, with moderate correlations between food liking and self-reported frequency of consumption ( r = 0.19-0.39, p s < 0.05). This new Food Liking Questionnaire assessing liking of a variety of savory and sweet foods demonstrated good psychometric properties in every validation step. This questionnaire will be useful to explore the role of food liking and its interactions with other factors in predicting eating behaviors and energy intake.

Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

PubMed

Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

2014-05-01

In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method of assessing and reporting whether items assess the intended theoretical construct and only that construct. In three studies, DCV was applied to measures of illness perceptions, control cognitions, and theory of planned behaviour response formats. Appendix S1 gives content validity indices for each item of each questionnaire investigated. Discriminant content validity is ideally applied while the measure is being developed, before using to measure the construct(s), but can also be applied after using a measure. © 2014 The British Psychological Society.

A Protocol for Advanced Psychometric Assessment of Surveys

PubMed Central

Squires, Janet E.; Hayduk, Leslie; Hutchinson, Alison M.; Cranley, Lisa A.; Gierl, Mark; Cummings, Greta G.; Norton, Peter G.; Estabrooks, Carole A.

2013-01-01

Background and Purpose. In this paper, we present a protocol for advanced psychometric assessments of surveys based on the Standards for Educational and Psychological Testing. We use the Alberta Context Tool (ACT) as an exemplar survey to which this protocol can be applied. Methods. Data mapping, acceptability, reliability, and validity are addressed. Acceptability is assessed with missing data frequencies and the time required to complete the survey. Reliability is assessed with internal consistency coefficients and information functions. A unitary approach to validity consisting of accumulating evidence based on instrument content, response processes, internal structure, and relations to other variables is taken. We also address assessing performance of survey data when aggregated to higher levels (e.g., nursing unit). Discussion. In this paper we present a protocol for advanced psychometric assessment of survey data using the Alberta Context Tool (ACT) as an exemplar survey; application of the protocol to the ACT survey is underway. Psychometric assessment of any survey is essential to obtaining reliable and valid research findings. This protocol can be adapted for use with any nursing survey. PMID:23401759

Psychometric evaluation of the Dutch version of the Subjective Opiate Withdrawal Scale (SOWS).

PubMed

Dijkstra, Boukje A G; Krabbe, Paul F M; Riezebos, Truus G M; van der Staak, Cees P F; De Jong, Cor A J

2007-01-01

To evaluate the psychometric properties of the Dutch version of the 16-item Subjective Opiate Withdrawal Scale (SOWS). The SOWS measures withdrawal symptoms at the time of assessment. The Dutch SOWS was repeatedly administered to a sample of 272 opioid-dependent inpatients of four addiction treatment centers during rapid detoxification with or without general anesthesia. Examination of the psychometric properties of the SOWS included exploratory factor analysis, internal consistency, test-retest reliability, and criterion validity. Exploratory factor analysis of the SOWS revealed a general pattern of four factors with three items not always clustered in the same factors at different points of measurement. After excluding these items from factor analysis four factors were identified during detoxification (temperature dysregulation, tractus locomotorius, tractus gastro-intestinalis and facial disinhibition). The 13-item SOWS shows high internal consistency and test-retest reliability and good validity at different stages of withdrawal. The 13-item SOWS is a reliable and valid instrument to assess opioid withdrawal during rapid detoxification. Three items were deleted because their content does not correspond directly with opioid withdrawal symptoms. Copyright (c) 2007 S. Karger AG, Basel.

Validation of the adherence questionnaire for Brazilian chronic kidney disease patients under hemodialysis.

PubMed

Lins, Silvia Maria de Sá Basilio; Leite, Josete Luzia; Godoy, Simone de; Fuly, Patrícia Dos Santos Claro; Araújo, Silvia Teresa Carvalho de; Silva, Ítalo Rodolfo

2017-01-01

To validate the evaluation questionnaire on adherence of chronic kidney disease (CKD) patients under hemodialysis. We verified the following psychometric properties of the instrument: reliability (stability and internal consistency) and validity (face, content, and construct). The intraclass correlation coefficient reached a value of 0.98 for the adherence questions and 0.91 for the perception questions. Regarding the kappa of the 14 questions examined, 12 had a value > 0.8, whereas the Cronbach's alpha had a value of 0.57. Experts ensured the face and content validity of the instrument, giving it an overall content validity index of 0.96. Construct validity, analyzed by Mann-Whitney test, was achieved as all domains showed a significant association with p<0.01. We verified, by the presented results, that the instrument has been validated for use in Brazil. Validar o questionário de avaliação sobre a adesão do portador de doença renal crônica em hemodiálise. Foram verificadas as seguintes propriedades psicométricas do instrumento: confiabilidade (estabilidade e consistência interna) e validade (de face, de conteúdo e de construto). O coeficiente de correlação intraclasse atingiu valor de 0,98 para as questões de adesão e 0,91 para as questões de percepção. Quanto ao kappa das 14 questões analisadas, 12 obtiveram um valor > 0,8. Já o alfa de Cronbach obteve valor de 0,57. Os especialistas asseguraram a validade de face e de conteúdo do instrumento, conferindo-lhe um índice de validade de conteúdo global de 0,96. A validade de construto, analisada por meio do teste de Mann-Whitney, foi alcançada na medida em que todos os domínios apresentaram uma associação significativa com p < 0,01. Verifica-se, pelos resultados apresentados, que o instrumento foi validado para uso no Brasil.

Developing an international scoring system for a consensus-based social cognition measure: MSCEIT-managing emotions.

PubMed

Hellemann, G S; Green, M F; Kern, R S; Sitarenios, G; Nuechterlein, K H

2017-10-01

Measures of social cognition are increasingly being applied to psychopathology, including studies of schizophrenia and other psychotic disorders. Tests of social cognition present unique challenges for international adaptations. The Mayer-Salovey-Caruso Emotional Intelligence Test, Managing Emotions Branch (MSCEIT-ME) is a commonly-used social cognition test that involves the evaluation of social scenarios presented in vignettes. This paper presents evaluations of translations of this test in six different languages based on representative samples from the relevant countries. The goal was to identify items from the MSCEIT-ME that show different response patterns across countries using indices of discrepancy and content validity criteria. An international version of the MSCEIT-ME scoring was developed that excludes items that showed undesirable properties across countries. We then confirmed that this new version had better performance (i.e. less discrepancy across regions) in international samples than the version based on the original norms. Additionally, it provides scores that are comparable to ratings based on local norms. This paper shows that it is possible to adapt complex social cognitive tasks so they can provide valid data across different cultural contexts.

[Discomfort associated with dental extraction surgery and development of a questionnaire (QCirDental). Part I: Impacts and internal consistency].

PubMed

Bortoluzzi, Marcelo Carlos; Martins, Luciana Dorochenko; Takahashi, André; Ribeiro, Bianca; Martins, Ligiane; Pinto, Marcia Helena Baldani

2018-01-01

The scope of this study was to develop and validate a questionnaire (QCirDental) to measure the impacts associated with dental extraction surgery. The QCirDental questionnaire was developed in two steps; (1) question and item generation and selection, and (2) pretest of the questionnaire with evaluation of the its measurement properties (internal consistency and responsiveness). The sample was composed of 123 patients. None of the patients had any difficulty in understanding the QCirDental. The instrument was found to have excellent internal consistency with Cronbach's alpha reliability coefficient of 0.83. The principal component analysis (Kaiser-Meyer-Olkin Measure of Sampling Adequacy 0,72 and Bartlett's Test of Sphericity with p < 0.001) showed six (6) dimensions explaining 67.5% of the variance. The QCirDental presented excellent internal consistency, being a questionnaire that is easy to read and understand with adequate semantic and content validity. More than 80% of the patients who underwent dental extraction reported some degree of discomfort within the perioperative period which highlights the necessity to assess the quality of care and impacts of dental extraction surgery.

Construction of a web-based questionnaire for longitudinal investigation of work exposure, musculoskeletal pain and performance impairments in high-performance marine craft populations

PubMed Central

de Alwis, Manudul Pahansen; Äng, Björn Olov; Garme, Karl

2017-01-01

Objective High-performance marine craft personnel (HPMCP) are regularly exposed to vibration and repeated shock (VRS) levels exceeding maximum limitations stated by international legislation. Whereas such exposure reportedly is detrimental to health and performance, the epidemiological data necessary to link these adverse effects causally to VRS are not available in the scientific literature, and no suitable tools for acquiring such data exist. This study therefore constructed a questionnaire for longitudinal investigations in HPMCP. Methods A consensus panel defined content domains, identified relevant items and outlined a questionnaire. The relevance and simplicity of the questionnaire’s content were then systematically assessed by expert raters in three consecutive stages, each followed by revisions. An item-level content validity index (I-CVI) was computed as the proportion of experts rating an item as relevant and simple, and a scale-level content validity index (S-CVI/Ave) as the average I-CVI across items. The thresholds for acceptable content validity were 0.78 and 0.90, respectively. Finally, a dynamic web version of the questionnaire was constructed and pilot tested over a 1-month period during a marine exercise in a study population sample of eight subjects, while accelerometers simultaneously quantified VRS exposure. Results Content domains were defined as work exposure, musculoskeletal pain and human performance, and items were selected to reflect these constructs. Ratings from nine experts yielded S-CVI/Ave of 0.97 and 1.00 for relevance and simplicity, respectively, and the pilot test suggested that responses were sensitive to change in acceleration and that the questionnaire, following some adjustments, was feasible for its intended purpose. Conclusions A dynamic web-based questionnaire for longitudinal survey of key variables in HPMCP was constructed. Expert ratings supported that the questionnaire content is relevant, simple and sufficiently comprehensive, and the pilot test suggested that the questionnaire is feasible for longitudinal measurements in the study population. PMID:28729320

Cross-cultural adaptation of the Individual Work Performance Questionnaire.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; Lerner, Debra; de Vet, Henrica C W; van der Beek, Allard J

2015-01-01

The Individual Work Performance Questionnaire (IWPQ), measuring task performance, contextual performance, and counterproductive work behavior, was developed in The Netherlands. To cross-culturally adapt the IWPQ from the Dutch to the American-English language, and assess the questionnaire's internal consistency and content validity in the American-English context. A five stage translation and adaptation process was used: forward translation, synthesis, back-translation, expert committee review, and pilot-testing. During the pilot-testing, cognitive interviews with 40 American workers were performed, to examine the comprehensibility, applicability, and completeness of the American-English IWPQ. Questionnaire instructions were slightly modified to aid interpretation in the American-English language. Inconsistencies with verb tense were identified, and it was decided to consistently use simple past tense. The wording of five items was modified to better suit the American-English language. In general, participants were positive on the comprehensibility, applicability and completeness of the questionnaire during the pilot-testing phase. Furthermore, the study showed positive results concerning the internal consistency (Cronbach's alphas for the scales between 0.79-0.89) and content validity of the American-English IWPQ. The results indicate that the cross-cultural adaptation of the American-English IWPQ was successful and that the measurement properties of the translated version are promising.

Do we know what foundation year doctors think about patient safety incident reporting? Development of a Web based tool to assess attitude and knowledge.

PubMed

Robson, Jean; de Wet, Carl; McKay, John; Bowie, Paul

2011-11-01

Making healthcare safer is an international priority. Patient safety modules are now taught in medical schools, and methods to assess related student knowledge and attitudes have been developed. However, little is known about the attitudes and knowledge which foundation doctors are developing to patient safety and incident reporting in the healthcare workplace, since a specific assessment tool appears to be lacking. To develop, content validate and pilot test an online questionnaire survey to elicit foundation doctors' knowledge and experience of patient safety and incident reporting, and assess related attitudes and behaviours. Questionnaire content validity was facilitated through: a steering group; literature review; feedback from foundation year doctors and consultant staff; a modified Delphi group; and completion of a content validity index by experts. In 2010 a cross-sectional online survey of 110 foundation year 1 and 2 doctors was then undertaken in three Scottish NHS board areas, utilising the developed 25 item questionnaire. The questionnaire was validated, and piloted among 69 foundation year doctors who responded to the questionnaire. The pilot has provided valuable insights into trainee attitudes and experience. For example, 32 (48%) believed that most safety incidents were due to things that they could not do anything about; and 31 (43%) admitted to being involved in medication errors which were not formally reported. The pilot study was successful in taking the first steps to developing a validated survey questionnaire for a key staff group, foundation year doctors, in a priority area. However, the findings raise concerns about trainee experience of and attitudes to reporting, and the frequency with which incidents go unreported.

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire.

PubMed

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. A descriptive-analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser-Meyer-Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students.

Development and evaluation of the Korean Health Literacy Instrument.

PubMed

Kang, Soo Jin; Lee, Tae Wha; Paasche-Orlow, Michael K; Kim, Gwang Suk; Won, Hee Kwan

2014-01-01

The purpose of this study is to develop and validate the Korean Health Literacy Instrument, which measures the capacity to understand and use health-related information and make informed health decisions in Korean adults. In Phase 1, 33 initial items were generated to measure functional, interactive, and critical health literacy with prose, document, and numeracy tasks. These items included content from health promotion, disease management, and health navigation contexts. Content validity assessment was conducted by an expert panel, and 11 items were excluded. In Phase 2, the 22 remaining items were administered to a convenience sample of 292 adults from community and clinical settings. Exploratory factor and item difficulty and discrimination analyses were conducted and four items with low discrimination were deleted. In Phase 3, the remaining 18 items were administered to a convenience sample of 315 adults 40-64 years of age from community and clinical settings. A confirmatory factor analysis was performed to test the construct validity of the instrument. The Korean Health Literacy Instrument has a range of 0 to 18. The mean score in our validation study was 11.98. The instrument exhibited an internal consistency reliability coefficient of 0.82, and a test-retest reliability of 0.89. The instrument is suitable for screening individuals who have limited health literacy skills. Future studies are needed to further define the psychometric properties and predictive validity of the Korean Health Literacy Instrument.

Development and validation of the Chinese Attitudes to Starting Insulin Questionnaire (Ch-ASIQ) for primary care patients with type 2 diabetes.

PubMed

Fu, Sau Nga; Chin, Weng Yee; Wong, Carlos King Ho; Yeung, Vincent Tok Fai; Yiu, Ming Pong; Tsui, Hoi Yee; Chan, Ka Hung

2013-01-01

To develop and evaluate the psychometric properties of a Chinese questionnaire which assesses the barriers and enablers to commencing insulin in primary care patients with poorly controlled Type 2 diabetes. Questionnaire items were identified using literature review. Content validation was performed and items were further refined using an expert panel. Following translation, back translation and cognitive debriefing, the translated Chinese questionnaire was piloted on target patients. Exploratory factor analysis and item-scale correlations were performed to test the construct validity of the subscales and items. Internal reliability was tested by Cronbach's alpha. Twenty-seven identified items underwent content validation, translation and cognitive debriefing. The translated questionnaire was piloted on 303 insulin naïve (never taken insulin) Type 2 diabetes patients recruited from 10 government-funded primary care clinics across Hong Kong. Sufficient variability in the dataset for factor analysis was confirmed by Bartlett's Test of Sphericity (P<0.001). Using exploratory factor analysis with varimax rotation, 10 factors were generated onto which 26 items loaded with loading scores > 0.4 and Eigenvalues >1. Total variance for the 10 factors was 66.22%. Kaiser-Meyer-Olkin measure was 0.725. Cronbach's alpha coefficients for the first four factors were ≥0.6 identifying four sub-scales to which 13 items correlated. Remaining sub-scales and items with poor internal reliability were deleted. The final 13-item instrument had a four scale structure addressing: 'Self-image and stigmatization'; 'Factors promoting self-efficacy; 'Fear of pain or needles'; and 'Time and family support'. The Chinese Attitudes to Starting Insulin Questionnaire (Ch-ASIQ) appears to be a reliable and valid measure for assessing barriers to starting insulin. This short instrument is easy to administer and may be used by healthcare providers and researchers as an assessment tool for Chinese diabetic primary care patients, including the elderly, who are unwilling to start insulin.

Development and Psychometric Properties of the Decision Making on the Type of Delivery Questionnaire in Iranian Women.

PubMed

Latifnejad Roudsari, Robab; Zakerihamidi, Maryam; Merghati Khoei, Effat; Kazemnejad, Anoshirvan

2017-07-01

A tool which can help to decide on the determinants in selecting the delivery type is an effective step towards the goals of the World Health. This study aimed to develop and evaluate the psychometric properties of a scale based on Iranian culture to make decision on the type of delivery. This is a methodological study using a questionnaire proposed by Schneider. The following steps were used to design the project. In the first step, perceptions and experiences of 45 pregnant women, postpartum women, midwives, gynecologists and non-pregnant women were determined based on interviews and observations using focused ethnography. In the second stage, the terms in the questionnaire based on qualitative study was assessed. Then, in the third stage, psychometric testing of the decision making on the type of delivery scale (DMTDS) based on the cultural concepts of decision making towards the type of delivery and its influencing factors based on focused ethnography using face validity, content validity, construct validity, internal consistency and reliability was done on400 pregnant and postpartum women. The initially developed scale consisted of 60 items on a 5-point Likert scale, which reduced to 43 items following measurement of the face and content validity. The results of the exploratory factor analysis elicited 36 items and a seven-factor structure including motivational beliefs on vaginal delivery, social beliefs towards childbirth, motivational beliefs on cesarean delivery, personal beliefs, sources of information, catastrophic thinking and child birth experiences. Cronbach's alpha coefficient (0.80) confirmed the high internal consistency of the scale. The developed questionnaire appears to be a valid and reliable tool for health care providers to measure the women's decision making towards type of delivery. Therefore, this tool can be used in the Iranian community. The scale may help the midwives and obstetricians to be aware of the women's decision regarding their choice of delivery and as a result to plan appropriately in order to reduce unnecessary cesarean sections.

The Achilles tendon total rupture score: a study of responsiveness, internal consistency and convergent validity on patients with acute Achilles tendon ruptures

PubMed Central

2012-01-01

Background The Achilles tendon Total Rupture Score was developed by a research group in 2007 in response to the need for a patient reported outcome measure for this patient population. Beyond this original development paper, no further validation studies have been published. Consequently the purpose of this study was to evaluate internal consistency, convergent validity and responsiveness of this newly developed patient reported outcome measure within patients who have sustained an isolated acute Achilles tendon rupture. Methods Sixty-four eligible patients with an acute rupture of their Achilles tendon completed the Achilles tendon Total Rupture Score alongside two further patient reported outcome measures (Disability Rating Index and EQ 5D). These were completed at baseline, six weeks, three months, six months and nine months post injury. The Achilles tendon Total Rupture Score was evaluated for internal consistency, using Cronbach's alpha, convergent validity, through correlation analysis and responsiveness, by analysing floor and ceiling effects and calculating its relative efficiency in comparison to the Disability Rating Index and EQ 5D scores. Results The Achilles tendon Total Rupture Score demonstrated high internal consistency (Cronbachs alpha > 0.8) and correlated significantly (p < 0.001) with the Disability Rating Index at five time points (pre-injury, six weeks, three, six and nine months) with correlation coefficients between -0.5 and -0.9. However, the confidence intervals were wide. Furthermore, the ability of the new score to detect clinically important changes over time (responsiveness) was shown to be greater than the Disability Rating Index and EQ 5D. Conclusions A universally accepted outcome measure is imperative to allow comparisons to be made across practice. This is the first study to evaluate aspects of validity of this newly developed outcome measure, outside of the developing centre. The ATRS demonstrated high internal consistency and responsiveness, with limited convergent validity. This research provides further support for the use of this outcome measure, however further research is required to advocate its universal use in patients with acute Achilles tendon ruptures. Such areas include inter-rater reliability and research to determine the minimally clinically important difference between scores. All authors have read and concur with the content of this manuscript. The material presented has not been and will not be submitted for publication elsewhere, except as an abstract. All authors have made substantial contributions to all of the following: (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content and (3) final approval of the submitted version. This research has been funded by Arthritis Research UK, no conflicts of interests have been declared by the authors. Kind Regards Rebecca Kearney (corresponding author) Research Physiotherapist PMID:22376047

Translation and validation of the Malay version of Shiffman-Jarvik withdrawal scale and cessation self-efficacy questionnaire: a review of psychometric properties.

PubMed

Teo, Eng Wah; Lee, Yuin Yi; Khoo, Selina; Morris, Tony

2015-04-09

Smoking tobacco is a major concern in Malaysia, with 23.1% of Malaysian adults smoking tobacco in 2012. Withdrawal symptoms and self-efficacy to quit smoking have been shown to have significant effects on the outcomes of smoking cessation. The Shiffman-Jarvik Withdrawal Scale (Psychopharmacology, 50: 35-39, 1976) and the Cessation Self-Efficacy Questionnaire (Cognitive Ther Res 5: 175-187, 1981) are two questionnaires that have been widely used in various smoking cessation research. The short SJWS consists of 15 items with five subscales: physical symptoms, psychological symptoms, stimulation/sedation, appetite, and cravings. The CSEQ is a 12-item questionnaire that assesses participant's self-efficacy to avoid smoking in various situations described in each item. The aim of this study was to translate and validate the Malay language version of the SJWS and the CSEQ. The SJWS and CSEQ were translated into the Malay language based on the back translation method. A total of 146 participants (25.08 ± 5.19 years) answered the translated questionnaires. Psychometrics properties such as reliability (internal consistency and test-retest) and validity (content validity, construct validity and face validity) were examined. Both questionnaires showed acceptable internal consistency; SJWS-M (α = 0.66) and CSEQ-M (α = 0.90) and good test-retest reliability; SJWS-M (r = 0.76) and the CSEQ-M (r = 0.80). SJWS-M (χ(2) = 15.964, GFI = 0.979, CFI = 1.000, RMSEA = 0.000, ChiSq/df = 0.939, AGFI = 0.933, TLI = 1.004, and NPI = 0.978) and CSEQ-M (of χ(2) = 35.16, GFI = 0.960, CFI = 0.999, RMSEA = 0.015, ChiSq/df = 1.034, AGFI = 0.908, TLI = 0.999, and NPI = 0.979) also showed good construct validity. Both questionnaires showed sufficient item to item convergent validity and item discriminant validity. Content validity was established (reassess) by experts in the field of psychology, culture and language whereas face validity was confirmed by smokers. The translated Malay version of the CSEQ-M and the SJWS-M showed great reliability and validity evidences therefore is an adequate and useful instrument to evaluate Malaysian smokers. Future studies could investigate differences in self-esteem between long-term and short-term smokers and evaluate the usability of these questionnaires in local smoking research and other Malay speaking countries (Brunei and Indonesia).

Pressure ulcer prevention algorithm content validation: a mixed-methods, quantitative study.

PubMed

van Rijswijk, Lia; Beitz, Janice M

2015-04-01

Translating pressure ulcer prevention (PUP) evidence-based recommendations into practice remains challenging for a variety of reasons, including the perceived quality, validity, and usability of the research or the guideline itself. Following the development and face validation testing of an evidence-based PUP algorithm, additional stakeholder input and testing were needed. Using convenience sampling methods, wound care experts attending a national wound care conference and a regional wound ostomy continence nursing (WOCN) conference and/or graduates of a WOCN program were invited to participate in an Internal Review Board-approved, mixed-methods quantitative survey with qualitative components to examine algorithm content validity. After participants provided written informed consent, demographic variables were collected and participants were asked to comment on and rate the relevance and appropriateness of each of the 26 algorithm decision points/steps using standard content validation study procedures. All responses were anonymous. Descriptive summary statistics, mean relevance/appropriateness scores, and the content validity index (CVI) were calculated. Qualitative comments were transcribed and thematically analyzed. Of the 553 wound care experts invited, 79 (average age 52.9 years, SD 10.1; range 23-73) consented to participate and completed the study (a response rate of 14%). Most (67, 85%) were female, registered (49, 62%) or advanced practice (12, 15%) nurses, and had > 10 years of health care experience (88, 92%). Other health disciplines included medical doctors, physical therapists, nurse practitioners, and certified nurse specialists. Almost all had received formal wound care education (75, 95%). On a Likert-type scale of 1 (not relevant/appropriate) to 4 (very relevant and appropriate), the average score for the entire algorithm/all decision points (N = 1,912) was 3.72 with an overall CVI of 0.94 (out of 1). The only decision point/step recommendation with a CVI of ≤ 0.70 was the recommendation to provide medical-grade sheepskin for patients at high risk for friction/shear. Many positive and substantive suggestions for minor modifications including color, flow, and algorithm orientation were received. The high overall and individual item rating scores and CVI further support the validity and appropriateness of the PUP algorithm with the addition of the minor modifications. The generic recommendations facilitate individualization, and future research should focus on construct validation testing.

Development and validation of the work-family-school role conflicts and role-related social support scales among registered nurses with multiple roles.

PubMed

Xu, Lijuan; Song, Rhayun

2013-10-01

The purpose of this study was to develop work-family-school role conflicts and role-related social support scales, and to validate the psychometrics of those scales among registered nurses with multiple roles. The concepts, generation of items, and the scale domains of work-family-school role conflicts and role-related social support scales were constructed based on a review of the literature. The validity and reliability of the scales were examined by administering them to 201 registered nurses who were recruited from 8 university hospitals in South Korea. The content validity was examined by nursing experts using a content validity index. Exploratory factor analysis and confirmatory factor analysis were used to establish the construct validity. The correlation with depression was examined to assess concurrent validity. Finally, internal consistency was assessed using Cronbach's alpha coefficients. The work-family-school role conflicts scale comprised ten items with three factors: work-school-to-family conflict (three items), family-school-to-work conflict (three items), and work-family-to-school conflict (four items). The role-related social support scale comprised nine items with three factors: support from family (three items), support from work (three items), and support from school (three items). Cronbach's alphas were 0.83 and 0.76 for the work-family-school role conflicts and role-related social support scales, respectively. Both instruments exhibited acceptable construct and concurrent validity. The validity and reliability of the developed scales indicate their potential usefulness for the assessment of work-family-school role conflict and role-related social support among registered nurses with multiple roles in Korea. Copyright © 2013 Elsevier Ltd. All rights reserved.

Determining the Appropriateness of the "What If" Situations Test (WIST) with Turkish Pre-Schoolers.

PubMed

Citak Tunc, Gulseren; Gorak, Gulay; Ozyazicioglu, Nurcan; Ak, Bedriye; Isil, Ozlem; Vural, Pinar

2018-04-01

Measurement instruments are needed to assess the child's sexual abuse prevention program. The purpose of the study was to determine the reliability and validity of the WIST (What If Situations Test) for Turkish culture. Participants were children of the 3-6 age group attending pre-school education institutions and the sample size was identified by means of a power analysis. Seventy children were identified as the sample with 0.85 power and 0.05 type I error according to the power analysis. Language validity, content validity, internal validity coefficient (Cronbach alpha coefficient), and test-retest analyses were conducted in terms of validity and reliability in the scope of efforts for adaptation to Turkish culture. Firstly, Kendall W = 0.83 was the score for the expert opinions concerning the content validity of the language validity scale. It was found that the Cronbach alpha coefficients were between 0.68 and 0.90 for the scale sub-dimensions of appropriate and inappropriate recognition, saying, doing, telling, and reporting. The test-retest reliability of the scale was found to be r = 0.89 and the test-retest reliabilities for the sub-dimensions (appropriate recognition, inappropriate recognition, say skills, do skills, tell skills, and reporting skills) were between r = 0.48 and r = 0.92. The test-retest reliability for the Personal Safety Questionnaire (PSQ), as having complimentary items to the WIST, was found to be r = 0.82. The reliability and validity analysis of the 'What If' Situations Test (WIST), used to evaluate pre-schoolers' skills regarding self-protection against sexual abuse, showed that the Test's adaptation to Turkish culture was reliable and valid.

Performance indicators for public mental healthcare: a systematic international inventory

PubMed Central

2012-01-01

Background The development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations. Methods Publications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated. Results A total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others. Conclusions PI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI. PMID:22433251

Reliability and Validity of the Persian Language Version of the International Consultation on Incontinence Questionnaire - Male Lower Urinary Tract Symptoms (ICIQ-MLUTS).

PubMed

Pourmomeny, Abbas Ali; Ghanei, Behnaz; Alizadeh, Farshid

2018-05-01

Assessment instruments are essential for research, allowing diagnosis and evaluating treatment outcomes in subjects with lower urinary tract disorders of both genders. The purpose of this study was to translate the Male Lower Urinary Tract Symptoms (MLUTS) Questionnaire and determine its psychometric properties in Persian subjects. After getting permission from the International Consultation on Incontinence Modular Questionnaire (ICIQ) web site, the forward and backward translation of the MLUTS questionnaire were carried out by researcher team. The content/face validity, construct validity and reliability were assessed in a sample of MLUTS Iranian patients by measuring with the Cronbach's alpha test. In total, 121 male patients were included in the study. The mean age of the patients was 60.5 years. Cronbach alpha value was 0.757, consecrated the internal consistency of the form (r > 0.7). The internal consistency of each question was examined separately and found to be over 0.7. For the evaluation of reliability test-retest was done, the test was administered to 20% of the patients for a second time with an interval of 1-2 weeks. The intraclass correlation coefficient (ICC) score was 0.901. The Correlation coefficient between the MLUTS and International Prostate Symptoms Score (IPSS) was 0.879. ICIQ-MLUTS is a robust instrument, which can be used for evaluating male LUTS in Persian patients. We believe that the Persian version of the MLUTS is an important tool for research and clinical setting. © 2017 John Wiley & Sons Australia, Ltd.

Using Content Maps to Measure Content Development in Physical Education: Validation and Application

ERIC Educational Resources Information Center

Ward, Phillip; Dervent, Fatih; Lee, Yun Soo; Ko, Bomna; Kim, Insook; Tao, Wang

2017-01-01

Purpose: This study reports on our efforts toward extending the conceptual understanding of content development in physical education by validating content maps as a measurement tool, examining new categories of instructional tasks to describe content development and validating formulae that can be used to evaluate depth of content development.…

Performing a Content Validation Study.

ERIC Educational Resources Information Center

Spool, Mark D.

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

[Survey adaptation for bio-behavioural surveillance of HIV in Chilean female sex workers].

PubMed

Carvajal, Bielka; Stuardo, Valeria; Manríquez, José Manuel; Belmar, Julieta; Folch, Cinta

To adapt a behavioural questionnaire for second-generation HIV/AIDS surveillance in female sex workers (FSWs) in the Metropolitan Region, Chile. Qualitative study of instruments validation. A Spanish instrument adapted in Catalonia was validated through a translation and back-translation of the original version. The content validity was determined through a modified Delphi method, via FSW and HIV experts representing community, political and institutional levels. Applicability aspects were determined by the application of the questionnaire to FSW in the Metropolitan Region. The questionnaire, drafted in Spain, was successfully adapted to Chilean Spanish. The content validity process enabled sections to be created that address HIV in FSWs. The adapted questionnaire takes less than 15minutes to complete, which makes it usable in fieldwork. The 61 women surveyed came from different countries (all were Latin Americans) and had different educational levels; all this enabled potential applicability problems to be detected. The adapted questionnaire for Chile contains all the UNAIDS indicators for FSWs, as well as the recommended indicators of Family Health International for bio-behavioural surveillance. Said questionnaire serves as a tool for second-generation HIV/other STD surveillance and further contributes to preventive policies in Chilean FSWs. Copyright © 2016 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Portuguese community pharmacists' attitudes to and knowledge of antibiotic misuse: questionnaire development and reliability.

PubMed

Roque, Fátima; Soares, Sara; Breitenfeld, Luiza; Gonzalez-Gonzalez, Cristian; Figueiras, Adolfo; Herdeiro, Maria Teresa

2014-01-01

To develop and evaluate the reliability of a self-administered questionnaire designed to assess the attitudes and knowledge of community pharmacists in Portugal about microbial resistance and the antibiotic dispensing process. This study was divided into the following three stages: (1) design of the questionnaire, which included a literature review and a qualitative study with focus-group sessions; (2) assessment of face and content validity, using a panel of experts and a pre-test of community pharmacists; and, (3) pilot study and reliability analysis, which included a test-retest study covering fifty practising pharmacists based at community pharmacies in five districts situated in Northern Portugal. Questionnaire reproducibility was quantified using the intraclass correlation coefficient (ICC; 95% confidence interval) computed by means of one-way analysis of variance (ANOVA). Internal consistency was evaluated using Cronbach's alpha. The correlation coefficients were fair to good (ICC>0.4) for all statements (scale-items) regarding knowledge of and attitudes to antibiotic resistance, and ranged from fair to good to excellent for statements about situations in which pharmacists acknowledged that antibiotics were sometimes dispensed without a medical prescription (ICC>0.8). Cronbach's alpha for this section was 0.716. The questionnaire designed in this study is valid and reliable in terms of content validity, face validity and reproducibility.

Reliability and validity of the Chinese version of the autoimmune bullous disease quality of life (ABQOL) questionnaire.

PubMed

Yang, Baoqi; Chen, Guo; Yang, Qing; Yan, Xiaoxiao; Zhang, Zhaoxia; Murrell, Dédée F; Zhang, Furen

2017-02-02

The autoimmune bullous diseases quality of life (ABQOL) questionnaire was recently developed by an Australian group and has been validated in Australian and North American patient cohorts. It is a 17-item, multidimensional, self-administered English questionnaire. The study aimed to validate the Chinese version of the ABQOL questionnaire and evaluate the reliability in Chinese patients. The Chinese version of the ABQOL questionnaire was produced by forward-backward translation and cross-cultural adaptation of the original English version. The ABQOL questionnaire was then distributed to a total of 101 patients with autoimmune bullous diseases (AIBDs) together with the Dermatology Life Quality Index (DLQI) and the 36-item Short Form Health Survey (SF-36). Validity was analyzed across a range of indices and reliability was assessed using internal consistency and test-retest methods. The Chinese version of the ABQOL questionnaire has a high internal consistency (Cronbach's alpha coefficient, 0.88) and test-retest reliability (the intraclass correlation coefficient, 0.87). Face and content validity were satisfactory. Convergent validity testing showed that the correlation coefficients for the ABQOL and DLQI was 0.77 and for the ABQOL and SF-36 was -0.62. In terms of discriminant validity, there was no significant difference between the proportions of insensitive items in ABQOL and DLQI (p = 0.236). There was no significant difference between the proportions of insensitive items in ABQOL and SF-36 (p = 0.823). The Chinese version of the ABQOL questionnaire has adequate validity and reliability. It may constitute a useful instrument to measure disease burden in Chinese patients with AIBDs.

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method.

PubMed

Kunz, Derek; Pariyadath, Manoj; Wittler, Mary; Askew, Kim; Manthey, David; Hartman, Nicholas

2017-06-01

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality. We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States. We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency. Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts. © 2017 by the American Institute of Ultrasound in Medicine.

[Nursing outcomes for ineffective breathing patterns and impaired spontaneous ventilation in intensive care].

PubMed

do Canto, Débora Francisco; Almeida, Miriam de Abreu

2013-12-01

This study aimed to validate the results of Nursing selected from the link NANDA-I-NOC (Nursing Outcomes Classification--NANDA--International) for diagnosis Ineffective Breathing Pattern and Impaired Spontaneous Ventilation in adult intensive care unit. This is a content validation study conducted in a university hospital in southern Brazil with 15 expert nurses with clinical experience and knowledge of the ratings. The instruments contained five-point Likert scales to rate the importance of each outcome (1st step) and indicator (Step 2) for the diagnoses studied. We calculated weighted averages for each outcome/indicator, considering) 1 = 0. 2 = 0.25, 3 = 0.50 4 = 0.75 and 5 = 1. The outcomes suggested by the NOC with averages above 0.8 were considered validated as well as the indicators. The results Respiratory State--airway permeability (Ineffective Breathing Patterns) and 11 indicators, and Response to mechanical ventilation: adult (Impaired Spontaneous Ventilation) with 26 indicators were validated.

Development and initial validation of an instrument to assess stressors among South African sports coaches.

PubMed

Kubayi, Alliance; Toriola, Abel; Didymus, Faye

2018-06-01

The aim of this series of studies was to develop and initially validate an instrument to assess stressors among South African sports coaches. In study one, a preliminary pool of 45 items was developed based on existing literature and an expert panel was employed to assess the content validity and applicability of these items. In study two, the 32 items that were retained after study one were analysed using principal component analysis (PCA). The resultant factorial structure comprised four components: environmental stressors, performance stressors, task-related stressors, and athlete stressors. These four components were made up of 26 items and, together, the components and items comprised the provisional Stressors in Sports Coaching Questionnaire (SSCQ). The results show that the SSCQ demonstrates acceptable internal consistency (.73-.89). The findings provide preliminary evidence that SSCQ is a valid tool to assess stressors among South African sports coaches.

Women's perceived internal control of future pregnancy outcomes and its related factors.

PubMed

Maleki, Azam; Mazloomzadeh, Saeideh

2013-03-01

With regards to the importance of women's beliefs in improving pregnancy outcomes, this study was performed to determine the perceived internal control on future pregnancy outcomes and its related factors in women who participated in pre-marital counseling. In a cross-sectional study, women's perceived internal control was investigated. The study population comprised the women in reproductive age of whom 400 were selected by random sampling. Data collection instrument was a questionnaire consisting of demographic, pre-conceptional care, and internal control questions. Two categories of favorite and not favorite levels of internal control were defined based on the total score. The validity of the questionnaire was determined via content validity method by use of experts' opinion and its reliability was evaluated through the calculation of Cronbach's alpha coefficient which was 0.76. Data were analyzed through frequency tables, correlation coefficient, and Chi-square test at the confidence level of 0.95. Two hundred sixty-five (65%) women had a good perceived internal control and it was significantly associated with the age, educational level, and hearing about pre-conceptional care. The internal control score also showed a positive and significant correlation with both age and the subject knowledge about folic acid (r = 0.19 and r = 0.15, respectively). The majority of women had a favorite perceived internal control. Since age and educational level were the affecting factors on the perceived internal control of women, promoting the level of internal control in young women and those with low education in pre-marital counseling classes seems necessary.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire.

PubMed

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-03-04

Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test - retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81-0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test - retest reliability) was found 0.66 (95% CI: 0.62-0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36-0.89). This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting.

A Chinese version of the Psychotic Symptom Rating Scales: psychometric properties in recent-onset and chronic psychosis.

PubMed

Chien, Wai-Tong; Lee, Isabella Yuet-Ming; Wang, Li-Qun

2017-01-01

The purpose of this study was to test the reliability, validity, and factor structure of a Chinese version of the Psychotic Symptom Rating Scale (PSYRATS) in 198 and 202 adult patients with recent-onset and chronic psychosis, respectively. The PSYRATS has been translated into different language versions and has been validated for clinical and research use mainly in chronic psychotic patients but not in recent-onset psychosis patients or in Chinese populations. The psychometric analysis of the translated Chinese version included assessment of its content validity, semantic equivalence, interrater and test-retest reliability, reproducibility, sensitivity to changes in psychotic symptoms, internal consistency, concurrent validity (compared to a valid psychotic symptom scale), and factor structure. The Chinese version demonstrated very satisfactory content validity as rated by an expert panel, good semantic equivalence with the original version, and high interrater and test-retest (at 2-week interval) reliability. It also indicated very good reproducibility of and sensitivity to changes in psychotic symptoms in line with the symptom severity measured with the Positive and Negative Syndrome Scale (PANSS). The scale consisted of four factors for the hallucination subscale and two factors for the delusion subscale, explaining about 80% of the total variance of the construct, indicating satisfactory correlations between the hallucination and delusion factors themselves, between items, factors, subscales, and overall scale, and between factors and relevant item and subscale scores of the PANSS. The Chinese version of the PSYRATS is a reliable and valid instrument to measure symptom severity in Chinese psychotic patients complementary to other existing measures mainly in English language.

A Psychometric Study of the Bayley Scales of Infant and Toddler Development in Persian Language Children

PubMed Central

AZARI, Nadia; SOLEIMANI, Farin; VAMEGHI, Roshanak; SAJEDI, Firoozeh; SHAHSHAHANI, Soheila; KARIMI, Hossein; KRASKIAN, Adis; SHAHROKHI, Amin; TEYMOURI, Robab; GHARIB, Masoud

2017-01-01

Objective Bayley Scales of infant & toddler development is a well-known diagnostic developmental assessment tool for children aged 1–42 months. Our aim was investigating the validity & reliability of this scale in Persian speaking children. Materials & Methods The method was descriptive-analytic. Translation- back translation and cultural adaptation was done. Content & face validity of translated scale was determined by experts’ opinions. Overall, 403 children aged 1 to 42 months were recruited from health centers of Tehran, during years of 2013-2014 for developmental assessment in cognitive, communicative (receptive & expressive) and motor (fine & gross) domains. Reliability of scale was calculated through three methods; internal consistency using Cronbach’s alpha coefficient, test-retest and interrater methods. Construct validity was calculated using factor analysis and comparison of the mean scores methods. Results Cultural and linguistic changes were made in items of all domains especially on communication subscale. Content and face validity of the test were approved by experts’ opinions. Cronbach’s alpha coefficient was above 0.74 in all domains. Pearson correlation coefficient in various domains, were ≥ 0.982 in test retest method, and ≥0.993 in inter-rater method. Construct validity of the test was approved by factor analysis. Moreover, the mean scores for the different age groups were compared and statistically significant differences were observed between mean scores of different age groups, that confirms validity of the test. Conclusion The Bayley Scales of Infant and Toddler Development is a valid and reliable tool for child developmental assessment in Persian language children. PMID:28277556

Development and Validation of the Biobanking Attitudes and Knowledge Survey (BANKS)

PubMed Central

Wells, Kristen J.; Arevalo, Mariana; Meade, Cathy D.; Gwede, Clement K.; Quinn, Gwendolyn P.; Luque, John S.; Miguel, Gloria San; Watson, Dale; Phillips, Rebecca; Reyes, Carmen; Romo, Margarita; West, Jim; Jacobsen, Paul B.

2014-01-01

Background No validated multi-scale instruments exist that measure community members’ views on biobanking and biospecimen donation. This study describes the development and psychometric properties of the English-language BANKS (Biobanking Attitudes aNd Knowledge Survey). Methods The BANKS was created by item generation through review of scientific literature, focus groups with community members, and input from a community advisory board. Items were refined through cognitive interviews. Content validity was assessed through an expert panel review. Psychometric properties of the BANKS were assessed in a sample of 85 community members. Results The final BANKS includes 3 scales: Attitudes, Knowledge, and Self-Efficacy; as well as 3 single items, which evaluated receptivity and intention to donate a biospecimen for research. Cronbach's alpha coefficients for two scales that use Likert response format indicated high internal consistency (Attitudes: α=.88; Self-Efficacy: α=.95). Content validity indices were moderate, ranging from 0.69 to 0.89. Intention to donate blood and intention to donate urine were positively correlated with attitudes, knowledge, self-efficacy, and receptivity to learning more about biobanking (p's range from .029 to <.001). Conclusions The final BANKS shows evidence of satisfactory reliability and validity, is easy to administer, and is a promising tool to inform biospecimen research. Additional studies should be conducted with larger samples considering biospecimen donation to further assess the instrument's reliability and validity. Impact A valid and reliable instrument measuring community members’ views about biobanking may help researchers evaluate relevant communication interventions to enhance understanding, intention, and actual biospecimen donation. A Spanish-language BANKS is under development. PMID:24609846

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

PubMed

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational or quality improvement programs. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

A Note on Economic Content and Test Validity.

ERIC Educational Resources Information Center

Soper, John C.; Brenneke, Judith Staley

1987-01-01

Offers practical tips on how teachers can determine whether classroom tests are actually measuring what they are designed to measure. Discusses criterion-related validity, construct validity, and content validity. Demonstrates how to determine the degree of content validity a particular test may have for a particular course or unit. (Author/DH)

American College of Rheumatology provisional criteria for defining clinical inactive disease in select categories of juvenile idiopathic arthritis.

PubMed

Wallace, Carol A; Giannini, Edward H; Huang, Bin; Itert, Lukasz; Ruperto, Nicolino

2011-07-01

To prospectively validate the preliminary criteria for clinical inactive disease (CID) in patients with select categories of juvenile idiopathic arthritis (JIA). We used the process for development of classification and response criteria recommended by the American College of Rheumatology Quality of Care Committee. Patient-visit profiles were extracted from the phase III randomized controlled trial of infliximab in polyarticular-course JIA (i.e., patients considered to resemble those with select categories of JIA) and sent to an international group of expert physician raters. Using the physician ratings as the gold standard, the sensitivity and specificity were calculated using the preliminary criteria. Modifications to the criteria were made, and these were sent to a larger group of pediatric rheumatologists to determine quantitative, face, and content validity. Variables weighted heaviest by physicians when making their judgment were the number of joints with active arthritis, erythrocyte sedimentation rate (ESR), physician's global assessment, and duration of morning stiffness. Three modifications were made: the definition of uveitis, the definition of abnormal ESR, and the addition of morning stiffness. These changes did not alter the accuracy of the preliminary set. The modified criteria, termed the "criteria for CID in select categories of JIA," have excellent feasibility and face, content, criterion, and discriminant validity to detect CID in select categories of JIA. The small changes made to the preliminary criteria set did not alter the area under the receiver operating characteristic curve (0.954) or accuracy (91%), but have increased face and content validity. Copyright © 2011 by the American College of Rheumatology.

Engagement of a Person with Dementia Scale: Establishing Content Validity and Psychometric Properties.

PubMed

Jones, Cindy; Sung, Billy; Moyle, Wendy

2018-05-17

To develop and psychometrically test the Engagement of a Person with Dementia Scale. It is important to study engagement in people with dementia when exploring the effectiveness of psychosocial interventions that can promote meaningful activity, stimulation and wellbeing, through an increase in positive emotions and an improvement in quality of life. The Engagement of a Person with Dementia Scale was developed based on current literature and previous research work on a video coding tool to ascertain the effect of psychosocial interventions on engagement in people with dementia. Using the Delphi technique, the content validity of the scale was evaluated by 15 dementia experts and formal/informal dementia carers. Psychometric properties of the scale were evaluated using 131 videos of people with dementia presented with PARO - a therapeutic, interactive, robotic seal - in long-term aged care facilities. A 10-item scale was established following the rewording, combining and elimination of prospective items, with revisions made to the instructions for using and scoring the scale. An overall consensus with agreement for the scale was established among the panel of experts. The scale demonstrated robust internal consistency, inter-rater and test-retest reliability and convergent and discriminant validity. This study successfully developed the Engagement of a Person with Dementia Scale, with established content validity and psychometric properties. The scale assesses the behavioural and emotional expressions and responses of engagement by people with dementia when partaking in a psychosocial activity in five areas: affective, visual, verbal, behavioural and social engagement. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Development of Mother’s Lifestyle Scale during Pregnancy with an Approach to Social Determinants of Health

PubMed Central

Mahmoodi, Zohreh; Karimlou, Masoud; Sajjadi, Homeira; Dejman, Masoumeh; Vameghi, Meroe

2013-01-01

Background and Objective: The present study was conducted to design and measure psychometrics of mothers’ lifestyle scale during pregnancy with regards to Iranians’ cultural norms and an approach to social determinants. Method: this study, started by reviewing previous studies and exploring similar questionnaires that examine different domains of lifestyle (nutrition, exercising, self-care, smoking, using alcohol and illegal drugs, social relations, and stress control), then besides translating questions of the questionnaires, content of some questions was modified and proper statements with regards to social determinant of health and Iranian cultural, was used. Secondly, the validity of the designed instruments was determined using face, content, criterion, and construct validity. Thirdly, the reliability of the measurement instruments was examined using Cronbach’s alpha. Participants were Healthy Iranian pregnant women (37-42 week) who refer to selected hospital for delivery. Results: In the first step of the study, of the 222 questions obtained from a review of the related instruments, certain questions were omitted due to their irrelevance to social determinants of health and finally 160 questions were selected in 10 sections. After determining the face and content validity qualitatively and quantitatively and exploratory factor analysis, the number of questionnaire items was reduced to 132. Calculation of Cronbach’s alpha confirmed the high internal consistency (0.76) of the questionnaire. Conclusion: This measurement instrument was designed in the context of the Iranian culture and sounded suitable for studying the pregnant women’s lifestyle due to its appropriate validity and reliability, simplicity, and functionality in different situations. PMID:23618491

Reliability and validity of an adapted Arabic version of the Scoliosis Research Society-22r Questionnaire.

PubMed

Haidar, Rachid K; Kassak, Kassem; Masrouha, Karim; Ibrahim, Kamal; Mhaidli, Hani

2015-09-01

Cross-sectional validation and reliability assessment study of Arabic version of Scoliosis Research Society-22 (SRS-22r) Questionnaire. To develop and validate the Arabic version of the SRS-22r questionnaire. The diagnosis and treatment of adolescent idiopathic scoliosis may influence patient quality of life. SRS-22r is an internationally validated questionnaire used to assess function/activity, pain, self-image, and mental health of patients with scoliosis. It has been translated into several languages but not into Arabic language. Therefore, a valid health-related quality-of-life outcome questionnaire for patients with spinal deformity is still lacking in Arabic language. The English version of SRS-22r questionnaire was translated, back-translated, and culturally adapted to Arabic language. Then, 81 patients with idiopathic adolescent scoliosis were allocated randomly into either the reliability testing group (group 1) or the validity testing group (group 2). Group 1 patients completed Arabic version of SRS-22r questionnaire twice with 1-week interval in-between. Cronbach α and intraclass correlation coefficient were measured to determine internal consistency and temporal reliability. Group 2 patients completed the Arabic version of SRS-22r questionnaire and the previously validated Arabic version of 36-Item Short Form Health Survey (Short Form-36) questionnaire concurrently, and Pearson correlation coefficient was obtained to assess validity. Content analysis, internal consistency reliability, test/retest reproducibility (intraclass correlation coefficient range: 0.82-0.90), and test of concurrent validity showed satisfactory results. Function/activity and satisfaction with management domains had a lower Cronbach α (0.58 and 0.44, respectively, vs. 0.71-0.85 range for others). Self-image/appearance and satisfaction with management had a lower correlation with domains of the 36-Item Short Form Health Survey. An Arabic version of the SRS-22r questionnaire has been developed and validated. This questionnaire will aid health care workers and researchers in evaluation of patient perception of the deformity, satisfaction with treatment, and quality of life in Arabic-speaking populations. 3.

The merits and problems of Neuropsychiatric Inventory as an assessment tool in people with dementia and other neurological disorders.

PubMed

Lai, Claudia K Y

2014-01-01

The Neuropsychiatric Inventory (NPI) is one of the most commonly used assessment scales for assessing symptoms in people with dementia and other neurological disorders. This paper analyzes its conceptual framework, measurement mode, psychometric properties, and merits and problems. All articles discussing the psychometric properties and factor structure of the NPI were searched for in Medline via Ovid. The abstracts of these papers were read to determine their relevance to the purpose of this paper. If deemed appropriate, a full paper was then obtained and read. The NPI has reasonably good content validity and internal consistency, and good test-retest and interrater reliability. There is limited information about its sensitivity, specificity, positive and negative predictive values, and, in particular, responsiveness. Merits of the NPI include being comprehensive, avoiding symptom overlap, ease of use, and flexibility. It has problems in scoring (no multiples of 5, 7, and 11) and, therefore, analysis using parametric tests may not be appropriate. The use of individual subscales also warrants further investigation. In terms of its content and concurrent validity, intra- and interrater reliability, test-retest reliability, and internal consistency, the NPI can be considered as valid and reliable, and can be used across different ethnic groups. The tool is most likely unable to deliver as good a performance in terms of discriminating between different disorders. More studies are required to further evaluate its psychometric properties, particularly in the areas of factor structure and responsiveness. The clinical utility of the NPI also needs to be further explored.

Development of Survey Scales for Measuring Exposure and Behavioral Responses to Disruptive Intraoperative Behavior.

PubMed

Villafranca, Alexander; Hamlin, Colin; Rodebaugh, Thomas L; Robinson, Sandra; Jacobsohn, Eric

2017-09-10

Disruptive intraoperative behavior has detrimental effects to clinicians, institutions, and patients. How clinicians respond to this behavior can either exacerbate or attenuate its effects. Previous investigations of disruptive behavior have used survey scales with significant limitations. The study objective was to develop appropriate scales to measure exposure and responses to disruptive behavior. We obtained ethics approval. The scales were developed in a sequence of steps. They were pretested using expert reviews, computational linguistic analysis, and cognitive interviews. The scales were then piloted on Canadian operating room clinicians. Factor analysis was applied to half of the data set for question reduction and grouping. Item response analysis and theoretical reviews ensured that important questions were not eliminated. Internal consistency was evaluated using Cronbach α. Model fit was examined on the second half of the data set using confirmatory factor analysis. Content validity of the final scales was re-evaluated. Consistency between observed relationships and theoretical predictions was assessed. Temporal stability was evaluated on a subsample of 38 respondents. A total of 1433 and 746 clinicians completed the exposure and response scales, respectively. Content validity indices were excellent (exposure = 0.96, responses = 1.0). Internal consistency was good (exposure = 0.93, responses = 0.87). Correlations between the exposure scale and secondary measures were consistent with expectations based on theory. Temporal stability was acceptable (exposure = 0.77, responses = 0.73). We have developed scales measuring exposure and responses to disruptive behavior. They generate valid and reliable scores when surveying operating room clinicians, and they overcome the limitations of previous tools. These survey scales are freely available.

Psychometric properties of the Affordances in the Home Environment for Motor Development inventory for use with Iranian children aged 18-42 months.

PubMed

Valadi, Saeed; Gabbard, Carl; Arabameri, Elahe; Kashi, Ali; Ghasemi, Abdollah

2018-02-01

The aim of this study was to translate the original English language version of the Affordances in the Home Environment for Motor Development (AHEMD) inventory and test its psychometric properties for use with Iranian children aged 18-42 months. For this purpose, the tool was translated into Farsi (a Persian language) using the forward-backward translation method and some of its psychometric properties were examined. Multistage stratified-cluster sampling was used to study 1019 families having children aged 18-42 months from among the regional divisions of Tehran urban community health centers. The questionnaire evaluated five factors: outside space, inside space, variety of stimulation, fine motor toys and gross motor toys. Expert opinion was used for content-related validity evaluation and confirmatory factor analysis was used to determine construct validity. For test-retest reliability, parents completed identical questionnaires two weeks apart. Internal consistency was evaluated using inter-examiner reliability, Cronbach's alpha and construct reliability. Linear regression analysis was used to explain and predict the effects of toys on AHEMD total score. Results showed that content-related validity was 0.92. Data confirmatory factor analysis showed an acceptable fit to the original five factors. Reliability over time was 0.91 and internal consistency was 0.93. It was also found that fine- and gross-motor toys showed a significant 55% predictability of affordance provision in the home. The Farsi translation of the AHEMD is acceptable for use with Iranian children aged 18-42 month. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of the Spanish Version of the COPD-Q Questionnaire on COPD Knowledge.

PubMed

Puente-Maestu, Luis; Chancafe-Morgan, Jorge; Calle, Myriam; Rodríguez-Hermosa, Juan L; Malo de Molina, Rosa; Ortega-González, Ángel; Fuster, Antonia; Márquez-Martín, Eduardo; Marcos, Pedro J; Ramírez, Laura; Ray, Shaunta'; Franks, Andrea

2016-01-01

Although recognition of the importance of educating chronic obstructive pulmonary disease (COPD) patients has grown in recent years, their understanding of this disease is not being measured due to a lack of specific instruments. The aim of this study was to validate the COPD-Q questionnaire, a 13-item instrument for determining COPD knowledge. The COPD-Q was translated and backtranslated, and subsequently submitted to logic and content validation by a group of COPD experts and 8 COPD patients. Reliability was studied in an independent group of 59 patients with severe COPD seen in the pulmonology ward or clinics of 6 hospitals in Spain (Andalusia, Baleares, Castilla-La Mancha, Galicia and Madrid). This sample was also used for other internal and external validations. The mean age of the group was approximately 70 years and their health awareness was low-to-medium. The number of correct answers was 8.3 (standard deviation: 1.9), median 8, range 3-13. Floor and ceiling effects were 0% and 1.5%, respectively. Internal consistency of the questionnaire was good (Cronbach's alpha=0.85) and reliability was also high, with a kappa coefficient >0.6 for all items and an intraclass correlation efficient of 0.84 for the total score. The 13-item COPD-Q is a valid, applicable and reliable instrument for determining patients' knowledge of COPD. Copyright © 2014 SEPAR. Published by Elsevier Espana. All rights reserved.

Development and Psychometric Evaluation of the HPV Clinical Trial Survey for Parents (CTSP‐HPV) Using Traditional Survey Development Methods and Community Engagement Principles

PubMed Central

Wallston, Kenneth A.; Wilkins, Consuelo H.; Hull, Pamela C.; Miller, Stephania T.

2015-01-01

Abstract Objective This study describes the development and psychometric evaluation of HPV Clinical Trial Survey for Parents with Children Aged 9 to 15 (CTSP‐HPV) using traditional instrument development methods and community engagement principles. Methods An expert panel and parental input informed survey content and parents recommended study design changes (e.g., flyer wording). A convenience sample of 256 parents completed the final survey measuring parental willingness to consent to HPV clinical trial (CT) participation and other factors hypothesized to influence willingness (e.g., HPV vaccine benefits). Cronbach's a, Spearman correlations, and multiple linear regression were used to estimate internal consistency, convergent and discriminant validity, and predictively validity, respectively. Results Internal reliability was confirmed for all scales (a ≥ 0.70.). Parental willingness was positively associated (p < 0.05) with trust in medical researchers, adolescent CT knowledge, HPV vaccine benefits, advantages of adolescent CTs (r range 0.33–0.42), supporting convergent validity. Moderate discriminant construct validity was also demonstrated. Regression results indicate reasonable predictive validity with the six scales accounting for 31% of the variance in parents’ willingness. Conclusions This instrument can inform interventions based on factors that influence parental willingness, which may lead to the eventual increase in trial participation. Further psychometric testing is warranted. PMID:26530324

A new music therapy engagement scale for persons with dementia.

PubMed

Tan, Jane; Wee, Shiou-Liang; Yeo, Pei Shi; Choo, Juliet; Ritholz, Michele; Yap, Philip

2018-05-25

ABSTRACTObjectives:To develop and validate a new scale to assess music therapy engagement in persons with dementia (PWDs). A draft scale was derived from literature review and >2 years of qualitative recording of PWDs during music therapy. Content validity was attained through iterative consultations, trial sessions, and revisions. The final five-item Music Therapy Engagement scale for Dementia (MTED) assessed music and non-music related elements. Internal consistency and inter-rater reliability were assessed over 120 music therapy sessions. MTED was validated with the Greater Cincinnati Chapter Well-being Observation Tool, Holden Communication Scale, and Participant Engagement Observation Checklist - Music Sessions. A total of 62 PWDs (83.2 ± 7.7 years, modified version of the mini-mental state examination = 13.2/30 ± 4.1) in an acute hospital dementia unit were involved. The mean MTED score was 13.02/30 ± 4.27; internal consistency (Cronbach's α = 0.87) and inter-rater reliability (intra-class correlation = 0.96) were good. Principal component analysis revealed a one-factor structure with Eigen value > 1 (3.27), which explained 65.4% of the variance. MTED demonstrated good construct validity. The MTED total score correlated strongly with the combined items comprising Pleasure, Interest, Sadness, and Sustained attention of the Greater Cincinnati Chapter Well-being Observation Tool (rs = 0.88, p < 0.001). MTED is a clinically appropriate and psychometrically valid scale to evaluate music therapy engagement in PWDs.

Validation of Social Cognition Rating Tools in Indian Setting (SOCRATIS): A new test-battery to assess social cognition.

PubMed

Mehta, Urvakhsh M; Thirthalli, Jagadisha; Naveen Kumar, C; Mahadevaiah, Mahesh; Rao, Kiran; Subbakrishna, Doddaballapura K; Gangadhar, Bangalore N; Keshavan, Matcheri S

2011-09-01

Social cognition is a cognitive domain that is under substantial cultural influence. There are no culturally appropriate standardized tools in India to comprehensively test social cognition. This study describes validation of tools for three social cognition constructs: theory of mind, social perception and attributional bias. Theory of mind tests included adaptations of, (a) two first order tasks [Sally-Anne and Smarties task], (b) two second order tasks [Ice cream van and Missing cookies story], (c) two metaphor-irony tasks and (d) the faux pas recognition test. Internal, Personal, and Situational Attributions Questionnaire (IPSAQ) and Social Cue Recognition Test were adapted to assess attributional bias and social perception, respectively. These tests were first modified to suit the Indian cultural context without changing the constructs to be tested. A panel of experts then rated the tests on likert scales as to (1) whether the modified tasks tested the same construct as in the original and (2) whether they were culturally appropriate. The modified tests were then administered to groups of actively symptomatic and remitted schizophrenia patients as well as healthy comparison subjects. All tests of the Social Cognition Rating Tools in Indian Setting had good content validity and known groups validity. In addition, the social cure recognition test in Indian setting had good internal consistency and concurrent validity. Copyright © 2011 Elsevier B.V. All rights reserved.

Reliability and Validity Study of the Chamorro Assisted Gait Scale for People with Sprained Ankles, Walking with Forearm Crutches

PubMed Central

Ridao-Fernández, Carmen; Ojeda, Joaquín; Benítez-Lugo, Marisa; Sevillano, José Luis

2016-01-01

Objective The aim of this study was to design and validate a functional assessment scale for assisted gait with forearm crutches (Chamorro Assisted Gait Scale—CHAGS) and to assess its reliability in people with sprained ankles. Design Thirty subjects who suffered from sprained ankle (anterior talofibular ligament first and second degree) were included in the study. A modified Delphi technique was used to obtain the content validity. The selected items were: pelvic and scapular girdle dissociation(1), deviation of Center of Gravity(2), crutch inclination(3), steps rhythm(4), symmetry of step length(5), cross support(6), simultaneous support of foot and crutch(7), forearm off(8), facing forward(9) and fluency(10). Two raters twice visualized the gait of the sample subjects which were recorded. The criterion-related validity was determined by correlation between CHAGS and Coding of eight criteria of qualitative gait analysis (Viel Coding). Internal consistency and inter and intra-rater reliability were also tested. Results CHAGS obtained a high and negative correlation with Viel Coding. We obtained a good internal consistency and the intra-class correlation coefficients oscillated between 0.97 and 0.99, while the minimal detectable changes were acceptable. Conclusion CHAGS scale is a valid and reliable tool for assessing assisted gait with crutches in people with sprained ankles to perform partial relief of lower limbs. PMID:27168236

Development and validation of a new instrument for testing functional health literacy in Japanese adults.

PubMed

Nakagami, Katsuyuki; Yamauchi, Toyoaki; Noguchi, Hiroyuki; Maeda, Tohru; Nakagami, Tomoko

2014-06-01

This study aimed to develop a reliable and valid measure of functional health literacy in a Japanese clinical setting. Test development consisted of three phases: generation of an item pool, consultation with experts to assess content validity, and comparison with external criteria (the Japanese Health Knowledge Test) to assess criterion validity. A trial version of the test was administered to 535 Japanese outpatients. Internal consistency reliability, calculated by Cronbach's alpha, was 0.81, and concurrent validity was moderate. Receiver Operating Characteristics and Item Response Theory were used to classify patients as having adequate, marginal, or inadequate functional health literacy. Both inadequate and marginal functional health literacy were associated with older age, lower income, lower educational attainment, and poor health knowledge. The time required to complete the test was 10-15 min. This test should enable health workers to better identify patients with inadequate health literacy. © 2013 Wiley Publishing Asia Pty Ltd.

[Design and Validation of a Questionnaire on Vaccination in Students of Health Sciences, Spain].

PubMed

Fernández-Prada, María; Ramos-Martín, Pedro; Madroñal-Menéndez, Jaime; Martínez-Ortega, Carmen; González-Cabrera, Joaquín

2016-11-07

Immunization rates among medicine and nursing students -and among health professional in general- during hospital training are low. It is necessary to investigate the causes for these low immunization rates. The objective of this study was to design and validate a questionnaire for exploring the attitudes and behaviours of medicine and nursing students toward immunization of vaccine-preventable diseases. An instrument validation study. The sample included 646 nursing and medicine students at University of Oviedo, Spain. It was a non-ramdom sampling. After the content validation process, a 24-item questionnaire was designed to assess attitudes and behaviours/behavioural intentions. Reliability (ordinal alpha), internal validity (exploratory factor analysis by parellel analysis), ANOVA and mediational model tests were performed. Exploratory factor analysis yielded two factors which accounted for 48.8% of total variance. Ordinal alpha for the total score was 0.92. Differences were observed across academic years in the dimensions of attitudes (F5.447=3.728) and knowledge (F5.448=65.59), but not in behaviours/behavioural intentions (F5.461=1.680). Attitudes demonstrated to be a moderating variable of knowledge and attitudes/behavioural attitudes (Indirect effect B=0.15; SD=0.3; 95% CI:0.09-0.19). We developed a questionnaie based on sufficient evidence of reliability and internal validity. Scores on attitudes and knowledge increase with the academic year. Attitudes act as a moderating variable between knowledge and behaviours/behavioural intentions.

Cross-cultural adaptation and validation of Persian Achilles tendon Total Rupture Score.

PubMed

Ansari, Noureddin Nakhostin; Naghdi, Soofia; Hasanvand, Sahar; Fakhari, Zahra; Kordi, Ramin; Nilsson-Helander, Katarina

2016-04-01

To cross-culturally adapt the Achilles tendon Total Rupture Score (ATRS) to Persian language and to preliminary evaluate the reliability and validity of a Persian ATRS. A cross-sectional and prospective cohort study was conducted to translate and cross-culturally adapt the ATRS to Persian language (ATRS-Persian) following steps described in guidelines. Thirty patients with total Achilles tendon rupture and 30 healthy subjects participated in this study. Psychometric properties of floor/ceiling effects (responsiveness), internal consistency reliability, test-retest reliability, standard error of measurement (SEM), smallest detectable change (SDC), construct validity, and discriminant validity were tested. Factor analysis was performed to determine the ATRS-Persian structure. There were no floor or ceiling effects that indicate the content and responsiveness of ATRS-Persian. Internal consistency was high (Cronbach's α 0.95). Item-total correlations exceeded acceptable standard of 0.3 for the all items (0.58-0.95). The test-retest reliability was excellent [(ICC)agreement 0.98]. SEM and SDC were 3.57 and 9.9, respectively. Construct validity was supported by a significant correlation between the ATRS-Persian total score and the Persian Foot and Ankle Outcome Score (PFAOS) total score and PFAOS subscales (r = 0.55-0.83). The ATRS-Persian significantly discriminated between patients and healthy subjects. Explanatory factor analysis revealed 1 component. The ATRS was cross-culturally adapted to Persian and demonstrated to be a reliable and valid instrument to measure functional outcomes in Persian patients with Achilles tendon rupture. II.

[Spanish cultural adaptation and psychometric validation of the Summary of Diabetes Self-Care Activities measure (SDSCA) among persons with type 2 diabetes mellitus].

PubMed

Caro-Bautista, Jorge; Morilla-Herrera, Juan Carlos; Villa-Estrada, Francisca; Cuevas-Fernández-Gallego, Magdalena; Lupiáñez-Pérez, Inmaculada; Morales-Asencio, José Miguel

2016-01-01

To undertake the cultural adaptation and the psychometric assessment of the Summary of Diabetes Self-Care Activities measure (SDSCA) in Spanish population with type 2 diabetes mellitus. Clinimetric validation study. Primary health care centers of District Malaga and Valle del Guadalhorce. Three hundred thirty-one persons with type 2 diabetes mellitus. The SDSCA validated in mexican population was subjected to semantic and content equivalence using a Delphi method, its legibility was determined by INFLESZ scale. Subsequently psychometric validation was conducted through exploratory and confirmatory factor analysis (herein after EFA and CFA), internal consistency, test-retest reliability and discriminant validity. Two rounds were needed to achieve the consensus in between the panel members. Then, the index provided a good readability. The EFA suggested a model with 3 factors (diet, exercise and self-analysis) with 7 items which explained 79.16% variance. The results of CFA showed a good fit of SDSCA-Sp. The Internal consistency was moderate to low (α-Cronbach =0.62) and test-retest reliability was evaluated in 198 patients (t=0.462-0.796, p<0.001) with a total correlation of 0.764 (p< 0.0001). The SDSCA-Sp is used, in a valid way to assess self-care in type 2 DM version in clinical practice and research with similar clinimetric properties to previous studies. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Measurement properties of depression questionnaires in patients with diabetes: a systematic review.

PubMed

van Dijk, Susan E M; Adriaanse, Marcel C; van der Zwaan, Lennart; Bosmans, Judith E; van Marwijk, Harm W J; van Tulder, Maurits W; Terwee, Caroline B

2018-06-01

To conduct a systematic review on measurement properties of questionnaires measuring depressive symptoms in adult patients with type 1 or type 2 diabetes. A systematic review of the literature in MEDLINE, EMbase and PsycINFO was performed. Full text, original articles, published in any language up to October 2016 were included. Eligibility for inclusion was independently assessed by three reviewers who worked in pairs. Methodological quality of the studies was evaluated by two independent reviewers using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Quality of the questionnaires was rated per measurement property, based on the number and quality of the included studies and the reported results. Of 6286 unique hits, 21 studies met our criteria evaluating nine different questionnaires in multiple settings and languages. The methodological quality of the included studies was variable for the different measurement properties: 9/15 studies scored 'good' or 'excellent' on internal consistency, 2/5 on reliability, 0/1 on content validity, 10/10 on structural validity, 8/11 on hypothesis testing, 1/5 on cross-cultural validity, and 4/9 on criterion validity. For the CES-D, there was strong evidence for good internal consistency, structural validity, and construct validity; moderate evidence for good criterion validity; and limited evidence for good cross-cultural validity. The PHQ-9 and WHO-5 also performed well on several measurement properties. However, the evidence for structural validity of the PHQ-9 was inconclusive. The WHO-5 was less extensively researched and originally not developed to measure depression. Currently, the CES-D is best supported for measuring depressive symptoms in diabetes patients.

Health-related quality of life in young adults in education, employment, or training: development of the Japanese version of Pediatric Quality of Life Inventory (PedsQL) Generic Core Scales Young Adult Version.

PubMed

Kaneko, Mei; Sato, Iori; Soejima, Takafumi; Kamibeppu, Kiyoko

2014-09-01

The purpose of the study is to develop a Japanese version of the Pediatric Quality of Life Inventory (PedsQL) Generic Core Scales Young Adult Version (PedsQL-YA-J) and determine the feasibility, reliability, and validity of the scales. Translation equivalence and content validity were verified using back-translation and cognitive debriefing tests. A total of 428 young adults recruited from one university, two vocational schools, or five companies completed questionnaires. We determined questionnaire feasibility, internal consistency, and test-retest reliability; checked concurrent validity against the Center for Epidemiologic Studies Depression Scale (CES-D); determined convergent and discriminant validity with the Medical Outcome Study 36-item Short Form Health Survey (SF-36); described known-groups validity with regard to subjective symptoms, illness or injury requiring regular medical visits, and depression; and verified factorial validity. All scales were internally consistent (Cronbach's coefficient alpha = 0.77-0.86); test-retest reliability was acceptable (intraclass correlation coefficient = 0.57-0.69); and all scales were concurrently valid with depression (Pearson's correlation coefficient = 0.43-0.57). The scales convergent and discriminant validity with the SF-36 and CES-D were acceptable. Evaluation of known-groups validity confirmed that the Physical Functioning scale was sensitive for subjective symptoms, the Emotional Functioning scale for depression, and the Work/School Functioning scale for illness or injury requiring regular medical visits. Exploratory factor analysis found a six-factor structure consistent with the assumed structure (cumulative proportion = 57.0%). The PedsQL-YA-J is suitable for assessing health-related quality of life in young adults in education, employment, or training, and for clinical trials and epidemiological research.

A comprehensive approach to psychometric assessment of instruments used in dementia educational interventions for health professionals: a cross-sectional study.

PubMed

Wang, Yao; Xiao, Lily Dongxia; He, Guo-Ping

2015-02-01

Suboptimal care for people with dementia in hospital settings has been reported and is attributed to the lack of knowledge and inadequate attitudes in dementia care among health professionals. Educational interventions have been widely used to improve care outcomes; however, Chinese-language instruments used in dementia educational interventions for health professionals are lacking. The aims of this study were to select, translate and evaluate instruments used in dementia educational interventions for Chinese health professionals in acute-care hospitals. A cross-sectional study design was used. A modified stratified random sampling was used to recruit 442 participants from different levels of hospitals in Changsha, China. Dementia care competence was used as a framework for the selection and evaluation of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale for health professionals in the study. These two scales were translated into Chinese using forward and back translation method. Content validity, test-retest reliability and internal consistency were assessed. Construct validity was tested using exploratory factor analysis. Known-group validity was established by comparing scores of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale in two sub-groups. A person-centred care scale was utilised as a gold standard to establish concurrent validity of these two scales. Results demonstrated acceptable content validity, internal consistency, test-retest reliability and concurrent validity. Exploratory factor analysis presented a single-factor structure of the Chinese Alzheimer's Disease Knowledge Scale and a two-factor structure of the Chinese Dementia Care Attitudes Scale, supporting the conceptual dimensions of the original scales. The Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale demonstrated known-group validity evidenced by significantly higher scores identified from the sub-group with a longer work experience compared to those in the sub-group with less work experience. The use of dementia care competence as a framework to inform the selection and evaluation of instruments used in dementia educational interventions for health professionals has wide applicability in other areas. The results support that Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale are reliable and valid instruments for health professionals to use in acute-care settings. Copyright © 2014 Elsevier Ltd. All rights reserved.

Knowledge and skills of the lamaze certified childbirth educator: results of a job task analysis.

PubMed

Budin, Wendy C; Gross, Leon; Lothian, Judith A; Mendelson, Jeanne

2014-01-01

Content validity of certification examinations is demonstrated over time with comprehensive job analyses conducted and analyzed by experts, with data gathered from stakeholders. In November 2011, the Lamaze International Certification Council conducted a job analysis update of the 2002 job analysis survey. This article presents the background, methodology, and findings of the job analysis. Changes in the test blueprint based on these findings are presented.

Validating emotional attention regulation as a component of emotional intelligence: A Stroop approach to individual differences in tuning in to and out of nonverbal cues.

PubMed

Elfenbein, Hillary Anger; Jang, Daisung; Sharma, Sudeep; Sanchez-Burks, Jeffrey

2017-03-01

Emotional intelligence (EI) has captivated researchers and the public alike, but it has been challenging to establish its components as objective abilities. Self-report scales lack divergent validity from personality traits, and few ability tests have objectively correct answers. We adapt the Stroop task to introduce a new facet of EI called emotional attention regulation (EAR), which involves focusing emotion-related attention for the sake of information processing rather than for the sake of regulating one's own internal state. EAR includes 2 distinct components. First, tuning in to nonverbal cues involves identifying nonverbal cues while ignoring alternate content, that is, emotion recognition under conditions of distraction by competing stimuli. Second, tuning out of nonverbal cues involves ignoring nonverbal cues while identifying alternate content, that is, the ability to interrupt emotion recognition when needed to focus attention elsewhere. An auditory test of valence included positive and negative words spoken in positive and negative vocal tones. A visual test of approach-avoidance included green- and red-colored facial expressions depicting happiness and anger. The error rates for incongruent trials met the key criteria for establishing the validity of an EI test, in that the measure demonstrated test-retest reliability, convergent validity with other EI measures, divergent validity from factors such as general processing speed and mostly personality, and predictive validity in this case for well-being. By demonstrating that facets of EI can be validly theorized and empirically assessed, results also speak to the validity of EI more generally. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Cross-cultural adaptation of the VISA-P questionnaire for Greek-speaking patients with patellar tendinopathy.

PubMed

Korakakis, Vasileios; Patsiaouras, Asterios; Malliaropoulos, Nikos

2014-12-01

To cross-culturally adapt the VISA-P questionnaire for Greek-speaking patients and evaluate its psychometric properties. The VISA-P was developed in the English language to evaluate patients with patellar tendinopathy. The validity and use of self-administered questionnaires in different language and cultural populations require a specific procedure in order to maintain their content validity. The VISA-P questionnaire was translated and cross-culturally adapted according to specific guidelines. The validity and reliability were tested in 61 healthy recreational athletes, 64 athletes at risk from different sports, 32 patellar tendinopathy patients and 30 patients with other knee injuries. Participants completed the questionnaire at baseline and after 15-17 days. The questionnaire's face and content validity were judged as good by the expert committee, and the participants. Concurrent validity was almost perfect (ρ=-0.839, p<0.001). Also, factorial validity testing revealed a two-factor solution, which explained 85.6% of the total variance. A one-factor solution explained 80.8% of the variance when the other knee injury group was excluded. Known group validity was demonstrated by significant differences between patients compared with the asymptomatic groups (p<0.001). The VISA-P-GR exhibited very good test-retest reliability (ICC=0.818, p<0.001; 95% CI 0.758 to 0.864) and internal consistency since Cronbach's α analysis ranged from α=0.785 to 0.784 following a 15-17 days interval. The translated VISA-P-GR is a valid and reliable questionnaire and its psychometric properties are comparable with the original and adapted versions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Psychometric Properties of the Chinese Version of the Occupational Fatigue Exhaustion/Recovery Scale: A Test in a Nursing Population.

PubMed

Fang, Jin-Bo; Zhou, Chun-Fen; Huang, Jing; Qiu, Chang-Jian

2018-06-01

The Occupational Fatigue Exhaustion/Recovery Scale (OFER) was designed to assess occupational fatigue in nurses. Although the original English version of this instrument has shown high degrees of reliability and validity, a Chinese version of this scale has yet to be verified. The aim of this study was to evaluate the psychometric properties of the OFER in a population of Chinese nurses. The scale was translated using translation and back-translation. The validities and reliabilities were evaluated on 923 qualified participants using content validity index, concurrent validity, factorial validity, internal consistency reliability, and test-retest reliability. The content validity index for the OFER was .92. The correlation coefficients between the scores of the OFER subscales and the criteria in this study (varying from -.498 to .705) verified that the OFER has acceptable concurrent validity. Principal component analysis and confirmatory factor analysis revealed that three factors correspond to the structure of the original instrument and that recovery mediates the relationship between acute and chronic fatigue. The Cronbach's alpha for the chronic fatigue, acute fatigue, and intershift recovery subscales were .83, .85, and .86, respectively. Test-retest reliabilities with correlation coefficients from .61 to .78 were found in the three subscales. OFER is a reliable and valid instrument for assessing work-related fatigue in Chinese nurses. However, further improvement of the acute fatigue subscale is recommended. The OFER has the potential to elicit information that is useful for assessing fatigue in nurses in China. Furthermore, as it differentiates between acute and chronic fatigue, OFER may be an effective tool for guiding the development and implementation of various, related intervention measures.

Validation of a web-based questionnaire for pregnant women to assess utilization of internet: survey among an Italian sample.

PubMed

Siliquini, R; Saulle, R; Rabacchi, G; Bert, F; Massimi, A; Bulzomì, V; Boccia, A; La Torre, G

2012-01-01

Objective of this pilot study was to evaluate the reliability and validity of the web-based questionnaire in pregnant women as a tool to examine prevalence, knowledge and attitudes about internet utilization for health-related purposes, in a sample of Italian pregnant women. The questionnaire was composed by 9 sections for a total of 73 items. Reliability analysis was tested and content validity was evaluated using Cronbach's alpha to check internal consistency. Statistical analysis was performed through SPSS 13.0. Questionnaire was administered to 56 pregnant women. The higher value of Cronbach's alpha resulted on 61 items: alpha = 0.786 (n. 73 items: alpha = 0.579). High rate of pregnant women generally utilized internet (87.5%) and the 92.1% confirmed to use internet with the focus to acquire information about pregnancy (p < 0.0001). The questionnaire showed a good reliability property in the pilot study. In terms of internal consistency and validity appeared to have a good performance. Given the high prevalence of pregnant women that use internet to search information about their pregnancy status, professional healthcare workers should give advice regarding official websites where they could retrieve safe information and learn knowledge based on scientific evidence.

Validation and Cultural Adaptation of the Arabic Version of the Eating Assessment Tool (EAT-10).

PubMed

Farahat, Mohamed; Mesallam, Tamer A

2015-01-01

The Eating Assessment Tool (EAT-10) is a 10-item self-administered questionnaire. It is a noninvasive tool to measure patients' perception of their swallowing problems. The purposes of the present study were to develop an Arabic version of the EAT-10 and to evaluate its validity, consistency, and reliability in the Arabic-speaking population with oropharyngeal dysphagia. This was a prospective study carried out at the Communication and Swallowing Disorders Unit, King Saud University, Riyadh, Saudi Arabia. The Arabic EAT-10 was administered to 138 patients with oropharyngeal dysphagia and 83 control subjects. Internal consistency and test-retest reliability were evaluated. Content and clinical validity were studied, and the EAT-10 results were compared across patients and control groups. The Arabic EAT-10 showed excellent internal consistency (Cronbach's α = 0.92). Also, good test-retest reliability was found for the total scores of the Arabic EAT-10 (intraclass correlation = 0.73). There was a significant difference in Arabic EAT-10 scores between the oropharyngeal dysphagia group and the control group (p < 0.001). This study demonstrated that the Arabic EAT-10 is a valid tool that can be used for screening of dysphagia-related problems in an Arabic-speaking population. © 2016 S. Karger AG, Basel.

Measuring professional satisfaction in Greek nurses: combination of qualitative and quantitative investigation to evaluate the validity and reliability of the Index of Work Satisfaction.

PubMed

Karanikola, Maria N K; Papathanassoglou, Elizabeth D E

2015-02-01

The Index of Work Satisfaction (IWS) is a comprehensive scale assessing nurses' professional satisfaction. The aim of the present study was to explore: a) the applicability, reliability and validity of the Greek version of the IWS and b) contrasts among the factors addressed by IWS against the main themes emerging from a qualitative phenomenological investigation of nurses' professional experiences. A descriptive correlational design was applied using a sample of 246 emergency and critical care nurses. Internal consistency and test-retest reliability were tested. Construct and content validity were assessed by factor analysis, and through qualitative phenomenological analysis with a purposive sample of 12 nurses. Scale factors were contrasted to qualitative themes to assure that IWS embraces all aspects of Greek nurses' professional satisfaction. The internal consistency (α = 0.81) and test-retest (tau = 1, p < 0.0001) reliability were adequate. Following appropriate modifications, factor analysis confirmed the construct validity of the scale and subscales. The qualitative data partially clarified the low reliability of one subscale. The Greek version of the IWS scale is supported for use in acute care. The mixed methods approach constitutes a powerful tool for transferring scales to different cultures and healthcare systems. Copyright © 2014 Elsevier Inc. All rights reserved.

[Design and validation of a questionnaire on attitudes to prevention and health promotion in primary care (CAPPAP)].

PubMed

Ramos-Morcillo, Antonio Jesús; Martínez-López, Emilio J; Fernández-Salazar, Serafín; del-Pino-Casado, Rafael

2013-12-01

To develop and validate a questionnaire to measure attitudes towards prevention and health promotion. Cross-sectional study for the validation of a questionnaire. Primary Health Care (autonomous community of Andalusia, Spain). 282 professionals (nurses and doctors) belonging to the Public Health System. Content validation by experts, ceiling effects and floor effects, correlation between items, internal consistency, stability and exploratory factor analysis. The 56 items of the tool (CAPPAP) obtained, including those from the review of other tools and the contributions of the experts, were grouped into 5 dimensions. The percentage of expert agreement was over 70% on all items, and a high concordance between prevention and promotion item was obtained, thus, duplicates were removed leaving a final tool with 44 items. The internal consistency, measured by Cronbach's alpha, was 0.888. The test retest indicated concordance from substantial to almost perfect. Exploratory factor analysis identified five factors that accounted for 48.92% of the variance. CAPPAP is a tool that is quick and easy to administer, that is well accepted by professionals, and that has acceptable psychometric results, both globally and at the level of each dimension. Copyright © 2012 Elsevier España, S.L. All rights reserved.

Psychometric Properties of the Thai Internalized Stigma Scale (TIS-LCH) for Care Home Residents.

PubMed

Tosangwarn, Suhathai; Clissett, Philip; Blake, Holly

2017-01-01

Living in a care home is a source of stigma in Thai culture, although there is currently no measurement tool in the Thai language specifically designed to assess internalized stigma in care home residents. The Thai Version of Internalized Stigma of Living in a Care Home (TIS-LCH) scale was developed and tested for its psychometric properties among Thai older residents. The Thai version of Internalized Stigma of Mental Health Illness (ISMI) Scale was revised into the TIS-LCH by replacing the word of "mental health illness" to "living in a care home." Content validity of the TIS-LCH was determined through expert review (n = 6), and reliability testing was undertaken with older care home residents (n = 128). The TIS-LCH showed good internal consistency, with a Cronbach's alpha of .87. Test-retest reliability coefficient of TIS-LCH was excellent for the full scale (ICC = .90). The Thai version of IS-LCH (TIS-LCH) is a valid and reliable measurement tool for assessing internalized stigma in Thai care home residents. The IS-LCH will be a useful research tool to assess internalized stigma in older adults living in care settings. Understanding stigma will help health and social care professionals to plan interventions aimed at reducing or preventing negative emotional reactions and negative behavioural responses toward stigma, which are known to be associated with mental illness and particularly depression among this population.

Avoiding pitfalls of internal controls: validation of reference genes for analysis by qRT-PCR and Western blot throughout rat retinal development.

PubMed

Rocha-Martins, Maurício; Njaine, Brian; Silveira, Mariana S

2012-01-01

Housekeeping genes have been commonly used as reference to normalize gene expression and protein content data because of its presumed constitutive expression. In this paper, we challenge the consensual idea that housekeeping genes are reliable controls for expression studies in the retina through the investigation of a panel of reference genes potentially suitable for analysis of different stages of retinal development. We applied statistical tools on combinations of retinal developmental stages to assess the most stable internal controls for quantitative RT-PCR (qRT-PCR). The stability of expression of seven putative reference genes (Actb, B2m, Gapdh, Hprt1, Mapk1, Ppia and Rn18s) was analyzed using geNorm, BestKeeper and Normfinder software. In addition, several housekeeping genes were tested as loading controls for Western blot in the same sample panel, using Image J. Overall, for qRT-PCR the combination of Gapdh and Mapk1 showed the highest stability for most experimental sets. Actb was downregulated in more mature stages, while Rn18s and Hprt1 showed the highest variability. We normalized the expression of cyclin D1 using various reference genes and demonstrated that spurious results may result from blind selection of internal controls. For Western blot significant variation could be seen among four putative internal controls (β-actin, cyclophilin b, α-tubulin and lamin A/C), while MAPK1 was stably expressed. Putative housekeeping genes exhibit significant variation in both mRNA and protein content during retinal development. Our results showed that distinct combinations of internal controls fit for each experimental set in the case of qRT-PCR and that MAPK1 is a reliable loading control for Western blot. The results indicate that biased study outcomes may follow the use of reference genes without prior validation for qRT-PCR and Western blot.

Development and psychometric testing of the Carter Assessment of Critical Thinking in Midwifery (Preceptor/Mentor version).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2016-03-01

develop and test a tool designed for use by preceptors/mentors to assess undergraduate midwifery students׳ critical thinking in practice. a descriptive cohort design was used. participants worked in a range of maternity settings in Queensland, Australia. 106 midwifery clinicians who had acted in the role of preceptor for undergraduate midwifery students. this study followed a staged model for tool development recommended by DeVellis (2012). This included generation of items, content validity testing through mapping of draft items to critical thinking concepts and expert review, administration of items to a convenience sample of preceptors, and psychometric testing. A 24 item tool titled the XXXX Assessment of Critical Thinking in Midwifery (CACTiM) was completed by registered midwives in relation to students they had recently preceptored in the clinical environment. ratings by experts revealed a content validity index score of 0.97, representing good content validity. An evaluation of construct validity through factor analysis generated three factors: 'partnership in practice', 'reflection on practice' and 'practice improvements'. The scale demonstrated good internal reliability with a Cronbach alpha coefficient of 0.97. The mean total score for the CACTiM scale was 116.77 (SD=16.68) with a range of 60-144. Total and subscale scores correlated significantly. the CACTiM (Preceptor/Mentor version) was found to be a valid and reliable tool for use by preceptors to assess critical thinking in undergraduate midwifery students. given the importance of critical thinking skills for midwifery practice, mapping and assessing critical thinking development in students׳ practice across an undergraduate programme is vital. The CACTiM (Preceptor/Mentor version) has utility for clinical education, research and practice. The tool can inform and guide preceptors׳ assessment of students׳ critical thinking in practice. The availability of a reliable and valid tool can be used to research the development of critical thinking in practice. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

Assessing child and adolescent pragmatic language competencies: toward evidence-based assessments.

PubMed

Russell, Robert L; Grizzle, Kenneth L

2008-06-01

Using language appropriately and effectively in social contexts requires pragmatic language competencies (PLCs). Increasingly, deficits in PLCs are linked to child and adolescent disorders, including autism spectrum, externalizing, and internalizing disorders. As the role of PLCs expands in diagnosis and treatment of developmental psychopathology, psychologists and educators will need to appraise and select clinical and research PLC instruments for use in assessments and/or studies. To assist in this appraisal, 24 PLC instruments, containing 1,082 items, are assessed by addressing four questions: (1) Can PLC domains targeted by assessment items be reliably identified?, (2) What are the core PLC domains that emerge across the 24 instruments?, (3) Do PLC questionnaires and tests assess similar PLC domains?, and (4) Do the instruments achieve content, structural, diagnostic, and ecological validity? Results indicate that test and questionnaire items can be reliably categorized into PLC domains, that PLC domains featured in questionnaires and tests significantly differ, and that PLC instruments need empirical confirmation of their dimensional structure, content validity across all developmental age bands, and ecological validity. Progress in building a better evidence base for PLC assessments should be a priority in future research.

Development and psychometric evaluation of the nursing instructors' clinical teaching performance inventory.

PubMed

A Farahani, Mansoureh; Emamzadeh Ghasemi, Hormat Sadat; Nikpaima, Nasrin; Fereidooni, Zhila; Rasoli, Maryam

2014-10-29

Evaluation of nursing instructors' clinical teaching performance is a prerequisite to the quality assurance of nursing education. One of the most common procedures for this purpose is using student evaluations. This study was to develop and evaluate the psychometric properties of Nursing Instructors' Clinical Teaching Performance Inventory (NICTPI). The primary items of the inventory were generated by reviewing the published literature and the existing questionnaires as well as consulting with the members of the Faculties Evaluation Committee of the study setting. Psychometric properties were assessed by calculating its content validity ratio and index, and test-retest correlation coefficient as well as conducting an exploratory factor analysis and an internal consistency assessment. The content validity ratios and indices of the items were respectively higher than 0.85 and 0.79. The final version of the inventory consisted of 25 items, and in the exploratory factor analysis, items were loaded on three factors which jointly accounting for 72.85% of the total variance. The test-retest correlation coefficient and the Cronbach's alpha of the inventory were 0.93 and 0.973, respectively. The results revealed that the developed inventory is an appropriate, valid, and reliable instrument for evaluating nursing instructors' clinical teaching performance.

Measurement properties of questionnaires assessing participation in children and adolescents with a disability: a systematic review.

PubMed

Rainey, Linda; van Nispen, Ruth; van der Zee, Carlijn; van Rens, Ger

2014-12-01

To critically appraise the measurement properties of questionnaires measuring participation in children and adolescents (0-18 years) with a disability. Bibliographic databases were searched for studies evaluating the measurement properties of self-report or parent-report questionnaires measuring participation in children and adolescents (0-18 years) with a disability. The methodological quality of the included studies and the results of the measurement properties were evaluated using a checklist developed on consensus-based standards. The search strategy identified 3,977 unique publications, of which 22 were selected; these articles evaluated the development and measurement properties of eight different questionnaires. The Child and Adolescent Scale of Participation was evaluated most extensively, generally showing moderate positive results on content validity, internal consistency, reliability and construct validity. The remaining questionnaires also demonstrated positive results. However, at least 50 % of the measurement properties per questionnaire were not (or only poorly) assessed. Studies of high methodological quality, using modern statistical methods, are needed to accurately assess the measurement properties of currently available questionnaires. Moreover, consensus is required on the definition of the construct 'participation' to determine content validity and to enable meaningful interpretation of outcomes.

Development and Validation of a Social Capital Questionnaire for Adolescent Students (SCQ-AS)

PubMed Central

Paiva, Paula Cristina Pelli; de Paiva, Haroldo Neves; de Oliveira Filho, Paulo Messias; Lamounier, Joel Alves; Ferreira, Efigênia Ferreira e; Ferreira, Raquel Conceição; Kawachi, Ichiro; Zarzar, Patrícia Maria

2014-01-01

Objectives Social capital has been studied due to its contextual influence on health. However, no specific assessment tool has been developed and validated for the measurement of social capital among 12-year-old adolescent students. The aim of the present study was to develop and validate a quick, simple assessment tool to measure social capital among adolescent students. Methods A questionnaire was developed based on a review of relevant literature. For such, searches were made of the Scientific Electronic Library Online, Latin American and Caribbean Health Sciences, The Cochrane Library, ISI Web of Knowledge, International Database for Medical Literature and PubMed Central bibliographical databases from September 2011 to January 2014 for papers addressing assessment tools for the evaluation of social capital. Focus groups were also formed by adolescent students as well as health, educational and social professionals. The final assessment tool was administered to a convenience sample from two public schools (79 students) and one private school (22 students), comprising a final sample of 101 students. Reliability and internal consistency were evaluated using the Kappa coefficient and Cronbach's alpha coefficient, respectively. Content validity was determined by expert consensus as well as exploratory and confirmatory factor analysis. Results The final version of the questionnaire was made up of 12 items. The total scale demonstrated very good internal consistency (Cronbach's alpha: 0.71). Reproducibility was also very good, as the Kappa coefficient was higher than 0.72 for the majority of items (range: 0.63 to 0.97). Factor analysis grouped the 12 items into four subscales: School Social Cohesion, School Friendships, Neighborhood Social Cohesion and Trust (school and neighborhood). Conclusions The present findings indicate the validity and reliability of the Social Capital Questionnaire for Adolescent Students. PMID:25093409

Psychometric properties of the communication skills attitude scale (CSAS) measure in a sample of Iranian medical students

PubMed Central

YAKHFOROSHHA, AFSANEH; SHIRAZI, MANDANA; YOUSEFZADEH, NASER; GHANBARNEJAD, AMIN; CHERAGHI, MOHAMMADALI; MOJTAHEDZADEH, RITA; MAHMOODI-BAKHTIARI, BEHROOZ; EMAMI, SEYED AMIR HOSSEIN

2018-01-01

Introduction: Communication skill (CS) has been regarded as one of the fundamental competencies for medical and other health care professionals. Student's attitude toward learning CS is a key factor in designing educational interventions. The original CSAS, as positive and negative subscales, was developed in the UK; however, there is no scale to measure these attitudes in Iran. The aim of this study was to assess the psychometric characteristic of the Communication Skills Attitude Scale (CSAS), in an Iranian context and to understand if it is a valid tool to assess attitude toward learning communication skills among health care professionals. Methods: Psychometric characteristics of the CSAS were assessed by using a cross-sectional design. In the current study, 410 medical students were selected using stratified sampling framework. The face validity of the scale was estimated through students and experts’ opinion. Content validity of CSAS was assessed qualitatively and quantitatively. Reliability was examined through two methods including Chronbach’s alpha coefficient and Intraclass Correlation of Coefficient (ICC). Construct validity of CSAS was assessed using confirmatory factor analysis (CFA) and explanatory factor analysis (PCA) followed by varimax rotation. Convergent and discriminant validity of the scale was measured through Spearman correlation. Statistical analysis was performed using SPSS 19 and EQS, 6.1. Results: The internal consistency and reproducibility of the total CSAS score were 0.84 (Cronbach’s alpha) and 0.81, which demonstrates an acceptable reliability of the questionnaire. The item-level content validity index (I-CVI) and the scale-level content validity index (S-CVI/Ave) demonstrated appropriate results: 0.97 and 0.94, respectively. An exploratory factor analysis (EFA) on the 25 items of the CSAS revealed 4-factor structure that all together explained %55 of the variance. Results of the confirmatory factor analysis indicated an acceptable goodness-of-fit between the model and the observed data. [χ2/df = 2.36, Comparative Fit Index (CFI) = 0.95, the GFI=0.96, Root Mean Square Error of Approximation (RMSEA) = 0.05]. Conclusion: The Persian version of CSAS is a multidimensional, valid and reliable tool for assessing attitudes towards communication skill among medical students. PMID:29344525

Adaptation of the QoL-AGHDA scale for adults with growth hormone deficiency in four Slavic languages.

PubMed

McKenna, Stephen P; Wilburn, Jeanette; Twiss, James; Crawford, Sigrid R; Hána, Václav; Karbownik-Lewinska, Malgorzata; Popovic, Vera; Pura, Mikulas; Koltowska-Häggström, Maria

2011-08-02

The Quality of Life in Adult Growth Hormone Deficiency Assessment (QoL-AGHDA) is a disease-specific quality of life measure specific to individuals who are growth hormone deficient. The present study describes the adaptation of the QoL-AGHDA for use in the following four Slavic languages; Czech, Polish, Serbian and Slovakian. The study involved three stages in each language; translation, cognitive debriefing and validation. The validation stage assessed internal consistency (Cronbach's alpha), reproducibility (test-retest reliability using Spearman's rank correlations), convergent and divergent validity (Correlations with the NHP) and known group validity. The QoL-AGHDA was successfully translated into the target languages with minimal problems. Cognitive debriefing interviewees (n = 15-18) found the measures easy to complete and identified few problems with the content. Internal consistency (Czech Republic = 0.91, Poland = 0.91, Serbia = 0.91 and Slovakia = 0.89) and reproducibility (Czech Republic = 0.91, Poland = 0.91, Serbia = 0.88 and Slovakia = 0.93) were good in all adaptations. Convergent and divergent validity and known group validity data were not available for Slovakia. The QoL-AGHDA correlated as expected with the NHP scales most relevant to GHD. The QoL-AGHDA was able to distinguish between participants based on a range of variables. The QoL-AGHDA was successfully adapted for use in the Czech Republic, Poland, Serbia and Slovakia. Further validation of the Slovakian version would be beneficial. The addition of these new language versions will prove valuable to multinational clinical trials and to clinical practice in the respective countries.

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale.

PubMed

Vivienne Wu, Shu-Fang; Courtney, Mary; Edwards, Helen; McDowell, Jan; Shortridge-Baggett, Lillie M; Chang, Pei-Jen

2008-04-01

The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86. The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

Development and psychometric testing of a chinese version of the caregiver burden index for parents of children with allergies.

PubMed

Liu, Pei-Ching; Gau, Bih-Shya; Hung, Chao-Chia

2015-01-01

BACKGROUNG: No specific instrument has thus far been developed for measuring the caregiver burden perceived by parents of children with allergies (CWA). To determine the psychometric properties of the Caregiver Burden Index (CBI). A mixed-methods design was adopted to evaluate the psychometric properties of the scale. The content validity index was 0.89, and the internal consistency was high with a coefficient alpha of 0.98. Three factors were extracted after exploratory factor analysis. The study findings suggest that the CBI has sufficient reliability and validity to evaluate the caregiver burden of parents of CWA. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and validation of the occupational identity scale.

PubMed

Melgosa, J

1987-12-01

Ego-identity research utilizing Marcia's (1966) identity statuses has been prolific during the past 15 years. The four types of statuses--achievement, moratorium, foreclosure, diffusion--have become part of the ego-identity development theory. The development of a research tool to study further one of the dimensions of ego-identity development (occupational dimension) was perceived as a need. Therefore, items were created utilizing the criteria established by previous research and content validated by a group of experts. These statements were validated by 417 students from six high schools and colleges. Responses were analyzed and measures of construct and concurrent validity were obtained. Also indexes of internal consistency and item discrimination were estimated. Through factor analysis techniques, four factors were identified for the occupational identity statuses. They accounted for 49 per cent of the total variance. Reliability coefficients ranged between 0.70 and 0.87. Concurrent validity coefficients ranged between 0.38 and 0.79, when correlated with a similar instrument. After deletion of those items that did not contribute significantly to the validity of the instrument, a 28-item Occupational Identity Scale was established.

Factors affecting unsafe behavior in construction projects: development and validation of a new questionnaire.

PubMed

Asilian-Mahabadi, Hassan; Khosravi, Yahya; Hassanzadeh-Rangi, Narmin; Hajizadeh, Ebrahim; Behzadan, Amir H

2018-02-05

Occupational safety in general, and construction safety in particular, is a complex phenomenon. This study was designed to develop a new valid measure to evaluate factors affecting unsafe behavior in the construction industry. A new questionnaire was generated from qualitative research according to the principles of grounded theory. Key measurement properties (face validity, content validity, construct validity, reliability and discriminative validity) were examined using qualitative and quantitative approaches. The receiver operating characteristic curve was used to estimate the discriminating power and the optimal cutoff score. Construct validity revealed an interpretable 12-factor structure which explained 61.87% of variance. Good internal consistency (Cronbach's α = 0.94) and stability (intra-class correlation coefficient = 0.93) were found for the new instrument. The area under the curve, sensitivity and specificity were 0.80, 0.80 and 0.75, respectively. The new instrument also discriminated safety performance among the construction sites with different workers' accident histories (F = 6.40, p < 0.05). The new instrument appears to be a valid, reliable and sensitive instrument that will contribute to investigating the root causes of workers' unsafe behaviors, thus promoting safety performance in the construction industry.

Desiderata for a Computer-Assisted Audit Tool for Clinical Data Source Verification Audits

PubMed Central

Duda, Stephany N.; Wehbe, Firas H.; Gadd, Cynthia S.

2013-01-01

Clinical data auditing often requires validating the contents of clinical research databases against source documents available in health care settings. Currently available data audit software, however, does not provide features necessary to compare the contents of such databases to source data in paper medical records. This work enumerates the primary weaknesses of using paper forms for clinical data audits and identifies the shortcomings of existing data audit software, as informed by the experiences of an audit team evaluating data quality for an international research consortium. The authors propose a set of attributes to guide the development of a computer-assisted clinical data audit tool to simplify and standardize the audit process. PMID:20841814

Development and psychometric evaluation of the Dialysis patient-perceived Exercise Benefits and Barriers Scale.

PubMed

Zheng, Jing; You, Li-Ming; Lou, Tan-Qi; Chen, Nian-Chang; Lai, De-Yuan; Liang, Yan-Yi; Li, Ying-Na; Gu, Ying-Ming; Lv, Shao-Fen; Zhai, Cui-Qiu

2010-02-01

Perceptions of exercise benefits and barriers affect exercise behavior. Because of the clinical course and treatment, dialysis patients differ from the general population in their perceptions of exercise benefits and barriers, especially the latter. At present, no valid instruments for assessing perceived exercise benefits and barriers in dialysis patients are available. Our goal was to develop and test the psychometric properties of the Dialysis patient-perceived Exercise Benefits and Barriers Scale (DPEBBS). A literature review and two focus groups were conducted to generate the initial item pool. An expert panel examined the content validity. Then, 269 Chinese hemodialysis patients were recruited by convenience sampling. Exploratory and confirmatory factor analyses were used to test construct validity. Finally, internal consistency and test-retest reliability were assessed. The expert panel determined that the content validity index was satisfactory. The final 24-item scale consisted of six factors explaining 57% of the total variance in the data. Confirmative factor analysis supported the six-factor structure and a higher-order model. Cronbach's alpha was 0.87 for the total scale, and 0.84 for test-retest reliability. The DPEBBS was a valid and reliable instrument for evaluating dialysis patients' perceived benefits and barriers to exercise. The application value of this scale remains to be investigated by increasing the sample size and evaluating patients undergoing different dialysis modalities and coming from different regions and cultural backgrounds. Copyright 2009 Elsevier Ltd. All rights reserved.

Sexual behavioral abstine HIV/AIDS questionnaire: Validation study of an Iranian questionnaire

PubMed Central

Najarkolaei, Fatemeh Rahmati; Niknami, Shamsaddin; Shokravi, Farkhondeh Amin; Tavafian, Sedigheh Sadat; Fesharaki, Mohammad Gholami; Jafari, Mohammad Reza

2014-01-01

Background: This study was designed to assess the validity and reliability of the designed sexual, behavioral abstinence, and avoidance of high-risk situation questionnaire (SBAHAQ), with an aim to construct an appropriate development tool in the Iranian population. Materials and Methods: A descriptive–analytic study was conducted among female undergraduate students of Tehran University, who were selected through cluster random sampling. After reviewing the questionnaires and investigating face and content validity, internal consistency of the questionnaire was assessed by Cronbach's alpha. Explanatory and confirmatory factor analysis was conducted using SPSS and AMOS 16 Software, respectively. Results: The sample consisted of 348 female university students with a mean age of 20.69 ± 1.63 years. The content validity ratio (CVR) coefficient was 0.85 and the reliability of each section of the questionnaire was as follows: Perceived benefit (PB; 0.87), behavioral intention (BI; 0.77), and self-efficacy (SE; 0.85) (Cronbach's alpha totally was 0.83). Explanatory factor analysis showed three factors, including SE, PB, and BI, with the total variance of 61% and Kaiser–Meyer–Olkin (KMO) index of 88%. These factors were also confirmed by confirmatory factor analysis [adjusted goodness of fitness index (AGFI) = 0.939, root mean square error of approximation (RMSEA) = 0.039]. Conclusion: This study showed the designed questionnaire provided adequate construct validity and reliability, and could be adequately used to measure sexual abstinence and avoidance of high-risk situations among female students. PMID:24741650

Development of a battery of tests to measure attitudes and intended behaviours of dental students towards people with disability or those in marginalised groups.

PubMed

Faulks, D; Dougall, A; Ting, G; Ari, T; Nunn, J; Friedman, C; John, J; Daly, B; Roger-Leroi, V; Newton, J T

2018-05-01

Recommended curricula in Special Care Dentistry (SCD) outline learning objectives that include the domain of attitudes and behaviours, but these are notoriously difficult to measure. The aims of this study were (i) to develop a test battery comprising adapted and new scales to evaluate values, attitudes and intentions of dental students towards people with disability and people in marginalised groups and (ii) to determine reliability (interitem consistency) and validity of the scales within the test battery. A literature search identified pre-existing measures and models for the assessment of attitudes in healthcare students. Adaptation of three pre-existing scales was undertaken, and a new scale was developed based upon the Theory of Planned Behaviour (TPB) using an elicitation survey. These scales underwent a process of content validation. The three adapted scales and the TPB scale were piloted by 130 students at 5 different professional stages, from 4 different countries. The scales were adjusted to ensure good internal reliability, variance, distribution, and face and content validity. In addition, the different scales showed good divergent validity. These results are positive, and the scales now need to be validated in the field. It is hoped that these tools will be useful to educators in SCD to evaluate the impact of teaching and clinical exposure on their students. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Development and Validation of the Actionable Bladder Symptom Screening Tool for Multiple Sclerosis Patients

PubMed Central

Chancellor, Michael; Bates, David; Denys, Pierre; MacDiarmid, Scott; Nitti, Victor; Globe, Denise; Signori, Manuel; Hudgens, Stacie; Odderson, Ib; Panicker, Jalesh; Ross, Amy Perrin

2013-01-01

Bladder symptoms such as urinary urgency, frequency, and incontinence are common in people with multiple sclerosis (MS). These symptoms, which often result from neurogenic detrusor overactivity (NDO), can have a major impact on patients' day-to-day lives. However, in many cases they are over-looked in the clinical management of MS. The objective of this study was to develop and validate a reliable, sensitive, and specific screening tool for patients with bladder problems related to MS. We performed a literature review and then conducted a content validation study followed by a multisite observational study of a new screening tool, the Actionable Bladder Symptom Screening Tool (ABSST). All ABSST domains as well as the total score met the threshold for good internal consistency (Cronbach α ≥ 0.70), with a Cronbach α value of 0.95 for the total score and values ranging from 0.85 to 0.90 for the three domains. The validity of the ABSST was demonstrated by high correlation of the domains and total score with the Overactive Bladder Questionnaire Short Form (OAB-q SF) Symptom Severity and Total Health-Related Quality of Life (HRQOL) scores (Spearman correlation coefficient ≥ 0.782). The predictive validity of the ABSST total score to identify patients who might receive a recommendation to see a urologist was strong. This new instrument, which was developed with input from clinicians as well as MS patients, meets the current content validity and psychometric testing thresholds established by the US Food and Drug Administration, with high sensitivity and specificity. PMID:24453782

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability.

PubMed

Maïano, Christophe; Bégarie, Jérôme; Morin, Alexandre J S; Garbarino, Jean-Marie; Ninot, Grégory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items' content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.

Development of a proficiency-based virtual reality simulation training curriculum for laparoscopic appendicectomy.

PubMed

Sirimanna, Pramudith; Gladman, Marc A

2017-10-01

Proficiency-based virtual reality (VR) training curricula improve intraoperative performance, but have not been developed for laparoscopic appendicectomy (LA). This study aimed to develop an evidence-based training curriculum for LA. A total of 10 experienced (>50 LAs), eight intermediate (10-30 LAs) and 20 inexperienced (<10 LAs) operators performed guided and unguided LA tasks on a high-fidelity VR simulator using internationally relevant techniques. The ability to differentiate levels of experience (construct validity) was measured using simulator-derived metrics. Learning curves were analysed. Proficiency benchmarks were defined by the performance of the experienced group. Intermediate and experienced participants completed a questionnaire to evaluate the realism (face validity) and relevance (content validity). Of 18 surgeons, 16 (89%) considered the VR model to be visually realistic and 17 (95%) believed that it was representative of actual practice. All 'guided' modules demonstrated construct validity (P < 0.05), with learning curves that plateaued between sessions 6 and 9 (P < 0.01). When comparing inexperienced to intermediates to experienced, the 'unguided' LA module demonstrated construct validity for economy of motion (5.00 versus 7.17 versus 7.84, respectively; P < 0.01) and task time (864.5 s versus 477.2 s versus 352.1 s, respectively, P < 0.01). Construct validity was also confirmed for number of movements, path length and idle time. Validated modules were used for curriculum construction, with proficiency benchmarks used as performance goals. A VR LA model was realistic and representative of actual practice and was validated as a training and assessment tool. Consequently, the first evidence-based internationally applicable training curriculum for LA was constructed, which facilitates skill acquisition to proficiency. © 2017 Royal Australasian College of Surgeons.

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs in an ethical and scientific manner in order to obtain a quality diagnosis in this field.

Development and evaluation of an instrument for assessing brief behavioral change interventions.

PubMed

Strayer, Scott M; Martindale, James R; Pelletier, Sandra L; Rais, Salehin; Powell, Jon; Schorling, John B

2011-04-01

To develop an observational coding instrument for evaluating the fidelity and quality of brief behavioral change interventions based on the behavioral theories of the 5 A's, Stages of Change and Motivational Interviewing. Content and face validity were assessed prior to an intervention where psychometric properties were evaluated with a prospective cohort of 116 medical students. Properties assessed included the inter-rater reliability of the instrument, internal consistency of the full scale and sub-scales and descriptive statistics of the instrument. Construct validity was assessed based on student's scores. Inter-rater reliability for the instrument was 0.82 (intraclass correlation). Internal consistency for the full scale was 0.70 (KR20). Internal consistencies for the sub-scales were as follows: MI intervention component (KR20=.7); stage-appropriate MI-based intervention (KR20=.55); MI spirit (KR20=.5); appropriate assessment (KR20=.45) and appropriate assisting (KR20=.56). The instrument demonstrated good inter-rater reliability and moderate overall internal consistency when used to assess performing brief behavioral change interventions by medical students. This practical instrument can be used with minimal training and demonstrates promising psychometric properties when evaluated with medical students counseling standardized patients. Further testing is required to evaluate its usefulness in clinical settings. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Need for certification of household water treatment products: examples from Haiti.

PubMed

Murray, Anna; Pierre-Louis, Jocelyne; Joseph, Flaurine; Sylvain, Ginelove; Patrick, Molly; Lantagne, Daniele

2015-04-01

To evaluate four household water treatment (HWT) products currently seeking approval for distribution in Haiti, through the application of a recently-developed national HWT product certification process. Four chemical treatment products were evaluated against the certification process validation stage by verifying international product certifications confirming treatment efficacy and reviewing laboratory efficacy data against WHO HWT microbiological performance targets; and against the approval stage by confirming product composition, evaluating treated water chemical content against national and international drinking water quality guidelines and reviewing packaging for dosing ability and usage directions in Creole. None of the four evaluated products fulfilled validation or approval stage requirements. None was certified by an international agency as efficacious for drinking water treatment, and none had data demonstrating its ability to meet WHO HWT performance targets. All product sample compositions differed from labelled composition by >20%, and no packaging included complete usage directions in Creole. Product manufacturers provided information that was inapplicable, did not demonstrate product efficacy, and was insufficient to ensure safe product use. Capacity building is needed with country regulatory agencies to objectively evaluate HWT products. Products should be internationally assessed against WHO performance targets and also locally approved, considering language, culture and usability, to ensure effective HWT. © 2014 John Wiley & Sons Ltd.

Need for certification of household water treatment products: examples from Haiti

PubMed Central

Murray, Anna; Pierre-Louis, Jocelyne; Joseph, Flaurine; Sylvain, Ginelove; Patrick, Molly; Lantagne, Daniele

2015-01-01

OBJECTIVE To evaluate four household water treatment (HWT) products currently seeking approval for distribution in Haiti, through the application of a recently-developed national HWT product certification process. METHODS Four chemical treatment products were evaluated against the certification process validation stage by verifying international product certifications confirming treatment efficacy and reviewing laboratory efficacy data against WHO HWT microbiological performance targets; and against the approval stage by confirming product composition, evaluating treated water chemical content against national and international drinking water quality guidelines and reviewing packaging for dosing ability and usage directions in Creole. RESULTS None of the four evaluated products fulfilled validation or approval stage requirements. None was certified by an international agency as efficacious for drinking water treatment, and none had data demonstrating its ability to meet WHO HWT performance targets. All product sample compositions differed from labelled composition by >20%, and no packaging included complete usage directions in Creole. CONCLUSIONS Product manufacturers provided information that was inapplicable, did not demonstrate product efficacy, and was insufficient to ensure safe product use. Capacity building is needed with country regulatory agencies to objectively evaluate HWT products. Products should be internationally assessed against WHO performance targets and also locally approved, considering language, culture and usability, to ensure effective HWT. PMID:25441711

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Development and psychometric testing of the Knowledge, Attitudes and Practices (KAP) questionnaire among student Tuberculosis (TB) Patients (STBP-KAPQ) in China.

PubMed

Fan, Yahui; Zhang, Shaoru; Li, Yan; Li, Yuelu; Zhang, Tianhua; Liu, Weiping; Jiang, Hualin

2018-05-08

TB outbreaking in schools is extremely complex, and presents a major challenge for public health. Understanding the knowledge, attitudes and practices among student TB patients in such settings is fundamental when it comes to decreasing future TB cases. The objective of this study was to develop a Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ), and evaluate its psychometric properties. This study was conducted in three stages: item construction, pilot testing in 10 student TB patients and psychometric testing, including reliability and validity. The item pool for the questionnaire was compiled from literature review and early individual interviews. The questionnaire items were evaluated by the Delphi method based on 12 experts. Reliability and validity were assessed using student TB patients (n = 416) and healthy students (n = 208). Reliability was examined with internal consistency reliability and test-retest reliability. Content validity was calculated by content validity index (CVI); Construct validity was examined using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA); The Public Tuberculosis Knowledge, Attitudes and Practices Questionnaire (PTB-KAPQ) was applied to evaluate criterion validity; As concerning discriminant validity, T-test was performed. The final STBP-KAPQ consisted of three dimensions and 25 items. Cronbach's α coefficient and intraclass correlation coefficient (ICC) was 0.817 and 0.765, respectively. Content validity index (CVI) was 0.962. Seven common factors were extracted by principal factor analysis and varimax rotation, with a cumulative contribution of 66.253%. The resulting CFA model of the STBP-KAPQ exhibited an appropriate model fit (χ2/df = 1.74, RMSEA = 0.082, CFI = 0.923, NNFI = 0.962). STBP-KAPQ and PTB-KAPQ had a strong correlation in the knowledge part, and the correlation coefficient was 0.606 (p < 0.05). Discriminant validity was supported through a significant difference between student TB patients and healthy students across all domains (p < 0.05). An instrument, "Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ)" was developed. Psychometric testing indicated that it had adequate validity and reliability for use in KAP researches with student TB patients in China. The new tool might help public health researchers evaluate the level of KAP in student TB patients, and it could also be used to examine the effects of TB health education.

Tryptanthrin content in Isatis tinctoria leaves--a comparative study of selected strains and post-harvest treatments.

PubMed

Oberthür, Christine; Hamburger, Matthias

2004-07-01

Tryptanthrin is a pharmacologically active compound in the anti-inflammatory herb Isatis tinctoria, with potent inhibitory activity on prostaglandin and leukotriene synthesis and on inducible NO synthase. The tryptanthrin content of five defined woad strains was analyzed in dependence of the time of harvest and post-harvest treatment. Tryptanthrin was determined by a validated ESI-LC-MS isotope dilution assay with d(8)-tryptanthrin as internal standard. The tryptanthrin concentration in freeze-dried leaf samples was low. Drying at ambient temperature led to a significant increase of tryptanthrin concentration, but the highest concentrations were found when leaves were dried at 40 degrees C. Tryptanthrin content in fermented woad leaves was below the limit of quantification. Tryptanthrin appears thus to be a product of post-harvest processes, but details of its formation remain to be elucidated.

Developing a measure of cultural-, maturity-, or esteem-driven modesty among Jewish women.

PubMed

Andrews, Caryn Scheinberg

2014-01-01

Understanding modesty and how it relates to religiosity among Jewish women was relatively unexplained, and as part of a larger study, a measure was needed. The purpose of this article is to report on three studies which represent the three stages of instrument development of a measure of modesty among Jewish women, "Your Views of Modesty": (a) content/concept definition; (b) instrument development; and (c) evaluation of the psychometric properties of the instrument: reliability and validity. In Study I, Q methodology was used to define the domain and results suggesting that modesty has multidimensions. In Study II, an instrument was developed based on distinctive perspectives from each group or what was important and not so important. This formed a 25-item Likert scale. In Study III, a survey of 300 Jewish women revealed internal consistency estimates with Cronbach's alpha 0.92, indicating high degree of internal consistency reliability for "Your Views of Modesty." For construct validity, four factors were found explaining 55% of the variance of modesty: (a) religion-driven, (b) maturity-driven, (c) esteem-driven, and (d) public-based modesty was identified. "Your Views of Modesty" shows good evidence for reliability and validity in this Jewish population.

Development and psychometric evaluation of child acute stress measures in Spanish and English.

PubMed

Kassam-Adams, Nancy; Gold, Jeffrey I; Montaño, Zorash; Kohser, Kristen L; Cuadra, Anai; Muñoz, Cynthia; Armstrong, F Daniel

2013-02-01

Clinicians and researchers need tools for accurate early assessment of children's acute stress reactions and acute stress disorder (ASD). There is a particular need for independently validated Spanish-language measures. The current study reports on 2 measures of child acute stress (a self-report checklist and a semistructured interview), describing the development of the Spanish version of each measure and psychometric evaluation of both the Spanish and English versions. Children between the ages of 8 to 17 years who had experienced a recent traumatic event completed study measures in Spanish (n = 225) or in English (n = 254). Results provide support for reliability (internal consistency of the measures in both languages ranged from .83 to .89; cross-language reliability of the checklist was .93) and for convergent validity (with later PTSD symptoms, and with concurrent anxiety symptoms). Comparing checklist and interview results revealed a strong association between severity scores within the Spanish and English samples. Differences between the checklist and interview in evaluating the presence of ASD appear to be linked to different content coverage for dissociation symptoms. Future studies should further assess the impact of differing assessment modes, content coverage, and the use of these measures in children with diverse types of acute trauma exposure in English- and Spanish-speaking children. Copyright © 2013 International Society for Traumatic Stress Studies.

Validation of a motivation survey tool for pharmacy students: Exploring a link to professional identity development.

PubMed

Mylrea, Martina F; Sen Gupta, Tarun; Glass, Beverley D

2017-09-01

Self-determination theory (SDT), which describes a continuum of motivation regulators, is proposed as an appropriate framework to study pharmacy student motivation. The aim was to develop a Pharmacy Motivation Scale (Pharm-S) to determine motivation regulators in undergraduate students and explore a possible link to professional identity development. The Pharm-S was adapted from the SDT-based, Sports Motivation Scale (SMS-II), and administered to undergraduate students in an Australian pharmacy course. Convergent validity was assessed by conducting a correlation analysis between the Pharm-S and MacLeod Clark Professional Identity Scale (MCPIS-9). Face, content and construct validity were established for the Pharm-S through the analysis of 327 survey responses. Factor analysis extracted four of the six theoretical subscales as proposed by SDT (variance explained: 65.7%). Support for the SDT structure was confirmed by high factor loadings in each of the subscales and acceptable reliability coefficients. Subscale correlations revealed a simplex pattern, supporting the presence of a motivation continuum, as described by SDT. A moderate positive correlation (0.64) between Pharm-S responses and the validated professional identity instrument, MCPIS-9, indicated a possible link between levels of motivation and professional identity. and conclusions: Content and structural validity and internal consistency of the Pharm-S confirmed the reliability of the Pharm-S as a valid tool to assess motivational regulators. Pharm-S and the MCPIS-9 were positively correlated, lending support to a link between motivation and professional identity. This suggests a potential role for the Pharm-S as a valid tool to measure pharmacy student professional identity development. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

The Italian validation of the Salford-Scott Nursing Values Questionnaire.

PubMed

Mecugni, Daniela; Albinelli, Patrizia; Pellegrin, Joellemarie; Finotto, Stefano

2015-03-01

To properly direct nursing training and to improve the professional practice to become more effective, it is important to understand students' values. Literature review has shown that there have been changes in students' values in the last 20 years. In contemporary students, a general decrease in altruism has been observed, but also a larger appreciation for honesty toward patients has been declared. The analyzed literature did not find validated tools available in Italian that explore personal and professional values of nursing students. This study was an Italian linguistic and cultural adaptation of a research tool. The authors aimed to validate, for the Italian context, the Salford-Scott Nursing Values Questionnaire, enhanced by Johnson to explore the nursing profession's values. The Beaton Model was used as well as Valmi's. These models require five phases, with the goal of producing a pre-final version of the instrument for it to then be administered to a sample of the target and expert population. The study was approved by the Council of the Nursing Degree University course of the Modena and Reggio Emilia University, Reggio Emilia site, and the identity of the subjects was protected at every moment of the testing. Face validation was achieved since the clarity percentile for each item was 100%. Content validity was also reached, measured from the content validity index and the scale validity index. The study has confirmed the reliability of the instrument's internal consistence with a value of Cronbach's alpha on 0.95 of total of items. The reliability of the test-retest confirms the stability of the instrument in time (r = 0.908; p = 0.01). The study concludes that the instrument is ready to be administered to the target population, a sample group of nursing students. © The Author(s) 2014.

Current status of validation for robotic surgery simulators - a systematic review.

PubMed

Abboudi, Hamid; Khan, Mohammed S; Aboumarzouk, Omar; Guru, Khurshid A; Challacombe, Ben; Dasgupta, Prokar; Ahmed, Kamran

2013-02-01

To analyse studies validating the effectiveness of robotic surgery simulators. The MEDLINE(®), EMBASE(®) and PsycINFO(®) databases were systematically searched until September 2011. References from retrieved articles were reviewed to broaden the search. The simulator name, training tasks, participant level, training duration and evaluation scoring were extracted from each study. We also extracted data on feasibility, validity, cost-effectiveness, reliability and educational impact. We identified 19 studies investigating simulation options in robotic surgery. There are five different robotic surgery simulation platforms available on the market. In all, 11 studies sought opinion and compared performance between two different groups; 'expert' and 'novice'. Experts ranged in experience from 21-2200 robotic cases. The novice groups consisted of participants with no prior experience on a robotic platform and were often medical students or junior doctors. The Mimic dV-Trainer(®), ProMIS(®), SimSurgery Educational Platform(®) (SEP) and Intuitive systems have shown face, content and construct validity. The Robotic Surgical SimulatorTM system has only been face and content validated. All of the simulators except SEP have shown educational impact. Feasibility and cost-effectiveness of simulation systems was not evaluated in any trial. Virtual reality simulators were shown to be effective training tools for junior trainees. Simulation training holds the greatest potential to be used as an adjunct to traditional training methods to equip the next generation of robotic surgeons with the skills required to operate safely. However, current simulation models have only been validated in small studies. There is no evidence to suggest one type of simulator provides more effective training than any other. More research is needed to validate simulated environments further and investigate the effectiveness of animal and cadaveric training in robotic surgery. © 2012 BJU International.

Translation and validation of the Dutch new Knee Society Scoring System ©.

PubMed

Van Der Straeten, Catherine; Witvrouw, Erik; Willems, Tine; Bellemans, Johan; Victor, Jan

2013-11-01

A new version of The Knee Society Knee Scoring System(©) (KSS) has recently been developed. Before this scale can be used in non-English-speaking populations, it has to be translated and validated for a particular population. We evaluated the construct and content validity, the test-retest reliability, and the internal consistency of the Dutch version of the New Knee Society KSS. A Dutch translation was performed using a forward-backward translation protocol. We tested the construct validity of the Dutch New KSS by comparing it with the Dutch versions of the WOMAC, Knee Injury and Osteoarthritis Outcome Score (KOOS), and SF-12 scores in 137 patients undergoing total knee arthroplasty (TKA). Content validity was assessed by comparing pre- and postoperative scores and by checking floor and ceiling effects. To evaluate test-retest reliability and consistency, 47 patients completed the questionnaire a second time with a mean of 8 days interval (range, 2-20 days) between tests. Construct validity was demonstrated because the Dutch New KSS correlated well with the Dutch WOMAC (r = -0.751; p < 0.001), Dutch KOOS (r = -0.723; p < 0.001), and Dutch SF-12 (r = 0.569; p < 0.001). There was a significant difference between pre- and postoperative scores (p < 0.001) in line with the other scores. Test-retest reliability proved excellent with an intraclass correlation coefficient between 0.73 and 0.92 depending on the domain tested. Consistency as indicated by Cronbach's alpha ranging from 0.84 to 0.96 was good to excellent. As demonstrated by the validation procedure, the Dutch New KSS is an excellent instrument to evaluate TKA outcome in Dutch-speaking patients.

Breaking Out of the Lab: Measuring Real-Time Responses to Televised Political Content in Real-World Settings.

PubMed

Maier, Jürgen; Hampe, J Felix; Jahn, Nico

2016-01-01

Real-time response (RTR) measurement is an important technique for analyzing human processing of electronic media stimuli. Although it has been demonstrated that RTR data are reliable and internally valid, some argue that they lack external validity. The reason for this is that RTR measurement is restricted to a laboratory environment due to its technical requirements. This paper introduces a smartphone app that 1) captures real-time responses using the dial technique and 2) provides a solution for one of the most important problems in RTR measurement, the (automatic) synchronization of RTR data. In addition, it explores the reliability and validity of mobile RTR measurement by comparing the real-time reactions of two samples of young and well-educated voters to the 2013 German televised debate. Whereas the first sample participated in a classical laboratory study, the second sample was equipped with our mobile RTR system and watched the debate at home. Results indicate that the mobile RTR system yields similar results to the lab-based RTR measurement, providing evidence that laboratory studies using RTR are externally valid. In particular, the argument that the artificial reception situation creates artificial results has to be questioned. In addition, we conclude that RTR measurement outside the lab is possible. Hence, mobile RTR opens the door for large-scale studies to better understand the processing and impact of electronic media content.

Measuring third year undergraduate nursing students' reflective thinking skills and critical reflection self-efficacy following high fidelity simulation: A pilot study.

PubMed

Tutticci, Naomi; Lewis, Peter A; Coyer, Fiona

2016-05-01

Critical reflection underpins critical thinking, a highly desirable generic nursing graduate capability. To improve the likelihood of critical thinking transferring to clinical practice, reflective thinking needs to be measured within the learning space of simulation. This study was divided into two phases to address the reliability and validity measures of previously untested surveys. Phase One data was collected from individuals (n = 6) using a 'think aloud' approach and an expert panel to review content validity, and verbatim comment analysis was undertaken. The Reflective Thinking Instrument and Critical Reflection Self-Efficacy Visual Analogue Scale items were contextualised to simulation. The expert review confirmed these instruments exhibited content validity. Phase Two data was collected through an online survey (n = 58). Cronbach's alpha measured internal consistency and was demonstrated by all subscales and the Instrument as a whole (.849). There was a small to medium positive correlation between critical reflection self-efficacy and general self-efficacy (r = .324, n = 56, p = .048). Participant responses were positive regarding the simulation experience. The research findings demonstrated that the Reflective Thinking and Simulation Satisfaction survey is reliable. Further development of this survey to establish validity is recommended to make it viable. Copyright © 2016 Elsevier Ltd. All rights reserved.

The validity and reliability of a Spanish version of the summary of diabetes self-care activities questionnaire.

PubMed

Vincent, Deborah; McEwen, Marylyn M; Pasvogel, Alice

2008-01-01

Translation of data collection instruments, paying careful attention to equivalency between the source and the target language, is important to obtain valid data collection instruments. To translate the Summary of Diabetes Self-Care Activities (SDSCA) questionnaire (English) into Spanish and to evaluate the reliability and validity of the Spanish version. Translation and back-translation were used to develop the Spanish version of the SDSCA. The Spanish version of the SDSCA was reviewed by an expert panel for conceptual and content equivalence to the English version. Psychometric properties were assessed further by combining data from three studies that used the Spanish version as a data collection instrument. Correlation of each item of the Spanish and English version of the SDSCA instrument ranged from .78 to 1.00, with no variability in the responses of 2 of the 12 items. Test-retest correlations for the SDSCA ranged from .51 to 1.00. Internal consistency (Cronbach's alpha) for the Spanish version was .68. Items loaded on three factors, with the factors accounting for 61% of the variance in SDSCA. The findings for the psychometric properties of the Spanish version of the SDSCA questionnaire suggest that it has conceptual and content equivalency with the original English version and is valid and reliable. However, further testing with larger samples is required.

Quantification of 16 polycyclic aromatic hydrocarbons in cigarette smoke condensate using stable isotope dilution liquid chromatography with atmospheric-pressure photoionization tandem mass spectrometry.

PubMed

Zhang, Xiaotao; Hou, Hongwei; Chen, Huan; Liu, Yong; Wang, An; Hu, Qingyuan

2015-09-17

A stable isotope dilution liquid chromatography with tandem mass spectrometry method for the analysis of 16 polycyclic aromatic hydrocarbons in cigarette smoke condensate was developed and validated. Compared with previously reported methods, this method has lower limits of detection (0.04-1.35 ng/cig). Additionally, the proposed method saves time, reduces the number of separation steps, and reduces the quantity of solvent needed. The new method was applied to evaluate polycyclic aromatic hydrocarbon content in 213 commercially available cigarettes in China, under the International Standardization Organization smoking regime and the Health Canadian intense smoking regime. The results showed that the total polycyclic aromatic hydrocarbon content was more than two times higher in samples from the Health Canadian intense smoking regime than in samples from the International Standardization Organization smoking regime (1189.23 vs. 2859.50 ng/cig, p<0.05). Meanwhile, the concentration of individual polycyclic aromatic hydrocarbons (and total polycyclic aromatic hydrocarbons) increased with labeled tar content in both of the tested smoking regimes. There was a positive correlation between total polycyclic aromatic hydrocarbons under the International Standardization Organization smoking regime with that under the Health Canadian intense smoking regime. The proposed liquid chromatography with tandem mass spectrometry method is satisfactory for the rapid, sensitive, and accurately quantitative evaluation of polycyclic aromatic hydrocarbon content in cigarette smoke condensate, and it can be applied to assess potential health risks from smoking. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Optimized determination method for trans-10-hydroxy-2-decenoic acid content in royal jelly by high-performance liquid chromatography with an internal standard.

PubMed

Zhou, Jinhui; Xue, Xiaofeng; Li, Yi; Zhang, Jinzhen; Zhao, Jing

2007-01-01

An optimized reversed-phase high-performance liquid chromatography method was developed to detect the trans-10-hydroxy-2-decenoic acid (10-HDA) content in royal jelly cream and lyophilized powder. The sample was extracted using absolute ethanol. Chromatographic separation of 10-HDA and methyl 4-hydroxybenzoate as the internal standard was performed on a Nova-pak C18 column. The average recoveries were 95.0-99.2% (n = 5) with relative standard deviation (RSD) values of 1.3-2.1% for royal jelly cream and 98.0-100.0% (n = 5) with RSD values of 1.6-3.0% for lyophilized powder, respectively. The limits of detection and quantitation were 0.5 and 1.5 mg/kg, respectively, for both royal jelly cream and lyophilized powder. The method was validated for the determination of practical royal jelly products. The concentration of 10-HDA ranged from 1.26 to 2.21% for pure royal jelly cream samples and 3.01 to 6.19% for royal jelly lyophilized powder samples. For 30 royal jelly products, the 10-HDA content varied from not detectable to 0.98%.

Development of the Autosomal Dominant Polycystic Kidney Disease Impact Scale: A New Health-Related Quality-of-Life Instrument.

PubMed

Oberdhan, Dorothee; Cole, Jason C; Krasa, Holly B; Cheng, Rebecca; Czerwiec, Frank S; Hays, Ron D; Chapman, Arlene B; Perrone, Ronald D

2018-02-01

The impact of autosomal dominant polycystic kidney disease (ADPKD) on health-related quality of life (HRQoL) is not well understood due to a lack of instruments specific to the condition. Content for a new self-administered patient-reported outcome (PRO) questionnaire to assess ADPKD-related HRQoL was developed through clinical expert and patient focus group discussions. The new PRO instrument was administered to study patients with ADPKD to evaluate its reliability and validity. 1,674 adult patients with ADPKD participated in this research: 285 patients in focus groups to generate questionnaire content, 15 patients in debriefing interviews to refine the PRO questionnaire, and 1,374 patients to assess the performance and measurement properties of the PRO questionnaire. A new PRO questionnaire. The ADPKD Impact Scale (ADPKD-IS), consisting of 14 items representing 3 conceptual domains (physical, emotional, and fatigue) plus 4 additional questions, was developed. The instrument's reliability (regarding internal consistency and test-retest consistency) and validity (content and construct) were supported. Need for more responsiveness testing when more data from clinical use become available over time. Complex concepts such as ADPKD-related pain and impact on a patient's HRQoL need further evaluation. The ADPKD-IS is a new patient-centric tool that reliably and validly provides a standardized method for assessing HRQoL and overall disease burden in patients with ADPKD. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

[Development and validity of workplace bullying in nursing-type inventory (WPBN-TI)].

PubMed

Lee, Younju; Lee, Mihyoung

2014-04-01

The purpose of this study was to develop an instrument to assess bullying of nurses, and test the validity and reliability of the instrument. The initial thirty items of WPBN-TI were identified through a review of the literature on types bullying related to nursing and in-depth interviews with 14 nurses who experienced bullying at work. Sixteen items were developed through 2 content validity tests by 9 experts and 10 nurses. The final WPBN-TI instrument was evaluated by 458 nurses from five general hospitals in the Incheon metropolitan area. SPSS 18.0 program was used to assess the instrument based on internal consistency reliability, construct validity, and criterion validity. WPBN-TI consisted of 16 items with three distinct factors (verbal and nonverbal bullying, work-related bullying, and external threats), which explained 60.3% of the total variance. The convergent validity and determinant validity for WPBN-TI were 100.0%, 89.7%, respectively. Known-groups validity of WPBN-TI was proven through the mean difference between subjective perception of bullying. The satisfied criterion validity for WPBN-TI was more than .70. The reliability of WPBN-TI was Cronbach's α of .91. WPBN-TI with high validity and reliability is suitable to determine types of bullying in nursing workplace.

What Do Clinicians Consider when Assessing Chronic Low Back Pain? A Content Analysis of Multidisciplinary Pain Centre Team Assessments of Functioning, Disability, and Health.

PubMed

Bagraith, Karl S; Strong, Jenny; Meredith, Pamela J; McPhail, Steven M

2018-05-22

Beyond expert suggestions as to the appropriate subject matter for chronic pain assessments, little is known about the actual content of multidisciplinary pain centre (MPC) clinical assessments. The International Classification of Functioning, Disability and Health Low Back Pain Core Set (ICF LBP-CS) provides a universal language to support the consistent description of LBP-related assessments across disciplines within multidisciplinary teams (MDT). This study sought to map the content of MPC clinical assessments to the ICF to: 1) identify and compare the content of clinical MDT assessments using a cross-disciplinary framework and, 2) examine the content validity of the LBP-CS. A qualitative examination of MPC team clinical assessments of CLBP was undertaken. MDT (pain medicine, psychiatry, nursing, physiotherapy, occupational therapy, and psychology) assessments were audio-recorded and transcribed. Concepts were extracted from transcripts using a meaning condensation procedure and then linked to the ICF. Across seven MDT assessments, comprised of 42 discipline-specific assessments and 241,209 transcribed words, 8596 concepts were extracted. Contextual factors (i.e., the person and environment), except for physiotherapy, accounted for almost half of each discipline's assessments (range: 49% - 58%) Concepts spanned 113 second-level ICF categories, including 73/78 LBP-CS categories. Overall, the findings revealed novel insights into the content of MPC clinical assessments that can be used to improve healthcare delivery. ICF-based assessment profiles demonstrated unique contributions from each discipline to CLBP assessment. Finally, users of the LBP-CS can be confident that the tool exhibits sound content validity from the perceptive of MDT assessments of functioning, disability, and health.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

A web-based team-oriented medical error communication assessment tool: development, preliminary reliability, validity, and user ratings.

PubMed

Kim, Sara; Brock, Doug; Prouty, Carolyn D; Odegard, Peggy Soule; Shannon, Sarah E; Robins, Lynne; Boggs, Jim G; Clark, Fiona J; Gallagher, Thomas

2011-01-01

Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Using valid data from 78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on the Likert-scale questions and ranged from α=.79 to α=.89 for each set of 7 Likert-type discussion/planning items and from α=.70 to α=.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r=.59 for discussion/planning and r=.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.

Cultural Adaptation and Psychometric Evaluation of the Spanish Version of the Nursing Outcome "Pain Control" in Primary Care Patients with Chronic Pain.

PubMed

Bellido-Vallejo, José Carlos; Pancorbo-Hidalgo, Pedro Luis

2017-10-01

The control of chronic pain is a major challenge for patients and health care professionals. To culturally adapt the Nursing Outcomes Classification outcome "Pain control" (PC) to the Spanish health care setting and to analyze its psychometric properties and sensitivity to change. A study of three stages was designed: (1) Translation and cultural adaptation by translation-back-translation method, (2) content validation by a group of experts, and (3) observational-longitudinal study in patients with chronic pain. Patient sampling was nonprobabilistic, and participants completed forms and questionnaires and responded to a question on pain. Statistical analysis included descriptive analysis, content validity index (for global PC and each indicator), principal component analysis, Spearman's test, Cronbach's α, Cohen's κ coefficient, and Wilcoxon range test. The new Spanish version of "Pain control" was semantically equivalent to the original, with a mean content validity index of 0.96. The clinical study included 88 patients with long-term pain, and the mean (standard deviation) interval between assessments (baseline and final) was 29.33 (8.05) days. Thirteen indicators were organized into two components. There was divergent but not convergent validity with the Change Pain Scale and Brief Pain Inventory. Between-observer agreement was κ = 0.48 and internal consistency was α = 0.85. No differences were found between mean baseline and final scores. The Spanish version of "Pain control," culturally adapted and structured in two components (13 indicators), is useful to assess and monitor pain control in patients with chronic pain. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Development and quality analysis of the Work Experience Measurement Scale (WEMS).

PubMed

Nilsson, Petra; Bringsén, Asa; Andersson, H Ingemar; Ejlertsson, Göran

2010-01-01

Instruments related to work are commonly illuminated from an ill-health perspective. The need for a concise and useable instrument in workplace health promotion governed the aim of this paper which is to present the development process and quality assessment of the Work Experience Measurement Scale (WEMS). A survey, using a questionnaire based on established theories regarding work and health, and a focus group study were performed in hospital settings in 2005 and 2006 respectively. A Principal Component Analysis (PCA) was used to statistically develop a model, and focus group interviews were made to compare quantitative and qualitative results for convergence and corroboration. The PCA resulted in a six factor model of dimensions containing items regarding management, reorganization, internal work experience, pressure of time, autonomy and supportive working conditions. In the analysis of the focus group study three themes appeared and their underlying content was compared to, and matched, with the dimensions of the PCA. The reliability, shown by weighted kappa values, ranged from 0.36 to 0.71, and adequate Cronbach's Alpha values of the dimensions were all above 0.7. The study validity, indicated by discriminant validity, with correlation values that ranged from 0.10 to 0.39, in relation to the content validity appeared to be good when the theoretical content of the WEMS was compared to the content of similar instruments. The WEMS presents a multidimensional picture of work experience. Its theoretical base and the psychometric properties give support for applicability and offer a possibility to measure trends in the work experience over time in health care settings. One intention of the WEMS is to stimulate the ability of organizations and the employees themselves to take action on improving their work experience. The conciseness of the instrument is intended to increase its usability.

Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients.

PubMed

Saber, Ali; Tabatabaei, Seyed Mahmoud; Akasheh, Godarz; Sehat, Mojtaba; Zanjani, Zahra; Larijani, Bagher

2017-01-01

There is not a valid Persian tool for measuring the decision-making competency of patients. The aim of this study is to evaluate the face and content validity of the MacArthur Competence Assessment Tool for the treatment of Iranian Persian-speaking patients. To assess the validity of the Persian version of the tool, a self-administrated questionnaire was designed. The Lawshe method was also used for assessing each item. Content validity ratio (CVR) and content validity index (CVI) were used to assess the content validity quantitatively. According to the experts' judgment, questions with a CVR ≥0.62 and CVR <0.62 were maintainable and unmaintainable, respectively. The questions were designed in a manner to achieve the desirable result (CVR ≥0.62). The CVI scale (S-CVI) and CVI (S-CVI/Ave) were 0.94 (higher than 0.79). Thus, the content validity was confirmed. Since capacity assessments are usually based on physician's subjective judgment, they are likely to bias and therefore, with this suitably validated tool, we can improve judgment of physicians and health-care providers in out- and in-patient cases.

Validation of the International Consultation on Incontinence Questionnaire-Vaginal Symptoms (ICIQ-VS) in two south- Asian languages.

PubMed

Ekanayake, Chanil D; Pathmeswaran, Arunasalam; Herath, Rasika P; Perera, H Suharshi S; Patabendige, Malitha; Wijesinghe, Prasantha S

2017-12-01

The multifaceted nature of pelvic floor disorders means that a systematic evaluation is required for optimal treatment outcome. It is also generally acknowledged that a valid tool is necessary to objectively assess symptoms reported by affected women. The International Consultation on Incontinence Questionnaire-Vaginal Symptoms (ICIQ-VS) questionnaire was translated to Sinhala and Tamil and a validation study carried out among women attending gynecology clinics at North Colombo Teaching Hospital, Ragama, and the district general hospitals Mannar and Vavuniya. Content validity was assessed by the level of missing answers, which was < 4% and 2% for each item in Sinhala and Tamil, respectively. Construct validity was assessed by the ability of the questionnaire to differentiate between patients and controls. Both differentiated patients from controls on vaginal symptoms score (VSS) (p < 0.001), sexual symptoms score (SSS) (p < 0.01), and quality of life (QoL) (p < 0.001). There was a strong positive correlation between Pelvic Organ Prolapse Quantification (POP-Q) scores and VSS (Sinhala r s  = 0.64, p < 0.001, Tamil r s  = 0.65, p < 0.001), and QoL (Sinhala r s  = 0.49, p < 0.001, Tamil r s  = 0.60, p < 0.001). Internal consistency as assessed using Cronbach's coefficient alpha: 0.78 (0.76-0.78) and 0.83 (0.80-0.84) in Sinhala and Tamil, respectively. Test-retest reliability was assessed by weighted kappa scores (Sinhala 0.58-0.88 and Tamil 0.76-0.90). Both questionnaires were sensitive to change and showed that VSS and QoL improved following surgery (Wilcoxon matched-pairs signed-rank test p < 0.001). The validated Sinhala and Tamil translations of ICIQ-VS will be useful for assessing vaginal and sexual symptoms among women speaking Sinhala and Tamil.

Patient experiences questionnaire for interdisciplinary treatment for substance dependence (PEQ-ITSD): reliability and validity following a national survey in Norway.

PubMed

Haugum, Mona; Iversen, Hilde Hestad; Bjertnaes, Oyvind; Lindahl, Anne Karin

2017-02-20

Patient experiences are an important aspect of health care quality, but there is a lack of validated instruments for their measurement in the substance dependence literature. A new questionnaire to measure inpatients' experiences of interdisciplinary treatment for substance dependence has been developed in Norway. The aim of this study was to psychometrically test the new questionnaire, using data from a national survey in 2013. The questionnaire was developed based on a literature review, qualitative interviews with patients, expert group discussions and pretesting. Data were collected in a national survey covering all residential facilities with inpatients in treatment for substance dependence in 2013. Data quality and psychometric properties were assessed, including ceiling effects, item missing, exploratory factor analysis, and tests of internal consistency reliability, test-retest reliability and construct validity. The sample included 978 inpatients present at 98 residential institutions. After correcting for excluded patients (n = 175), the response rate was 91.4%. 28 out of 33 items had less than 20.5% of missing data or replies in the "not applicable" category. All but one item met the ceiling effect criterion of less than 50.0% of the responses in the most favorable category. Exploratory factor analysis resulted in three scales: "treatment and personnel", "milieu" and "outcome". All scales showed satisfactory internal consistency reliability (Cronbach's alpha ranged from 0.75-0.91) and test-retest reliability (ICC ranged from 0.82-0.85). 17 of 18 significant associations between single variables and the scales supported construct validity of the PEQ-ITSD. The content validity of the PEQ-ITSD was secured by a literature review, consultations with an expert group and qualitative interviews with patients. The PEQ-ITSD was used in a national survey in Norway in 2013 and psychometric testing showed that the instrument had satisfactory internal consistency reliability and construct validity.

Cross-cultural adaptation, reliability and validity of the Turkish version of the Lower Limb Functional Index.

PubMed

Duruturk, Neslihan; Tonga, Eda; Gabel, Charles Philip; Acar, Manolya; Tekindal, Agah

2015-07-26

This study aims to adapt culturally a Turkish version of the Lower Limb Functional Index (LLFI) and to determine its validity, reliability, internal consistency, measurement sensitivity and factor structure in lower limb problems. The LLFI was translated into Turkish and cross-culturally adapted with a double forward-backward protocol that determined face and content validity. Individuals (n = 120) with lower limb musculoskeletal disorders completed the LLFI and Short Form-36 questionnaires and the Timed Up and Go physical test. The psychometric properties were evaluated for the all participants from patient-reported outcome measures made at baseline and repeated at day 3 to determine criterion between scores (Pearson's r), internal consistency (Cronbachs α) and test-retest reliability (intraclass correlation coefficient - ICC 2.1 ). Error was determined using standard error of the measurement (SEM) and minimal detectable change at the 90% level (MDC 90 ), while factor structure was determined using exploratory factor analysis with maximum likelihood extraction and Varimax rotation. The psychometric characteristics showed strong criterion validity (r = 0.74-0.76), high internal consistency (α = 0.82) and high test-retest reability (ICC 2.1  = 0.97). The SEM of 3.2% gave an MDC 90  = 5.8%. The factor structure was uni-dimensional. Turkish version of LLFI was found to be valid and reliable for the measurement of lower limb function in a Turkish population. Implications for Rehabilitation Lower extremity musculoskeletal disorders are common and greatly impact activities among the affected individuals pertaining to daily living, work, leisure and quality of life. Patient-reported outcome (PRO) measures have advantages as they are practical, cost-effective and clinically convenient for use in patient-centered care. The Lower Limb Functional Index is a recently validated PRO measure shown to have strong clinimetric properties.

Developing and validating a scale to measure Food and Nutrition Literacy (FNLIT) in elementary school children in Iran.

PubMed

Doustmohammadian, Aazam; Omidvar, Nasrin; Keshavarz-Mohammadi, Nastaran; Abdollahi, Morteza; Amini, Maryam; Eini-Zinab, Hassan

2017-01-01

Food and nutrition literacy is an emerging term which is increasingly used in policy and research. Though research in this area is growing, progression is limited by the lack of an accepted method to measure food and nutrition literacy. The aim of this study is to develop a valid and reliable questionnaire to assess food and nutrition literacy in elementary school children in the city of Tehran. The study was conducted in three phases. To develop Food and Nutrition Literacy (FNLIT) questionnaire, a comprehensive literature review and a qualitative study were initially performed to identify food and nutrition literacy dimensions and its components. Content and face validity of the questionnaire were evaluated by an expert panel as well as students. In the second phase, construct validity of the scale was evaluated using Explanatory Factor Analyses (EFA) and Confirmatory Factor Analyses (CFA). In the last phase (confirmatory phase), the final version of the questionnaire was evaluated on 400 students. Findings show Content Validity Ratio (CVR) and Content Validity Index (CVI) of the 62-item questionnaire at acceptable levels of 0.87 and 0.92, respectively. EFA suggested a six-factor construct, namely, understanding food and nutrition information, knowledge, functional, interactive, food choice, and critical. The results of CFA indicated acceptable fit indices for the proposed models. All subscales demonstrated satisfactory internal consistency (Cronbach's alpha≥0.70), except for critical skill subscale (0.48). The intraclass correlation coefficient (ICC = 0.90, CI: 0.83-0.94) indicated that Food and Nutrition Literacy (FNLIT) scale had satisfactory stability. Each phase of development progressively improved the questionnaire, which resulted in a 46-item (42 likert-type items and 4 true-false items) Food and Nutrition Literacy (FNLIT) scale. The questionnaire measured two domains with 6 subscales, including: 1) cognitive domain: understanding and knowledge; 2) skill domain: functional, food choice, interactive, and critical skills. The developed food and nutrition literacy scale is a valid and reliable instrument to measure food and nutrition literacy in children. This measure lays a solid empirical and theoretical foundation for future research and tailored interventions to promote food and nutrition literacy in this age group.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.

Content Validity of National Post Marriage Educational Program Using Mixed Methods

PubMed Central

MOHAJER RAHBARI, Masoumeh; SHARIATI, Mohammad; KERAMAT, Afsaneh; YUNESIAN, Masoud; ESLAMI, Mohammad; MOUSAVI, Seyed Abbas; MONTAZERI, Ali

2015-01-01

Background: Although the validity of content of program is mostly conducted with qualitative methods, this study used both qualitative and quantitative methods for the validation of content of post marriage training program provided for newly married couples. Content validity is a preliminary step of obtaining authorization required to install the program in country's health care system. Methods: This mixed methodological content validation study carried out in four steps with forming three expert panels. Altogether 24 expert panelists were involved in 3 qualitative and quantitative panels; 6 in the first item development one; 12 in the reduction kind, 4 of them were common with the first panel, and 10 executive experts in the last one organized to evaluate psychometric properties of CVR and CVI and Face validity of 57 educational objectives. Results: The raw data of post marriage program had been written by professional experts of Ministry of Health, using qualitative expert panel, the content was more developed by generating 3 topics and refining one topic and its respective content. In the second panel, totally six other objectives were deleted, three for being out of agreement cut of point and three on experts' consensus. The validity of all items was above 0.8 and their content validity indices (0.8–1) were completely appropriate in quantitative assessment. Conclusion: This study provided a good evidence for validation and accreditation of national post marriage program planned for newly married couples in health centers of the country in the near future. PMID:26056672

Development and psychometric properties of the client's assessment of treatment scale for supported accommodation (CAT-SA).

PubMed

Sandhu, Sima; Killaspy, Helen; Krotofil, Joanna; McPherson, Peter; Harrison, Isobel; Dowling, Sarah; Arbuthnott, Maurice; Curtis, Sarah; King, Michael; Leavey, Gerard; Shepherd, Geoff; Priebe, Stefan

2016-02-25

Patient-Reported Outcome Measures (PROMs) are important for evaluating mental health services. Yet, no specific PROM exists for the large and diverse mental health supported accommodation sector. We aimed to produce and validate a PROM specifically for supported accommodation services, by adapting the Client's Assessment of Treatment Scale (CAT) and assessing its psychometric properties in a large sample. Focus groups with service users in the three main types of mental health supported accommodation services in the United Kingdom (residential care, supported housing and floating outreach) were conducted to adapt the contents of the original CAT items and assess the acceptability of the modified scale (CAT-SA). The CAT-SA was then administered in a survey to service users across England. Internal consistency was assessed using Cronbach's alpha. Convergent validity was tested through correlations with subjective quality of life and satisfaction with accommodation, as measured by the Manchester Short Assessment of Quality of Life (MANSA). All seven original items of the CAT were regarded as relevant to appraisals of mental health supported accommodation services, with only slight modifications to the wording required. In the survey, data were obtained from 618 clients. The internal consistency of the CAT-SA items was 0.89. Mean CAT-SA scores were correlated with the specific accommodation item on the MANSA (r s  = 0.37, p ˂ .001). The content of the CAT-SA has relevance to service users living in mental health supported accommodation. The findings from our large survey show that the CAT-SA is acceptable across different types of supported accommodation and suggest good psychometric properties. The CAT-SA appears a valid and easy to use PROM for service users in mental health supported accommodation services.

Graduate nurses' evaluation of mentorship: Development of a new tool.

PubMed

Tiew, Lay Hwa; Koh, Catherine S L; Creedy, Debra K; Tam, W S W

2017-07-01

Develop and test an instrument to measure graduate-nurses' perceptions of a structured mentorship program. New graduate nurses may experience difficulties in the transition from student to practitioner. Mentoring is commonly used to support graduates. However, there is a lack of published tools measuring graduate nurses' perceptions of mentorship. As mentoring is resource intensive, development and testing of a validated tool are important to assist in determining program effectiveness. A pretest-posttest interventional design was used. Following a critical review of literature and content experts' input, the 10-item National University Hospital Mentorship Evaluation (NUH ME) instrument was tested with a convenience sample of 83 graduate nurses. Psychometric tests included internal reliability, stability, content validity, and factor analysis. Changed scores were evaluated using paired samples t-test. Seventy-three graduates (88%) out of a possible 83 completed the pre-and post-program survey. Internal reliability was excellent with a Cronbach's alpha of 0.92. Test-retest reliability was stable over time (ICC=0.81). Exploratory factor analysis supported a 1-factor solution explaining 58.2% of variance. Paired samples t-test showed statistical significance between the pre- and post-program scores (p<0.001). The NUH-ME measure was found to be valid and reliable. Confirmatory Factor Analysis of the tool with different groups of nursing graduates is required. Mentorship programs can be an effective recruitment and retention strategy, but are also resource intensive. Measuring new graduates' perceptions of mentoring contributes to program relevance in addressing their personal, professional and clinical skill development needs. As mentoring engages a diverse range of mentors, feedback through measurement may also positively alter organizational learning culture. Copyright © 2017. Published by Elsevier Ltd.

Content validation of the international classification of functioning, disability and health core set for stroke from gender perspective using a qualitative approach.

PubMed

Glässel, A; Coenen, M; Kollerits, B; Cieza, A

2014-06-01

The extended ICF Core Set for stroke is an application of the International Classification of Functioning, Disability and Health (ICF) of the World Health Organisation (WHO) with the purpose to represent the typical spectrum of functioning of persons with stroke. The objective of the study is to add evidence to the content validity of the extended ICF Core Set for stroke from persons after stroke taking into account gender perspective. A qualitative study design was conducted by using individual interviews with women and men after stroke in an in- and outpatient rehabilitation setting. The sampling followed the maximum variation strategy. Sample size was determined by saturation. Concepts from qualitative data analysis were linked to ICF categories and compared to the extended ICF Core Set for stroke. Twelve women and 12 men participated in 24 individual interviews. In total, 143 out of 166 ICF categories included in the extended ICF Core Set for stroke were confirmed (women: N.=13; men: N.=17; both genders: N.=113). Thirty-eight additional categories that are not yet included in the extended ICF Core Set for stroke were raised by women and men. This study confirms that the experience of functioning and disability after stroke shows communalities and differences for women and men. The validity of the extended ICF Core Set for stroke could be mostly confirmed, since it does not only include those areas of functioning and disability relevant to both genders but also those exclusively relevant to either women or men. Further research is needed on ICF categories not yet included in the extended ICF Core Set for stroke.

Psychometric properties of the SCOFF questionnaire (Chinese version) for screening eating disorders in Hong Kong secondary school students: a cross-sectional study.

PubMed

Leung, Sau Fong; Lee, Ka Li; Lee, Sze Man; Leung, Sik Chi; Hung, Wing Sze; Lee, Wai Leng; Leung, Yuen Yee; Li, Man Wai; Tse, Tak Kin; Wong, Hoi Kei; Wong, Yuen Ni

2009-02-01

Eating disorders are affecting an increasing number of high school students in Western and Asian countries. The availability of an effective screening tool is crucial for early detection and prompt intervention. The objective of this study was to examine the validity and reliability of the SCOFF questionnaire for screening eating disorders in Hong Kong high school students. This study adopted a cross-sectional design to examine the psychometric properties of the SCOFF questionnaire. A panel of 7 experts and 936 students of a high school participated in the study. The SCOFF questionnaire was translated into Chinese and back-translated into English to ensure the linguistic equivalence. A panel of 7 experts involved in the content validation of the SCOFF questionnaire. The Eating Disorder Examination-Questionnaire (EDE-Q) was used as the "reference standard" to assess its concurrent validity in 936 students of a high school. Its reliability was examined by internal consistency and the test-retest method at a 2-week interval and with 38 students. The SCOFF questionnaire achieved an agreement of 86-100% among the experts for the content relevance. Of 812 students (86.8%) who responded to this study, their SCOFF scores correlated significantly with their global scores on the EDE-Q (r=0.5, P<0.01). Students identified as potentially having eating disorders had significantly higher scores in the EDE-Q than those not identified as such by SCOFF. The SCOFF questionnaire demonstrated moderate test-retest reliability (ICC=0.66) and an acceptable internal consistency reliability (Cronbach's alpha=0.44-0.57) in comparing with previous studies. The SCOFF questionnaire has acceptable psychometric properties in the Chinese culture. It will be useful for detecting potential eating disorders and assisting health promotion activity.

Construction of a web-based questionnaire for longitudinal investigation of work exposure, musculoskeletal pain and performance impairments in high-performance marine craft populations.

PubMed

Lo Martire, Riccardo; de Alwis, Manudul Pahansen; Äng, Björn Olov; Garme, Karl

2017-07-20

High-performance marine craft personnel (HPMCP) are regularly exposed to vibration and repeated shock (VRS) levels exceeding maximum limitations stated by international legislation. Whereas such exposure reportedly is detrimental to health and performance, the epidemiological data necessary to link these adverse effects causally to VRS are not available in the scientific literature, and no suitable tools for acquiring such data exist. This study therefore constructed a questionnaire for longitudinal investigations in HPMCP. A consensus panel defined content domains, identified relevant items and outlined a questionnaire. The relevance and simplicity of the questionnaire's content were then systematically assessed by expert raters in three consecutive stages, each followed by revisions. An item-level content validity index (I-CVI) was computed as the proportion of experts rating an item as relevant and simple, and a scale-level content validity index (S-CVI/Ave) as the average I-CVI across items. The thresholds for acceptable content validity were 0.78 and 0.90, respectively. Finally, a dynamic web version of the questionnaire was constructed and pilot tested over a 1-month period during a marine exercise in a study population sample of eight subjects, while accelerometers simultaneously quantified VRS exposure. Content domains were defined as work exposure, musculoskeletal pain and human performance, and items were selected to reflect these constructs. Ratings from nine experts yielded S-CVI/Ave of 0.97 and 1.00 for relevance and simplicity, respectively, and the pilot test suggested that responses were sensitive to change in acceleration and that the questionnaire, following some adjustments, was feasible for its intended purpose. A dynamic web-based questionnaire for longitudinal survey of key variables in HPMCP was constructed. Expert ratings supported that the questionnaire content is relevant, simple and sufficiently comprehensive, and the pilot test suggested that the questionnaire is feasible for longitudinal measurements in the study population. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Developing and validating a nutrition knowledge questionnaire: key methods and considerations.

PubMed

Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina

2017-10-01

To outline key statistical considerations and detailed methodologies for the development and evaluation of a valid and reliable nutrition knowledge questionnaire. Literature on questionnaire development in a range of fields was reviewed and a set of evidence-based guidelines specific to the creation of a nutrition knowledge questionnaire have been developed. The recommendations describe key qualitative methods and statistical considerations, and include relevant examples from previous papers and existing nutrition knowledge questionnaires. Where details have been omitted for the sake of brevity, the reader has been directed to suitable references. We recommend an eight-step methodology for nutrition knowledge questionnaire development as follows: (i) definition of the construct and development of a test plan; (ii) generation of the item pool; (iii) choice of the scoring system and response format; (iv) assessment of content validity; (v) assessment of face validity; (vi) purification of the scale using item analysis, including item characteristics, difficulty and discrimination; (vii) evaluation of the scale including its factor structure and internal reliability, or Rasch analysis, including assessment of dimensionality and internal reliability; and (viii) gathering of data to re-examine the questionnaire's properties, assess temporal stability and confirm construct validity. Several of these methods have previously been overlooked. The measurement of nutrition knowledge is an important consideration for individuals working in the nutrition field. Improved methods in the development of nutrition knowledge questionnaires, such as the use of factor analysis or Rasch analysis, will enable more confidence in reported measures of nutrition knowledge.

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content validity of a PRO instrument for an intended application is often limited. Such evidence is, however, important to evaluating the adequacy of a PRO instrument for the intended application. This article provides an overview of key issues involved in assessing and documenting content validity as it relates to using existing instruments in the drug approval process.

Psychometric properties including reliability, validity and responsiveness of the Majeed pelvic score in patients with chronic sacroiliac joint pain.

PubMed

Bajada, Stefan; Mohanty, Khitish

2016-06-01

The Majeed scoring system is a disease-specific outcome measure that was originally designed to assess pelvic injuries. The aim of this study was to determine the psychometric properties of the Majeed scoring system for chronic sacroiliac joint pain. Internal consistency, content validity, criterion validity, construct validity and responsiveness to change was assessed prospectively for the Majeed scoring system in a cohort of 60 patients diagnosed with sacroiliac joint pain. This diagnosis was confirmed with CT-guided sacroiliac joint anaesthetic block. The overall Majeed score showed acceptable internal consistency (Cronbach alpha = 0.63). Similarly, it showed acceptable floor (0 %) and ceiling (0 %) effects. On the other hand, the domains of pain, work, sitting and sexual intercourse had high (>30 %) floor effects. Significant correlation with the physical component of the Short Form-36 (p = 0.005) and Oswestry disability index (p ≤ 0.001) was found indicating acceptable criterion validity. The overall Majeed score showed acceptable construct validity with all five developed hypotheses showing significance (p ≤ 0.05). The overall Majeed score showed acceptable responsiveness to change with a large (≥0.80) effect size and standardized response mean. Overall the Majeed scoring system demonstrated acceptable psychometric properties for outcome assessment in chronic sacroiliac joint pain. Thus, its use in this condition is adequate. However, some domains demonstrated suboptimal performance indicating that improvement might be achieved with the development of an outcome measure specific for sacroiliac joint dysfunction and degeneration.

Development and psychometric characteristics of a new domain of the stanford faculty development program instrument.

PubMed

Owolabi, Mayowa O

2014-01-01

Teacher's attitude domain, a pivotal aspect of clinical teaching, is missing in the Stanford Faculty Development Program Questionnaire (SFDPQ), the most widely used student-based assessment method of clinical teaching skills. This study was conducted to develop and validate the teacher's attitude domain and evaluate the validity and internal consistency reliability of the augmented SFDPQ. Items generated for the new domain included teacher's enthusiasm, sobriety, humility, thoroughness, empathy, and accessibility. The study involved 20 resident doctors assessed once by 64 medical students using the augmented SFDPQ. Construct validity was explored using correlation among the different domains and a global rating scale. Factor analysis was performed. The response rate was 94%. The new domain had a Cronbach's alpha of 0.89, with 1-factor solution explaining 57.1% of its variance. It showed the strongest correlation to the global rating scale (rho = 0.71). The augmented SFDPQ, which had a Cronbach's alpha of 0.93, correlated better (rho = 0.72, p < 0.00001) to the global rating scale than the original SFDPQ (rho = 0.67, p < 0.00001). The new teacher's attitude domain exhibited good internal consistency and construct and factorial validity. It enhanced the content and construct validity of the SFDPQ. The validated construct of the augmented SFDPQ is recommended for design and evaluation of basic and continuing clinical teaching programs. © 2014 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Development of a chromatographic method with multi-criteria decision making design for simultaneous determination of nifedipine and atenolol in content uniformity testing.

PubMed

Ahmed, Sameh; Alqurshi, Abdulmalik; Mohamed, Abdel-Maaboud Ismail

2018-07-01

A new robust and reliable high-performance liquid chromatography (HPLC) method with multi-criteria decision making (MCDM) approach was developed to allow simultaneous quantification of atenolol (ATN) and nifedipine (NFD) in content uniformity testing. Felodipine (FLD) was used as an internal standard (I.S.) in this study. A novel marriage between a new interactive response optimizer and a HPLC method was suggested for multiple response optimizations of target responses. An interactive response optimizer was used as a decision and prediction tool for the optimal settings of target responses, according to specified criteria, based on Derringer's desirability. Four independent variables were considered in this study: Acetonitrile%, buffer pH and concentration along with column temperature. Eight responses were optimized: retention times of ATN, NFD, and FLD, resolutions between ATN/NFD and NFD/FLD, and plate numbers for ATN, NFD, and FLD. Multiple regression analysis was applied in order to scan the influences of the most significant variables for the regression models. The experimental design was set to give minimum retention times, maximum resolution and plate numbers. The interactive response optimizer allowed prediction of optimum conditions according to these criteria with a good composite desirability value of 0.98156. The developed method was validated according to the International Conference on Harmonization (ICH) guidelines with the aid of the experimental design. The developed MCDM-HPLC method showed superior robustness and resolution in short analysis time allowing successful simultaneous content uniformity testing of ATN and NFD in marketed capsules. The current work presents an interactive response optimizer as an efficient platform to optimize, predict responses, and validate HPLC methodology with tolerable design space for assay in quality control laboratories. Copyright © 2018 Elsevier B.V. All rights reserved.

Assessment of a condition-specific quality-of-life measure for patients with developmentally absent teeth: validity and reliability testing.

PubMed

Akram, A J; Ireland, A J; Postlethwaite, K C; Sandy, J R; Jerreat, A S

2013-11-01

This article describes the process of validity and reliability testing of a condition-specific quality-of-life measure for patients with hypodontia presenting for orthodontic treatment. The development of the instrument is described in a previous article. Royal Devon and Exeter NHS Foundation Trust & Musgrove Park Hospital, Taunton. The child perception questionnaire was used as a standard against which to test criterion validity. The Bland and Altman method was used to check agreement between the two questionnaires. Construct validity was tested using principal component analysis on the four sections of the questionnaire. Test-retest reliability was tested using intraclass correlation coefficient and Bland and Altman method. Cronbach's alpha was used to test internal consistency reliability. Overall the questionnaire showed good reliability, criterion and construct validity. This together with previous evidence of good face and content validity suggests that the instrument may prove useful in clinical practice and further research. This study has demonstrated that the newly developed condition-specific quality-of-life questionnaire is both valid and reliable for use in young patients with hypodontia. © 2013 John Wiley & Sons A/S. Published by Blackwell Publishing Ltd.

Initial Development and Validation of the BullyHARM: The Bullying, Harassment, and Aggression Receipt Measure.

PubMed

Hall, William J

2016-11-01

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and 6 subscales: physical bullying, verbal bullying, social/relational bullying, cyber-bullying, property bullying, and sexual bullying. First-order and second-order factor models were evaluated. Results demonstrate that the first-order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent-related validation and is a promising instrument for measuring bullying victimization in school.

Adaptation and Validation of the Psychological Need Thwarting Scale in Spanish Physical Education Teachers.

PubMed

Cuevas, Ricardo; Sánchez-Oliva, David; Bartholomew, Kimberley J; Ntoumanis, Nikos; García-Calvo, Tomás

2015-07-20

Drawing from self-determination theory (SDT; Deci & Ryan, 1985; Ryan & Deci, 2002), the aim of the study was to adapt and validate a Spanish version of the Psychological Need Thwarting Scale (PNTS; Bartholomew, Ntoumanis, Ryan, & Thørgersen-Ntoumani, 2011) in the educational domain. Psychological need thwarting and burnout were assessed in 619 physical education teachers from several high schools in Spain. Overall, the adapted measure demonstrated good content, factorial (χ2/gl = 4.87, p < .01, CFI = .95, IFI = .96, TLI = .94, RMSEA = .08, SRMR = .05), and external validity, as well as internal consistency (α ≥ .81) and invariance across gender. Moreover, burnout was strongly predicted by teachers' perceptions of competence (β = .53, p ≤ .01), autonomy (β = .34, p ≤ .01), and relatedness (β = .31, p ≤ .01) need thwarting. In conclusion, these results support the Spanish version of the PNTS as a valid and reliable instrument for assessing the understudied concept of psychological need thwarting in teachers.

Initial Development and Validation of the BullyHARM: The Bullying, Harassment, and Aggression Receipt Measure

PubMed Central

Hall, William J.

2017-01-01

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and 6 subscales: physical bullying, verbal bullying, social/relational bullying, cyber-bullying, property bullying, and sexual bullying. First-order and second-order factor models were evaluated. Results demonstrate that the first-order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent-related validation and is a promising instrument for measuring bullying victimization in school. PMID:28194041

Development and Testing of the Nurse Manager EBP Competency Scale.

PubMed

Shuman, Clayton J; Ploutz-Snyder, Robert J; Titler, Marita G

2018-02-01

The purpose of this study was to develop and evaluate the validity and reliability of an instrument to measure nurse manager competencies regarding evidence-based practice (EBP). The Nurse Manager EBP Competency Scale consists of 16 items for respondents to indicate their perceived level of competency on a 0 to 3 Likert-type scale. Content validity was demonstrated through expert panel review and pilot testing. Principal axis factoring and Cronbach's alpha evaluated construct validity and internal consistency reliability, respectively. Eighty-three nurse managers completed the scale. Exploratory factor analysis resulted in a 16-item scale with two subscales, EBP Knowledge ( n = 6 items, α = .90) and EBP Activity ( n = 10 items, α = .94). Cronbach's alpha for the entire scale was .95. The Nurse Manager EBP Competency Scale is a brief measure of nurse manager EBP competency with evidence of validity and reliability. The scale can enhance our understanding in future studies regarding how nurse manager EBP competency affects implementation.

Patient-reported outcome instruments that evaluate adherence behaviours in adults with asthma: A systematic review of measurement properties.

PubMed

Gagné, Myriam; Boulet, Louis-Philippe; Pérez, Norma; Moisan, Jocelyne

2018-04-30

To systematically identify the measurement properties of patient-reported outcome instruments (PROs) that evaluate adherence to inhaled maintenance medication in adults with asthma. We conducted a systematic review of six databases. Two reviewers independently included studies on the measurement properties of PROs that evaluated adherence in asthmatic participants aged ≥18 years. Based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), the reviewers (1) extracted data on internal consistency, reliability, measurement error, content validity, structural validity, hypotheses testing, cross-cultural validity, criterion validity, and responsiveness; (2) assessed the methodological quality of the included studies; (3) assessed the quality of the measurement properties (positive or negative); and (4) summarised the level of evidence (limited, moderate, or strong). We screened 6,068 records and included 15 studies (14 PROs). No studies evaluated measurement error or responsiveness. Based on methodological and measurement property quality assessments, we found limited positive evidence of: (a) internal consistency of the Adherence Questionnaire, Refined Medication Adherence Reason Scale (MAR-Scale), Medication Adherence Report Scale for Asthma (MARS-A), and Test of the Adherence to Inhalers (TAI); (b) reliability of the TAI; and (c) structural validity of the Adherence Questionnaire, MAR-Scale, MARS-A, and TAI. We also found limited negative evidence of: (d) hypotheses testing of Adherence Questionnaire; (e) reliability of the MARS-A; and (f) criterion validity of the MARS-A and TAI. Our results highlighted the need to conduct further high-quality studies that will positively evaluate the reliability, validity, and responsiveness of the available PROs. This article is protected by copyright. All rights reserved.

Development and validation of the Multidimensional Home Environment Scale (MHES) for adolescents and their mothers.

PubMed

Tabbakh, Tamara; Freeland-Graves, Jeanne

2016-08-01

The home environment is an important setting for the development of weight status in adolescence. At present a limited number of valid and reliable tools are available to evaluate the weight-related comprehensive home environment of this population. The goal of this research was to develop the Multidimensional Home Environment Scale which measures multiple components of the home. It includes psychological, social, and environmental domains from the perspective of an adolescent and the mother. Items were generated based on a literature review and then assessed for content validity by an expert panel and focus group in the target population. Internal consistency reliability was determined using Cronbach's α. Principal components analysis with varimax rotation was employed for assessment of construct validity. Temporal stability was evaluated using paired sample t-tests and bivariate correlations between responses at two different times, 1-2weeks apart. Associations between adolescent and mother responses were utilized for convergent validity. The final versions contained 32-items for adolescents and 36-items for mothers; these were administered to 218 adolescents and mothers. The subscales on the questionnaires exhibited high construct validity, internal consistency reliability (adolescent: α=0.82, mother: α=0.83) and test-retest reliability (adolescent: r=0.90, p<0.01; mother: r=0.91, p<0.01). Total home environment scores were computed, with greater scores reflecting a better health environment. These results verify the utility of the MHES as a valid and reliable instrument. This promising tool can be utilized to capture the comprehensive home environment of young adolescents (11-14years old). Copyright © 2016 Elsevier Ltd. All rights reserved.

Validation of the Turkish Version of the Sexual Health Outcomes in Women Questionnaire (SHOW-Q) in Turkish-Speaking Women.

PubMed

Selcuk, Selcuk; Kucukbas, Mehmet; Cam, Cetin; Eser, Ahmet; Devranoglu, Belgin; Turkyilmaz, Sebnem; Karateke, Ates

2016-06-01

The Sexual Health Outcomes in Women Questionnaire (SHOW-Q) is designed to evaluate the sexual life of women for satisfaction, orgasm, desire, and pelvic problem interference. The SHOW-Q is important for evaluating worsening of sexual life for patients with pelvic problems and the management of these women to improve their sexual life. To validate the Turkish versions of the SHOW-Q for Turkish-speaking women. The Turkish version of the SHOW-Q was generated by two independent professional English-to-Turkish translators. The translated version of the SHOW-Q was reverse translated by two bilingual translators whose native language was English. Women with at least one symptom related to pelvic problems (n = 71) and those with no symptoms (n = 38) were included in the present study. Test-retest reliability analysis, content-face validity, internal consistency reliability, item-total correlations, convergent validity, construct validity, and factorial validity were performed to assess the psychometric properties of the Turkish versions of the SHOW-Q. Test-retest reliability demonstrated good correlation for all subscales. Cronbach α values ranged from 0.735 to 0.892 and indicated high internal consistency. There was a strong correlation for the corresponding subscales between the SHOW-Q and the Female Sexual Function Index. The mean score of each SHOW-Q subscale showed significant differences between symptomatic and asymptomatic patients. The Turkish version of the SHOW-Q is a valid and reliable instrument that can be used to evaluate the sexual life of Turkish-speaking women with different pelvic problems. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire

PubMed Central

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-01-01

Background Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. Methods The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test – retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. Results The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81–0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test – retest reliability) was found 0.66 (95% CI: 0.62–0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36–0.89). Conclusion This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting. PMID:16515708

Development and Validation of the Chinese Attitudes to Starting Insulin Questionnaire (Ch-ASIQ) for Primary Care Patients with Type 2 Diabetes

PubMed Central

Fu, Sau Nga; Chin, Weng Yee; Wong, Carlos King Ho; Yeung, Vincent Tok Fai; Yiu, Ming Pong; Tsui, Hoi Yee; Chan, Ka Hung

2013-01-01

Objectives To develop and evaluate the psychometric properties of a Chinese questionnaire which assesses the barriers and enablers to commencing insulin in primary care patients with poorly controlled Type 2 diabetes. Research Design and Method Questionnaire items were identified using literature review. Content validation was performed and items were further refined using an expert panel. Following translation, back translation and cognitive debriefing, the translated Chinese questionnaire was piloted on target patients. Exploratory factor analysis and item-scale correlations were performed to test the construct validity of the subscales and items. Internal reliability was tested by Cronbach’s alpha. Results Twenty-seven identified items underwent content validation, translation and cognitive debriefing. The translated questionnaire was piloted on 303 insulin naïve (never taken insulin) Type 2 diabetes patients recruited from 10 government-funded primary care clinics across Hong Kong. Sufficient variability in the dataset for factor analysis was confirmed by Bartlett’s Test of Sphericity (P<0.001). Using exploratory factor analysis with varimax rotation, 10 factors were generated onto which 26 items loaded with loading scores > 0.4 and Eigenvalues >1. Total variance for the 10 factors was 66.22%. Kaiser-Meyer-Olkin measure was 0.725. Cronbach’s alpha coefficients for the first four factors were ≥0.6 identifying four sub-scales to which 13 items correlated. Remaining sub-scales and items with poor internal reliability were deleted. The final 13-item instrument had a four scale structure addressing: ‘Self-image and stigmatization’; ‘Factors promoting self-efficacy; ‘Fear of pain or needles’; and ‘Time and family support’. Conclusion The Chinese Attitudes to Starting Insulin Questionnaire (Ch-ASIQ) appears to be a reliable and valid measure for assessing barriers to starting insulin. This short instrument is easy to administer and may be used by healthcare providers and researchers as an assessment tool for Chinese diabetic primary care patients, including the elderly, who are unwilling to start insulin. PMID:24236071

Development of a Child Abuse Checklist to Evaluate Prehospital Provider Performance.

PubMed

Alphonso, Aimee; Auerbach, Marc; Bechtel, Kirsten; Bilodeau, Kyle; Gawel, Marcie; Koziel, Jeannette; Whitfill, Travis; Tiyyagura, Gunjan Kamdar

2017-01-01

To develop and provide validity evidence for a performance checklist to evaluate the child abuse screening behaviors of prehospital providers. Checklist Development: We developed the first iteration of the checklist after review of the relevant literature and on the basis of the authors' clinical experience. Next, a panel of six content experts participated in three rounds of Delphi review to reach consensus on the final checklist items. Checklist Validation: Twenty-eight emergency medical services (EMS) providers (16 EMT-Basics, 12 EMT-Paramedics) participated in a standardized simulated case of physical child abuse to an infant followed by one-on-one semi-structured qualitative interviews. Three reviewers scored the videotaped performance using the final checklist. Light's kappa and Cronbach's alpha were calculated to assess inter-rater reliability (IRR) and internal consistency, respectively. The correlation of successful child abuse screening with checklist task completion and with participant characteristics were compared using Pearson's chi squared test to gather evidence for construct validity. The Delphi review process resulted in a final checklist that included 24 items classified with trichotomous scoring (done, not done, or not applicable). The overall IRR of the three raters was 0.70 using Light's kappa, indicating substantial agreement. Internal consistency of the checklist was low, with an overall Cronbach's alpha of 0.61. Of 28 participants, only 14 (50%) successfully screened for child abuse in simulation. Participants who successfully screened for child abuse did not differ significantly from those who failed to screen in terms of training level, past experience with child abuse reporting, or self-reported confidence in detecting child abuse (all p > 0.30). Of all 24 tasks, only the task of exposing the infant significantly correlated with successful detection of child abuse (p < 0.05). We developed a child abuse checklist that demonstrated strong content validity and substantial inter-rater reliability, but successful item completion did not correlate with other markers of provider experience. The validated instrument has important potential for training, continuing education, and research for prehospital providers at all levels of training.

Development of a Work Climate Scale in Emergency Health Services

PubMed Central

Sanduvete-Chaves, Susana; Lozano-Lozano, José A.; Chacón-Moscoso, Salvador; Holgado-Tello, Francisco P.

2018-01-01

An adequate work climate fosters productivity in organizations and increases employee satisfaction. Workers in emergency health services (EHS) have an extremely high degree of responsibility and consequent stress. Therefore, it is essential to foster a good work climate in this context. Despite this, scales with a full study of their psychometric properties (i.e., validity evidence based on test content, internal structure and relations to other variables, and reliability) are not available to measure work climate in EHS specifically. For this reason, our objective was to develop a scale to measure the quality of work climates in EHS. We carried out three studies. In Study 1, we used a mixed-method approach to identify the latent conceptual structure of the construct work climate. Thus, we integrated the results found in (a) a previous study, where a content analysis of seven in-depth interviews obtained from EHS professionals in two hospitals in Gibraltar Countryside County was carried out; and (b) the factor analysis of the responses given by 113 EHS professionals from these same centers to 18 items that measured the work climate in health organizations. As a result, we obtained 56 items grouped into four factors (work satisfaction, productivity/achievement of aims, interpersonal relationships, and performance at work). In Study 2, we presented validity evidence based on test content through experts' judgment. Fourteen experts from the methodology and health fields evaluated the representativeness, utility, and feasibility of each of the 56 items with respect to their factor (theoretical dimension). Forty items met the inclusion criterion, which was to obtain an Osterlind index value greater than or equal to 0.5 in the three aspects assessed. In Study 3, 201 EHS professionals from the same centers completed the resulting 40-item scale. This new instrument produced validity evidence based on the internal structure in a second-order factor model with four components (RMSEA = 0.079, GFI = 0.97, AGFI = 0.97, CFI = 0.97; NFI = 0.95, and NNFI = 0.97); absence of Differential Item Functioning (DIF) in 80% of the items; reliability (α = 0.96); and validity evidence based on relations to other variables, specifically the test-criterion relationship (ρ = 0.680). Finally, we discuss further developments of the instrument and its possible implications for EHS workers. PMID:29403417

Development of a Work Climate Scale in Emergency Health Services.

PubMed

Sanduvete-Chaves, Susana; Lozano-Lozano, José A; Chacón-Moscoso, Salvador; Holgado-Tello, Francisco P

2018-01-01

An adequate work climate fosters productivity in organizations and increases employee satisfaction. Workers in emergency health services (EHS) have an extremely high degree of responsibility and consequent stress. Therefore, it is essential to foster a good work climate in this context. Despite this, scales with a full study of their psychometric properties (i.e., validity evidence based on test content, internal structure and relations to other variables, and reliability) are not available to measure work climate in EHS specifically. For this reason, our objective was to develop a scale to measure the quality of work climates in EHS. We carried out three studies. In Study 1, we used a mixed-method approach to identify the latent conceptual structure of the construct work climate . Thus, we integrated the results found in (a) a previous study, where a content analysis of seven in-depth interviews obtained from EHS professionals in two hospitals in Gibraltar Countryside County was carried out; and (b) the factor analysis of the responses given by 113 EHS professionals from these same centers to 18 items that measured the work climate in health organizations. As a result, we obtained 56 items grouped into four factors (work satisfaction, productivity/achievement of aims, interpersonal relationships, and performance at work). In Study 2, we presented validity evidence based on test content through experts' judgment. Fourteen experts from the methodology and health fields evaluated the representativeness, utility, and feasibility of each of the 56 items with respect to their factor (theoretical dimension). Forty items met the inclusion criterion, which was to obtain an Osterlind index value greater than or equal to 0.5 in the three aspects assessed. In Study 3, 201 EHS professionals from the same centers completed the resulting 40-item scale. This new instrument produced validity evidence based on the internal structure in a second-order factor model with four components ( RMSEA = 0.079, GFI = 0.97, AGFI = 0.97, CFI = 0.97; NFI = 0.95, and NNFI = 0.97); absence of Differential Item Functioning (DIF) in 80% of the items; reliability (α = 0.96); and validity evidence based on relations to other variables, specifically the test-criterion relationship (ρ = 0.680). Finally, we discuss further developments of the instrument and its possible implications for EHS workers.

Development of a Research Participants’ Perception Survey to Improve Clinical Research

PubMed Central

Yessis, Jennifer L.; Kost, Rhonda G.; Lee, Laura M.; Coller, Barry S.; Henderson, David K.

2012-01-01

Abstract Introduction: Clinical research participants’ perceptions regarding their experiences during research protocols provide outcome‐based insights into the effectiveness of efforts to protect rights and safety, and opportunities to enhance participants’ clinical research experiences. Use of validated surveys measuring patient‐centered outcomes is standard in hospitals, yet no instruments exist to assess outcomes of clinical research processes. Methods: We derived survey questions from data obtained from focus groups comprised of research participants and professionals. We assessed the survey for face/content validity, and privacy/confidentiality protections and fielded it to research participants at 15 centers. We conducted analyses of response rates, sample characteristics, and psychometrics, including survey and item completion and analysis, internal consistency, item internal consistency, criterion‐related validity, and item usefulness. Responses were tested for fit into existing patient‐centered dimensions of care and new clinical research dimensions using Cronbach's alpha coefficient. Results: Surveys were mailed to 18,890 individuals; 4,961 were returned (29%). Survey completion was 89% overall; completion rates exceeded 90% for 88 of 93 evaluable items. Questions fit into three dimensions of patient‐centered care and two novel clinical research dimensions (Cronbach's alpha for dimensions: 0.69–0.85). Conclusions: The validated survey offers a new method for assessing and improving outcomes of clinical research processes. Clin Trans Sci 2012; Volume 5: 452–460 PMID:23253666

Psychometric Properties of the Persian Version of Death Depression Scale-Revised in Iranian Patients with Acute Myocardial Infarction.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Lehto, Rebecca H; Allen, Kelly A; Goudarzian, Amir Hossein; Yaghoobzadeh, Ameneh; Soleimani, Mohammad Ali

2017-07-01

Objective: Limited research has examined the psychometric properties of death depression scales in Persian populations with cardiac disease despite the need for valid assessment tools for evaluating depressive symptoms in patients with life-limiting chronic conditions. The present study aimed at evaluating the reliability and validity of the Persian Version of Death Depression Scale - Revised (DDS-R) in Iranian patients who had recent acute myocardial infarction (AMI). Method: This psychometric study was conducted with a convenience sample of 407 patients with AMI diagnosis who completed the Persian version of the DDS-R. The face, content, and construct validity of the scale were ascertained. Internal consistency, test-retest, and construct reliability (CR) were used to assess reliability of the Persian Version of DDS-R. Results: Based on maximum likelihood exploratory factor analysis and consideration of conceptual meaning, a 4-factor solution was identified, explaining 75.89% of the total variance. Goodness-of-fit indices (GFI), Comparative Fit Index (CFI), Normed Fit Index (NFI), Incremental Fit Index (IFI), and Root Mean Square Error of Approximation (RMSEA) in the final DDS-R structure demonstrated the adequacy of the 4-domain structure. The internal consistency, construct reliability, and Intra-class Correlation Coefficients (ICC) were greater than .70. Conclusion: The DDS-R was found to be a valid and reliable assessment tool for evaluating death depression symptoms in Iranian patients with AMI.

[Construction and validation of a short scale of perception of barriers for the physical activity in adolescents].

PubMed

Cabanas-Sánchez, Verónica; Tejero-González, Carlos M; Veiga, Oscar L

2012-01-01

One of the main problems of health in the first world is the increase of physical inactivity. In this respect, adolescence has been identified as a critic period with high decline of physical activity. Therefore, a relevant line of research is the understanding of this social phenomenon. The aim of this study was to design a scale to assess perceived barriers to physical activity on adolescents. A convenience sample of 160 Spanish adolescents (84 girls), between 12 and 18 years old, was recruited for this study. Firstly, there were designed 40 items whose pertinence was evaluated through content validation by experts. Later, the participants were divided in two randomized groups, and Exploratory Factor Analysis and Confirmatory Factor Analysis were performed to define a short scale of 12 items. Cronbach Alfa Coefficent was used to evaluate internal consistence of the instrument. The scale reports four dimensions: incompatibility barriers (2 items), self-concept barriers (4 items), amotivation barriers (4 items) and social barriers (2 items). The scale showed enough construct validity (χ2=60.78; d.f.=48; p=0.100; GFI=0.88; CFI=0.94; RMSEA=0.58) and high internal reliability (α=0.80). Moreover, the scale was able to explain 67% of the data variance. The Short Scale of Perceived Barriers to Physical Activity in Adolescents is a valid and reliable instrument.

Aesthetic dermatology and emotional well-being questionnaire.

PubMed

Martínez-González, M Covadonga; Martínez-González, Raquel-Amaya; Guerra-Tapia, Aurora

2014-12-01

In recent years, there has been a great development of esthetic dermatology as a subspecialty of dermatology. It is important to know to which extent the general population regard this branch of medical surgical specialty as being of interest and contributing to emotional well-being. To analyze the technical features of a questionnaire which has been designed to reflect such perception of the general population about esthetic dermatology and its contribution to emotional well-being. Production and psychometric analysis of a self-filled in questionnaire in relation to esthetic dermatology and emotional well-being (DEBIE). This questionnaire is made of 57 items and has been applied to a sample of 770 people within the general population. The drawing-up process of the questionnaire is described to provide content validity. Items analysis was carried out together with exploratory and confirmatory factor analysis to assess the structure and construct validity of the tool. The extent of internal consistency (reliability) and concurrent validity has also been verified. DEBIE questionnaire (Spanish acronym for Aesthetic Dermatology and Emotional Well-being) revolves around six factors explaining 53.91% of the variance; there is a high level of internal consistency (Cronbach's α 0.90) and reasonable criterion validity. DEBIE questionnaire brings together adequate psychometric properties that can be applied to assess the perception that the general population have in relation to esthetic dermatology and its contribution to their emotional well-being. © 2014 Wiley Periodicals, Inc.

Using the risk behaviour diagnosis scale to understand Australian Aboriginal smoking — A cross-sectional validation survey in regional New South Wales

PubMed Central

Gould, Gillian Sandra; Watt, Kerrianne; Cadet-James, Yvonne; Clough, Alan R.

2014-01-01

Objective To validate, for the first time, the Risk Behaviour Diagnosis (RBD) Scale for Aboriginal Australian tobacco smokers, based on the Extended Parallel Process Model (EPPM). Despite high smoking prevalence, little is known about how Indigenous peoples assess their smoking risks. Methods In a cross-sectional study of 121 aboriginal smokers aged 18–45 in regional New South Wales, in 2014, RBD subscales were assessed for internal consistency. Scales included measures of perceived threat (susceptibility to and severity of smoking risks) and perceived efficacy (response efficacy and self-efficacy for quitting). An Aboriginal community panel appraised face and content validity. EPPM constructs of danger control (protective motivation) and fear control (defensive motivation) were assessed for cogency. Results Scales had acceptable to good internal consistency (Cronbach's alpha = 0.65–1.0). Most participants demonstrated high-perceived threat (77%, n = 93); and half had high-perceived efficacy (52%, n = 63). High-perceived efficacy with high-threat appeared consistent with danger control dominance; low-perceived efficacy with high-threat was consistent with fear control dominance. Conclusions In these Aboriginal smokers of reproductive age, the RBD Scale appeared valid and reliable. Further research is required to assess whether the RBD Scale and EPPM can predict quit attempts and assist with tailored approaches to counselling and targeted health promotion campaigns. PMID:26844043

Are posttraumatic stress disorder (PTSD) and complex-PTSD distinguishable within a treatment-seeking sample of Syrian refugees living in Lebanon?

PubMed

Hyland, P; Ceannt, R; Daccache, F; Abou Daher, R; Sleiman, J; Gilmore, B; Byrne, S; Shevlin, M; Murphy, J; Vallières, F

2018-01-01

The World Health Organization will publish its 11 th revision of the International Classification of Diseases (ICD-11) in 2018. The ICD-11 will include a refined model of posttraumatic stress disorder (PTSD) and a new diagnosis of complex PTSD (CPTSD). Whereas emerging data supports the validity of these proposals, the discriminant validity of PTSD and CPTSD have yet to be tested amongst a sample of refugees. Treatment-seeking Syrian refugees ( N  = 110) living in Lebanon completed an Arabic version of the International Trauma Questionnaire ; a measure specifically designed to capture the symptom content of ICD-11 PTSD and CPTSD. In total, 62.6% of the sample met the diagnostic criteria for PTSD or CPTSD. More refugees met the criteria for CPTSD (36.1%) than PTSD (25.2%) and no gender differences were observed. Latent class analysis results identified three distinct groups: (1) a PTSD class, (2) a CPTSD class and (3) a low symptom class. Class membership was significantly predicted by levels of functional impairment. Support for the discriminant validity of ICD-11 PTSD and CPTSD was observed for the first time within a sample of refugees. In support of the cross-cultural validity of the ICD-11 proposals, the prevalence of PTSD and CPTSD were similar to those observed in culturally distinct contexts.

The development and validation of the On-the-job Learning Styles Questionnaire for the Nursing Profession.

PubMed

Berings, Marjolein G M C; Poell, Rob F; Simons, P Robert-Jan; van Veldhoven, Marc J P M

2007-06-01

This paper is a report of a study to develop and test the psychometric properties of the On-the-job Learning Style Questionnaire for the Nursing Profession. Although numerous questionnaires measuring learning styles have been developed, none are suitable for working environments. Existing instruments do not meet the requirements for use in workplace settings and tend to ignore the influence of different learning situations. The questionnaire was constructed using a situation-response design, measuring learning activities in different on-the-job learning situations. Content validity was ensured by basing the questionnaire on interview studies. The questionnaire was distributed to 912 Registered Nurses working in different departments of 13 general hospitals in the Netherlands at the end of 2005. The response rate was 41% (372 questionnaires). The internal factor structure of the questionnaire was partly based on the learning activities in which nurses participate and partly on the learning situation in which they are performed. The internal consistency was good. The situation-response design of the questionnaire demonstrated its added value. Construct validity was estimated using intercorrelations between the scales, and criterion validity was estimated based on the relationships of the scales with perceived professional competence. The On-the-job Learning Styles Questionnaire for the Nursing Profession is well suited to describing nurses' learning styles in on-the-job settings and has satisfactory psychometric properties.

Content Validation and Semantic Evaluation of a Check-List Elaborated for the Prevention of Gluten Cross-Contamination in Food Services.

PubMed

Farage, Priscila; Puppin Zandonadi, Renata; Cortez Ginani, Verônica; Gandolfi, Lenora; Pratesi, Riccardo; de Medeiros Nóbrega, Yanna Karla

2017-01-06

Conditions associated to the consumption of gluten have emerged as a major health care concern and the treatment consists on a lifelong gluten-free diet. Providing safe food for these individuals includes adapting to safety procedures within the food chain and preventing gluten cross-contamination in gluten-free food. However, a gluten cross-contamination prevention protocol or check-list has not yet been validated. Therefore, the aim of this study was to perform the content validation and semantic evaluation of a check-list elaborated for the prevention of gluten cross-contamination in food services. The preliminary version of the check-list was elaborated based on the Brazilian resolution for food safety Collegiate Board Resolution 216 (RDC 216) and Collegiate Board Resolution 275 (RDC 275), the standard 22000 from the International Organization for Standardization (ISO 22000) and the Canadian Celiac Association Gluten-Free Certification Program documents. Seven experts with experience in the area participated in the check-list validation and semantic evaluation. The criteria used for the approval of the items, as to their importance for the prevention of gluten cross-contamination and clarity of the wording, was the achievement of a minimal of 80% of agreement between the experts (W-values ≥ 0.8). Moreover, items should have a mean ≥4 in the evaluation of importance (Likert scale from 1 to 5) and clarity (Likert scale from 0 to 5) in order to be maintained in the instrument. The final version of the check-list was composed of 84 items, divided into 12 sections. After being redesigned and re-evaluated, the items were considered important and comprehensive by the experts (both with W-values ≥ 0.89). The check-list developed was validated with respect to content and approved in the semantic evaluation.

Precipitable water vapour content from ESR/SKYNET sun-sky radiometers: validation against GNSS/GPS and AERONET over three different sites in Europe

NASA Astrophysics Data System (ADS)

Campanelli, Monica; Mascitelli, Alessandra; Sanò, Paolo; Diémoz, Henri; Estellés, Victor; Federico, Stefano; Iannarelli, Anna Maria; Fratarcangeli, Francesca; Mazzoni, Augusto; Realini, Eugenio; Crespi, Mattia; Bock, Olivier; Martínez-Lozano, Jose A.; Dietrich, Stefano

2018-01-01

The estimation of the precipitable water vapour content (W) with high temporal and spatial resolution is of great interest to both meteorological and climatological studies. Several methodologies based on remote sensing techniques have been recently developed in order to obtain accurate and frequent measurements of this atmospheric parameter. Among them, the relative low cost and easy deployment of sun-sky radiometers, or sun photometers, operating in several international networks, allowed the development of automatic estimations of W from these instruments with high temporal resolution. However, the great problem of this methodology is the estimation of the sun-photometric calibration parameters. The objective of this paper is to validate a new methodology based on the hypothesis that the calibration parameters characterizing the atmospheric transmittance at 940 nm are dependent on vertical profiles of temperature, air pressure and moisture typical of each measurement site. To obtain the calibration parameters some simultaneously seasonal measurements of W, from independent sources, taken over a large range of solar zenith angle and covering a wide range of W, are needed. In this work yearly GNSS/GPS datasets were used for obtaining a table of photometric calibration constants and the methodology was applied and validated in three European ESR-SKYNET network sites, characterized by different atmospheric and climatic conditions: Rome, Valencia and Aosta. Results were validated against the GNSS/GPS and AErosol RObotic NETwork (AERONET) W estimations. In both the validations the agreement was very high, with a percentage RMSD of about 6, 13 and 8 % in the case of GPS intercomparison at Rome, Aosta and Valencia, respectively, and of 8 % in the case of AERONET comparison in Valencia. Analysing the results by W classes, the present methodology was found to clearly improve W estimation at low W content when compared against AERONET in terms of % bias, bringing the agreement with the GPS (considered the reference one) from a % bias of 5.76 to 0.52.