A New Tool for Nutrition App Quality Evaluation (AQEL): Development, Validation, and Reliability Testing.

PubMed

DiFilippo, Kristen Nicole; Huang, Wenhao; Chapman-Novakofski, Karen M

2017-10-27

The extensive availability and increasing use of mobile apps for nutrition-based health interventions makes evaluation of the quality of these apps crucial for integration of apps into nutritional counseling. The goal of this research was the development, validation, and reliability testing of the app quality evaluation (AQEL) tool, an instrument for evaluating apps' educational quality and technical functionality. Items for evaluating app quality were adapted from website evaluations, with additional items added to evaluate the specific characteristics of apps, resulting in 79 initial items. Expert panels of nutrition and technology professionals and app users reviewed items for face and content validation. After recommended revisions, nutrition experts completed a second AQEL review to ensure clarity. On the basis of 150 sets of responses using the revised AQEL, principal component analysis was completed, reducing AQEL into 5 factors that underwent reliability testing, including internal consistency, split-half reliability, test-retest reliability, and interrater reliability (IRR). Two additional modifiable constructs for evaluating apps based on the age and needs of the target audience as selected by the evaluator were also tested for construct reliability. IRR testing using intraclass correlations (ICC) with all 7 constructs was conducted, with 15 dietitians evaluating one app. Development and validation resulted in the 51-item AQEL. These were reduced to 25 items in 5 factors after principal component analysis, plus 9 modifiable items in two constructs that were not included in principal component analysis. Internal consistency and split-half reliability of the following constructs derived from principal components analysis was good (Cronbach alpha >.80, Spearman-Brown coefficient >.80): behavior change potential, support of knowledge acquisition, app function, and skill development. App purpose split half-reliability was .65. Test-retest reliability showed no significant change over time (P>.05) for all but skill development (P=.001). Construct reliability was good for items assessing age appropriateness of apps for children, teens, and a general audience. In addition, construct reliability was acceptable for assessing app appropriateness for various target audiences (Cronbach alpha >.70). For the 5 main factors, ICC (1,k) was >.80, with a P value of <.05. When 15 nutrition professionals evaluated one app, ICC (2,15) was .98, with a P value of <.001 for all 7 constructs when the modifiable items were specified for adults seeking weight loss support. Our preliminary effort shows that AQEL is a valid, reliable instrument for evaluating nutrition apps' qualities for clinical interventions by nutrition clinicians, educators, and researchers. Further efforts in validating AQEL in various contexts are needed. ©Kristen Nicole DiFilippo, Wenhao Huang, Karen M. Chapman-Novakofski. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 27.10.2017.

Physics Metacognition Inventory Part II: Confirmatory factor analysis and Rasch analysis

NASA Astrophysics Data System (ADS)

Taasoobshirazi, Gita; Bailey, MarLynn; Farley, John

2015-11-01

The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. The college students' scores on the inventory were found to be reliable and related to students' physics motivation and physics grade. However, the results of the exploratory factor analysis indicated that the questionnaire could be revised to improve its construct validity. The goal of this study was to revise the questionnaire and establish its construct validity through a confirmatory factor analysis. In addition, a Rasch analysis was applied to the data to better understand the psychometric properties of the inventory and to further evaluate the construct validity. Results indicated that the final, revised inventory is a valid, reliable, and efficient tool for assessing student metacognition for physics problem solving.

Face, Content, and Construct Validations of Endoscopic Needle Injection Simulator for Transurethral Bulking Agent in Treatment of Stress Urinary Incontinence.

PubMed

Farhan, Bilal; Soltani, Tandis; Do, Rebecca; Perez, Claudia; Choi, Hanul; Ghoniem, Gamal

2018-05-02

Endoscopic injection of urethral bulking agents is an office procedure that is used to treat stress urinary incontinence secondary to internal sphincteric deficiency. Validation studies important part of simulator evaluation and is considered important step to establish the effectiveness of simulation-based training. The endoscopic needle injection (ENI) simulator has not been formally validated, although it has been used widely at University of California, Irvine. We aimed to assess the face, content, and construct validity of the UC, Irvine ENI simulator. Dissected female porcine bladders were mounted in a modified Hysteroscopy Diagnostic Trainer. Using routine endoscopic equipment for this procedure with video monitoring, 6 urologists (experts group) and 6 urology trainee (novice group) completed urethral bulking agents injections on a total of 12 bladders using ENI simulator. Face and content validities were assessed by using structured quantitative survey which rating the realism. Construct validity was assessed by comparing the performance, time of the procedure, and the occlusive (anatomical and functional) evaluations between the experts and novices. Trainees also completed a postprocedure feedback survey. Effective injections were evaluated by measuring the retrograde urethral opening pressure, visual cystoscopic coaptation, and postprocedure gross anatomic examination. All 12 participants felt the simulator was a good training tool and should be used as essential part of urology training (face validity). ENI simulator showed good face and content validity with average score varies between the experts and the novices was 3.9/5 and 3.8/5, respectively. Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.9-3.8/5). However, the bladder does not bleed, and sometimes thin. Experts significantly outperformed novices (p < 001) across all measure of performance therefore establishing construct validity. The ENI simulator shows face, content and construct validities, although few aspects of simulator were not very realistic (e.g., bleeding).This study provides a base for the future formal validation for this simulator and for continuing use of this simulator in endourology training. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Structured learning for robotic surgery utilizing a proficiency score: a pilot study.

PubMed

Hung, Andrew J; Bottyan, Thomas; Clifford, Thomas G; Serang, Sarfaraz; Nakhoda, Zein K; Shah, Swar H; Yokoi, Hana; Aron, Monish; Gill, Inderbir S

2017-01-01

We evaluated feasibility and benefit of implementing structured learning in a robotics program. Furthermore, we assessed validity of a proficiency assessment tool for stepwise graduation. Teaching cases included robotic radical prostatectomy and partial nephrectomy. Procedure steps were categorized: basic, intermediate, and advanced. An assessment tool ["proficiency score" (PS)] was developed to evaluate ability to safely and autonomously complete a step. Graduation required a passing PS (PS ≥ 3) on three consecutive attempts. PS and validated global evaluative assessment of robotic skills (GEARS) were evaluated for completed steps. Linear regression was utilized to determine postgraduate year/PS relationship (construct validity). Spearman's rank correlation coefficient measured correlation between PS and GEARS evaluations (concurrent validity). Intraclass correlation (ICC) evaluated PS agreement between evaluator classes. Twenty-one robotic trainees participated within the pilot program, completing a median of 14 (2-69) cases each. Twenty-three study evaluators scored 14 (1-60) cases. Over 4 months, 229/294 (78 %) cases were designated "teaching" cases. Residents completed 91 % of possible evaluations; faculty completed 78 %. Verbal and quantitative feedback received by trainees increased significantly (p = 0.002, p < 0.001, respectively). Average PS increased with PGY (post-graduate year) for basic and intermediate steps (regression slopes: 0.402 (p < 0.0001), 0.323 (p < 0.0001), respectively) (construct validation). Overall, PS correlated highly with GEARS (ρ = 0.81, p < 0.0001) (concurrent validity). ICC was 0.77 (95 % CI 0.61-0.88) for resident evaluations. Structured learning can be implemented in an academic robotic program with high levels of trainee and evaluator participation, encouraging both quantitative and verbal feedback. A proficiency assessment tool developed for step-specific proficiency has construct and concurrent validity.

Comparative assessment of three standardized robotic surgery training methods.

PubMed

Hung, Andrew J; Jayaratna, Isuru S; Teruya, Kara; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2013-10-01

To evaluate three standardized robotic surgery training methods, inanimate, virtual reality and in vivo, for their construct validity. To explore the concept of cross-method validity, where the relative performance of each method is compared. Robotic surgical skills were prospectively assessed in 49 participating surgeons who were classified as follows: 'novice/trainee': urology residents, previous experience <30 cases (n = 38) and 'experts': faculty surgeons, previous experience ≥30 cases (n = 11). Three standardized, validated training methods were used: (i) structured inanimate tasks; (ii) virtual reality exercises on the da Vinci Skills Simulator (Intuitive Surgical, Sunnyvale, CA, USA); and (iii) a standardized robotic surgical task in a live porcine model with performance graded by the Global Evaluative Assessment of Robotic Skills (GEARS) tool. A Kruskal-Wallis test was used to evaluate performance differences between novices and experts (construct validity). Spearman's correlation coefficient (ρ) was used to measure the association of performance across inanimate, simulation and in vivo methods (cross-method validity). Novice and expert surgeons had previously performed a median (range) of 0 (0-20) and 300 (30-2000) robotic cases, respectively (P < 0.001). Construct validity: experts consistently outperformed residents with all three methods (P < 0.001). Cross-method validity: overall performance of inanimate tasks significantly correlated with virtual reality robotic performance (ρ = -0.7, P < 0.001) and in vivo robotic performance based on GEARS (ρ = -0.8, P < 0.0001). Virtual reality performance and in vivo tissue performance were also found to be strongly correlated (ρ = 0.6, P < 0.001). We propose the novel concept of cross-method validity, which may provide a method of evaluating the relative value of various forms of skills education and assessment. We externally confirmed the construct validity of each featured training tool. © 2013 BJU International.

Validity and Reliability Testing of an e-learning Questionnaire for Chemistry Instruction

NASA Astrophysics Data System (ADS)

Guspatni, G.; Kurniawati, Y.

2018-04-01

The aim of this paper is to examine validity and reliability of a questionnaire used to evaluate e-learning implementation in chemistry instruction. 48 questionnaires were filled in by students who had studied chemistry through e-learning system. The questionnaire consisted of 20 indicators evaluating students’ perception on using e-learning. Parametric testing was done as data were assumed to follow normal distribution. Item validity of the questionnaire was examined through item-total correlation using Pearson’s formula while its reliability was assessed with Cronbach’s alpha formula. Moreover, convergent validity was assessed to see whether indicators building a factor had theoretically the same underlying construct. The result of validity testing revealed 19 valid indicators while the result of reliability testing revealed Cronbach’s alpha value of .886. The result of factor analysis showed that questionnaire consisted of five factors, and each of them had indicators building the same construct. This article shows the importance of factor analysis to get a construct valid questionnaire before it is used as research instrument.

The development and validation of the clinicians' awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool.

PubMed

Chew, Keng Sheng; Kueh, Yee Cheng; Abdul Aziz, Adlihafizi

2017-03-21

Despite their importance on diagnostic accuracy, there is a paucity of literature on questionnaire tools to assess clinicians' awareness toward cognitive errors. A validation study was conducted to develop a questionnaire tool to evaluate the Clinician's Awareness Towards Cognitive Errors (CATChES) in clinical decision making. This questionnaire is divided into two parts. Part A is to evaluate the clinicians' awareness towards cognitive errors in clinical decision making while Part B is to evaluate their perception towards specific cognitive errors. Content validation for both parts was first determined followed by construct validation for Part A. Construct validation for Part B was not determined as the responses were set in a dichotomous format. For content validation, all items in both Part A and Part B were rated as "excellent" in terms of their relevance in clinical settings. For construct validation using exploratory factor analysis (EFA) for Part A, a two-factor model with total variance extraction of 60% was determined. Two items were deleted. Then, the EFA was repeated showing that all factor loadings are above the cut-off value of >0.5. The Cronbach's alpha for both factors are above 0.6. The CATChES questionnaire tool is a valid questionnaire tool aimed to evaluate the awareness among clinicians toward cognitive errors in clinical decision making.

The Fear of Positive Evaluation Scale: assessing a proposed cognitive component of social anxiety.

PubMed

Weeks, Justin W; Heimberg, Richard G; Rodebaugh, Thomas L

2008-01-01

Cognitive-behavioral models propose that fear of negative evaluation is the core feature of social anxiety disorder. However, it may be that fear of evaluation in general is important in social anxiety, including fears of positive as well as negative evaluation. To test this hypothesis, we developed the Fear of Positive Evaluation Scale (FPES) and conducted analyses to examine the psychometric properties of the FPES, as well as test hypotheses regarding the construct of fear of positive evaluation (FPE). Responses from a large (n = 1711) undergraduate sample were utilized. The reliability, construct validity, and factorial validity of the FPES were examined; the distinction of FPE from fear of negative evaluation was evaluated utilizing confirmatory factor analysis; and the ability of FPE to predict social interaction anxiety above and beyond fear of negative evaluation was assessed. Results provide preliminary support for the psychometric properties of the FPES and the validity of the construct of FPE. The implications of FPE with respect to the study and treatment of social anxiety disorder are discussed.

Factors affecting unsafe behavior in construction projects: development and validation of a new questionnaire.

PubMed

Asilian-Mahabadi, Hassan; Khosravi, Yahya; Hassanzadeh-Rangi, Narmin; Hajizadeh, Ebrahim; Behzadan, Amir H

2018-02-05

Occupational safety in general, and construction safety in particular, is a complex phenomenon. This study was designed to develop a new valid measure to evaluate factors affecting unsafe behavior in the construction industry. A new questionnaire was generated from qualitative research according to the principles of grounded theory. Key measurement properties (face validity, content validity, construct validity, reliability and discriminative validity) were examined using qualitative and quantitative approaches. The receiver operating characteristic curve was used to estimate the discriminating power and the optimal cutoff score. Construct validity revealed an interpretable 12-factor structure which explained 61.87% of variance. Good internal consistency (Cronbach's α = 0.94) and stability (intra-class correlation coefficient = 0.93) were found for the new instrument. The area under the curve, sensitivity and specificity were 0.80, 0.80 and 0.75, respectively. The new instrument also discriminated safety performance among the construction sites with different workers' accident histories (F = 6.40, p < 0.05). The new instrument appears to be a valid, reliable and sensitive instrument that will contribute to investigating the root causes of workers' unsafe behaviors, thus promoting safety performance in the construction industry.

Evaluating Evidence for Conceptually Related Constructs Using Bivariate Correlations

ERIC Educational Resources Information Center

Swank, Jacqueline M.; Mullen, Patrick R.

2017-01-01

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

An Evaluation of the Validity and Reliability of a Food Behavior Checklist Modified for Children

ERIC Educational Resources Information Center

Branscum, Paul; Sharma, Manoj; Kaye, Gail; Succop, Paul

2010-01-01

Objective: The objective of this study was to report the construct validity and internal consistency reliability of the Food Behavior Checklist modified for children (FBC-MC), with low-income, Youth Expanded Food and Nutrition Education Program (EFNEP)-eligible children. Methods: Using a cross-sectional research design, construct validity was…

Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results.

PubMed

Yen, Po-Yin; Sousa, Karen H; Bakken, Suzanne

2014-10-01

In a previous study, we developed the Health Information Technology Usability Evaluation Scale (Health-ITUES), which is designed to support customization at the item level. Such customization matches the specific tasks/expectations of a health IT system while retaining comparability at the construct level, and provides evidence of its factorial validity and internal consistency reliability through exploratory factor analysis. In this study, we advanced the development of Health-ITUES to examine its construct validity and predictive validity. The health IT system studied was a web-based communication system that supported nurse staffing and scheduling. Using Health-ITUES, we conducted a cross-sectional study to evaluate users' perception toward the web-based communication system after system implementation. We examined Health-ITUES's construct validity through first and second order confirmatory factor analysis (CFA), and its predictive validity via structural equation modeling (SEM). The sample comprised 541 staff nurses in two healthcare organizations. The CFA (n=165) showed that a general usability factor accounted for 78.1%, 93.4%, 51.0%, and 39.9% of the explained variance in 'Quality of Work Life', 'Perceived Usefulness', 'Perceived Ease of Use', and 'User Control', respectively. The SEM (n=541) supported the predictive validity of Health-ITUES, explaining 64% of the variance in intention for system use. The results of CFA and SEM provide additional evidence for the construct and predictive validity of Health-ITUES. The customizability of Health-ITUES has the potential to support comparisons at the construct level, while allowing variation at the item level. We also illustrate application of Health-ITUES across stages of system development. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Risks Associated with Federal Construction Projects

DTIC Science & Technology

2011-06-01

awarding contracts for construction projects (USACE, 2010). BIM offers a method to effectively design a facility while maximizing work performance during...includes Requirements, Programming, Funding, Solicitation, AEC Evaluation, Award , Project Validation, Design and Construction, and Project Management...includes the Solicitation, AEC Evaluation, and Award Steps. In this Phase, BIM is only used in the Solicitation and the AEC Evaluation steps

Measuring production loss due to health and work environment problems: construct validity and implications.

PubMed

Karlsson, Malin Lohela; Bergström, Gunnar; Björklund, Christina; Hagberg, Jan; Jensen, Irene

2013-12-01

The aim was to validate two measures of production loss, health-related and work environment-related production loss, concerning their associations with health status and work environment factors. Validity was assessed by evaluating the construct validity. Health problems related and work environment-related problems (or factors) were included in separate analyses and evaluated regarding the significant difference in proportion of explained variation (R) of production loss. health problems production loss was not found to fulfill the criteria for convergent validity in this study; however, the measure of work environment-related production loss did fulfill the criteria that were set up. The measure of work environment-related production loss can be used to screen for production loss due to work environment problems as well as an outcome measure when evaluating the effect of organizational interventions.

Construct validity of the modified numeric rating scale of patient global assessment in psoriatic arthritis.

PubMed

Leung, Ying-Ying; Ho, Kwok-Wah; Zhu, Tracy-Yanner; Tam, Lai-Shan; Kun, Emily Wailin; Li, Edmund Kwok-Ming

2012-04-01

The construct validity of the patient global health assessment (PGA) in psoriatic arthritis (PsA) has not been analyzed, despite its common use. We evaluated the construct validity of a numeric rating scale (NRS) of the PGA in PsA. Patients with PsA who fulfilled the ClASsification for Psoriatic ARthritis (CASPAR) criteria were recruited at a tertiary referral center. Demographic data were collected and PGA data were determined from administration of an 11-point NRS (0 to 10 points representing best to worst status). Convergent and discriminant validity were evaluated by correlation between PGA and clinical variables. Patients were grouped as having severe disease based on Disease Activity Score 28-joint count (DAS28) > 5.1, Health Assessment Questionnaire (HAQ) > 1.0, walking with aids, and social welfare-dependent. Patients were grouped as being in remission by DAS28 < 2.6 and the Minimal Disease Activity Criteria. Known-group validity of PGA was evaluated. A total of 125 patients (52% men) were studied. Convergent validity revealed strong correlations of PGA with pain score, HAQ, and DAS28; and weak correlations with skin severity score, physician's global assessment and morning stiffness. In multivariate analysis, PGA was associated with pain, physical function, mental function, and skin severity score. PGA distinguished different levels of severity well, as determined by comparison with different known groups with large effect sizes. Judged on an NRS, the PGA had good construct validity and satisfactorily distinguished all levels of severity in PsA.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

Constructing a Validity Argument for the Objective Structured Assessment of Technical Skills (OSATS): A Systematic Review of Validity Evidence

ERIC Educational Resources Information Center

Hatala, Rose; Cook, David A.; Brydges, Ryan; Hawkins, Richard

2015-01-01

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

Construct Validity of Three Clerkship Performance Assessments

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2010-01-01

This study examined construct validity of three commonly used clerkship performance assessments: preceptors' evaluations, OSCE-type clinical performance measures, and the NBME [National Board of Medical Examiners] medicine subject examination. Six hundred and eighty-six students taking the inpatient medicine clerkship from 2003 to 2007…

Validation of the breast evaluation questionnaire for breast hypertrophy and breast reduction.

PubMed

Lewin, Richard; Elander, Anna; Lundberg, Jonas; Hansson, Emma; Thorarinsson, Andri; Claudelin, Malin; Bladh, Helena; Lidén, Mattias

2018-06-13

There is a lack of published, validated questionnaires for evaluating psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. To validate the breast evaluation questionnaire (BEQ), originally developed for the assessment of breast augmentation patients, for the assessment of psychosocial morbidity in patients with breast hypertrophy undergoing breast reduction surgery. Validation study Subjects: Women with macromastia Methods: The validation of the BEQ, adapted to breast reduction, was performed in several steps. Content validity, reliability, construct validity and responsiveness were assessed. The original version was adjusted according to the results for content validity and resulted in item reduction and a modified BEQ (mBEQ) that was then assessed for reliability, construct validity and responsiveness. Internal and external validation was performed for the modified BEQ. Convergent validity was tested against Breast-Q (reduction) and discriminate validity was tested against the SF-36. Known-groups validation revealed significant differences between the normal population and patients undergoing breast reduction surgery. The BEQ showed good reliability by test-re-test analysis and high responsiveness. The modified BEQ may be reliable, valid and responsive instrument for assessing women who undergo breast reduction.

Validity of the Microcomputer Evaluation Screening and Assessment Aptitude Scores.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1991-01-01

Examined validity of Microcomputer Evaluation Screening and Assessment (MESA) aptitude scores relative to General Aptitude Test Battery (GATB) using multitrait-multimethod correlational analyses. Findings from 54 rehabilitation clients and 29 displaced workers revealed no evidence to support the construct validity of the MESA. (Author/NB)

Convergent and Discriminant Validity of the Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1990-01-01

Examined construct validity of Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey. Administered MESA and United States Employment Service (USES) Interest Inventory to 74 volunteer rehabilitation clients. Evidence supported convergent and discriminant validity of MESA. Found fewer significant intercorrelations among MESA…

Validity and Reliability of General Nutrition Knowledge Questionnaire for Adults in Uganda

PubMed Central

Bukenya, Richard; Ahmed, Abhiya; Andrade, Jeanette M.; Grigsby-Toussaint, Diana S.; Muyonga, John; Andrade, Juan E.

2017-01-01

This study sought to develop and validate a general nutrition knowledge questionnaire (GNKQ) for Ugandan adults. The initial draft consisted of 133 items on five constructs associated with nutrition knowledge; expert recommendations (16 items), food groups (70 items), selecting food (10 items), nutrition and disease relationship (23 items), and food fortification in Uganda (14 items). The questionnaire validity was evaluated in three studies. For the content validity (study 1), a panel of five content matter nutrition experts reviewed the GNKQ draft before and after face validity. For the face validity (study 2), head teachers and health workers (n = 27) completed the questionnaire before attending one of three focus groups to review the clarity of the items. For the construct and test-rest reliability (study 3), head teachers (n = 40) from private and public primary schools and nutrition (n = 52) and engineering (n = 49) students from Makerere University took the questionnaire twice (two weeks apart). Experts agreed (content validity index, CVI > 0.9; reliability, Gwet’s AC1 > 0.85) that all constructs were relevant to evaluate nutrition knowledge. After the focus groups, 29 items were identified as unclear, requiring major (n = 5) and minor (n = 24) reviews. The final questionnaire had acceptable internal consistency (Cronbach α > 0.95), test-retest reliability (r = 0.89), and differentiated (p < 0.001) nutrition knowledge scores between nutrition (67 ± 5) and engineering (39 ± 11) students. Only the construct on nutrition recommendations was unreliable (Cronbach α = 0.51, test-retest r = 0.55), which requires further optimization. The final questionnaire included topics on food groups (41 items), selecting food (2 items), nutrition and disease relationship (14 items), and food fortification in Uganda (22 items) and had good content, construct, and test-retest reliability to evaluate nutrition knowledge among Ugandan adults. PMID:28230779

Assessing impact of physical activity-based youth development programs: validation of the Life Skills Transfer Survey (LSTS).

PubMed

Weiss, Maureen R; Bolter, Nicole D; Kipp, Lindsay E

2014-09-01

A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program. In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the Life Skills Transfer Survey (LSTS), a measure of perceived life skills transfer. Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS. RESULTS from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Psychometric Properties of an Instrument to Measure Mother-Infant Togetherness After Childbirth.

PubMed

Lawrence, Carol L; Norris, Anne E

2016-01-01

The purpose of this research was to evaluate the psychometric properties of a new instrument to measure mother-infant togetherness, Mother-Infant Togetherness Survey (MITS). Stage 1 examined content validity. Stage 2 pretested the readability and understandability and further examined content validity. Stage 3 examined women's ability to accurately self-report on the Delivery Events subscale. Stages 4 and 5 examined construct validity. Good content validity was obtained at the scale/subscale level (CVI = .91-1.00). Internal consistency reliability was evaluated at the scale/subscale level (α = .62-.89). Construct validity was supported with known groups testing and factor analysis. Study findings provide support for the reliability and validity of the MITS. Future research should be done to improve the internal consistency reliability of the Postpartum Events subscale.

Construct Validation of a Measure to Assess Sustainability of School-Wide Behavior Interventions

ERIC Educational Resources Information Center

Hume, Amanda; McIntosh, Kent

2013-01-01

This study assessed aspects of construct validity of the School-wide Universal Behavior Sustainability Index-School Teams (SUBSIST), a measure evaluating critical features of the school context related to sustainability of school-wide interventions. Participants at 217 schools implementing School-wide Positive Behavior Support (SWPBS) were…

On the validity and generality of transfer effects in cognitive training research.

PubMed

Noack, Hannes; Lövdén, Martin; Schmiedek, Florian

2014-11-01

Evaluation of training effectiveness is a long-standing problem of cognitive intervention research. The interpretation of transfer effects needs to meet two criteria, generality and specificity. We introduce each of the two, and suggest ways of implementing them. First, the scope of the construct of interest (e.g., working memory) defines the expected generality of transfer effects. Given that the constructs of interest are typically defined at the latent level, data analysis should also be conducted at the latent level. Second, transfer should be restricted to measures that are theoretically related to the trained construct. Hence, the construct of interest also determines the specificity of expected training effects; to test for specificity, study designs should aim at convergent and discriminant validity. We evaluate the recent cognitive training literature in relation to both criteria. We conclude that most studies do not use latent factors for transfer assessment, and do not test for convergent and discriminant validity.

Construction and validation of clinical contents for development of learning objects.

PubMed

Hortense, Flávia Tatiana Pedrolo; Bergerot, Cristiane Decat; Domenico, Edvane Birelo Lopes de

2018-01-01

to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Calibration and Validation of the Dutch-Flemish PROMIS Pain Interference Item Bank in Patients with Chronic Pain

PubMed Central

Crins, Martine H. P.; Roorda, Leo D.; Smits, Niels; de Vet, Henrica C. W.; Westhovens, Rene; Cella, David; Cook, Karon F.; Revicki, Dennis; van Leeuwen, Jaap; Boers, Maarten; Dekker, Joost; Terwee, Caroline B.

2015-01-01

The Dutch-Flemish PROMIS Group translated the adult PROMIS Pain Interference item bank into Dutch-Flemish. The aims of the current study were to calibrate the parameters of these items using an item response theory (IRT) model, to evaluate the cross-cultural validity of the Dutch-Flemish translations compared to the original English items, and to evaluate their reliability and construct validity. The 40 items in the bank were completed by 1085 Dutch chronic pain patients. Before calibrating the items, IRT model assumptions were evaluated using confirmatory factor analysis (CFA). Items were calibrated using the graded response model (GRM), an IRT model appropriate for items with more than two response options. To evaluate cross-cultural validity, differential item functioning (DIF) for language (Dutch vs. English) was examined. Reliability was evaluated based on standard errors and Cronbach’s alpha. To evaluate construct validity correlations with scores on legacy instruments (e.g., the Disabilities of the Arm, Shoulder and Hand Questionnaire) were calculated. Unidimensionality of the Dutch-Flemish PROMIS Pain Interference item bank was supported by CFA tests of model fit (CFI = 0.986, TLI = 0.986). Furthermore, the data fit the GRM and showed good coverage across the pain interference continuum (threshold-parameters range: -3.04 to 3.44). The Dutch-Flemish PROMIS Pain Interference item bank has good cross-cultural validity (only two out of 40 items showing DIF), good reliability (Cronbach’s alpha = 0.98), and good construct validity (Pearson correlations between 0.62 and 0.75). A computer adaptive test (CAT) and Dutch-Flemish PROMIS short forms of the Dutch-Flemish PROMIS Pain Interference item bank can now be developed. PMID:26214178

Calibration and Validation of the Dutch-Flemish PROMIS Pain Interference Item Bank in Patients with Chronic Pain.

PubMed

Crins, Martine H P; Roorda, Leo D; Smits, Niels; de Vet, Henrica C W; Westhovens, Rene; Cella, David; Cook, Karon F; Revicki, Dennis; van Leeuwen, Jaap; Boers, Maarten; Dekker, Joost; Terwee, Caroline B

2015-01-01

The Dutch-Flemish PROMIS Group translated the adult PROMIS Pain Interference item bank into Dutch-Flemish. The aims of the current study were to calibrate the parameters of these items using an item response theory (IRT) model, to evaluate the cross-cultural validity of the Dutch-Flemish translations compared to the original English items, and to evaluate their reliability and construct validity. The 40 items in the bank were completed by 1085 Dutch chronic pain patients. Before calibrating the items, IRT model assumptions were evaluated using confirmatory factor analysis (CFA). Items were calibrated using the graded response model (GRM), an IRT model appropriate for items with more than two response options. To evaluate cross-cultural validity, differential item functioning (DIF) for language (Dutch vs. English) was examined. Reliability was evaluated based on standard errors and Cronbach's alpha. To evaluate construct validity correlations with scores on legacy instruments (e.g., the Disabilities of the Arm, Shoulder and Hand Questionnaire) were calculated. Unidimensionality of the Dutch-Flemish PROMIS Pain Interference item bank was supported by CFA tests of model fit (CFI = 0.986, TLI = 0.986). Furthermore, the data fit the GRM and showed good coverage across the pain interference continuum (threshold-parameters range: -3.04 to 3.44). The Dutch-Flemish PROMIS Pain Interference item bank has good cross-cultural validity (only two out of 40 items showing DIF), good reliability (Cronbach's alpha = 0.98), and good construct validity (Pearson correlations between 0.62 and 0.75). A computer adaptive test (CAT) and Dutch-Flemish PROMIS short forms of the Dutch-Flemish PROMIS Pain Interference item bank can now be developed.

The Importance of Considering Clinical Utility in the Construction of a Diagnostic Manual.

PubMed

Mullins-Sweatt, Stephanie N; Lengel, Gregory J; DeShong, Hilary L

2016-01-01

The development of major diagnostic manuals primarily has been guided by construct validity rather than clinical utility. The purpose of this article is to summarize recent research and theory examining the importance of clinical utility when constructing and evaluating a diagnostic manual. We suggest that construct validity is a necessary but not sufficient criterion for diagnostic constructs. This article discusses components of clinical utility and how these have applied to the current and forthcoming diagnostic manuals. Implications and suggestions for future research are provided.

Utility of pedometers for assessing physical activity: construct validity.

PubMed

Tudor-Locke, Catrine; Williams, Joel E; Reis, Jared P; Pluto, Delores

2004-01-01

Valid assessment of physical activity is necessary to fully understand this important health-related behaviour for research, surveillance, intervention and evaluation purposes. This article is the second in a companion set exploring the validity of pedometer-assessed physical activity. The previous article published in Sports Medicine dealt with convergent validity (i.e. the extent to which an instrument's output is associated with that of other instruments intended to measure the same exposure of interest). The present focus is on construct validity. Construct validity is the extent to which the measurement corresponds with other measures of theoretically-related parameters. Construct validity is typically evaluated by correlational analysis, that is, the magnitude of concordance between two measures (e.g. pedometer-determined steps/day and a theoretically-related parameter such as age, anthropometric measures and fitness). A systematic literature review produced 29 articles published since > or =1980 directly relevant to construct validity of pedometers in relation to age, anthropometric measures and fitness. Reported correlations were combined and a median r-value was computed. Overall, there was a weak inverse relationship (median r = -0.21) between age and pedometer-determined physical activity. A weak inverse relationship was also apparent with both body mass index and percentage overweight (median r = -0.27 and r = -0.22, respectively). Positive relationships regarding indicators of fitness ranged from weak to moderate depending on the fitness measure utilised: 6-minute walk test (median r = 0.69), timed treadmill test (median r = 0.41) and estimated maximum oxygen uptake (median r = 0.22). Studies are warranted to assess the relationship of pedometer-determined physical activity with other important health-related outcomes including blood pressure and physiological parameters such as blood glucose and lipid profiles. The aggregated evidence of convergent validity (presented in the previous companion article) and construct validity herein provides support for considering simple and inexpensive pedometers in both research and practice.

Validation of an Evaluation Model for Learning Management Systems

ERIC Educational Resources Information Center

Kim, S. W.; Lee, M. G.

2008-01-01

This study aims to validate a model for evaluating learning management systems (LMS) used in e-learning fields. A survey of 163 e-learning experts, regarding 81 validation items developed through literature review, was used to ascertain the importance of the criteria. A concise list of explanatory constructs, including two principle factors, was…

The Universal Design for Play Tool: Establishing Validity and Reliability

ERIC Educational Resources Information Center

Ruffino, Amy Goetz; Mistrett, Susan G.; Tomita, Machiko; Hajare, Poonam

2006-01-01

The Universal Design for Play (UDP) Tool is an instrument designed to evaluate the presence of universal design (UD) features in toys. This study evaluated its psychometric properties, including content validity, construct validity, and test-retest reliability. The UDP tool was designed to assist in selecting toys most appropriate for children…

Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics.

PubMed

Garfjeld Roberts, Patrick; Guyver, Paul; Baldwin, Mathew; Akhtar, Kash; Alvand, Abtin; Price, Andrew J; Rees, Jonathan L

2017-02-01

To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.

Development and Validation of a Measure of Maladaptive Social-Evaluative Beliefs Characteristic of Social Anxiety Disorder in Youth: The Report of Youth Social Cognitions (RYSC).

PubMed

Wong, Quincy J J; Certoma, Sarah P; McLellan, Lauren F; Halldorsson, Brynjar; Reyes, Natasha; Boulton, Kelsie; Hudson, Jennifer L; Rapee, Ronald M

2017-12-28

Recent research has started to examine the applicability of influential adult models of the maintenance of social anxiety disorder (SAD) to youth. This research is limited by the lack of psychometrically validated measures of underlying constructs that are developmentally appropriate for youth. One key construct in adult models of SAD is maladaptive social-evaluative beliefs. The current study aimed to develop and validate a measure of these beliefs in youth, known as the Report of Youth Social Cognitions (RYSC). The RYSC was developed with a clinical sample of youth with anxiety disorders (N = 180) and cross-validated in a community sample of youth (N = 305). In the clinical sample, the RYSC exhibited a 3-factor structure (negative evaluation, revealing self, and positive impression factors), good internal consistency, and construct validity. In the community sample, the 3-factor structure and the internal consistency of the RYSC were replicated, but the test of construct validity showed that the RYSC had similarly strong associations with social anxiety and depressed affect. The RYSC had good test-retest reliability overall, although the revealing self subscale showed lower temporal stability which improved when only older participants were considered (age ≥9 years). The RYSC in general was also shown to discriminate between youth with and without SAD although the revealing self subscale again performed suboptimally but improved when only older participants were considered. These findings provide psychometric support for the RYSC and justifies its use with youth in research and clinical settings requiring the assessment of maladaptive social-evaluative beliefs. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Background, College Experiences, and the ACT-COMP Exam: Using Construct Validity to Evaluate Assessment Instruments.

ERIC Educational Resources Information Center

Pike, Gary R.

1989-01-01

A study investigated the appropriateness of the American College Testing Program's College Outcome Measures Program, conducted at the University of Tennessee, Knoxville, by applying the criterion of construct validity. Results indicated that while the test primarily measures individual differences, it is also sensitive to the effects of higher…

The Construction and Initial Validation of the "Student Teachers' Efficacy Scale for Teaching Students with Disabilities"

ERIC Educational Resources Information Center

Zhang, Dake; Wang, Qiu; Stegall, Joanna; Losinki, Mickey; Katsiyannis, Antonis

2018-01-01

Although there have been numerous instruments for assessing teacher efficacy in teaching general education students, there is a need to develop and validate an instrument that specifically assesses teachers' efficacy in teaching students with disabilities. This study constructed and evaluated the psychometric properties of the "Student…

Construct Validity Examination of Critical Thinking Dispositions for Undergraduate Students in University Putra Malaysia

ERIC Educational Resources Information Center

Ghadi, Ibrahim; Alwi, Nor Hayati; Bakar, Kamariah Abu; Talib, Othman

2012-01-01

This research aims to evaluate the psychology properties of the construct validity for the Critical Thinking Disposition (CTD) instrument. The CTD instrument consists of 39 Likert-type items measuring seven dispositions, namely analyticity, open-mind, truth-seeking, systematicity, self-confidence inquisitiveness and maturity. The study involves…

Development of a Culturally Valid Counselor Burnout Inventory for Korean Counselors

ERIC Educational Resources Information Center

Yu, Kumlan; Lee, Sang Min; Nesbit, Elisabeth A.

2008-01-01

This article describes the development of the culturally valid Counselor Burnout Inventory. A multistage approach including item translation; item refinement; and evaluation of factorial validity, reliability, and score validity was used to test constructs and validation. Implications for practice and future research are discussed. (Contains 3…

Validity of the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire.

PubMed

João, Thaís Moreira São; Rodrigues, Roberta Cunha Matheus; Gallani, Maria Cecília Bueno Jayme; Miura, Cinthya Tamie Passos; Domingues, Gabriela de Barros Leite; Amireault, Steve; Godin, Gaston

2015-09-01

This study provides evidence of construct validity for the Brazilian version of the Godin-Shephard Leisure-Time Physical Activity Questionnaire (GSLTPAQ), a 1-item instrument used among 236 participants referred for cardiopulmonary exercise testing. The Baecke Habitual Physical Activity Questionnaire (Baecke-HPA) was used to evaluate convergent and divergent validity. The self-reported measure of walking (QCAF) evaluated the convergent validity. Cardiorespiratory fitness assessed convergent validity by the Veterans Specific Activity Questionnaire (VSAQ), peak measured (VO2peak) and maximum predicted (VO2pred) oxygen uptake. Partial adjusted correlation coefficients between the GSLTPAQ, Baecke-HPA, QCAF, VO2pred and VSAQ provided evidence for convergent validity; while divergent validity was supported by the absence of correlations between the GSLTPAQ and the Occupational Physical Activity domain (Baecke-HPA). The GSLTPAQ presents level 3 of evidence of construct validity and may be useful to assess leisure-time physical activity among patients with cardiovascular disease and healthy individuals.

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

Preliminary Face and Construct Validation Study of a Virtual Basic Laparoscopic Skill Trainer

PubMed Central

Sankaranarayanan, Ganesh; Lin, Henry; Arikatla, Venkata S.; Mulcare, Maureen; Zhang, Likun; Derevianko, Alexandre; Lim, Robert; Fobert, David; Cao, Caroline; Schwaitzberg, Steven D.; Jones, Daniel B.

2010-01-01

Abstract Background The Virtual Basic Laparoscopic Skill Trainer (VBLaST™) is a developing virtual-reality–based surgical skill training system that incorporates several of the tasks of the Fundamentals of Laparoscopic Surgery (FLS) training system. This study aimed to evaluate the face and construct validity of the VBLaST™ system. Materials and Methods Thirty-nine subjects were voluntarily recruited at the Beth Israel Deaconess Medical Center (Boston, MA) and classified into two groups: experts (PGY 5, fellow and practicing surgeons) and novice (PGY 1–4). They were then asked to perform three FLS tasks, consisting of peg transfer, pattern cutting, and endoloop, on both the VBLaST and FLS systems. The VBLaST performance scores were automatically computed, while the FLS scores were rated by a trained evaluator. Face validity was assessed using a 5-point Likert scale, varying from not realistic/useful (1) to very realistic/useful (5). Results Face-validity scores showed that the VBLaST system was significantly realistic in portraying the three FLS tasks (3.95 ± 0.909), as well as the reality in trocar placement and tool movements (3.67 ± 0.874). Construct-validity results show that VBLaST was able to differentiate between the expert and novice group (P = 0.015). However, of the two tasks used for evaluating VBLaST, only the peg-transfer task showed a significant difference between the expert and novice groups (P = 0.003). Spearman correlation coefficient analysis between the two scores showed significant correlation for the peg-transfer task (Spearman coefficient 0.364; P = 0.023). Conclusions VBLaST demonstrated significant face and construct validity. A further set of studies, involving improvement to the current VBLaST system, is needed to thoroughly demonstrate face and construct validity for all the tasks. PMID:20201683

Evaluation of Supplemental Nutrition Assistance Program Education: Application of Behavioral Theory and Survey Validation

ERIC Educational Resources Information Center

Wyker, Brett A.; Jordan, Patricia; Quigley, Danielle L.

2012-01-01

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

Development and Validation of a Rating Scale for Wind Jazz Improvisation Performance

ERIC Educational Resources Information Center

Smith, Derek T.

2009-01-01

The purpose of this study was to construct and validate a rating scale for collegiate wind jazz improvisation performance. The 14-item Wind Jazz Improvisation Evaluation Scale (WJIES) was constructed and refined through a facet-rational approach to scale development. Five wind jazz students and one professional jazz educator were asked to record…

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

A test of the validity of the motivational interviewing treatment integrity code.

PubMed

Forsberg, Lars; Berman, Anne H; Kallmén, Håkan; Hermansson, Ulric; Helgason, Asgeir R

2008-01-01

To evaluate the Swedish version of the Motivational Interviewing Treatment Code (MITI), MITI coding was applied to tape-recorded counseling sessions. Construct validity was assessed using factor analysis on 120 MITI-coded sessions. Discriminant validity was assessed by comparing MITI coding of motivational interviewing (MI) sessions with information- and advice-giving sessions as well as by comparing MI-trained practitioners with untrained practitioners. A principal-axis factoring analysis yielded some evidence for MITI construct validity. MITI differentiated between practitioners with different levels of MI training as well as between MI practitioners and advice-giving counselors, thus supporting discriminant validity. MITI may be used as a training tool together with supervision to confirm and enhance MI practice in clinical settings. MITI can also serve as a tool for evaluating MI integrity in clinical research.

Cross-cultural adaptation and validation of the Ankle Osteoarthritis Scale for use in French-speaking populations.

PubMed

Angers, Magalie; Svotelis, Amy; Balg, Frederic; Allard, Jean-Pascal

2016-04-01

The Ankle Osteoarthritis Scale (AOS) is a self-administered score specific for ankle osteoarthritis (OA) with excellent reliability and strong construct and criterion validity. Many recent randomized multicentre trials have used the AOS, and the involvement of the French-speaking population is limited by the absence of a French version. Our goal was to develop a French version and validate the psychometric properties to assure equivalence to the original English version. Translation was performed according to American Association of Orthopaedic Surgeons (AAOS) 2000 guidelines for cross-cultural adaptation. Similar to the validation process of the English AOS, we evaluated the psychometric properties of the French version (AOS-Fr): criterion validity (AOS-Fr v. Western Ontario and McMaster Universities Arthritis Index [WOMAC] and SF-36 scores), construct validity (AOS-Fr correlation to single heel-lift test), and reliability (AOS-Fr test-retest). Sixty healthy individuals tested a prefinal version of the AOS-Fr for comprehension, leading to modifications and a final version that was approved by C. Saltzman, author of the AOS. We then recruited patients with ankle OA for evaluation of the AOS-Fr psychometric properties. Twenty-eight patients with ankle OA participated in the evaluation. The AOS-Fr showed strong criterion validity (AOS:WOMAC r = 0.709 and AOS:SF-36 r = -0.654) and construct validity (r = 0.664) and proved to be reliable (test-retest intraclass correlation coefficient = 0.922). The AOS-Fr is a reliable and valid score equivalent to the English version in terms of psychometric properties, thus is available for use in multicentre trials.

Psychometric evaluation of the Persian version of the Templer's Death Anxiety Scale in cancer patients.

PubMed

Soleimani, Mohammad Ali; Yaghoobzadeh, Ameneh; Bahrami, Nasim; Sharif, Saeed Pahlevan; Sharif Nia, Hamid

2016-10-01

In this study, 398 Iranian cancer patients completed the 15-item Templer's Death Anxiety Scale (TDAS). Tests of internal consistency, principal components analysis, and confirmatory factor analysis were conducted to assess the internal consistency and factorial validity of the Persian TDAS. The construct reliability statistic and average variance extracted were also calculated to measure construct reliability, convergent validity, and discriminant validity. Principal components analysis indicated a 3-component solution, which was generally supported in the confirmatory analysis. However, acceptable cutoffs for construct reliability, convergent validity, and discriminant validity were not fulfilled for the three subscales that were derived from the principal component analysis. This study demonstrated both the advantages and potential limitations of using the TDAS with Persian-speaking cancer patients.

Evaluating instruments for quality: testing convergent validity of the consumer emergency care satisfaction scale.

PubMed

Davis, Barbara A; Kiesel, Cynthia K; McFarland, Julie; Collard, Adressa; Coston, Kyle; Keeton, Ada

2005-01-01

Having reliable and valid instruments is a necessity for nurses and others measuring concepts such as patient satisfaction. The purpose of this article is to describe the use of convergence to test the construct validity of the Davis Consumer Emergency Care Satisfaction Scale (CECSS). Results indicate convergence of the CECSS with the Risser Patient Satisfaction Scale and 2 single-item visual analogue scales, therefore supporting construct validity. Persons measuring patient satisfaction with nurse behaviors in the emergency department can confidently use the CECSS.

Do Self Concept Tests Test Self Concept? An Evaluation of the Validity of Items on the Piers Harris and Coopersmith Measures.

ERIC Educational Resources Information Center

Lynch, Mervin D.; Chaves, John

Items from Peirs-Harris and Coopersmith self-concept tests were evaluated against independent measures on three self-constructs, idealized, empathic, and worth. Construct measurements were obtained with the semantic differential and D statistic. Ratings were obtained from 381 children, grades 4-6. For each test, item ratings and construct measures…

Measuring Educators' Attitudes and Beliefs about Evaluation: Construct Validity and Reliability of the Teacher Evaluation Experience Scale

ERIC Educational Resources Information Center

Reddy, Linda A.; Dudek, Christopher M.; Kettler, Ryan J.; Kurz, Alexander; Peters, Stephanie

2016-01-01

This study presents the reliability and validity of the Teacher Evaluation Experience Scale--Teacher Form (TEES-T), a multidimensional measure of educators' attitudes and beliefs about teacher evaluation. Confirmatory factor analyses of data from 583 teachers were conducted on the TEES-T hypothesized five-factor model, as well as on alternative…

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Toward a Common Language for Measuring Patient Mobility in the Hospital: Reliability and Construct Validity of Interprofessional Mobility Measures.

PubMed

Hoyer, Erik H; Young, Daniel L; Klein, Lisa M; Kreif, Julie; Shumock, Kara; Hiser, Stephanie; Friedman, Michael; Lavezza, Annette; Jette, Alan; Chan, Kitty S; Needham, Dale M

2018-02-01

The lack of common language among interprofessional inpatient clinical teams is an important barrier to achieving inpatient mobilization. In The Johns Hopkins Hospital, the Activity Measure for Post-Acute Care (AM-PAC) Inpatient Mobility Short Form (IMSF), also called "6-Clicks," and the Johns Hopkins Highest Level of Mobility (JH-HLM) are part of routine clinical practice. The measurement characteristics of these tools when used by both nurses and physical therapists for interprofessional communication or assessment are unknown. The purposes of this study were to evaluate the reliability and minimal detectable change of AM-PAC IMSF and JH-HLM when completed by nurses and physical therapists and to evaluate the construct validity of both measures when used by nurses. A prospective evaluation of a convenience sample was used. The test-retest reliability and the interrater reliability of AM-PAC IMSF and JH-HLM for inpatients in the neuroscience department (n = 118) of an academic medical center were evaluated. Each participant was independently scored twice by a team of 2 nurses and 1 physical therapist; a total of 4 physical therapists and 8 nurses participated in reliability testing. In a separate inpatient study protocol (n = 69), construct validity was evaluated via an assessment of convergent validity with other measures of function (grip strength, Katz Activities of Daily Living Scale, 2-minute walk test, 5-times sit-to-stand test) used by 5 nurses. The test-retest reliability values (intraclass correlation coefficients) for physical therapists and nurses were 0.91 and 0.97, respectively, for AM-PAC IMSF and 0.94 and 0.95, respectively, for JH-HLM. The interrater reliability values (intraclass correlation coefficients) between physical therapists and nurses were 0.96 for AM-PAC IMSF and 0.99 for JH-HLM. Construct validity (Spearman correlations) ranged from 0.25 between JH-HLM and right-hand grip strength to 0.80 between AM-PAC IMSF and the Katz Activities of Daily Living Scale. The results were obtained from inpatients in the neuroscience department of a single hospital. The AM-PAC IMSF and JH-HLM had excellent interrater reliability and test-retest reliability for both physical therapists and nurses. The evaluation of convergent validity suggested that AM-PAC IMSF and JH-HLM measured constructs of patient mobility and physical functioning. © 2017 American Physical Therapy Association

A critical evaluation of the validity of episodic future thinking: A clinical neuropsychology perspective.

PubMed

Ward, Amanda M

2016-11-01

Episodic future thinking is defined as the ability to mentally simulate a future event. Although episodic future thinking has been studied extensively in neuroscience, this construct has not been explored in depth from the perspective of clinical neuropsychology. The aim of this critical narrative review is to assess the validity and clinical implications of episodic future thinking. A systematic review of episodic future thinking literature was conducted. PubMed and PsycInfo were searched through July 2015 for review and empirical articles with the following search terms: "episodic future thinking," "future mental simulation," "imagining the future," "imagining new experiences," "future mental time travel," "future autobiographical experience," and "prospection." The review discusses evidence that episodic future thinking is important for adaptive functioning, which has implications for neurological populations. To determine the validity of episodic future thinking, the construct is evaluated with respect to related constructs, such as imagination, episodic memory, autobiographical memory, prospective memory, narrative construction, and working memory. Although it has been minimally investigated, there is evidence of convergent and discriminant validity for episodic future thinking. Research has not addressed the incremental validity of episodic future thinking. Practical considerations of episodic future thinking tasks and related constructs in a clinical neuropsychological setting are considered. The utility of episodic future thinking is currently unknown due to the lack of research investigating the validity of episodic future thinking. Future work is discussed, which could determine whether episodic future thinking is an important missing piece in standard clinical neuropsychological assessment. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The Virtual Shop: A new immersive virtual reality environment and scenario for the assessment of everyday memory.

PubMed

Ouellet, Émilie; Boller, Benjamin; Corriveau-Lecavalier, Nick; Cloutier, Simon; Belleville, Sylvie

2018-06-01

Assessing and predicting memory performance in everyday life is a common assignment for neuropsychologists. However, most traditional neuropsychological tasks are not conceived to capture everyday memory performance. The Virtual Shop is a fully immersive task developed to assess memory in a more ecological way than traditional neuropsychological assessments. Two studies were undertaken to assess the feasibility of the Virtual Shop and to appraise its ecological and construct validity. In study 1, 20 younger and 19 older adults completed the Virtual Shop task to evaluate its level of difficulty and the way the participants interacted with the VR material. The construct validity was examined with the contrasted-group method, by comparing the performance of younger and older adults. In study 2, 35 individuals with subjective cognitive decline completed the Virtual Shop task. Performance was correlated with an existing questionnaire evaluating everyday memory in order to appraise its ecological validity. To add further support to its construct validity, performance was correlated with traditional episodic memory and executive tasks. All participants successfully completed the Virtual Shop. The task had an appropriate level of difficulty that helped differentiate younger and older adults, supporting the feasibility and construct validity of the task. The performance on the Virtual Shop was significantly and moderately correlated with the performance on the questionnaire and on the traditional memory and executive tasks. Results support the feasibility and both the ecological and construct validity of the Virtual Shop. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

A Multitrait-Multimethod Analysis of the Construct Validity of Child Anxiety Disorders in a Clinical Sample

ERIC Educational Resources Information Center

Langer, David A.; Wood, Jeffrey J.; Bergman, R. Lindsey; Piacentini, John C.

2010-01-01

The present study examines the construct validity of separation anxiety disorder (SAD), social phobia (SoP), panic disorder (PD), and generalized anxiety disorder (GAD) in a clinical sample of children. Participants were 174 children, 6 to 17 years old (94 boys) who had undergone a diagnostic evaluation at a university hospital based clinic.…

Sixteen-Item Anxiety Sensitivity Index: Confirmatory Factor Analytic Evidence, Internal Consistency, and Construct Validity in a Young Adult Sample from the Netherlands

ERIC Educational Resources Information Center

Vujanovic, Anka A.; Arrindell, Willem A.; Bernstein, Amit; Norton, Peter J.; Zvolensky, Michael J.

2007-01-01

The present investigation examined the factor structure, internal consistency, and construct validity of the 16-item Anxiety Sensitivity Index (ASI; Reiss Peterson, Gursky, & McNally 1986) in a young adult sample (n = 420) from the Netherlands. Confirmatory factor analysis was used to comparatively evaluate two-factor, three-factor, and…

The Construct Validity of Higher Order Structure-of-Intellect Abilities in a Battery of Tests Emphasizing the Product of Transformations: A Confirmatory Maximum Likelihood Factor Analysis.

ERIC Educational Resources Information Center

Khattab, Ali-Maher; And Others

1982-01-01

A causal modeling system, using confirmatory maximum likelihood factor analysis with the LISREL IV computer program, evaluated the construct validity underlying the higher order factor structure of a given correlation matrix of 46 structure-of-intellect tests emphasizing the product of transformations. (Author/PN)

Brief Report: Preliminary Reliability, Construct Validity and Standardization of the Auditory Behavior Questionnaire (ABQ) for Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Egelhoff, Kelsey; Lane, Alison E.

2013-01-01

The Auditory Behavior Questionnaire (ABQ) evaluates abnormal behavioral responses to auditory stimulation in children with Autism Spectrum Disorder (ASD). This study reports preliminary reliability, construct validity and standardization of the ABQ. Parents of children with ASD aged 7-21 years (n = 165) completed the ABQ on-line. Cronbach's alpha…

Development and Validation of Triarchic Psychopathy Scales from the Multidimensional Personality Questionnaire

PubMed Central

Brislin, Sarah J.; Drislane, Laura E.; Smith, Shannon Toney; Edens, John F.; Patrick, Christopher J.

2015-01-01

Psychopathy is conceptualized by the triarchic model as encompassing three distinct phenotypic constructs: boldness, meanness, and disinhibition. In the current study, the Multidimensional Personality Questionnaire (MPQ), a normal-range personality measure, was evaluated for representation of these three constructs. Consensus ratings were used to identify MPQ items most related to each triarchic (Tri) construct. Scale measures were developed from items indicative of each construct, and scores for these scales were evaluated for convergent and discriminant validity in community (N = 176) and incarcerated samples (N = 240). A cross the two samples, MPQ-Tri scale scores demonstrated good internal consistencies and relationships with criterion measures of various types consistent with predictions based on the triarchic model. Findings are discussed in terms of their implications for further investigation of the triarchic model constructs in preexisting datasets that include the MPQ, in particular longitudinal and genetically informative datasets. PMID:25642934

Risk management in technovigilance: construction and validation of a medical-hospital product evaluation instrument.

PubMed

Kuwabara, Cleuza Catsue Takeda; Evora, Yolanda Dora Martinez; de Oliveira, Márcio Mattos Borges

2010-01-01

With the continuous incorporation of health technologies, hospital risk management should be implemented to systemize the monitoring of adverse effects, performing actions to control and eliminate their damage. As part of these actions, Technovigilance is active in the procedures of acquisition, use and quality control of health products and equipment. This study aimed to construct and validate an instrument to evaluate medical-hospital products. This is a quantitative, exploratory, longitudinal and methodological development study, based on the Six Sigma quality management model, which has as its principle basis the component stages of the DMAIC Cycle. For data collection and content validation, the Delphi technique was used with professionals from the Brazilian Sentinel Hospital Network. It was concluded that the instrument developed permitted the evaluation of the product, differentiating between the results of the tested brands, in line with the initial study goal of qualifying the evaluations performed.

Assessing Reliability and Validity of the "GroPromo" Audit Tool for Evaluation of Grocery Store Marketing and Promotional Environments

ERIC Educational Resources Information Center

Kerr, Jacqueline; Sallis, James F.; Bromby, Erica; Glanz, Karen

2012-01-01

Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

The Bull's-Eye Values Survey: A Psychometric Evaluation

ERIC Educational Resources Information Center

Lundgren, Tobias; Luoma, Jason B.; Dahl, JoAnne; Strosahl, Kirk; Melin, Lennart

2012-01-01

Two studies were conducted to develop and evaluate an instrument intended to identify and measure personal values, values attainment, and persistence in the face of barriers. Study 1 describes a content validity approach to the construction and preliminary validation of the Bull's Eye Values Survey (BEVS), using a sample of institutionalized…

Knee Injury and Osteoarthritis Outcome Score (KOOS): systematic review and meta-analysis of measurement properties.

PubMed

Collins, N J; Prinsen, C A C; Christensen, R; Bartels, E M; Terwee, C B; Roos, E M

2016-08-01

To conduct a systematic review and meta-analysis to synthesize evidence regarding measurement properties of the Knee injury and Osteoarthritis Outcome Score (KOOS). A comprehensive literature search identified 37 eligible papers evaluating KOOS measurement properties in participants with knee injuries and/or osteoarthritis (OA). Methodological quality was evaluated using the COSMIN checklist. Where possible, meta-analysis of extracted data was conducted for all studies and stratified by age and knee condition; otherwise narrative synthesis was performed. KOOS has adequate internal consistency, test-retest reliability and construct validity in young and old adults with knee injuries and/or OA. The ADL subscale has better content validity for older patients and Sport/Rec for younger patients with knee injuries, while the Pain subscale is more relevant for painful knee conditions. The five-factor structure of the original KOOS is unclear. There is some evidence that the KOOS subscales demonstrate sufficient unidimensionality, but this requires confirmation. Although measurement error requires further evaluation, the minimal detectable change for KOOS subscales ranges from 14.3 to 19.6 for younger individuals, and ≥20 for older individuals. Evidence of responsiveness comes from larger effect sizes following surgical (especially total knee replacement) than non-surgical interventions. KOOS demonstrates adequate content validity, internal consistency, test-retest reliability, construct validity and responsiveness for age- and condition-relevant subscales. Structural validity, cross-cultural validity and measurement error require further evaluation, as well as construct validity of KOOS Physical function Short form. Suggested order of subscales for different knee conditions can be applied in hierarchical testing of endpoints in clinical trials. PROSPERO (CRD42011001603). Copyright © 2016 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

The Teenage Nonviolence Test: Concurrent and Discriminant Validity.

ERIC Educational Resources Information Center

Konen, Kristopher; Mayton, Daniel M., II; Delva, Zenita; Sonnen, Melinda; Dahl, William; Montgomery, Richard

This study was designed to document the validity of the Teenage Nonviolence Test (TNT). In this study the concurrent validity of the TNT in various ways, the validity of the TNT using known groups, and the discriminant validity of the TNT by evaluating its relationships with other psychological constructs were assessed. The results showed that the…

Community-Based Participatory Research Conceptual Model: Community Partner Consultation and Face Validity.

PubMed

Belone, Lorenda; Lucero, Julie E; Duran, Bonnie; Tafoya, Greg; Baker, Elizabeth A; Chan, Domin; Chang, Charlotte; Greene-Moton, Ella; Kelley, Michele A; Wallerstein, Nina

2016-01-01

A national community-based participatory research (CBPR) team developed a conceptual model of CBPR partnerships to understand the contribution of partnership processes to improved community capacity and health outcomes. With the model primarily developed through academic literature and expert consensus building, we sought community input to assess face validity and acceptability. Our research team conducted semi-structured focus groups with six partnerships nationwide. Participants validated and expanded on existing model constructs and identified new constructs based on "real-world" praxis, resulting in a revised model. Four cross-cutting constructs were identified: trust development, capacity, mutual learning, and power dynamics. By empirically testing the model, we found community face validity and capacity to adapt the model to diverse contexts. We recommend partnerships use and adapt the CBPR model and its constructs, for collective reflection and evaluation, to enhance their partnering practices and achieve their health and research goals. © The Author(s) 2014.

Validation of the Center for Epidemiological Studies Depression Scale among Korean Adolescents.

PubMed

Heo, Eun-Hye; Choi, Kyeong-Sook; Yu, Je-Chun; Nam, Ji-Ae

2018-02-01

The Center for Epidemiological Studies Depression Scale (CES-D) is designed to measure the current level of depressive symptomatology in the general population. However, no review has examined whether the scale is reliable and valid among children and adolescents in Korea. The purpose of this study was to test whether the Korean form of the CES-D is valid in adolescents. Data were obtained from 1,884 adolescents attending grades 1-3 in Korean middle schools. Reliability was evaluated by internal consistency (Cronbach's alpha). Concurrent validity was evaluated by a correlation analysis between the CES-D and other scales. Construct validity was evaluated by exploratory factor and confirmatory factor analyses. The internal consistency coefficient for the entire group was 0.88. The CES-D was positively correlated with scales that measure negative psychological constructs, such as the State Anxiety Inventory for Children, the Korean Social Anxiety Scale for Children and Adolescents, and the Reynold Suicidal Ideation Questionnaire, but it was negatively correlated with scales that measure positive psychological constructs, such as the Korean version of the Rosenberg Self-Esteem Scale and the Connor-Davidson Resilience Scale-2. The CES-D was examined by three-dimensional exploratory factor analysis, and the three-factor structure of the scale explained 53.165% of the total variance. The variance explained by factor I was 24.836%, that explained by factor II was 15.988%, and that explained by factor III was 12.341%. The construct validity of the CES-D was tested by confirmatory factor analysis, and we applied the entire group's data using a three-factor hierarchical model. The fit index showed a level similar to those of other countries' adolescent samples. The CES-D has high internal consistency and addresses psychological constructs similar to those addressed by other scales. The CES-D showed a three-factor structure in an exploratory factor analysis. The present findings suggest that the CES-D is a useful and reliable tool for measuring depression in Korean adolescents.

[Construction and validation of the "La Salle Instrument" to evaluate the ethical aspects in biomedical research on human beings].

PubMed

Valdivia-Gómez, Gilberto Guzmán; Velasco-Jiménez, María Teresa; Domínguez-González, Alejandro; Meneses-Ruíz, Dulce María; Padilla-García, Raúl Amauri

2017-01-01

Research projects must demonstrate not only a rigorous scientific methodology, but also the ethical aspects that require profound reflection of the reviewers. Current regulations establish criteria for research projects on human health, but many of these aspects are subjective. How can the evaluation of such projects be standardized? This is the main subject of the current project. This project comprises two phases. First, the design and construction of an instrument of evaluation based on the fundamental principles of bioethics, which are autonomy, beneficence, non-maleficence, and justice, and other aspects. The second phase consists of content validation through expert. During the phase of reviewing the instrument, it was necessary to make changes by adding, removing, or changing the concepts or criteria, which lead to the construction of the second version of the format. This new instrument was reviewed and analyzed by using the AGREE II instrument, and this version was validated by experts by greater than 95%. There are some recommendations to analyze the ethical aspects in research protocols involving human subjects, but they define the concepts and criteria to be evaluated. By presenting the criteria to be evaluated individually, the "La Salle instrument" allows the evaluation to be more objective and standardized.

Initial evaluation of psychometric properties of a structured work task application for the Assessment of Work Performance in a constructed environment.

PubMed

Karlsson, Elin A; Liedberg, Gunilla M; Sandqvist, Jan L

2017-06-22

The Swedish Social Insurance Administration has developed a new assessment tool for sickness insurance. This study is a part of the initial evaluation of the application, called the Assessment of Work Performance, Structured Activities, and focuses on evaluation of the psychometric properties of social validity, content validity, and utility. This was a qualitative study using semi-structured telephone interviews with occupational therapists. A convenience sample was used and participants who fulfilled inclusion criteria (n = 15) were interviewed. Data were analyzed using content analysis with a directed approach. The results indicate that the application provides valuable information and that it is socially valid. Assessors found work tasks suitable for a diverse group of clients and reported that clients accepted the assessments. Improvements were suggested, for example, expanding the application with more work tasks. The instrument has benefits; however, further development is desired. The use of a constructed environment in assessments may be a necessary option to supplement a real environment. But depending on organizational factors such as time and other resources, the participants had different opportunities to do so. Further evaluations regarding ecological validity are essential to ensure that assessments are fair and realistic when using constructed environments. Implications for rehabilitation This study indicates that assessment in a constructed environment can provide a secure and protected context for clients being assessed. Psychometric evaluations are a never-ending process and this assessment instrument needs further development. However, this initial evaluation provides guidance in development of the instrument but also what studies to give priority to. It is important to evaluate social validity in order to ensure that clients and assessors perceive assessment methods fair and meaningful. In this study, participants found the work tasks appropriate and usable when assessing their clients but client's perspective must also be included in following studies. This assessment instrument is the only activity-based assessment instrument within the Swedish Social Security Insurance. Psychometric evaluations are important since it affects so many individuals in Sweden.

Construct Definition Using Cognitively Based Evidence: A Framework for Practice

ERIC Educational Resources Information Center

Ketterlin-Geller, Leanne R.; Yovanoff, Paul; Jung, EunJu; Liu, Kimy; Geller, Josh

2013-01-01

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Construct and Predictive Validity of Social Acceptability: Scores From High School Teacher Ratings on the School Intervention Rating Form

ERIC Educational Resources Information Center

Harrison, Judith R.; State, Talida M.; Evans, Steven W.; Schamberg, Terah

2016-01-01

The purpose of this study was to evaluate the construct and predictive validity of scores on a measure of social acceptability of class-wide and individual student intervention, the School Intervention Rating Form (SIRF), with high school teachers. Utilizing scores from 158 teachers, exploratory factor analysis revealed a three-factor (i.e.,…

Using Exploratory and Confirmatory Factor Analysis to Measure Construct Validity of the Traits, Aptitudes, and Behaviors Scale (TABS)

ERIC Educational Resources Information Center

Besnoy, Kevin D.; Dantzler, John; Besnoy, Lisa R.; Byrne, Caitlin

2016-01-01

This study evaluated the construct validity of the Traits, Aptitudes, and Behaviors Scale (TABS). Data for this study were collected from two separate school districts across three different academic years in the Southeastern United States. Of the total sample (N = 2,330), 64.6% of the children were identified as African American, 29.0% as…

Construct validity of the ovine model in endoscopic sinus surgery training.

PubMed

Awad, Zaid; Taghi, Ali; Sethukumar, Priya; Tolley, Neil S

2015-03-01

To demonstrate construct validity of the ovine model as a tool for training in endoscopic sinus surgery (ESS). Prospective, cross-sectional evaluation study. Over 18 consecutive months, trainees and experts were evaluated in their ability to perform a range of tasks (based on previous face validation and descriptive studies conducted by the same group) relating to ESS on the sheep-head model. Anonymized randomized video recordings of the above were assessed by two independent and blinded assessors. A validated assessment tool utilizing a five-point Likert scale was employed. Construct validity was calculated by comparing scores across training levels and experts using mean and interquartile range of global and task-specific scores. Subgroup analysis of the intermediate group ascertained previous experience. Nonparametric descriptive statistics were used, and analysis was carried out using SPSS version 21 (IBM, Armonk, NY). Reliability of the assessment tool was confirmed. The model discriminated well between different levels of expertise in global and task-specific scores. A positive correlation was noted between year in training and both global and task-specific scores (P < .001). Experience of the intermediate group was variable, and the number of ESS procedures performed under supervision had the highest impact on performance. This study describes an alternative model for ESS training and assessment. It is also the first to demonstrate construct validity of the sheep-head model for ESS training. © 2014 The American Laryngological, Rhinological and Otological Society, Inc.

[Job stress and quality of life of primary care health-workers: evidence of validity of the PECVEC questionnaire].

PubMed

Fernández-López, Juan Antonio; Fernández-Fidalgo, María; Martín-Payo, Rubén; Rödel, Andreas

2007-08-01

To evaluate the relationship between Health-Related Quality of Life (HRQL) and stress at work among Primary Care workers, as evidence of the construct validity of the Spanish version (PECVEC) of the profile of quality of life in the chronically ill (PLC) questionnaire. In addition, to check its other psychometric properties. Cross-sectional study. Eighteen primary care centres in Health Area IV, Asturias (Oviedo), Spain, sharing similar socio-demographic conditions. Two hundred and thirty-three primary care nurses and physicians. HRQL was evaluated by the 6 general dimensions of the Spanish version of the PLC. Stress at work was evaluated by the three scales of the Effort-Reward Imbalance (ERI) questionnaire. The construct validity of the PECVEC was assessed by testing the inverse associations of QoL dimensions and job stress ones, when the most important confuser variables were monitored. The non-response rate was low (<3%), and no floor effects and only small ceiling effects were observed. Internal consistency analysis and exploratory and confirmatory factor analysis demonstrated high reliability, factorial validity and convergent/divergent validity of the PECVEC. The PECVEC demonstrates adequate psychometric properties for evaluating HRQL in healthy subjects.

Development and validation of the brief esophageal dysphagia questionnaire.

PubMed

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

Development and Validation of the Brief Esophageal Dysphagia Questionnaire

PubMed Central

Taft, Tiffany H.; Riehl, Megan; Sodikoff, Jamie B.; Kahrilas, Peter J.; Keefer, Laurie; Doerfler, Bethany; Pandolfino, John E.

2017-01-01

Background Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. Methods 1,638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. Key Results The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. Conclusions & Inferences The BEDQ represents a rapid, reliable and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. PMID:27380834

Using Office Discipline Referral Data for Decision Making about Student Behavior in Elementary and Middle Schools: An Empirical Evaluation of Validity

ERIC Educational Resources Information Center

Irvin, Larry K.; Horner, Robert H.; Ingram, Kimberly; Todd, Anne W.; Sugai, George; Sampson, Nadia Katul; Boland, Joseph B.

2006-01-01

In this evaluation we used Messick's construct validity as a conceptual framework for an empirical study assessing the validity of use, utility, and impact of office discipline referral (ODR) measures for data-based decision making about student behavior in schools. The Messick approach provided a rubric for testing the fit of our theory of use of…

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

PubMed

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Construct validity of the items on the Stroke Specific Quality of Life (SS-QOL) questionnaire that evaluate the participation component of the International Classification of Functioning, Disability and Health.

PubMed

Silva, Soraia Micaela; Corrêa, Fernanda Ishida; Pereira, Gabriela Santos; Faria, Christina Danielli Coelho de Morais; Corrêa, João Carlos Ferrari

2018-01-01

Analyze the construct validity and internal consistency of the Stroke Specific Quality of Life (SS-QOL) items that address the participation component of the ICF as well as analyze the ceiling and floor effects. One hundred subjects were analyzed: 85 community-dwelling and 15 institutionalized individuals. The analysis of construct validity was performed using classic psychometrics: (1) the comparison of known groups (individuals without restriction to participation vs. those with restriction to participation) using the Mann-Whitney test and (2) convergent validity - correlation between the scores on the SS-QOL items that address participation and the subscale scores of measures used to evaluate the similar constructs and concepts [the Short-Form Health Survey (SF-36), Functional Independence Measure (FIM) and grip strength test]. Spearman's correlation coefficients were calculated for this analysis. Cronbach's α was used for the analysis of internal consistency and both the ceiling and floor effects were analyzed. The level of significance for all analyses was α = 0.05. The a priori hypotheses regarding construct validity were partially demonstrated, as only five of the eight domains exhibited positive moderate to strong correlations (r > 0.40) with measures that address constructs similar to those addressed on the SS-QOL questionnaire. The items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. The ceiling and floor effects were considered adequate for the total SS-QOL score, but beyond acceptable standards for some domains. The 26 items of the SS-QOL questionnaire measure a multidimensional construct and therefore do not only address participation. However, the items demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. Implications for rehabilitation The 26 items of the SS-QOL questionnaire demonstrated adequate internal consistency and are capable of differentiating individuals with and without restriction to participation. The present findings can guide healthcare professionals regarding the selection of an assessment tool for the evaluation of post-stroke participation. The findings can lead to consistent and standardization evaluations, which facilitates comparisons and discussion on functional health and social participation after stroke.

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs in an ethical and scientific manner in order to obtain a quality diagnosis in this field.

Development and initial psychometric evaluation of patient-reported outcome questionnaires to evaluate the symptoms and impact of hidradenitis suppurativa.

PubMed

Kimball, Alexa B; Sundaram, Murali; Banderas, Benjamin; Foley, Catherine; Shields, Alan L

2018-03-01

Two patient-reported outcome (PRO) questionnaires, the Hidradenitis Suppurativa Symptom Assessment (HSSA) and Hidradenitis Suppurativa Impact Assessment (HSIA), were developed to measure signs, symptoms and impacts of HS in treatment efficacy studies. In accordance with FDA guidelines and published best practices, four stages of research were conducted to create the questionnaires: concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Subjects (N = 20) who participated in the concept elicitation stage reported 15 unique HS-related signs and symptoms and 51 impacts. Following this, eight sign and symptom concepts and 21 impacts were selected for construction of the HSSA and HSIA, respectively. During content evaluation, cognitive debriefing interviews with HS subjects (N = 20) confirmed subjects could read, comprehend and meaningfully respond to both questionnaires. Modifications made after this stage of work resulted in a nine-item HSSA and a 17-item HSIA. The HSSA and HSIA were subsequently entered into a US-based observational study (N = 40), and the scores produced by each were found to be reliable, construct valid, and able to distinguish among clinically distinct groups. The HSSA and HSIA are content-valid, HS-specific, PRO questionnaires with demonstrated ability to generate reliable, valid scores when administered to patients with HS in a research setting.

Reliability and Validity of "Parents' Evaluation of Responsible Behaviors of 5-6 Year Old Children" Scale

ERIC Educational Resources Information Center

Polat, Ozgul; Dagal, Asude B.

2013-01-01

This study is aimed at developing a scale (Parents' Evaluation of Responsible Behaviors of 5-6 Year Old Children) for measuring parents' evaluation of their 5-6 year-old children's responsible behaviors. The construct validity of the scale was tested by Factor Analysis. Factor analysis determined that the scale can be clustered under 10 factors.…

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Cross-cultural adaptation of the Disability of Arm, Shoulder, and Hand questionnaire: Spanish for Puerto Rico Version

PubMed Central

Mulero-Portela, Ana L.; Colón-Santaella, Carmen L.; Cruz-Gomez, Cynthia

2010-01-01

The purpose of this study was to perform a cross-cultural adaptation of the Disability of Arm, Shoulder, and Hand (DASH) questionnaire to Spanish for Puerto Rico. Five steps were followed for the cross-cultural adaptation: forward translations into Spanish for Puerto Rico, synthesis of the translations, back translations into English, revision by an expert committee, and field test of the prefinal version. Psychometric characteristics of reliability and construct validity were evaluated for the final version. Internal consistency of the final version was high (Cronbach's α = 0.97) and item-to-total correlations were moderate (range from 0.44 to 0.85). Construct validity was evaluated by correlating the DASH with the scales of the Functional Assessment of Cancer Therapy - Breast. Fair to moderate correlations found in this study between the DASH and most scales of the Functional Assessment of Cancer Therapy - Breast support the construct validity of the Puerto Rico-Spanish DASH. The final version of the questionnaire was revised and approved by the Institute for Work and Health of Canada. Revisions to the original DASH English version are recommended. This version of the DASH is valid and reliable, and it can be used to evaluate outcomes in both clinical and research settings. PMID:19901616

[Evaluation of Suicide Risk Levels in Hospitals: Validity and Reliability Tests].

PubMed

Macagnino, Sandro; Steinert, Tilman; Uhlmann, Carmen

2018-05-01

Examination of in-hospital suicide risk levels concerning their validity and their reliability. The internal suicide risk levels were evaluated in a cross sectional study of in 163 inpatients. A reliability check was performed via determining interrater-reliability of senior physician, therapist and the responsible nurse. Within the scope of the validity check, we conducted analyses of criterion validity and construct validity. For the total sample an "acceptable" to "good" interrater-reliability (Kendalls W = .77) of suicide risk levels were obtained. Schizophrenic disorders showed the lowest values, for personality disorders we found the highest level of interrater-reliability. When examining the criterion validity, Item-9 of the BDI-II is substantial correlated to our suicide risk levels (ρ m  = .54, p < .01). Within the scope of construct validity check, affective disorders showed the highest correlation (ρ = .77), compatible also with "convergent validity". They differed with schizophrenic disorders which showed the least concordance (ρ = .43). In-hospital suicide risk levels may represent an important contribution to the assessment of suicidal behavior of inpatients experiencing psychiatric treatment due to their overall good validity and reliability. © Georg Thieme Verlag KG Stuttgart · New York.

The Reliability and Validity of a Scale to Measure Teachers' Attitudes toward Integration in an Australian Context.

ERIC Educational Resources Information Center

Roberts, Clare; Pratt, Chris

1988-01-01

The study evaluated the psychometric properties of reliability and construct validity of the Attitude Toward Mainstreaming Scale (ATMS) in an Australian context. It was concluded that the scale is both reliable and factorially valid in an Australian context. (Author/DB)

Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

NASA Astrophysics Data System (ADS)

Kurnia, Feni; Rosana, Dadan; Supahar

2017-08-01

This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

Evaluating and comparing Singaporean and Taiwanese eighth graders' conceptions of science assessment

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tan, Aik-Ling; Lee, Min-Hsien; Tsai, Chin-Chung

2017-10-01

Background: Researchers have indicated that assessment practices and methods should support learners' construction of meaningful understanding of knowledge. Understanding students' conceptions of assessment will enable us to construct more realistic, valid and fair assessments. Learners' conceptualization of assessment would be imperative to serve as an essential reference to evaluate their learning progress.

Development and Validation of a Novel Robotic Procedure Specific Simulation Platform: Partial Nephrectomy.

PubMed

Hung, Andrew J; Shah, Swar H; Dalag, Leonard; Shin, Daniel; Gill, Inderbir S

2015-08-01

We developed a novel procedure specific simulation platform for robotic partial nephrectomy. In this study we prospectively evaluate its face, content, construct and concurrent validity. This hybrid platform features augmented reality and virtual reality. Augmented reality involves 3-dimensional robotic partial nephrectomy surgical videos overlaid with virtual instruments to teach surgical anatomy, technical skills and operative steps. Advanced technical skills are assessed with an embedded full virtual reality renorrhaphy task. Participants were classified as novice (no surgical training, 15), intermediate (less than 100 robotic cases, 13) or expert (100 or more robotic cases, 14) and prospectively assessed. Cohort performance was compared with the Kruskal-Wallis test (construct validity). Post-study questionnaire was used to assess the realism of simulation (face validity) and usefulness for training (content validity). Concurrent validity evaluated correlation between virtual reality renorrhaphy task and a live porcine robotic partial nephrectomy performance (Spearman's analysis). Experts rated the augmented reality content as realistic (median 8/10) and helpful for resident/fellow training (8.0-8.2/10). Experts rated the platform highly for teaching anatomy (9/10) and operative steps (8.5/10) but moderately for technical skills (7.5/10). Experts and intermediates outperformed novices (construct validity) in efficiency (p=0.0002) and accuracy (p=0.002). For virtual reality renorrhaphy, experts outperformed intermediates on GEARS metrics (p=0.002). Virtual reality renorrhaphy and in vivo porcine robotic partial nephrectomy performance correlated significantly (r=0.8, p <0.0001) (concurrent validity). This augmented reality simulation platform displayed face, content and construct validity. Performance in the procedure specific virtual reality task correlated highly with a porcine model (concurrent validity). Future efforts will integrate procedure specific virtual reality tasks and their global assessment. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Development and Validation of an Instrument for Evaluating Inquiry-Based Tasks in Science Textbooks

ERIC Educational Resources Information Center

Yang, Wenyuan; Liu, Enshan

2016-01-01

This article describes the development and validation of an instrument that can be used for content analysis of inquiry-based tasks. According to the theories of educational evaluation and qualities of inquiry, four essential functions that inquiry-based tasks should serve are defined: (1) assisting in the construction of understandings about…

Translation and validation of a Nepalese version of the Psychosocial Impact of Dental Aesthetic Questionnaire (PIDAQ).

PubMed

Singh, Varun Pratap; Singh, Rajkumar

2014-03-01

The aim of this study was to develop a reliable and valid Nepali version of the Psychosocial Impact of Dental Aesthetic Questionnaire (PIDAQ). Cross-sectional descriptive validation study. B.P. Koirala Institute of Health Sciences, Dharan, Nepal. A rigorous translation process including conceptual and semantic evaluation, translation, back translation and pre-testing was carried out. Two hundred and fifty-two undergraduates, including equal numbers of males and females with an age ranging from 18 to 29 years (mean age: 22·33±2·114 years), participated in this study. Reliability was assessed by Cronbach's alpha coefficient and the coefficient of correlation was used to assess correlation between items and test-retest reliability. The construct validity was tested by factorial analysis. Convergent construct validity was tested by comparison of PIDAQ scores with the aesthetic component of the index of orthodontic treatment needs (IOTN-AC) and perception of occlusion scale (POS), respectively. Discriminant construct validity was assessed by differences in score for those who demand treatment and those who did not. The response rate was 100%. One hundred and twenty-three individuals had a demand for orthodontic treatment. The Nepali PIDAQ had excellent reliability with Cronbach's alpha of 0·945, corrected item correlation between 0·525 and 0·790 and overall test-retest reliability of 0·978. The construct validity was good with formation of a new sub-domain 'Dental self-consciousness'. The scale had good correlation with IOTN-AC and POS fulfilling convergent construct validity. The discriminant construct validity was proved by significant differences in scores for subjects with demand and without demand for treatment. To conclude, Nepali version of PIDAQ has good psychometric properties and can be used effectively in this population group for further research.

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

PubMed

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling

PubMed Central

Koller, Ingrid; Levenson, Michael R.; Glück, Judith

2017-01-01

The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. PMID:28270777

Construct validity, test-retest reliability and internal consistency of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) in patients with carpal tunnel syndrome.

PubMed

Buntragulpoontawee, Montana; Phutrit, Suphatha; Tongprasert, Siam; Wongpakaran, Tinakon; Khunachiva, Jeeranan

2018-03-27

This study evaluated additional psychometric properties of the Thai version of the disabilities of the arm, shoulder and hand questionnaire (DASH-TH) which included, test-retest reliability, construct validity, internal consistency of in patients with carpal tunnel syndrome. As for determining construct validity, the Thai EuroQOL questionnaire (EQ-5D-5L) was also administered in order to examine convergent and divergent validity. Fifty patients completed both questionnaires. The DASH-TH showed excellent test-retest reliability (intraclass correlation coefficient = 0.811) and internal consistency (Cronbach's alpha = 0.911). The exploratory factor analysis yielded a six-factor solution while the confirmatory factor analysis denoted that the hypothesized model adequately fit the data with a comparative fit index of 0.967 and a Tucker-Lewis index of 0.964. The related subscales between the DASH-TH and the Thai EQ-5D-5L were significantly correlated, indicating the DASH-TH's convergent and discriminant validity. The DASH-TH demonstrated good reliability, internal consistency construct validity, and multidimensionality, in assessing the upper extremity function in carpal tunnel syndrome patients.

Development and psychometric characteristics of a new domain of the stanford faculty development program instrument.

PubMed

Owolabi, Mayowa O

2014-01-01

Teacher's attitude domain, a pivotal aspect of clinical teaching, is missing in the Stanford Faculty Development Program Questionnaire (SFDPQ), the most widely used student-based assessment method of clinical teaching skills. This study was conducted to develop and validate the teacher's attitude domain and evaluate the validity and internal consistency reliability of the augmented SFDPQ. Items generated for the new domain included teacher's enthusiasm, sobriety, humility, thoroughness, empathy, and accessibility. The study involved 20 resident doctors assessed once by 64 medical students using the augmented SFDPQ. Construct validity was explored using correlation among the different domains and a global rating scale. Factor analysis was performed. The response rate was 94%. The new domain had a Cronbach's alpha of 0.89, with 1-factor solution explaining 57.1% of its variance. It showed the strongest correlation to the global rating scale (rho = 0.71). The augmented SFDPQ, which had a Cronbach's alpha of 0.93, correlated better (rho = 0.72, p < 0.00001) to the global rating scale than the original SFDPQ (rho = 0.67, p < 0.00001). The new teacher's attitude domain exhibited good internal consistency and construct and factorial validity. It enhanced the content and construct validity of the SFDPQ. The validated construct of the augmented SFDPQ is recommended for design and evaluation of basic and continuing clinical teaching programs. © 2014 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Reliability and construct validity of the Participation in Life Activities Scale for children and adolescents with asthma: an instrument evaluation study.

PubMed

Kintner, Eileen K; Sikorskii, Alla

2008-06-04

The purpose of this study was to evaluate the reliability and construct validity of the Participation in Life Activities Scale, an instrument designed to measure older school-age child and early adolescent level of involvement in chosen pursuits. A cross-sectional design was used. The convenience sample consisted of 313 school-age children and early adolescents with asthma, ages 9-15 years. The self-report summative scale of interest is a 3-indicator survey. Higher scores are reflective of higher levels of participation. Internal consistency reliability and construct validity for the entire sample and sub groups of the sample were evaluated. The instrument was deemed sound for the entire sample as well as sub groups based on sex, race, age, socioeconomic status, and severity of illness. Cronbach's alpha coefficient for internal consistency reliability for the entire sample was .74. Exploratory factor analysis indicated a single component solution (loadings .79-.85) accounting for 66% of the explained variance. Construct validity was established by testing the posed relationship between participation in life activities scores and severity of illness. Confirmatory factor analysis revealed a good fit between the data and specified model, chi2(10, n = 302) = 8.074, p = .62. This instrument could be used (a) in clinical settings to diagnose restricted participation in desired activities, guide decision-making about treatment plans to increase participation, and motivate behavioral change in the management of asthma; and (b) in research settings to explore factors influencing and consequences of restricted and unrestricted participation, and as an outcome measure to evaluate the effectiveness of programs designed to foster child and early adolescent management of asthma.

Validation of the Narrowing Beam Walking Test in Lower Limb Prosthesis Users.

PubMed

Sawers, Andrew; Hafner, Brian

2018-04-11

To evaluate the content, construct, and discriminant validity of the Narrowing Beam Walking Test (NBWT), a performance-based balance test for lower limb prosthesis users. Cross-sectional study. Research laboratory and prosthetics clinic. Unilateral transtibial and transfemoral prosthesis users (N=40). Not applicable. Content validity was examined by quantifying the percentage of participants receiving maximum or minimum scores (ie, ceiling and floor effects). Convergent construct validity was examined using correlations between participants' NBWT scores and scores or times on existing clinical balance tests regularly administered to lower limb prosthesis users. Known-groups construct validity was examined by comparing NBWT scores between groups of participants with different fall histories, amputation levels, amputation etiologies, and functional levels. Discriminant validity was evaluated by analyzing the area under each test's receiver operating characteristic (ROC) curve. No minimum or maximum scores were recorded on the NBWT. NBWT scores demonstrated strong correlations (ρ=.70‒.85) with scores/times on performance-based balance tests (timed Up and Go test, Four Square Step Test, and Berg Balance Scale) and a moderate correlation (ρ=.49) with the self-report Activities-specific Balance Confidence scale. NBWT performance was significantly lower among participants with a history of falls (P=.003), transfemoral amputation (P=.011), and a lower mobility level (P<.001). The NBWT also had the largest area under the ROC curve (.81) and was the only test to exhibit an area that was statistically significantly >.50 (ie, chance). The results provide strong evidence of content, construct, and discriminant validity for the NBWT as a performance-based test of balance ability. The evidence supports its use to assess balance impairments and fall risk in unilateral transtibial and transfemoral prosthesis users. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Validity and reliability of the Brazilian version of the Work Ability Index questionnaire.

PubMed

Martinez, Maria Carmen; Latorre, Maria do Rosário Dias de Oliveira; Fischer, Frida Marina

2009-06-01

To evaluate the validity and reliability of the Portuguese language version of a work ability index. Cross sectional survey of a sample of 475 workers from an electrical company in the state of Sao Paulo, Southeastern Brazil (spread across ten municipalities in the Campinas area), carried out in 2005. The following aspects of the Brazilian version of the Work Ability Index were evaluated: construct validity, using factorial exploratory analysis, and discriminant capacity, by comparing mean Work Ability Index scores in two groups with different absenteeism levels; criterion validity, by determining the correlation between self-reported health and Work Ability Index score; and reliability, using Cronbach's alpha to determine the internal consistency of the questionnaire. Factorial analysis indicated three factors in the work ability construct: issues pertaining to 'mental resources' (20.6% of the variance), self-perceived work ability (18.9% of the variance), and presence of diseases and health-related limitations (18.4% of the variance). The index was capable of discriminating workers according to levels of absenteeism, identifying a significantly lower (p<0.0001) mean score among subjects with high absenteeism (37.2 points) when compared to those with low absenteeism (42.3 points). Criterion validity analysis showed a correlation between the index and all dimensions of health status analyzed (p<0.0001). Reliability of the index was high, with a Cronbach's alpha of 0.72. The Brazilian version of the Work Ability Index showed satisfactory psychometric properties with respect to construct validity, thus constituting an appropriate option for evaluating work ability in both individual and population-based settings.

Translation and validation of the Dutch new Knee Society Scoring System ©.

PubMed

Van Der Straeten, Catherine; Witvrouw, Erik; Willems, Tine; Bellemans, Johan; Victor, Jan

2013-11-01

A new version of The Knee Society Knee Scoring System(©) (KSS) has recently been developed. Before this scale can be used in non-English-speaking populations, it has to be translated and validated for a particular population. We evaluated the construct and content validity, the test-retest reliability, and the internal consistency of the Dutch version of the New Knee Society KSS. A Dutch translation was performed using a forward-backward translation protocol. We tested the construct validity of the Dutch New KSS by comparing it with the Dutch versions of the WOMAC, Knee Injury and Osteoarthritis Outcome Score (KOOS), and SF-12 scores in 137 patients undergoing total knee arthroplasty (TKA). Content validity was assessed by comparing pre- and postoperative scores and by checking floor and ceiling effects. To evaluate test-retest reliability and consistency, 47 patients completed the questionnaire a second time with a mean of 8 days interval (range, 2-20 days) between tests. Construct validity was demonstrated because the Dutch New KSS correlated well with the Dutch WOMAC (r = -0.751; p < 0.001), Dutch KOOS (r = -0.723; p < 0.001), and Dutch SF-12 (r = 0.569; p < 0.001). There was a significant difference between pre- and postoperative scores (p < 0.001) in line with the other scores. Test-retest reliability proved excellent with an intraclass correlation coefficient between 0.73 and 0.92 depending on the domain tested. Consistency as indicated by Cronbach's alpha ranging from 0.84 to 0.96 was good to excellent. As demonstrated by the validation procedure, the Dutch New KSS is an excellent instrument to evaluate TKA outcome in Dutch-speaking patients.

Measuring Steady-State Oxygen Uptake during the 6-Min Walk Test in Adults with Cerebral Palsy: Feasibility and Construct Validity

ERIC Educational Resources Information Center

Maltais, Desiree B.; Robitaille, Nancy-Michelle; Dumas, Francine; Boucher, Normand; Richards, Carol L.

2012-01-01

This study evaluated the feasibility of measuring steady-state oxygen uptake (V[Combining Dot Above]O[subscript 2]) during the 6-min walk test (6MWT) in adults with cerebral palsy (CP) who walk without support and whether there is construct validity for net 6MWT V[Combining Dot Above]O[subscript 2] as a measure of their walking ability.…

Reliability of the AMA Guides to the Evaluation of Permanent Impairment.

PubMed

Forst, Linda; Friedman, Lee; Chukwu, Abraham

2010-12-01

AMA's Guides to the Evaluation of Permanent Impairment is used to rate loss of function and determine compensation and ability to work after injury or illness; however, there are few studies that evaluate reliability or construct validity. To evaluate the reliability of the fifth and sixth editions for back injury; to determine best methods for further study. Intra-class correlation coefficients within and between raters were relatively high. There was wider variability for individual cases. Impairment ratings were lower and correlated less well for the sixth edition, though confidence intervals overlapped. The sixth edition may not be an improvement over the fifth. A research agenda should include investigations of reliability and construct validity for different body sites and organ systems along the entire rating scale and among different categories of raters.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Cataract surgeons outperform medical students in Eyesi virtual reality cataract surgery: evidence for construct validity.

PubMed

Selvander, Madeleine; Asman, Peter

2013-08-01

To investigate construct validity for modules hydromaneuvers and phaco on the Eyesi surgical simulator. Seven cataract surgeons and 17 medical students performed capsulorhexis, hydromaneuvers, phaco, navigation, forceps, cracking and chopping modules in a standardized manner. Three trials were performed on each module (two on phaco) in the above order. Performance parameters as calculated by the simulator for each trial were saved. Video recordings of the second trial of the modules capsulorhexis, hydromaneuvers and phaco were evaluated with the modified Objective Structured Assessment of Surgical Skill (OSATS) and Objective Structured Assessment of Cataract Surgical Skill (OSACSS) tools. Cataract surgeons outperformed medical students with regard to overall score on capsulorhexis (p < 0.001, p = 0.035, p = 0.010 for the tree iterations, respectively), navigation (p = 0.024, p = 0.307, p = 0.007), forceps (p = 0.017, p = 0.03, p = 0.028). Less obvious differences in overall score were found for modules cracking and chopping (p = 0.266, p = 0.022, p = 0.324) and phaco (p = 0.011, p = 0.081 for the two iterations, respectively). No differences in overall score were found on hydromaneuvers (p = 0.588, p = 0.503, p = 0.773), but surgeons received better scores from the evaluations of the modified OSATS (p = 0.001) and OSACSS (capsulorhexis, p = 0.003; hydromaneuvers, p = 0.017; phaco, p = 0.001). Construct validity was found on several modules previously not investigated (phaco, hydromaneuvers, cracking and chopping, navigation), and our results confirm previously demonstrated construct validity for capsulorhexis and forceps modules. Interestingly, validation of the hydromaneuvers module required OSACSS video evaluation tool. A further development of the scoring system in the simulator for the hydromaneuvers module would be advantageous and make training and evaluation of progress more accessible and immediate. © 2012 The Authors. Acta Ophthalmologica © 2012 Acta Ophthalmologica Scandinavica Foundation.

Translation and psychometric evaluation of Persian versions of Burn Specific Pain Anxiety Scale and Impact of Event Scale.

PubMed

Ghezeljeh, Tahereh Najafi; Ardebili, Fatimah Mohades; Rafii, Forough; Hagani, Hamid

2013-09-01

Burn as a traumatic life incident manifests severe pain and psychological problems. Specific instruments are needed to evaluate burn patients' psychological issues related to the injury. The aim of this study was to translate and evaluate the reliability and validity of the Persian versions of Impact of Burn Specific Pain Anxiety scale (BSPAS) and Impact of Event Scale (IES). In this cross-sectional study, convenience sampling method was utilized to select 55 Iranian hospitalized burn patients. Combined translation was utilized for translating scales. Alpha cronbach, item-total correlation, convergent and discriminative validity were evaluated. The Cronbach's α for both BSPAS- and IES-Persian version was 0.96. Item-total correlation coefficients ranged from 0.70 to 0.90. Convergent construct validity was confirmed by indicating high correlation between the scales designed to measure the same concepts. The mean score of BSPAS- and IES-Persian version was lower for individuals with a lower TBSA burn percentage which assessed discriminative construct validity of scales. BSPAS- and IES-Persian version showed high internal consistency and good validity for the assessment of burn psychological outcome in hospitalized burn patients. Future studies are needed to determine repeatability, factor structure, sensitivity and specificity of the scales. Copyright © 2013 Elsevier Ltd and ISBI. All rights reserved.

Full immersion simulation: validation of a distributed simulation environment for technical and non-technical skills training in Urology.

PubMed

Brewin, James; Tang, Jessica; Dasgupta, Prokar; Khan, Muhammad S; Ahmed, Kamran; Bello, Fernando; Kneebone, Roger; Jaye, Peter

2015-07-01

To evaluate the face, content and construct validity of the distributed simulation (DS) environment for technical and non-technical skills training in endourology. To evaluate the educational impact of DS for urology training. DS offers a portable, low-cost simulated operating room environment that can be set up in any open space. A prospective mixed methods design using established validation methodology was conducted in this simulated environment with 10 experienced and 10 trainee urologists. All participants performed a simulated prostate resection in the DS environment. Outcome measures included surveys to evaluate the DS, as well as comparative analyses of experienced and trainee urologist's performance using real-time and 'blinded' video analysis and validated performance metrics. Non-parametric statistical methods were used to compare differences between groups. The DS environment demonstrated face, content and construct validity for both non-technical and technical skills. Kirkpatrick level 1 evidence for the educational impact of the DS environment was shown. Further studies are needed to evaluate the effect of simulated operating room training on real operating room performance. This study has shown the validity of the DS environment for non-technical, as well as technical skills training. DS-based simulation appears to be a valuable addition to traditional classroom-based simulation training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings

PubMed Central

Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E

2005-01-01

Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998

Instruments to measure cancer management knowledge of rural health care providers.

PubMed

Elliott, T E; Regal, R R; Renier, C M; Crouse, B J; Gangeness, D E; Pharmd; Elliott, B A; Witrak, M

2001-01-01

Instruments to measure cancer management knowledge of rural physicians, nurses, and pharmacists were needed to evaluate the effect of an educational intervention. Since such instruments did not exist, the authors designed and validated a new instrument for each discipline. The design and validation process for these instruments are described. These three instruments were shown to be practical and to have high content and construct validity. Content validation demonstrated that all items were rated as essential or useful by 90% or more of the respondents. Construct validation show highly significant differences in mean scores among several levels of learners and practitioners as expected. These instruments may be useful to other investigators for measuring cancer management knowledge of rural physicians, nurses, and pharmacists.

Enhancing the Validity of a Quality of Life Measure for Autistic People

ERIC Educational Resources Information Center

McConachie, Helen; Mason, David; Parr, Jeremy R.; Garland, Deborah; Wilson, Colin; Rodgers, Jacqui

2018-01-01

Accurate measurement of quality of life (QoL) is important for evaluation of autism services and trials of interventions. We undertook psychometric validation of the World Health Organisation measure--WHOQoL-BREF, examined construct validity of the WHO Disabilities module and developed nine additional autism-specific items (ASQoL) from extensive…

The Support Appraisal for Work Stressors Inventory: Construction and Initial Validation

ERIC Educational Resources Information Center

Lawrence, Sandra A.; Gardner, John; Callan, Victor J.

2007-01-01

In order to better understand the role of perceived available support in buffering the negative effects of workplace stressors, a new multidimensional measure of perceived available support, the SAWS, was developed. Initial item development and content validation were conducted, followed by scale evaluation and validation. Two samples of 190 and…

Analyzing the Validity of the Adult-Adolescent Parenting Inventory for Low-Income Populations

ERIC Educational Resources Information Center

Lawson, Michael A.; Alameda-Lawson, Tania; Byrnes, Edward

2017-01-01

Objectives: The purpose of this study was to examine the construct and predictive validity of the Adult-Adolescent Parenting Inventory (AAPI-2). Methods: The validity of the AAPI-2 was evaluated using multiple statistical methods, including exploratory factor analysis, confirmatory factor analysis, and latent class analysis. These analyses were…

Designing a valid and reliable Likert attitude scale on the generation of electricity from nuclear power plants

DOE Office of Scientific and Technical Information (OSTI.GOV)

Calhoun, L.D.

A 15-step flowchart model was applied to the construction of a 20-item long form and a 6-item short form of the scale. Both scales were field-tested on 829 respondents representing a diverse range of subjects: high school juniors and seniors, nuclear engineering students, pre-service teachers, and members of a citizens action group. Both scales are available for immediate use. The 20-item scale appears to be reliable, content valid, and construct valid. Content validity was examined through factor analysis and the use of two separate juries of nuclear experts. Construct validity was examined by application of the known-groups approach. Scale reliabilitymore » and homogeneity were evidenced by a 0.93 coefficient alpha, a range of positive interim correlations of 0.15 to 0.73, and a range of adjusted item-total correlations of 0.46 to 0.80. The 20-item scale also has evaluative quality; means ranged from 2.80 to 3.70. Content validity for the 6-item scale was examined by a jury of nuclear experts. An obtained coefficient alpha of 0.82, a range of interim correlations of 0.51 to 0.72 suggest the scale is reliable and homogeneous. The 6-item short form also appears to have evaluative quality; means ranged from 2.37 to 3.18.« less

Validation study of a Chinese version of Partners in Health in Hong Kong (C-PIH HK).

PubMed

Chiu, Teresa Mei Lee; Tam, Katharine Tai Wo; Siu, Choi Fong; Chau, Phyllis Wai Ping; Battersby, Malcolm

2017-01-01

The Partners in Health (PIH) scale is a measure designed to assess the generic knowledge, attitudes, behaviors, and impacts of self-management. A cross-cultural adaptation of the PIH for use in Hong Kong was evaluated in this study. This paper reports the validity and reliability of the Chinese version of PIH (C-PIH[HK]). A 12-item PIH was translated using forward-backward translation technique and reviewed by individuals with chronic diseases and health professionals. A total of 209 individuals with chronic diseases completed the scale. The construct validity, internal consistency, and test-retest reliability were evaluated in two waves. The findings in Wave 1 (n = 73) provided acceptable psychometric properties of the C-PIH(HK) but supported the adaptation of question 5 to improve the cultural relevance, validity, and reliability of the scale. An adapted version of C-PIH(HK) was evaluated in Wave 2. The findings in Wave 2 (n = 136) demonstrated good construct validity and internal consistency of C-PIH(HK). A principal component analysis with Oblimin rotation yielded a 3-factor solution, and the Cronbach's alphas of the subscales ranged from 0.773 to 0.845. Participants were asked whether they perceived the self-management workshops they attended and education provided by health professionals as useful or not. The results showed that the C-PIH(HK) was able to discriminate those who agreed and those who disagreed related to the usefulness of individual health education (p < 0.0001 in all subscales) and workshops (p < 0.001 in the knowledge subscale) as hypothesized. The test-retest reliability was high (ICC = 0.818). A culturally adapted version of PIH for use in Hong Kong was evaluated. The study supported good construct validity, discriminate validity, internal consistency, and test-retest reliability of the C-PIH(HK).

Questionnaire to assess patient satisfaction with pharmaceutical care in Spanish language.

PubMed

Traverso, María Luz; Salamano, Mercedes; Botta, Carina; Colautti, Marisel; Palchik, Valeria; Pérez, Beatriz

2007-08-01

To develop and validate a questionnaire, in Spanish, for assessing patient satisfaction with pharmaceutical care received in community pharmacies. Selection and translation of questionnaire's items; definition of response scale and demographic questions. Evaluation of face and content validity, feasibility, factor structure, reliability and construct validity. Forty-one community pharmacies of the province of Santa Fe. Argentina. Questionnaire administered to patients receiving pharmaceutical care or traditional pharmacy services. Pilot test to assess feasibility. Factor analysis used principal components and varimax rotation. Reliability established using internal consistency with Cronbach's alpha. Construct validity determined with extreme group method. A self-administered questionnaire with 27 items, 5-point Likert response scale and demographic questions was designed considering multidimensional structure of patient satisfaction. Questionnaire evaluates cumulative experience of patients with comprehensive pharmaceutical care practice in community pharmacies. Two hundred and seventy-four complete questionnaires were obtained. Factor analysis resulted in three factors: Managing therapy, Interpersonal relationship and General satisfaction, with a cumulative variance of 62.51%. Cronbach's alpha for the whole questionnaire was 0.96, and 0.95, 0.88 and 0.76 for the three factors, respectively. Mann-Whitney test for construct validity did not showed significant differences between pharmacies that provide pharmaceutical care and those that do not, however, 23 items showed significant differences between the two groups of pharmacies. The questionnaire developed can be a reliable and valid instrument to assess patient satisfaction with pharmaceutical care in community pharmacies in Spanish. Further research is needed to deepen the validation process.

Development of a proficiency-based virtual reality simulation training curriculum for laparoscopic appendicectomy.

PubMed

Sirimanna, Pramudith; Gladman, Marc A

2017-10-01

Proficiency-based virtual reality (VR) training curricula improve intraoperative performance, but have not been developed for laparoscopic appendicectomy (LA). This study aimed to develop an evidence-based training curriculum for LA. A total of 10 experienced (>50 LAs), eight intermediate (10-30 LAs) and 20 inexperienced (<10 LAs) operators performed guided and unguided LA tasks on a high-fidelity VR simulator using internationally relevant techniques. The ability to differentiate levels of experience (construct validity) was measured using simulator-derived metrics. Learning curves were analysed. Proficiency benchmarks were defined by the performance of the experienced group. Intermediate and experienced participants completed a questionnaire to evaluate the realism (face validity) and relevance (content validity). Of 18 surgeons, 16 (89%) considered the VR model to be visually realistic and 17 (95%) believed that it was representative of actual practice. All 'guided' modules demonstrated construct validity (P < 0.05), with learning curves that plateaued between sessions 6 and 9 (P < 0.01). When comparing inexperienced to intermediates to experienced, the 'unguided' LA module demonstrated construct validity for economy of motion (5.00 versus 7.17 versus 7.84, respectively; P < 0.01) and task time (864.5 s versus 477.2 s versus 352.1 s, respectively, P < 0.01). Construct validity was also confirmed for number of movements, path length and idle time. Validated modules were used for curriculum construction, with proficiency benchmarks used as performance goals. A VR LA model was realistic and representative of actual practice and was validated as a training and assessment tool. Consequently, the first evidence-based internationally applicable training curriculum for LA was constructed, which facilitates skill acquisition to proficiency. © 2017 Royal Australasian College of Surgeons.

Analysis of Test-Retest Reliability, Construct Validity, and Internal Consistency of the Brazilian Version of the Pelvic Girdle Questionnaire.

PubMed

Simões, Luan; Teixeira-Salmela, Luci Fuscaldi; Magalhães, Lívia; Stuge, Britt; Laurentino, Glória; Wanderley, Elaine; Barros, Raphaela; Lemos, Andrea

2018-04-24

The purpose of this study was to evaluate test-retest reliability, construct validity, and internal consistency of the Brazilian version of the Pelvic Girdle Questionnaire (PGQ-Brazil). Analysis of the measurement properties was carried out in 4 steps. Step 1 was the pilot study, on which basis 4 hypotheses were formulated. These hypotheses were tested during the next step (construct validity, step 2) by completion of the questionnaire by the 2 groups (in pain [n = 105] and not in pain [n = 52]). For implementation of the PGQ-Brazil in the group with pain, we calculated the internal consistency (step 3) and, 7 days later, test-retest reliability (step 4) by re-application of the instrument in this group. First, the PGQ-Brazil was able to discriminate between these groups (construct validity). Second, test-retest reliability (intraclass correlation coefficients for Activities subscale [0.97 with 95% confidence interval of 0.95-0.98] and Symptoms subscale [0.98 with 95% confidence interval of 0.97-0.98] and κ coefficient between 0.50 and 0.89 for the items) was found to be good; the Bland-Altman test indicated satisfactory agreement. The Rasch analysis indicated good internal consistency, and the instrument's ability to divide the participants into at least 3 levels of skills was confirmed. In contrast, a ceiling effect was observed, as 24% of pregnant women exhibited skills superior to what the PGQ-Brazil could evaluate. The PGQ-Brazil had good internal consistency, test-retest reliability, and construct validity in assessment of limitations in activities and symptoms of pregnant women with pelvic girdle pain. Copyright © 2018. Published by Elsevier Inc.

Psychometric Evaluation of the Ford Insomnia Response to Stress Test (FIRST) in Early Pregnancy.

PubMed

Gelaye, Bizu; Zhong, Qiu-Yue; Barrios, Yasmin V; Redline, Susan; Drake, Christopher L; Williams, Michelle A

2016-04-15

To evaluate the construct validity and factor structure of the Spanish-language version of the Ford Insomnia Response to Stress Test questionnaire (FIRST-S) when used in early pregnancy. A cohort of 647 women were interviewed at ≤ 16 weeks of gestation to collect information regarding lifestyle, demographic, and sleep characteristics. The factorial structure of the FIRST-S was tested through exploratory and confirmatory factor analyses (EFA and CFA). Internal consistency and construct validity were also assessed by evaluating the association between the FIRST-S with symptoms of depression, anxiety, and sleep quality. Item response theory (IRT) analyses were conducted to complement classical test theory (CTT) analytic approaches. The mean score of the FIRST-S was 13.8 (range: 9-33). The results of the EFA showed that the FIRST-S contained a one-factor solution that accounted for 69.8% of the variance. The FIRST-S items showed good internal consistency (Cronbach α = 0.81). CFA results corroborated the one-factor structure finding from the EFA; and yielded measures indicating goodness of fit (comparative fit index of 0.902) and accuracy (root mean square error of approximation of 0.057). The FIRST-S had good construct validity as demonstrated by statistically significant associations of FIRST-S scores with sleep quality, antepartum depression and anxiety symptoms. Finally, results from IRT analyses suggested excellent item infit and outfit measures. The FIRST-S was found to have good construct validity and internal consistency for assessing vulnerability to insomnia during early pregnancy. © 2016 American Academy of Sleep Medicine.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

The brief multidimensional students' life satisfaction scale-college version.

PubMed

Zullig, Keith J; Huebner, E Scott; Patton, Jon M; Murray, Karen A

2009-01-01

To investigate the psychometric properties of the BMSLSS-College among 723 college students. Internal consistency estimates explored scale reliability, factor analysis explored construct validity, and known-groups validity was assessed using the National College Youth Risk Behavior Survey and Harvard School of Public Health College Alcohol Study. Criterion-related validity was explored through analyses with the CDC's health-related quality of life scale and a social isolation scale. Acceptable internal consistency reliability, construct, known-groups, and criterion-related validity were established. Findings offer preliminary support for the BMSLSS-C; it could be useful in large-scale research studies, applied screening contexts, and for program evaluation purposes toward achieving Healthy People 2010 objectives.

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

PubMed

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

Psychometric Properties of the Persian Version of Death Depression Scale-Revised in Iranian Patients with Acute Myocardial Infarction.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Lehto, Rebecca H; Allen, Kelly A; Goudarzian, Amir Hossein; Yaghoobzadeh, Ameneh; Soleimani, Mohammad Ali

2017-07-01

Objective: Limited research has examined the psychometric properties of death depression scales in Persian populations with cardiac disease despite the need for valid assessment tools for evaluating depressive symptoms in patients with life-limiting chronic conditions. The present study aimed at evaluating the reliability and validity of the Persian Version of Death Depression Scale - Revised (DDS-R) in Iranian patients who had recent acute myocardial infarction (AMI). Method: This psychometric study was conducted with a convenience sample of 407 patients with AMI diagnosis who completed the Persian version of the DDS-R. The face, content, and construct validity of the scale were ascertained. Internal consistency, test-retest, and construct reliability (CR) were used to assess reliability of the Persian Version of DDS-R. Results: Based on maximum likelihood exploratory factor analysis and consideration of conceptual meaning, a 4-factor solution was identified, explaining 75.89% of the total variance. Goodness-of-fit indices (GFI), Comparative Fit Index (CFI), Normed Fit Index (NFI), Incremental Fit Index (IFI), and Root Mean Square Error of Approximation (RMSEA) in the final DDS-R structure demonstrated the adequacy of the 4-domain structure. The internal consistency, construct reliability, and Intra-class Correlation Coefficients (ICC) were greater than .70. Conclusion: The DDS-R was found to be a valid and reliable assessment tool for evaluating death depression symptoms in Iranian patients with AMI.

The work role functioning questionnaire 2.0 (Dutch version): examination of its reliability, validity and responsiveness in the general working population.

PubMed

Abma, Femke I; van der Klink, Jac J L; Bültmann, Ute

2013-03-01

The promotion of a sustainable, healthy and productive working life attracts more and more attention. Recently the Work Role Functioning Questionnaire (WRFQ) has been cross-culturally translated and adapted to Dutch. This questionnaire aims to measure the health-related work functioning of workers with health problems. The aim of this study is to evaluate the reliability, validity (including five new items) and responsiveness of the WRFQ 2.0 in the working population. A longitudinal study was conducted among workers. The reliability (internal consistency, test-retest reliability, measurement error), validity (structural validity-factor analysis, construct validity by means of hypotheses testing) and responsiveness of the WRFQ 2.0 were evaluated. A total of N = 553 workers completed the survey. The final WRFQ 2.0 has four subscales and showed very good internal consistency, moderate test-retest reliability, good construct validity and moderate responsiveness in the working population. The WRFQ was able to distinguish between groups with different levels of mental health, physical health, fatigue and need for recovery. A moderate correlation was found between WRFQ and related constructs respectively work ability and work productivity. A weak relationship was found with general self-rated health, work engagement and work involvement. The WRFQ 2.0 is a reliable and valid instrument to measure health-related work functioning in the working population. Further validation in larger samples is recommended, especially for test-retest reliability, responsiveness and the questionnaire's ability to predict the future course of health-related work functioning.

Development of knowledge tests for multi-disciplinary emergency training: a review and an example.

PubMed

Sørensen, J L; Thellesen, L; Strandbygaard, J; Svendsen, K D; Christensen, K B; Johansen, M; Langhoff-Roos, P; Ekelund, K; Ottesen, B; Van Der Vleuten, C

2015-01-01

The literature is sparse on written test development in a post-graduate multi-disciplinary setting. Developing and evaluating knowledge tests for use in multi-disciplinary post-graduate training is challenging. The objective of this study was to describe the process of developing and evaluating a multiple-choice question (MCQ) test for use in a multi-disciplinary training program in obstetric-anesthesia emergencies. A multi-disciplinary working committee with 12 members representing six professional healthcare groups and another 28 participants were involved. Recurrent revisions of the MCQ items were undertaken followed by a statistical analysis. The MCQ items were developed stepwise, including decisions on aims and content, followed by testing for face and content validity, construct validity, item-total correlation, and reliability. To obtain acceptable content validity, 40 out of originally 50 items were included in the final MCQ test. The MCQ test was able to distinguish between levels of competence, and good construct validity was indicated by a significant difference in the mean score between consultants and first-year trainees, as well as between first-year trainees and medical and midwifery students. Evaluation of the item-total correlation analysis in the 40 items set revealed that 11 items needed re-evaluation, four of which addressed content issues in local clinical guidelines. A Cronbach's alpha of 0.83 for reliability was found, which is acceptable. Content and construct validity and reliability were acceptable. The presented template for the development of this MCQ test could be useful to others when developing knowledge tests and may enhance the overall quality of test development. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Positive Response Distortion by Police Officer Applicants: Association of Paulhus Deception Scales with MMPI-2 and Inwald Personality Inventory Validity Scales

ERIC Educational Resources Information Center

Detrick, Paul; Chibnall, John T.

2008-01-01

Interpretation of positive response distortion (socially desirable responding) in employment evaluations is an important validity issue. This study of police officer applicants examined the construct validity of the Paulhus Deception Scales (PDS)--Moralistic Bias (MB; exaggerated adjustment/agreeableness) and Egoistic Bias (EB; exaggerated…

Validation of the Treatment Motivation Scales for Forensic Outpatient Treatment (TMS-F)

ERIC Educational Resources Information Center

Drieschner, Klaus H.; Boomsma, Anne

2008-01-01

The validity of the Treatment Motivation Scales for outpatient offender treatment (TMS-F), a self-report questionnaire with scales for the motivation of patients to engage in the treatment and six cognitive and emotional determinants of this motivation, is evaluated in two studies. In Study 1 (N = 620), the "construct validity" of the…

Evaluation of Guidelines for Subgrade Treatments

DOT National Transportation Integrated Search

2005-02-01

ODOT has recently developed guidelines for subgrade treatments to be used during plan : development and construction. This study evaluates these guidelines by comparing them with : existing guidelines developed elsewhere and validating them through c...

Reliability and Validity of the Musculoskeletal Tumor Society Scoring System for the Upper Extremity in Japanese Patients.

PubMed

Uehara, Kosuke; Ogura, Koichi; Akiyama, Toru; Shinoda, Yusuke; Iwata, Shintaro; Kobayashi, Eisuke; Tanzawa, Yoshikazu; Yonemoto, Tsukasa; Kawano, Hirotaka; Kawai, Akira

2017-09-01

The Musculoskeletal Tumor Society (MSTS) scoring system developed in 1993 is a widely used disease-specific evaluation tool for assessment of physical function in patients with musculoskeletal tumors; however, only a few studies have confirmed its reliability and validity. The aim of this study was to validate the MSTS scoring system for the upper extremity (MSTS-UE) in Japanese patients with musculoskeletal tumors for use by others in research. Does the MSTS-UE have: (1) sufficient reliability and internal consistency; (2) adequate construct validity; and (3) reasonable criterion validity in comparison to the Toronto Extremity Salvage Score (TESS) or SF-36? Reliability was performed using test-retest analysis, and internal consistency was evaluated with Cronbach's alpha coefficient. Construct validity was evaluated using a scree plot to confirm the construct number and the Akaike information criterion network. Criterion validity was evaluated by comparing the MSTS-UE with the TESS and SF-36. The test-retest reliability with intraclass correlation coefficient (0.95; 95% CI, 0.91-0.97) was excellent, and internal consistency with Cronbach's α (0.7; 95% CI, 0.53-0.81) was acceptable. There were no ceiling and floor effects. The Akaike Information Criterion network showed that lifting ability, pain, and dexterity played central roles among the components. The MSTS-UE showed substantial correlation with the TESS scoring scale (r = 0.75; p < 0.001) and fair correlation with the SF-36 physical component summary (r = 0.37; p = 0.007). Although the MSTS-UE showed slight correlation with the SF-36 mental component summary, the emotional acceptance component of the MSTS-UE showed fair correlation (r = 0.29; p = 0.039). We can conclude that the MSTS is not an adequate measure of general health-related quality of life; however, this system was designed mainly to be a simple measure of function in a single extremity. To evaluate the mental state of patients with musculoskeletal tumors in the upper extremity, further study is needed.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Validation of the Spanish version of the Index of Spouse Abuse.

PubMed

Plazaola-Castaño, Juncal; Ruiz-Pérez, Isabel; Escribà-Agüir, Vicenta; Jiménez-Martín, Juan Manuel; Hernández-Torres, Elisa

2009-04-01

Partner violence against women is a major public health problem. Although there are currently a number of validated screening and diagnostic tools that can be used to evaluate this type of violence, such tools are not available in Spain. The aim of this study is to analyze the validity and reliability of the Spanish version of the Index of Spouse Abuse (ISA). A cross-sectional study was carried out in 2005 in two health centers in Granada, Spain, in 390 women between 18 and 70 years old. Analyses of the factorial structure, internal consistency, test-retest reliability, and construct validity were conducted. Cutoff points for each subscale were also defined. For the construct validity analysis, the SF-36 perceived general health dimension, the Rosenberg Self-Esteem Scale and the Goldberg 12-item General Health Questionnaire were included. The psychometric analysis shows that the instrument has good internal consistency, reproducibility, and construct validity. The scale is useful for the analysis of partner violence against women in both a research setting and a healthcare setting.

The Social Physique Anxiety Scale: construct validity in adolescent females.

PubMed

McAuley, E; Burman, G

1993-09-01

Hart, Leary, and Rejeski have developed the Social Physique Anxiety Scale (SPA), a measure of the anxiety experienced in response to having one's physique evaluated by other people. The present study cross-validated the psychometric properties of this measure in a sample (N = 236) of adolescent competitive female gymnasts. Employing structural equation modeling, the proposed unidimensional factor structure of the SPA was supported, although some questions regarding the robustness of the fit are raised. Construct validity was demonstrated by significant inverse relationships between aspects of physical efficacy (perceived physical ability and physical self-presentation confidence) and degree of social physique anxiety. These findings are discussed in terms of possible alternative factor structures and integration of social anxiety and other psychosocial constructs to better understand physical activity behavior.

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

PubMed

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and validation of the Myasthenia Gravis Impairment Index.

PubMed

Barnett, Carolina; Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M

2016-08-30

We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test-retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test-retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79-0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79-0.94). The MGII correlated well with comparison measures, with higher correlations with the MG-activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. © 2016 American Academy of Neurology.

Development and validation of the Myasthenia Gravis Impairment Index

PubMed Central

Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M.

2016-01-01

Objective: We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. Methods: The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test–retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. Results: The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test–retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79–0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79–0.94). The MGII correlated well with comparison measures, with higher correlations with the MG–activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. Conclusions: The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. PMID:27402891

The Self-Evaluation Scale-Self-Report (SES-S) Version: Studies of Reliability and Validity

ERIC Educational Resources Information Center

Erford, Bradley T.; Bardhoshi, Gerta; Duncan, Kelly; Voucas, Stephanie; Dewlin, Emily

2017-01-01

The Self-Evaluation Scale-Self-Report version was designed to assess self-concept in students aged 10 to 17 years. Coefficient a was 0.94, and test-retest was 0.87. A unidimensional construct emerged with strong convergent validity with scores on the Piers-Harris 2 (r = 0.77) and Self-Efficacy Self-Report Scale (r = 0.70).

Psychometrics of a new questionnaire to assess glaucoma adherence: the Glaucoma Treatment Compliance Assessment Tool (an American Ophthalmological Society thesis).

PubMed

Mansberger, Steven L; Sheppler, Christina R; McClure, Tina M; Vanalstine, Cory L; Swanson, Ingrid L; Stoumbos, Zoey; Lambert, William E

2013-09-01

To report the psychometrics of the Glaucoma Treatment Compliance Assessment Tool (GTCAT), a new questionnaire designed to assess adherence with glaucoma therapy. We developed the questionnaire according to the constructs of the Health Belief Model. We evaluated the questionnaire using data from a cross-sectional study with focus groups (n = 20) and a prospective observational case series (n=58). Principal components analysis provided assessment of construct validity. We repeated the questionnaire after 3 months for test-retest reliability. We evaluated predictive validity using an electronic dosing monitor as an objective measure of adherence. Focus group participants provided 931 statements related to adherence, of which 88.7% (826/931) could be categorized into the constructs of the Health Belief Model. Perceived barriers accounted for 31% (288/931) of statements, cues-to-action 14% (131/931), susceptibility 12% (116/931), benefits 12% (115/931), severity 10% (91/931), and self-efficacy 9% (85/931). The principal components analysis explained 77% of the variance with five components representing Health Belief Model constructs. Reliability analyses showed acceptable Cronbach's alphas (>.70) for four of the seven components (severity, susceptibility, barriers [eye drop administration], and barriers [discomfort]). Predictive validity was high, with several Health Belief Model questions significantly associated (P <.05) with adherence and a correlation coefficient (R (2)) of .40. Test-retest reliability was 90%. The GTCAT shows excellent repeatability, content, construct, and predictive validity for glaucoma adherence. A multisite trial is needed to determine whether the results can be generalized and whether the questionnaire accurately measures the effect of interventions to increase adherence.

Evaluation of the spoken knowledge in low literacy in diabetes scale for use with Mexican Americans.

PubMed

Garcia, Alexandra A; Zuniga, Julie; Reynolds, Raquel; Cairampoma, Laura; Sumlin, Lisa

2015-05-01

This article evaluates the Spoken Knowledge in Low Literacy in Diabetes (SKILLD) questionnaire, a measure of essential knowledge for type 2 diabetes self-management, after it was modified for English- and Spanish-speaking Mexican Americans. We collected surveys (SKILLD, demographic, acculturation) and blood for A1C analysis from 72 community-recruited participants to analyze the SKILLD's internal consistency, interrater reliability, item analysis, and construct validity. Clinical experts evaluated content validity. The SKILLD demonstrated low internal consistency but high interrater reliability and content and construct validity. There were significant correlations in expected directions between SKILLD scores and acculturation, education, and A1C and significant differences in SKILLD scores between and within groups after an educational intervention and between high- and low-acculturated participants. The SKILLD generates useful information about Mexican Americans' diabetes knowledge. Lower SKILLD scores suggest less diabetes knowledge, lower health literacy, and participants' difficulties understanding items. Further modifications should improve use with low-acculturated Mexican Americans. © The Author(s) 2014.

Reliability, validity, and responsiveness of the Persian version of Shoulder Activity Scale in a group of patients with shoulder disorders.

PubMed

Negahban, Hossein; Mohtasebi, Elham; Goharpey, Shahin

2015-01-01

The aim of this methodological study was to cross-culturally translate the Shoulder Activity Scale (SAS) into the Persian and determine its clinimetric properties including reliability, validity, and responsiveness in patients with shoulder disorders. Persian version of the SAS was obtained after standard forward-backward translation. Three questionnaires were completed by the respondents: SAS, shoulder pain and disability index (SPADI), and Short-Form 36 Health Survey (SF-36). The patients completed the SAS, 1 week after the first visit to evaluate the test-retest reliability. Construct validity was evaluated by examining the associations between the scores on the SAS and the scores obtained from the SPADI, SF-36, and age of the patients. To assess responsiveness, data were collected in the first visit and then again after 4 weeks physiotherapy intervention. Test-retest reliability and internal consistency were assessed using Intra-class Correlation Coefficient (ICC) and Cronbach's alpha, respectively. To evaluate construct validity, Spearman's rank correlation was used. The ability of the SAS to detect changes was evaluated by the receiver-operating characteristics method. No problem or language difficulties were reported during translation process. Test-retest reliability of the SAS was excellent with an ICC of 0.98. Also, the marginal Cronbach's alpha level of 0.64 was obtained. The correlation between the SAS and the SPADI was low, proving divergent validity, whereas the correlations between the SAS and the SF-36/age were moderate proving convergent validity. A marginally acceptable responsiveness was achieved for the Persian SAS. The study provides some evidences to support the test-retest reliability, internal consistency, construct validity, and responsiveness of the Persian version of the SAS in patients with shoulder disorders. Therefore, it seems that this instrument is a useful measure of shoulder activity level in research setting and clinical practice. The shoulder activity scale (SAS) is a reliable, valid, and responsive measure of shoulder activity level in Persian-speaking patients with different shoulder disorders. The results on clinimetric properties of the Persian SAS are comparable with its original, English version. Persian version of the SAS can be used in "clinical" and "research" settings of patients with shoulder disorders.

Validation of World Health Organization Assessment Schedule 2.0 in specialized somatic rehabilitation services in Norway.

PubMed

Moen, Vegard Pihl; Drageset, Jorunn; Eide, Geir Egil; Klokkerud, Mari; Gjesdal, Sturla

2017-02-01

The World Health Organization Disability Assessment Schedule (WHODAS) 2.0 is a generic instrument to assess disability covering six domains. The purpose of this study was to investigate the potential of the instrument for monitoring disability in specialized somatic rehabilitation by testing reliability, construct validity and responsiveness of WHODAS 2.0, Norwegian version, among patients with various health conditions. For taxonomy, terminology and definitions, the Consensus-based Standards for the Selection of Health Measurement Instruments were followed. Reproducibility was investigated by the intra-class correlation coefficient (ICC) in a randomly selected sample. Internal consistency was assessed by Cronbach's alpha. Construct validity was evaluated by correlations between WHODAS 2.0 and the Medical Outcomes Study 36-item Short Form, and fit of the hypothesized structure using confirmatory factor analysis (CFA). Responsiveness was evaluated in another randomly selected sample by testing a priori formulated hypotheses. Nine hundred seventy patients were included in the study. Reproducibility and responsiveness were evaluated in 53 and 104 patients, respectively. The ICC for the WHODAS 2.0 domains ranged from 0.63 to 0.84 and was 0.87 for total score. Cronbach's alpha for domains ranged from 0.75 to 0.94 and was 0.93 for total score. For construct validity, 6 of 12 expected correlations were confirmed and CFA did not achieve satisfactory fit indices. For responsiveness, 3 of 8 hypotheses were confirmed. The Norwegian version of WHODAS 2.0 showed moderate to satisfactory reliability and moderate validity in rehabilitation patients. However, the present study indicated possible limitations in terms of responsiveness.

Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses.

PubMed

Taffarel, Marilda Onghero; Luna, Stelio Pacca Loureiro; de Oliveira, Flavia Augusta; Cardoso, Guilherme Schiess; Alonso, Juliana de Moura; Pantoja, Jose Carlos; Brondani, Juliana Tabarelli; Love, Emma; Taylor, Polly; White, Kate; Murrell, Joanna C

2015-04-01

Quantification of pain plays a vital role in the diagnosis and management of pain in animals. In order to refine and validate an acute pain scale for horses a prospective, randomized, blinded study was conducted. Twenty-four client owned adult horses were recruited and allocated to one of four following groups: anaesthesia only (GA); pre-emptive analgesia and anaesthesia (GAA,); anaesthesia, castration and postoperative analgesia (GC); or pre-emptive analgesia, anaesthesia and castration (GCA). One investigator, unaware of the treatment group, assessed all horses at time-points before and after intervention and completed the pain scale. Videos were also obtained at these time-points and were evaluated by a further four blinded evaluators who also completed the scale. The data were used to investigate the relevance, specificity, criterion validity and inter- and intra-observer reliability of each item on the pain scale, and to evaluate construct validity and responsiveness of the scale. Construct validity was demonstrated by the observed differences in scores between the groups, four hours after anaesthetic recovery and before administration of systemic analgesia in the GC group. Inter- and intra-observer reliability for the items was only satisfactory. Subsequently the pain scale was refined, based on results for relevance, specificity and total item correlation. Scale refinement and exclusion of items that did not meet predefined requirements generated a selection of relevant pain behaviours in horses. After further validation for reliability, these may be used to evaluate pain under clinical and experimental conditions.

Safer Conception Methods and Counseling: Psychometric Evaluation of New Measures of Attitudes and Beliefs Among HIV Clients and Providers.

PubMed

Woldetsadik, Mahlet Atakilt; Goggin, Kathy; Staggs, Vincent S; Wanyenze, Rhoda K; Beyeza-Kashesya, Jolly; Mindry, Deborah; Finocchario-Kessler, Sarah; Khanakwa, Sarah; Wagner, Glenn J

2016-06-01

With data from 400 HIV clients with fertility intentions and 57 HIV providers in Uganda, we evaluated the psychometrics of new client and provider scales measuring constructs related to safer conception methods (SCM) and safer conception counselling (SCC). Several forms of validity (i.e., content, face, and construct validity) were examined using standard methods including exploratory and confirmatory factor analysis. Internal consistency was established using Cronbach's alpha correlation coefficient. The final scales consisted of measures of attitudes towards use of SCM and delivery of SCC, including measures of self-efficacy and motivation to use SCM, and perceived community stigma towards childbearing. Most client and all provider measures had moderate to high internal consistency (alphas 0.60-0.94), most had convergent validity (associations with other SCM or SCC-related measures), and client measures had divergent validity (poor associations with depression). These findings establish preliminary psychometric properties of these scales and should facilitate future studies of SCM and SCC.

Construct validity and internal consistency in the Leisure Practices Scale (EPL) for adults.

PubMed

Andrade, Rubian Diego; Schwartz, Gisele Maria; Tavares, Giselle Helena; Pelegrini, Andreia; Teixeira, Clarissa Stefani; Felden, Érico Pereira Gomes

2018-02-01

This study proposes and analyzes the construct validity and internal consistency of the Leisure Practices Scale (EPL). This survey seeks to identify the preferences and involvement in in different leisure practices in adults. The instrument was formed based on the cultural leisure content (artistic, manual, physical, sports, intellectual, social, tourist, virtual and contemplation/leisure). The validation process was conducted with: a) content analysis by leisure experts, who evaluated the instrument for clarity of language and practical relevance, which allowed the calculation of the content validity coefficient (CVC); b) reproducibility test-retest with 51 subjects to calculate the temporal variation coefficient; c) internal consistency analysis with 885 participants. The evaluation presented appropriate coefficients, both with respect to language clarity (CVCt = 0.883) and practical relevance (CVCt = 0.879). The reproducibility coefficients were moderate to excellent. The scale showed adequate internal consistency (0.72). The EPL has psychometric quality and acceptable values in its structure, and can be used to investigate adult involvement in leisure activities.

Developing and testing instruments for improving cooperation and patient's participation in mental health care.

PubMed

Latvala, E; Saranto, K; Pekkala, E

2004-10-01

The main purpose of the project was to develop computerized instruments that could be used by nurses and patients to assess their cooperation and mutual contributions to care. This paper presents a part of the project: the reliability and validity testing phase of a process of instrument development. To test the validity and reliability of the instruments, data were collected with questionnaires from nurses (n = 146) and patients (n = 286). The validity evaluated as construct validity and the reliability evaluated as internal consistency of the instruments were quite good. Construct validity was tested by factor analysis, and internal consistency was tested by Cronbach's alpha coefficient, which varied from 0.69 to 0.79. The instruments, which consisted of a software application that can be operated in a www environment, were meant to be used as tools in the psychiatric nursing context for assessing the cooperation between the nurses and patients and the patient's participation in his/her care. Furthermore, the computer programme can be used as a tool for developing and assessing the patient orientation in nursing.

Psychometric Evaluation of Two Appetite Questionnaires in Patients With Heart Failure.

PubMed

Andreae, Christina; Strömberg, Anna; Sawatzky, Richard; Årestedt, Kristofer

2015-12-01

Decreased appetite in heart failure (HF) may lead to undernutrition which could negatively influence prognosis. Appetite is a complex clinical issue that is often best measured with the use of self-report instruments. However, there is a lack of self-rated appetite instruments. The Council on Nutrition Appetite Questionnaire (CNAQ) and the Simplified Nutritional Appetite Questionnaire (SNAQ) are validated instruments developed primarily for elderly people. Yet, the psychometric properties have not been evaluated in HF populations. The aim of the present study was to evaluate the psychometric properties of CNAQ and SNAQ in patients with HF. A total of 186 outpatients with reduced ejection fraction and New York Heart Association (NYHA) functional classifications II-IV were included (median age 72 y; 70% men). Data were collected with the use of a questionnaire that included the CNAQ and SNAQ. The psychometric evaluation included data quality, factor structure, construct validity, known-group validity, and internal consistency. Unidimensionality was supported by means of parallel analysis and confirmatory factor analyses (CFAs). The CFA results indicated sufficient model fit. Both construct validity and known-group validity were supported. Internal consistency reliability was acceptable, with ordinal coefficient alpha estimates of 0.82 for CNAQ and 0.77 for SNAQ. CNAQ and SNAQ demonstrated sound psychometric properties and can be used to measure appetite in patients with HF. Copyright © 2015 Elsevier Inc. All rights reserved.

Perceived visual informativeness (PVI): construct and scale development to assess visual information in printed materials.

PubMed

King, Andy J; Jensen, Jakob D; Davis, LaShara A; Carcioppolo, Nick

2014-01-01

There is a paucity of research on the visual images used in health communication messages and campaign materials. Even though many studies suggest further investigation of these visual messages and their features, few studies provide specific constructs or assessment tools for evaluating the characteristics of visual messages in health communication contexts. The authors conducted 2 studies to validate a measure of perceived visual informativeness (PVI), a message construct assessing visual messages presenting statistical or indexical information. In Study 1, a 7-item scale was created that demonstrated good internal reliability (α = .91), as well as convergent and divergent validity with related message constructs such as perceived message quality, perceived informativeness, and perceived attractiveness. PVI also converged with a preference for visual learning but was unrelated to a person's actual vision ability. In addition, PVI exhibited concurrent validity with a number of important constructs including perceived message effectiveness, decisional satisfaction, and three key public health theory behavior predictors: perceived benefits, perceived barriers, and self-efficacy. Study 2 provided more evidence that PVI is an internally reliable measure and demonstrates that PVI is a modifiable message feature that can be tested in future experimental work. PVI provides an initial step to assist in the evaluation and testing of visual messages in campaign and intervention materials promoting informed decision making and behavior change.

Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills.

PubMed

Kawaguchi, Koji; Egi, Hiroyuki; Hattori, Minoru; Sawada, Hiroyuki; Suzuki, Takahisa; Ohdan, Hideki

2014-10-01

Virtual reality surgical simulators are becoming popular as a means of providing trainees with an opportunity to practice laparoscopic skills. The Lap-X (Epona Medical, Rotterdam, the Netherlands) is a novel VR simulator for training basic skills in laparoscopic surgery. The objective of this study was to validate the LAP-X laparoscopic virtual reality simulator by assessing the face and construct validity in order to determine whether the simulator is adequate for basic skills training. The face and content validity were evaluated using a structured questionnaire. To assess the construct validity, the participants, nine expert surgeons (median age: 40 (32-45)) (>100 laparoscopic procedures) and 11 novices performed three basic laparoscopic tasks using the Lap-X. The participants reported a high level of content validity. No significant differences were found between the expert surgeons and the novices (Ps > 0.246). The performance of the expert surgeons on the three tasks was significantly better than that of the novices in all parameters (Ps < 0.05). This study demonstrated the face, content and construct validity of the Lap-X. The Lap-X holds real potential as a home and hospital training device.

The utility of the Total Neuropathy Score as an instrument to assess neuropathy severity in chronic kidney disease: A validation study.

PubMed

Issar, Tushar; Arnold, Ria; Kwai, Natalie C G; Pussell, Bruce A; Endre, Zoltan H; Poynten, Ann M; Kiernan, Matthew C; Krishnan, Arun V

2018-05-01

To demonstrate construct validity of the Total Neuropathy Score (TNS) in assessing peripheral neuropathy in subjects with chronic kidney disease (CKD). 113 subjects with CKD and 40 matched controls were assessed for peripheral neuropathy using the TNS. An exploratory factor analysis was conducted and internal consistency of the scale was evaluated using Cronbach's alpha. Construct validity of the TNS was tested by comparing scores between case and control groups. Factor analysis revealed valid item correlations and internal consistency of the TNS was good with a Cronbach's alpha of 0.897. Subjects with CKD scored significantly higher on the TNS (CKD: median, 6, interquartile range, 1-13; controls: median, 0, interquartile range, 0-1; p < 0.001). Subgroup analysis revealed construct validity was maintained for subjects with stages 3-5 CKD with and without diabetes. The TNS is a valid measure of peripheral neuropathy in patients with CKD. The TNS is the first neuropathy scale to be formally validated in patients with CKD. Copyright © 2018 International Federation of Clinical Neurophysiology. Published by Elsevier B.V. All rights reserved.

Pancreatitis Quality of Life Instrument: A Psychometric Evaluation.

PubMed

Wassef, Wahid; DeWitt, John; McGreevy, Kathleen; Wilcox, Mel; Whitcomb, David; Yadav, Dhiraj; Amann, Stephen; Mishra, Girish; Alkaade, Samer; Romagnuolo, Joseph; Stevens, Tyler; Vargo, John; Gardner, Timothy; Singh, Vikesh; Park, Walter; Hartigan, Celia; Barton, Bruce; Bova, Carol

2016-08-01

Chronic pancreatitis is a significant medical problem that impacts a large number of patients worldwide. In 2014, we developed a disease-specific instrument for the evaluation of quality of life in this group of patients: pancreatitis quality of life instrument (PANQOLI). The goal of this study was to evaluate its psychometric properties: its reliability and its construct validity. This is a cross-sectional multi-center study that involved 12 pancreatic disease centers. Patients who met the inclusion/exclusion criteria for chronic pancreatitis were invited to participate. Those who accepted were asked to complete seven questionnaires/instruments. Only patients who completed the PANQOLI were included in the study. Its reliability and its construct validity were tested. A total of 159 patients completed the PANQOLI and were included in the study. They had a mean age of 49.03, 49% were male, and 84% were Caucasian. Six of the 24 items on the scale were removed because of lack of inter-item correlation, redundancy, or lack of correlation to quality of life issues. The final 18-item scale had excellent reliability (Cronbach's alpha coefficient: 0.914) and excellent construct validity with good correlation to generic quality of life instruments (SF-12 and EORTC QLQ-C30/QLQ-PAN26) and lack of correlation to non-quality of life instruments (MAST and DAST). Through exploratory factor analysis, the PANQOLI was found to consist of four subscales: emotional function scale, role function scale, physical function scale, and "self-worth" scale. PANQOLI is the first disease-specific instrument to be developed and validated for the evaluation of quality of life in chronic pancreatitis patients. It has a unique subscale for "self-worth" that differentiates it from other generic instruments. Studies are currently under way to evaluate its use in other populations not included in this study.

Development and psychometric properties of a self-regulation scale about leisure time physical activity in Iranian male adolescents.

PubMed

Abasi, Mohammad Hadi; Eslami, Ahmad Ali; Rakhshani, Fatemeh; Shiri, Mansoor

2016-01-01

Self-regulation is one of the current psychological concepts that have been known as a determinant of leisure time physical activity. Due to cultural and social diversity in different societies and age groups, application of specific questionnaires is essential to perform investigations about physical activities. The aim of this study is development and evaluation of psychometric properties of a self-regulation questionnaire about leisure time physical activity in Iranian male adolescents. This cross-sectional study was conducted in 2013, and data of 603 male students from 12 high schools in Isfahan were collected. A comprehensive literature review and similar questionnaire review were conducted and 25 items were selected or developed to measure self-regulation. Comprehensibility of items was evaluated in a pilot study and an expert panel evaluated face and content validity. Exploratory factors analysis (EFA) was used for evaluation of construct validity and extraction of sub-constructs of self-regulation. Leisure time physical activity was assessed using International Physical Activity Questionnaire (IPAQ). The mean age of the participants was 16.3 years (SD =1.0) and the range was 15-19 years. Cronbach's α coefficient of the questionnaire in the pilot and main study was 0.84 and 0.90, respectively. EFA resulted in four sub-constructs including "enlistment of social support", "goal setting", "self-construction", and "self-monitoring", which explained 63.6% of the variance of self-regulation. Results of this investigation provide some support to the validity and reliability of the 16-item questionnaire of self-regulation abut leisure time physical activity in the target group.

Development of an Agility Test for Badminton Players and Assessment of Its Validity and Test-Retest Reliability.

PubMed

Loureiro, Luiz de França Bahia; de Freitas, Paulo Barbosa

2016-04-01

Badminton requires open and fast actions toward the shuttlecock, but there is no specific agility test for badminton players with specific movements. To develop an agility test that simultaneously assesses perception and motor capacity and examine the test's concurrent and construct validity and its test-retest reliability. The Badcamp agility test consists of running as fast as possible to 6 targets placed on the corners and middle points of a rectangular area (5.6 × 4.2 m) from the start position located in the center of it, following visual stimuli presented in a luminous panel. The authors recruited 43 badminton players (17-32 y old) to evaluate concurrent (with shuttle-run agility test--SRAT) and construct validity and test-retest reliability. Results revealed that Badcamp presents concurrent and construct validity, as its performance is strongly related to SRAT (ρ = 0.83, P < .001), with performance of experts being better than nonexpert players (P < .01). In addition, Badcamp is reliable, as no difference (P = .07) and a high intraclass correlation (ICC = .93) were found in the performance of the players on 2 different occasions. The findings indicate that Badcamp is an effective, valid, and reliable tool to measure agility, allowing coaches and athletic trainers to evaluate players' athletic condition and training effectiveness and possibly detect talented individuals in this sport.

Using Scratch with Primary School Children: An Evaluation of Games Constructed to Gauge Understanding of Programming Concepts

ERIC Educational Resources Information Center

Wilson, Amanda; Hainey, Thomas; Connolly, Thomas M.

2013-01-01

Newer approaches such as games-based learning (GBL) and games-based construction are being adopted to motivate and engage students within the Curriculum for Excellence (CfE) in Scotland. GBL and games-based construction suffer from a dearth of empirical evidence supporting their validity as teaching and learning approaches. To address this issue…

Development Scaffolding for Construction of Evaluation Instrument Training Program on The Cognitive Domain For Senior High School Physics Teachers and The Same Level

NASA Astrophysics Data System (ADS)

Arif, W.; Suhandi, A.; Kaniawati, I.; Setiawan, A.

2017-02-01

The development of scaffolding for evaluation instrument construction training program on the cognitive domain for senior high school physics teacher and the same level that is specified in the test instrument has been done. This development was motivated by the low ability of the majority of physics teachers in constructing the physics learning achievement test. This situation not in accordance with the demands of Permendiknas RI no. 16 tahun 2007 concerning the standard of academic qualifications and competence of teachers, stating that teachers should have a good ability to develop instruments for assessment and evaluation of process and learning outcomes. Based on the preliminary study results, it can be seen that the main cause of the inability of teachers in developing physics achievement test is because they do not good understand of the indicators for each aspect of cognitive domains. Scaffolding development is done by using the research and development methods formulated by Thiagarajan which includes define, design and develope steps. Develop step includes build the scaffolding, validation of scaffolding by experts and the limited pilot implementations on the training activities. From the build scaffolding step, resulted the scaffolding for the construction of test instruments training program which include the process steps; description of indicators, operationalization of indicators, construction the itemsframework (items scenarios), construction the items stem, construction the items and checking the items. The results of the validation by three validator indicates that the built scaffolding are suitable for use in the construction of physics achievement test training program, especially for novice. The limited pilot implementation of the built scaffolding conducted in training activities attended by 10 senior high school physics teachers in Garut district. The results of the limited pilot implementation shows that the built scaffolding have a medium effectiveness in improving the ability of senior high school physics teachers in constructing the physic achievement test instrument that is characterized by more than 70% of trainees achieve scores of test instruments construction of about 80 or more.

Construct validity of ADHD/ODD rating scales: recommendations for the evaluation of forthcoming DSM-V ADHD/ODD scales.

PubMed

Burns, G Leonard; Walsh, James A; Servera, Mateu; Lorenzo-Seva, Urbano; Cardo, Esther; Rodríguez-Fornells, Antoni

2013-01-01

Exploratory structural equation modeling (SEM) was applied to a multiple indicator (26 individual symptom ratings) by multitrait (ADHD-IN, ADHD-HI and ODD factors) by multiple source (mothers, fathers and teachers) model to test the invariance, convergent and discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with 872 Thai adolescents and the ADHD Rating Scale-IV and ODD scale of the Disruptive Behavior Inventory with 1,749 Spanish children. Most of the individual ADHD/ODD symptoms showed convergent and discriminant validity with the loadings and thresholds being invariant over mothers, fathers and teachers in both samples (the three latent factor means were higher for parents than teachers). The ADHD-IN, ADHD-HI and ODD latent factors demonstrated convergent and discriminant validity between mothers and fathers within the two samples. Convergent and discriminant validity between parents and teachers for the three factors was either absent (Thai sample) or only partial (Spanish sample). The application of exploratory SEM to a multiple indicator by multitrait by multisource model should prove useful for the evaluation of the construct validity of the forthcoming DSM-V ADHD/ODD rating scales.

Development and validation of a new questionnaire assessing quality of life in adults with hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ).

PubMed

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach's alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Development and validation of a nutrition knowledge questionnaire for a Canadian population.

PubMed

Bradette-Laplante, Maude; Carbonneau, Élise; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-05-01

The present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines. A thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test-retest reliability were evaluated through a validation study. Online survey. Six nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated. Content validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RD v. non-RD (21·5 (sd 2·1) v. 15·7 (sd 3·0) out of 24, P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach's α=0·73). Assessment of test-retest reliability resulted in significant associations for the total knowledge score (r=0·59, P<0·001). This nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Development and validation of a knowledge test for health professionals regarding lifestyle modification.

PubMed

Talip, Whadi-ah; Steyn, Nelia P; Visser, Marianne; Charlton, Karen E; Temple, Norman

2003-09-01

We wanted to develop and validate a test that assesses the knowledge and practices of health professionals (HPs) with regard to the role of nutrition, physical activity, and smoking cessation (lifestyle modification) in chronic diseases of lifestyle. A descriptive cross-sectional validation study was carried out. The validation design consisted of two phases, namely 1) test planning and development and 2) test evaluation. The study sample consisted of five groups of HPs: dietitians, dietetic interns, general practitioners, medical students, and nurses. The overall response rate was 58%, resulting in a sample size of 186 participants. A test was designed to evaluate the knowledge and practices of HPs. The test was first evaluated by an expert group to ensure content, construct, and face validity. Thereafter, the questionnaire was tested on five groups of HPs to test for criterion validity. Internal consistency was evaluated by Cronbach's alpha. An expert panel ensured content, construct, and face validity of the test. Groups with the most training and exposure to nutrition (dietitians and dietetic interns) had the highest group mean score, ranging from 61% to 88%, whereas those with limited nutrition training (general practitioners, medical students, and nurses) had significantly lower scores, ranging from 26% to 80%. This result demonstrated criterion validity. Internal consistency of the overall test demonstrated a Cronbach's alpha of 0.99. Most HPs identified the mass media as their main source of information on lifestyle modification. These HPs also identified lack of time, lack of patient compliance, and lack of knowledge as barriers that prevent them from providing counseling on lifestyle modification. The results of this study showed that this test instrument identifies groups of health professionals with adequate training (knowledge) in lifestyle modification and those who require further training (knowledge).

Development and validation of a new instrument to evaluate the ease of use of patient-controlled analgesic modalities for postoperative patients.

PubMed

Harding, Gale; Schein, Jeff R; Nelson, Winnie W; Vallow, Sue; Olson, William H; Hewitt, David J; Polomano, Rosemary C

2010-03-01

To describe the development and psychometric evaluation of a questionnaire assessing the ease of use that patients associate with patient-controlled analgesia (PCA) modalities. Qualitative interviews were conducted with patients who had experience with intravenous (IV) PCA for postoperative pain management to generate items relevant to the ease of using PCA modalities. The content validity of the resulting questionnaire was examined through follow-up patient interviews, and an expert panel reviewed the questionnaire. Cognitive debriefing interviews were conducted with patients to determine the clarity and content of the instructions, items, and response scales, and the ease of completing the instrument. Psychometric evaluation was performed with patients who had undergone surgery and received IV PCA for postoperative pain management. Item and scale quality and the internal consistency reliability of the questionnaire were assessed. Construct validity was evaluated by examining the relationship between subscales of the questionnaire with patient-reported outcome measures. Known-groups validity was determined by assessing the instrument's ability to differentiate between patients with versus without an IV PCA problem. A potential limitation of this study was the exclusive sampling of patients who had experience with IV PCA. The Patient Ease-of-Care (EOC) Questionnaire included 23 items in the following subscales: Confidence with Device, Comfort with Device, Movement, Dosing Confidence, Pain Control, Knowledge/Understanding, and Satisfaction. Coefficient alpha reliability estimates were ≥ 0.66 for Overall EOC (includes all subscales except Satisfaction) and all EOC subscales. Construct validity was supported by the moderate relationship between the Pain Control subscale and measures of pain severity and pain interference; additional evidence of construct validity was provided by correlations of the Confidence with Device subscale, the Satisfaction subscale, and Overall EOC with measures of pain severity, pain interference, and satisfaction. Significant mean score differences were reported between participants with and without IV PCA problems for Overall EOC and for the Comfort with Device, Confidence with Device, Movement, Pain Control, and Satisfaction subscales indicating known-groups validity. Results provide evidence for the reliability and validity of the Patient EOC Questionnaire as a measure of the ease of use that patients associate with PCA systems and may be useful for evaluating emerging PCA modalities.

Translation and Validation of the Dutch Western Ontario Meniscal Evaluation Tool.

PubMed

van der Wal, Robert J P; Heemskerk, Bastiaan T J; van Arkel, Ewoud R A; Mokkink, Lidwine B; Thomassen, Bregje J W

2017-05-01

The aim of this study was to translate the Western Ontario Meniscal Evaluation Tool (WOMET) into Dutch, to evaluate the content validity, construct validity, reliability, and responsiveness, and to determine the minimal important change (MIC) of the Dutch version. The WOMET was translated into Dutch according to a standardized forward-backward translation protocol. A total of 86 patients (51 males, 35 females, median age 52 years [interquartile range, 43-60 years]) with isolated meniscal pathology were included. The WOMET was completed three times; at baseline, around 2 weeks, and after 3 months from the baseline. Knee injury and osteoarthritis outcome score, International Knee Documentation Committee subjective knee form, short-form 36, and an anchor question were also answered. There were good results for content validity (floor and ceiling effects [< 15%]), construct validity (79% of the predefined hypotheses were confirmed), internal consistency (Cronbach α = 0.87, 0.79, and 0.86 for each subscale score), test-retest reliability (intraclass correlation coefficient = 0.78 for total WOMET score), and responsiveness (79% of the predefined hypotheses were confirmed). The smallest detectable change and MIC for the Dutch WOMET are 20.5 and 14.7, respectively. The Dutch version of the WOMET is valid and reliable for assessing health-related quality of life in patients with meniscal pathology. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Construct Validity of Symptom Checklist-90-Revised (SCL-90-R) and General Health Questionnaire-28 (GHQ-28) in Patients with Drug Addiction and Diabetes, and Normal Population

PubMed Central

ARDAKANI, Abolfazl; SEGHATOLESLAM, Tahereh; HABIL, Hussain; JAMEEI, Fahimeh; RASHID, Rusdi; ZAHIRODIN, Alireza; MOTLAQ, Farid; MASJIDI ARANI, Abbas

2016-01-01

Background: Given that validity is the baseline of psychological assessments, there is a need to provide evidence-based data for construct validity of such scales to advance the clinicians for evaluating psychiatric morbidity in psychiatric and psychosomatic setting. Methods: This comparative cross-sectional study aimed to investigate the construct validity of the Malaysian version of the GHQ-28 and the SCL-90-R. The sample comprised 660 individuals including diabetics, drug dependents, and normal population. The research scales were administered to the participants. Convergent and discriminant validity of both scales were investigated by Confirmatory Factor Analysis (CFA) using AMOS. The Pearson correlation coefficient was utilized to obtain the relationship between the two scales. Results: The internal consistency of the GHQ-28 and SCL-90-R were highly acceptable, and confirmatory factor analysis confirmed the convergent validity of both scales. The results of this study revealed that the construct validity of GHQ-28 was acceptable, whereas discriminant validity of SCL-90-R was not adequate. According to Pearson correlation coefficient the relationships between three common subscales of the GHQ-28 and SCL-90-R were significantly positive; somatization (r=0.671, P<0.01), Anxiety (r=0.728, P<0.01), and Depression (r=0.660, P <0.01). Conclusions: This study replicated the construct of the Malaysian version of GHQ-28, yet failed to support the nine-factor structure of the SCL-90-R. Therefore, multidimensionality of the SCL-90-R as clinical purposes is questionable, and it may be a better unitary measure for assessing and screening mental disorders. Further research need to be carried out to prove this finding. PMID:27252914

Validation of the Perception of Change Scale - Family Version (EMP-F) as a treatment outcome measure in mental health services.

PubMed

Bandeira, Marina; Felicio, Cynthia Mara; Cesari, Luciana

2010-09-01

This study aimed to validate the Perception of Change Scale - Family Version, which evaluates the perception of family caregivers in regard to the treatment outcomes of psychiatric patients in mental health services. Family caregivers (N = 300) of psychiatric patients attending mental health services completed the Perception of Change Scale - Family Version. The scale has 19 items rated in a three-point Likert scale that evaluate changes perceived in the patient's life as a result of treatment. The factorial analysis revealed a four-factor structure, with the following dimensions: 1) occupation, 2) psychological factors, 3) relationships, and 4) physical health. In the internal consistency analysis, Cronbach's alpha coefficient was 0.85. The test-retest temporal stability analysis yielded a significant intraclass correlation coefficient (r = 0.96; p < 0.005). The convergent validity analysis revealed a positive significant correlation with another scale evaluating a distinct but theoretically related construct of family satisfaction with services (r = 0.41; p < 0.05). The Perception of Change Scale - Family Version has adequate reliability and construct and convergent validity. It can be used to evaluate treatment outcome in mental health services from the perspective of family caregivers, indicating targets to improve treatment.

A process-oriented measure of habit strength for moderate-to-vigorous physical activity

PubMed Central

Grove, J. Robert; Zillich, Irja; Medic, Nikola

2014-01-01

Purpose: Habitual action is an important aspect of health behaviour, but the relevance of various habit strength indicators continues to be debated. This study focused specifically on moderate-to-vigorous physical activity (MVPA) and evaluated the construct validity of a framework emphasizing patterned action, stimulus-response bonding, automaticity, and negative consequences for nonperformance as indicators of habit strength for this form of exercise. Methods: Upper-level undergraduates (N = 124) provided demographic information and responded to questionnaire items assessing historical MVPA involvement, current MVPA involvement, and the four proposed habit strength dimensions. Factor analyses were used to examine the latent structure of the habit strength indicators, and the model's construct validity was evaluated via an examination of relationships with repetition history and current behaviour. Results: At a measurement level, findings indicated that the proposed four-component model possessed psychometric integrity as a coherent set of factors. Criterion-related validity was also demonstrated via significant changes in three of the four factors as a function of past involvement in MVPA and significant correlations with the frequency, duration, and intensity of current MVPA. Conclusions: These findings support the construct validity of this exercise habit strength model and suggest that it could provide a template for future research on how MVPA habits are developed and maintained. PMID:25750789

Some psychometric properties of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales (PedsQL™) in the general Serbian population.

PubMed

Stevanović, Dejan; Lakić, Aneta; Damnjanović, Maja

2011-08-01

The aim of this study was to evaluate the general measurement properties of the Serbian version of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales (PedsQL™) self-report versions for children and adolescents (8-18 years). The PedsQL™ was completed by 238 children and adolescents. The version was descriptively analyzed first. Afterward, internal consistency and construct and convergent validity were analyzed using the classic test theory psychometrical procedures. The PedsQL™ scale score means ranged 70.65-88.34, with the total score was 80.74. Scale internal consistency reliability determined by Cronbach's coefficient was above 0.7 for all except the School, 0.65, and Emotional Functioning Scale, 0.69. The statistics assessing the adequacy of the model in confirmatory factor analysis revealed poor model fit for the current structure of the PedsQL™. Finally, the PedsQL™ total and psychosocial health showed convincing negative correlations with emotional and conduct problems, hyperactivity/inattention, and peer relationship problems. The Serbian PedsQL™ scales have appropriate internal consistency reliability, sufficient for group evaluations, and good convergent validity against psychological constructs. However, there are problems regarding its current construct validity (factorial validity).

A process-oriented measure of habit strength for moderate-to-vigorous physical activity.

PubMed

Grove, J Robert; Zillich, Irja; Medic, Nikola

2014-01-01

Purpose : Habitual action is an important aspect of health behaviour, but the relevance of various habit strength indicators continues to be debated. This study focused specifically on moderate-to-vigorous physical activity (MVPA) and evaluated the construct validity of a framework emphasizing patterned action, stimulus-response bonding, automaticity, and negative consequences for nonperformance as indicators of habit strength for this form of exercise. Methods : Upper-level undergraduates ( N  = 124) provided demographic information and responded to questionnaire items assessing historical MVPA involvement, current MVPA involvement, and the four proposed habit strength dimensions. Factor analyses were used to examine the latent structure of the habit strength indicators, and the model's construct validity was evaluated via an examination of relationships with repetition history and current behaviour. Results : At a measurement level, findings indicated that the proposed four-component model possessed psychometric integrity as a coherent set of factors. Criterion-related validity was also demonstrated via significant changes in three of the four factors as a function of past involvement in MVPA and significant correlations with the frequency, duration, and intensity of current MVPA. Conclusions : These findings support the construct validity of this exercise habit strength model and suggest that it could provide a template for future research on how MVPA habits are developed and maintained.

Construct validity of posture as a measure of physical function in elderly individuals: Use of a digitalized inclinometer to assess trunk inclination.

PubMed

Suzuki, Yoshikazu; Kawai, Hisashi; Kojima, Motonaga; Shiba, Yoshitaka; Yoshida, Hideyo; Hirano, Hirohiko; Fujiwara, Yoshinori; Ihara, Kazushige; Obuchi, Shuichi

2016-09-01

The first aim of the present study was to determine the construct validity of evaluating posture as a measure of physical function in elderly individuals. The second aim was to determine reference values for sternum inclination in elderly individuals when measured using a digitalized inclinometer. We included 834 community-dwelling elderly individuals (350 men and 484 women) in this study. We used a digital inclinometer for measuring sternum inclination angle. We evaluated physical functions, including muscle strength, static balance, gait ability and the functional mobility of our study participants. To assess the construct validity of sternum inclination in elderly people, Pearson's correlation coefficient between sternum inclination and participant characteristics was calculated. To determine a reference value of sternum inclination by age, P for trend was calculated. In men, the sternum inclination angle and sternum inclination index were significantly associated with all anthropometric measures, except static balance. In women, the sternum inclination index was significantly associated with all measures, whereas the sternum inclination angle was associated with all measures except for balance and the Timed Up and Go test. Trend of sternum inclination index by age was significant. Our results show that the sternum inclination as a measure of physical function in elderly men and women has construct validity. We determined reference values for sternum inclination of which trend by age was considered. Geriatr Gerontol Int 2016; 16: 1068-1073. © 2015 Japan Geriatrics Society.

Twelve tips for blueprinting.

PubMed

Coderre, Sylvain; Woloschuk, Wayne; McLaughlin, Kevin

2009-04-01

Content validity is a requirement of every evaluation and is achieved when the evaluation content is congruent with the learning objectives and the learning experiences. Congruence between these three pillars of education can be facilitated by blueprinting. Here we describe an efficient process for creating a blueprint and explain how to use this tool to guide all aspects of course creation and evaluation. A well constructed blueprint is a valuable tool for medical educators. In addition to validating evaluation content, a blueprint can also be used to guide selection of curricular content and learning experiences.

Patient perspective on quality of geriatric care and rehabilitation--development and psychometric testing of a questionnaire.

PubMed

Wressle, Ewa; Eriksson, Lennart; Fahlander, Amie; Rasmusson, Ing-Marie; Tedemalm, Ulla; Tängmark, Karin

2006-06-01

The aim was to develop and test a questionnaire for use in telephone interviews concerning patient evaluation of geriatric care and rehabilitation. Instrument development was performed comprising qualitative interviews, construction of items, content validation, pilot study and data collection for evaluation of care and rehabilitation, clinical utility, reliability and construct validity. Qualitative interviews were performed with 12 elderly participants. The qualitative interviews formed the basis for the construction of 45 items. An expert panel performed a content validation of the questionnaire resulting in a revised version. A pilot study comprised 29 participants recently discharged from geriatric wards and the main data collection comprised 221 participants. Inclusion criteria were being able to perform a telephone interview and willingness to participate. Clinical utility was examined through questions to the interviewers, answered in writing. Cronbach's alpha coefficient was 0.79. According to a factor analysis and the evaluation of clinical utility, the underlying dimensions of the final revised questionnaire concern 'Respect and safety', 'Information and participation' and 'Rehabilitation interventions', scored in 18 items. In addition, one global item concerns satisfaction with care, resulting in 19 items in total. The revised questionnaire was named PaPeR, Patient Perspective on care and Rehabilitation. The questionnaire is considered valid, reliable and judged to have good clinical utility. The time consumption for the telephone interview is about 10-20 minutes. The questionnaire is useful in defining areas for potential quality improvement in geriatric wards.

Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing.

PubMed

Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J

2017-02-01

The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.

Development and evaluation of an instrument to measure health-related quality of life in Cuban breast cancer patients receiving radiotherapy.

PubMed

Lugo, Josefina; Nápoles, Misleidy; Pérez, Inés; Ordaz, Niurka; Luzardo, Mario; Fernández, Leticia

2014-01-01

INTRODUCTION Although modern technology has extended the survival of breast cancer patients, treatment's adverse effects impact their health-related quality of life. Currently, no instrument exists capable of identifying the range of problems affecting breast cancer patients receiving radiotherapy in Cuba's socioeconomic and cultural context. OBJECTIVES Construct and validate an instrument to measure the effects of breast cancer and radiotherapy on health-related quality of life in Cuban patients. METHODS The study was conducted at the Oncology and Radiobiology Institute, Havana, Cuba, from January 2010 through December 2011. Inclusion criteria were: adult female, histological diagnosis of breast cancer, treated with ambulatory radiotherapy, and written informed consent; patients unable to communicate orally or in writing, or who had neurologic or psychiatric conditions were excluded. Development phase: focus groups guided by a list of questions were carried out with 50 women. The patients reported 61 problems affecting their health-related quality-of-life. A nominal group (six oncologists and two nurses) identified the same problems. A syntactic analysis of the information was performed to create items for study and measurement scales. Content validity was determined by a nominal group of seven experts using professional judgment. Another 20 patients were selected to evaluate face validity. Validation phase: the instrument was applied to 230 patients at three different points: before radiotherapy, at the end of radiotherapy and four weeks after radiotherapy was concluded. Reliability, construct validity, discriminant validity, predictive validity, interpretability and response burden were evaluated. RESULTS The final instrument developed had 33 items distributed in 4 domains: physical functioning, psychological functioning, social and family relationships, and physical and emotional adverse effects of disease and treatment. There were two discrete items: perceived general health and perceived health-related quality of life. Content validity and face validity were assessed as acceptable, by experts and patients respectively. Homogeneity, construct validity, and discriminant validity were satisfactory. The best results were obtained with test-retest reliability, predictive validity, and interpretability; the low rate of unanswered questions indicated that the instrument did not produce excessive patient response burden. CONCLUSION The new instrument fulfilled the requirements for measuring impact of breast cancer and of radiotherapy on health-related quality of life in these Cuban patients, validating its usefulness for inclusion in clinical trial protocols.

Development of the 3-SET 4P questionnaire for evaluating former ICU patients' physical and psychosocial problems over time: a pilot study.

PubMed

Akerman, Eva; Fridlund, Bengt; Ersson, Anders; Granberg-Axéll, Anetth

2009-04-01

Current studies reveal a lack of consensus for the evaluation of physical and psychosocial problems after ICU stay and their changes over time. The aim was to develop and evaluate the validity and reliability of a questionnaire for assessing physical and psychosocial problems over time for patients following ICU recovery. Thirty-nine patients completed the questionnaire, 17 were retested. The questionnaire was constructed in three sets: physical problems, psychosocial problems and follow-up care. Face and content validity were tested by nurses, researchers and patients. The questionnaire showed good construct validity in all three sets and had strong factor loadings (explained variance >70%, factor loadings >0.5) for all three sets. There was good concurrent validity compared with the SF 12 (r(s)>0.5). Internal consistency was shown to be reliable (Cronbach's alpha 0.70-0.85). Stability reliability on retesting was good for the physical and psychosocial sets (r(s)>0.5). The 3-set 4P questionnaire was a first step in developing an instrument for assessment of former ICU patients' problems over time. The sample size was small and thus, further studies are needed to confirm these findings.

A Comprehensive, Multi-modal Evaluation of the Assessment System of an Undergraduate Research Methodology Course: Translating Theory into Practice.

PubMed

Mohammad Abdulghani, Hamza; G Ponnamperuma, Gominda; Ahmad, Farah; Amin, Zubair

2014-03-01

To evaluate assessment system of the 'Research Methodology Course' using utility criteria (i.e. validity, reliability, acceptability, educational impact, and cost-effectiveness). This study demonstrates comprehensive evaluation of assessment system and suggests a framework for similar courses. Qualitative and quantitative methods used for evaluation of the course assessment components (50 MCQ, 3 Short Answer Questions (SAQ) and research project) using the utility criteria. RESULTS of multiple evaluation methods for all the assessment components were collected and interpreted together to arrive at holistic judgments, rather than judgments based on individual methods or individual assessment. Face validity, evaluated using a self-administered questionnaire (response rate-88.7%) disclosed that the students perceived that there was an imbalance in the contents covered by the assessment. This was confirmed by the assessment blueprint. Construct validity was affected by the low correlation between MCQ and SAQ scores (r=0.326). There was a higher correlation between the project and MCQ (r=0.466)/SAQ (r=0.463) scores. Construct validity was also affected by the presence of recall type of MCQs (70%; 35/50), item construction flaws and non-functioning distractors. High discriminating indices (>0.35) were found in MCQs with moderate difficulty indices (0.3-0.7). Reliability of the MCQs was 0.75 which could be improved up to 0.8 by increasing the number of MCQs to at least 70. A positive educational impact was found in the form of the research project assessment driving students to present/publish their work in conferences/peer reviewed journals. Cost per student to complete the course was US$164.50. The multi-modal evaluation of an assessment system is feasible and provides thorough and diagnostic information. Utility of the assessment system could be further improved by modifying the psychometrically inappropriate assessment items.

A Comprehensive, Multi-modal Evaluation of the Assessment System of an Undergraduate Research Methodology Course: Translating Theory into Practice

PubMed Central

Mohammad Abdulghani, Hamza; G. Ponnamperuma, Gominda; Ahmad, Farah; Amin, Zubair

2014-01-01

Objective: To evaluate assessment system of the 'Research Methodology Course' using utility criteria (i.e. validity, reliability, acceptability, educational impact, and cost-effectiveness). This study demonstrates comprehensive evaluation of assessment system and suggests a framework for similar courses. Methods: Qualitative and quantitative methods used for evaluation of the course assessment components (50 MCQ, 3 Short Answer Questions (SAQ) and research project) using the utility criteria. Results of multiple evaluation methods for all the assessment components were collected and interpreted together to arrive at holistic judgments, rather than judgments based on individual methods or individual assessment. Results: Face validity, evaluated using a self-administered questionnaire (response rate-88.7%) disclosed that the students perceived that there was an imbalance in the contents covered by the assessment. This was confirmed by the assessment blueprint. Construct validity was affected by the low correlation between MCQ and SAQ scores (r=0.326). There was a higher correlation between the project and MCQ (r=0.466)/SAQ (r=0.463) scores. Construct validity was also affected by the presence of recall type of MCQs (70%; 35/50), item construction flaws and non-functioning distractors. High discriminating indices (>0.35) were found in MCQs with moderate difficulty indices (0.3-0.7). Reliability of the MCQs was 0.75 which could be improved up to 0.8 by increasing the number of MCQs to at least 70. A positive educational impact was found in the form of the research project assessment driving students to present/publish their work in conferences/peer reviewed journals. Cost per student to complete the course was US$164.50. Conclusions: The multi-modal evaluation of an assessment system is feasible and provides thorough and diagnostic information. Utility of the assessment system could be further improved by modifying the psychometrically inappropriate assessment items. PMID:24772117

Criterion-Referenced Testing in Foreign Language Teaching.

ERIC Educational Resources Information Center

Takala, Sauli

A review of literature serves as the basis for a discussion of various aspects of criterion-referenced tests. The aspects discussed are: teaching and evaluation objectives, criterion- and norm-referenced measurement, stages in construction of criterion-referenced tests, construction and selection of items, test validity, and test reliability.…

Evaluating and Comparing Singaporean and Taiwanese Eighth Graders' Conceptions of Science Assessment

ERIC Educational Resources Information Center

Lin, Tzung-Jin; Tan, Aik-Ling; Lee, Min-Hsien; Tsai, Chin-Chung

2017-01-01

Background: Researchers have indicated that assessment practices and methods should support learners' construction of meaningful understanding of knowledge. Understanding students' conceptions of assessment will enable us to construct more realistic, valid and fair assessments. Learners' conceptualization of assessment would be imperative to serve…

Technical considerations in the evaluation of pediatric motor scales.

PubMed

Berk, R A; DeGangi, G A

1979-04-01

Guidelines are suggested for evaluating the validity and reliability of fine and gross motor scales. In the process of examining three types of validity (domain, construct, discriminant) and two types of reliability (interobserver, decision-making), it was found that there were marked deficiencies in most of the instruments currently available, particularly in the areas of discriminant validity and decision-making reliability. Each psychometric property of the scales was addressed from both scale-developer and user perspectives. An evaluative checklist is generated to assist occupational therapists who need to decide on the quality and appropriateness of a motor behavior scale for specific decision applications.

Validating MMI Scores: Are We Measuring Multiple Attributes?

ERIC Educational Resources Information Center

Oliver, Tom; Hecker, Kent; Hausdorf, Peter A.; Conlon, Peter

2014-01-01

The multiple mini-interview (MMI) used in health professional schools' admission processes is reported to assess multiple non-cognitive constructs such as ethical reasoning, oral communication, or problem evaluation. Though validation studies have been performed with total MMI scores, there is a paucity of information regarding how well MMI…

Reliability and Validity of the Evidence-Based Practice Confidence (EPIC) Scale

ERIC Educational Resources Information Center

Salbach, Nancy M.; Jaglal, Susan B.; Williams, Jack I.

2013-01-01

Introduction: The reliability, minimal detectable change (MDC), and construct validity of the evidence-based practice confidence (EPIC) scale were evaluated among physical therapists (PTs) in clinical practice. Methods: A longitudinal mail survey was conducted. Internal consistency and test-retest reliability were estimated using Cronbach's alpha…

Codification and Validation of Professional Development Questionnaire of Teachers

ERIC Educational Resources Information Center

Ayyoobi, Fatemah; Pourshafei, Hadi; Asgari, Ali

2016-01-01

Teacher in the educational system and the teaching-learning process, as a main leading should need to knowledge and professional skills. Therefore, evaluation of professional development is important. This study aims to design and modify Construction and Validation of professional development questionnaire of teachers. This research based on…

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate methodological quality of pharmacological trials. Both risk of bias tools have acceptably high interrater reliability. Copyright © 2017 Elsevier Inc. All rights reserved.

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

PubMed Central

Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-01-01

Background The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users’ satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=−.35, P<.001) and perceived stress (r=−.48, P<.001) demonstrated the construct validity of the scale. Conclusions The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user’s general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user’s perspective in the overall evaluation of Web-based health interventions. PMID:27582341

Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions.

PubMed

Boß, Leif; Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel

2016-08-31

The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

The DASS-14: Improving the Construct Validity and Reliability of the Depression, Anxiety, and Stress Scale in a Cohort of Health Professionals.

PubMed

Wise, Frances M; Harris, Darren W; Olver, John H

2017-01-01

Considerable research has been undertaken in evaluating the DASS-21 in a variety of clinical populations, but studies of the instrument's psychometric adequacy in healthcare professionals is lacking. This study aimed to establish and improve the construct validity and reliability of the DASS-21 in a cohort of Australian health professionals. 343 rehabilitation health professionals completed the DASS-21, along with a demographic questionnaire. Principal components analysis was performed to identify potential factors in the DASS-21. Factors were interpreted against theoretical constructs underlying the instrument. Items loading on separate factors were then subjected to reliability analysis to determine internal consistency of subscales. Items that demonstrated poor fit, or loaded onto more than one factor, were deleted to maximise the reliability of each subscale. Principal components analysis identified three dimensions (depression, anxiety, stress) in a modified version of the DASS-21 (renamed DASS-14), with appropriate construct validity and good reliability (a=0.73 to 0.88). The three dimensions accounted for over 62% of variance between items. The modified DASS-14 scale is a more parsimonious measure of depression, anxiety, and stress, with acceptable reliability and construct validity, in rehabilitation health professionals and is appropriate for use in studies of similar populations.

Psychometrics of A New Questionnaire to Assess Glaucoma Adherence: The Glaucoma Treatment Compliance Assessment Tool (An American Ophthalmological Society Thesis)

PubMed Central

Mansberger, Steven L.; Sheppler, Christina R.; McClure, Tina M.; VanAlstine, Cory L.; Swanson, Ingrid L.; Stoumbos, Zoey; Lambert, William E.

2013-01-01

Purpose: To report the psychometrics of the Glaucoma Treatment Compliance Assessment Tool (GTCAT), a new questionnaire designed to assess adherence with glaucoma therapy. Methods: We developed the questionnaire according to the constructs of the Health Belief Model. We evaluated the questionnaire using data from a cross-sectional study with focus groups (n = 20) and a prospective observational case series (n=58). Principal components analysis provided assessment of construct validity. We repeated the questionnaire after 3 months for test-retest reliability. We evaluated predictive validity using an electronic dosing monitor as an objective measure of adherence. Results: Focus group participants provided 931 statements related to adherence, of which 88.7% (826/931) could be categorized into the constructs of the Health Belief Model. Perceived barriers accounted for 31% (288/931) of statements, cues-to-action 14% (131/931), susceptibility 12% (116/931), benefits 12% (115/931), severity 10% (91/931), and self-efficacy 9% (85/931). The principal components analysis explained 77% of the variance with five components representing Health Belief Model constructs. Reliability analyses showed acceptable Cronbach’s alphas (>.70) for four of the seven components (severity, susceptibility, barriers [eye drop administration], and barriers [discomfort]). Predictive validity was high, with several Health Belief Model questions significantly associated (P <.05) with adherence and a correlation coefficient (R2) of .40. Test-retest reliability was 90%. Conclusion: The GTCAT shows excellent repeatability, content, construct, and predictive validity for glaucoma adherence. A multisite trial is needed to determine whether the results can be generalized and whether the questionnaire accurately measures the effect of interventions to increase adherence. PMID:24072942

An instrument based on protection motivation theory to predict Chinese adolescents' intention to engage in protective behaviors against schistosomiasis.

PubMed

Xiao, Han; Peng, Minjin; Yan, Hong; Gao, Mengting; Li, Jingjing; Yu, Bin; Wu, Hanbo; Li, Shiyue

2016-01-01

Further advancement in schistosomiasis prevention requires new tools to assess protective motivation, and promote innovative intervention program. This study aimed to develop and evaluate an instrument developed based on the Protection Motivation Theory (PMT) to predict protective behavior intention against schistosomiasis among adolescents in China. We developed the Schistosomiasis PMT Scale based on two appraisal pathways of protective motivation- threat appraisal pathway and coping appraisal pathway. Data from a large sample of middle school students ( n  = 2238, 51 % male, mean age 13.13 ± 1.10) recruited in Hubei, China was used to evaluated the validity and reliability of the scale. The final scale contains 18 items with seven sub-constructs. Cronbach's Alpha coefficients for the entire instrument was 0.76, and for the seven sub-constructs of severity, vulnerability, intrinsic reward, extrinsic reward, response efficacy, self-efficacy and response cost was 0.56, 0.82, 0.75, 0.80, 0.90, 0.72 and 0.70, respectively. The construct validity analysis revealed that the one level 7 sub-constructs model fitted data well (GFI = 0.98, CFI = 0.98, RMSEA = 0.03, Chi-sq/df = 3.90, p  < 0.001). Predictive validity showed that both the PMT instrument score and the 7 sub-construct scores were significantly correlated with the intention engaged in protective behavior against schistosomiasis ( p  < 0.05). This study provides a reliable and valid tool to measure protective motivation in schistosomiasis prevention control. Further studies are needed to develop more effective intervention programs for schistosomiasis prevention.

Construct Validity and Reliability of the Beliefs Toward Mental Illness Scale for American, Japanese, and Korean Women.

PubMed

Saint Arnault, Denise M; Gang, Moonhee; Woo, Seoyoon

2017-11-01

The aim of this study was to evaluate the psychometric properties of the Beliefs Toward Mental Illness Scale (BMI) across women from the United States, Japan, and South Korea. A cross-sectional study design was employed. The sample was 564 women aged 21-64 years old who were recruited in the United States and Korea (American = 127, Japanese immigrants in the United States = 204, and Korean = 233). We carried out item analysis, construct validity by confirmatory factor analysis (CFA), and internal consistency using SPSS Version 22 and AMOS Version 22. An acceptable model fit for a 20-item BMI (Beliefs Toward Mental Illness Scale-Revised [BMI-R]) with 3 factors was confirmed using CFA. Construct validity of the BMI-R showed to be all acceptable; convergent validity (average variance extracted [AVE] ≥0.5, construct reliability [CR] ≥0.7) and discriminant validity (r = .65-.89, AVE >.79). The Cronbach's alpha of the BMI-R was .92. These results showed that the BMI was a reliable tool to study beliefs about mental illness across cultures. Our findings also suggested that continued efforts to reduce stigma in culturally specific contexts within and between countries are necessary to promote help-seeking for those suffering from psychological distress.

Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course

NASA Astrophysics Data System (ADS)

Price, Edward; Goldberg, Fred; Robinson, Steve; McKean, Michael

2016-12-01

Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a "calibration" process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers' work. By independently assessing students' responses, we evaluated the CPR calibration process and compared students' peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.

Evaluation of biologic occupational risk control practices: quality indicators development and validation.

PubMed

Takahashi, Renata Ferreira; Gryschek, Anna Luíza F P L; Izumi Nichiata, Lúcia Yasuko; Lacerda, Rúbia Aparecida; Ciosak, Suely Itsuko; Gir, Elucir; Padoveze, Maria Clara

2010-05-01

There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists' assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. The developed indicators were considered validated, and the method used for construction and validation proved to be effective. Copyright (c) 2010 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Reliability and Validity of a Nepalese Version of the Oral Health Impact Profile for Edentulous Subjects.

PubMed

Shrestha, Bidhan; Niraula, Surya Raj; Parajuli, Prakash K; Suwal, Pramita; Singh, Raj Kumar

2018-06-01

To assess the reliability and to validate the translated Nepalese version of the Oral Health Impact Profile (OHIP-EDENT-N) in Nepalese edentulous subjects. The international guidelines for translation and cross-cultural adaption of OHIP-EDENT were followed, and a Nepalese version of the questionnaire was adapted for this study. Eighty-eight completely edentulous subjects were then selected for the study and completed their responses for the questionnaire. The reliability of the OHIP-EDENT-N was evaluated using internal consistency. Validity was assessed as construct and convergent validity. Construct validity was determined using exploratory factor analysis (EFA). The correlation between OHIP-EDENT-N subscale scores and the global question was investigated to test the convergent validity. Cronbach's alpha for the total score of OHIP-EDENT-N was 0.78. Construct validity was assessed by factor analysis: 70.196% of the variance was accountable to five factors extracted from the factor analysis. Factor loadings above 0.40 were noted for all items. In terms of convergent validity, significant correlations could be established between OHIP-EDENT-N and global questions. This study has been able to establish the reliability and validity of the OHIP-EDENT-N, and OHIP-EDENT-N can be a considered a reliable tool to assess the oral health related quality of life in the Nepalese edentulous population. © 2016 by the American College of Prosthodontists.

Evaluation of the Irritable Bowel Syndrome Quality of Life (IBS-QOL) questionnaire in diarrheal-predominant irritable bowel syndrome patients

PubMed Central

2013-01-01

Background Diarrhea-predominant irritable bowel syndrome (IBS-d) significantly diminishes the health-related quality of life (HRQOL) of patients. Psychological and social impacts are common with many IBS-d patients reporting comorbid depression, anxiety, decreased intimacy, and lost working days. The Irritable Bowel Syndrome Quality of Life (IBS-QOL) questionnaire is a 34-item instrument developed and validated for measurement of HRQOL in non-subtyped IBS patients. The current paper assesses this previously-validated instrument employing data collected from 754 patients who participated in a randomized clinical trial of a novel treatment, eluxadoline, for IBS-d. Methods Psychometric methods common to HRQOL research were employed to evaluate the IBS-QOL. Many of the historical analyses of the IBS-QOL validations were used. Other techniques that extended the original methods were applied where more appropriate for the current dataset. In IBS-d patients, we analyzed the items and substructure of the IBS-QOL via item reduction, factor structure, internal consistency, reproducibility, construct validity, and ability to detect change. Results This study supports the IBS-QOL as a psychometrically valid measure. Factor analyses suggested that IBS-specific QOL as measured by the IBS-QOL is a unidimensional construct. Construct validity was further buttressed by significant correlations between IBS-QOL total scores and related measures of IBS-d severity including the historically-relevant Irritable Bowel Syndrome Adequate Relief (IBS-AR) item and the FDA’s Clinical Responder definition. The IBS-QOL also showed a significant ability to detect change as evidenced by analysis of treatment effects. A minority of the items, unrelated to the IBS-d, performed less well by the standards set by the original authors. Conclusions We established that the IBS-QOL total score is a psychometrically valid measure of HRQOL in IBS-d patients enrolled in this study. Our analyses suggest that the IBS-QOL items demonstrate very good construct validity and ability to detect changes due to treatment effects. Furthermore, our analyses suggest that the IBS-QOL items measure a univariate construct and we believe further modeling of the IBS-QOL from an item response theory (IRT) approach under both non-treatment and treatment conditions would greatly further our understanding as item-based methods could be used to develop a short form. PMID:24330412

Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

PubMed

Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

2018-06-04

To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Evaluating and Refining the Construct of Sexual Quality With Item Response Theory: Development of the Quality of Sex Inventory.

PubMed

Shaw, Amanda M; Rogge, Ronald D

2016-02-01

This study took a critical look at the construct of sexual quality. The 65 items of four well-validated self-report measures of sexual satisfaction (the Index of Sexual Satisfaction [ISS], Hudson, Harrison, & Crosscup, 1981; the Global Measure of Sexual Satisfaction [GMSEX], Lawrance & Byers, 1995; the Pinney Sexual Satisfaction Inventory [PSSI], Pinney, Gerrard, & Denney, 1987; the Young Sexual Satisfaction Scale [YSSS], Young, Denny, Luquis, & Young, 1998) and an additional 74 potential sexual quality items were given to 3060 online participants. Using Item Response Theory (IRT), we demonstrated that the ISS, YSSS, and PSSI scales provided suboptimal levels of precision in assessing sexual quality, particularly given the length of those scales. Exploratory factor analyses, IRT, differential item functioning analyses, and longitudinal responsiveness analyses were used to develop and evaluate the Quality of Sex Inventory. Results suggested that, in comparison to existing scales, the QSI (1) offers investigators and clinicians more theoretically focused scales, (2) distinguishes sexual satisfaction from sexual dissatisfaction, and (3) offers greater precision and power for detecting differences with (4) comparably high levels of responsiveness for detecting change over time despite being notably shorter than most of the existing scales. The QSI-satisfaction subscales demonstrated strong convergent validity with other measures of sexual satisfaction and excellent construct validity with anchor scales from the nomological net surrounding that construct, suggesting that they continue to assess the same theoretical construct as prior scales. Implications for research are discussed.

Validation of the INCEPT: A Multisource Feedback Tool for Capturing Different Perspectives on Physicians' Professional Performance.

PubMed

van der Meulen, Mirja W; Boerebach, Benjamin C M; Smirnova, Alina; Heeneman, Sylvia; Oude Egbrink, Mirjam G A; van der Vleuten, Cees P M; Arah, Onyebuchi A; Lombarts, Kiki M J M H

2017-01-01

Multisource feedback (MSF) instruments are used to and must feasibly provide reliable and valid data on physicians' performance from multiple perspectives. The "INviting Co-workers to Evaluate Physicians Tool" (INCEPT) is a multisource feedback instrument used to evaluate physicians' professional performance as perceived by peers, residents, and coworkers. In this study, we report on the validity, reliability, and feasibility of the INCEPT. The performance of 218 physicians was assessed by 597 peers, 344 residents, and 822 coworkers. Using explorative and confirmatory factor analyses, multilevel regression analyses between narrative and numerical feedback, item-total correlations, interscale correlations, Cronbach's α and generalizability analyses, the psychometric qualities, and feasibility of the INCEPT were investigated. For all respondent groups, three factors were identified, although constructed slightly different: "professional attitude," "patient-centeredness," and "organization and (self)-management." Internal consistency was high for all constructs (Cronbach's α ≥ 0.84 and item-total correlations ≥ 0.52). Confirmatory factor analyses indicated acceptable to good fit. Further validity evidence was given by the associations between narrative and numerical feedback. For reliable total INCEPT scores, three peer, two resident and three coworker evaluations were needed; for subscale scores, evaluations of three peers, three residents and three to four coworkers were sufficient. The INCEPT instrument provides physicians performance feedback in a valid and reliable way. The number of evaluations to establish reliable scores is achievable in a regular clinical department. When interpreting feedback, physicians should consider that respondent groups' perceptions differ as indicated by the different item clustering per performance factor.

A Framework for Evaluation and Use of Automated Scoring

ERIC Educational Resources Information Center

Williamson, David M.; Xi, Xiaoming; Breyer, F. Jay

2012-01-01

A framework for evaluation and use of automated scoring of constructed-response tasks is provided that entails both evaluation of automated scoring as well as guidelines for implementation and maintenance in the context of constantly evolving technologies. Consideration of validity issues and challenges associated with automated scoring are…

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

PubMed Central

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

Objective To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. Methods We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Results Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. Conclusion The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism. PMID:22984490

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Validity and reliability of the Spanish-language version of the self-administered Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS) pain scale.

PubMed

López-de-Uralde-Villanueva, I; Gil-Martínez, A; Candelas-Fernández, P; de Andrés-Ares, J; Beltrán-Alacreu, H; La Touche, R

2016-12-08

The self-administered Leeds Assessment of Neuropathic Symptoms and Signs (S-LANSS) scale is a tool designed to identify patients with pain with neuropathic features. To assess the validity and reliability of the Spanish-language version of the S-LANSS scale. Our study included a total of 182 patients with chronic pain to assess the convergent and discriminant validity of the S-LANSS; the sample was increased to 321 patients to evaluate construct validity and reliability. The validated Spanish-language version of the ID-Pain questionnaire was used as the criterion variable. All participants completed the ID-Pain, the S-LANSS, and the Numerical Rating Scale for pain. Discriminant validity was evaluated by analysing sensitivity, specificity, and the area under the receiver operating characteristic curve (AUC). Construct validity was assessed with factor analysis and by comparing the odds ratio of each S-LANSS item to the total score. Convergent validity and reliability were evaluated with Pearson's r and Cronbach's alpha, respectively. The optimal cut-off point for S-LANSS was ≥12 points (AUC=.89; sensitivity=88.7; specificity=76.6). Factor analysis yielded one factor; furthermore, all items contributed significantly to the positive total score on the S-LANSS (P<.05). The S-LANSS showed a significant correlation with ID-Pain (r=.734, α=.71). The Spanish-language version of the S-LANSS is valid and reliable for identifying patients with chronic pain with neuropathic features. Copyright © 2016 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

Validity and reliability of a novel immunosuppressive adverse effects scoring system in renal transplant recipients.

PubMed

Meaney, Calvin J; Arabi, Ziad; Venuto, Rocco C; Consiglio, Joseph D; Wilding, Gregory E; Tornatore, Kathleen M

2014-06-12

After renal transplantation, many patients experience adverse effects from maintenance immunosuppressive drugs. When these adverse effects occur, patient adherence with immunosuppression may be reduced and impact allograft survival. If these adverse effects could be prospectively monitored in an objective manner and possibly prevented, adherence to immunosuppressive regimens could be optimized and allograft survival improved. Prospective, standardized clinical approaches to assess immunosuppressive adverse effects by health care providers are limited. Therefore, we developed and evaluated the application, reliability and validity of a novel adverse effects scoring system in renal transplant recipients receiving calcineurin inhibitor (cyclosporine or tacrolimus) and mycophenolic acid based immunosuppressive therapy. The scoring system included 18 non-renal adverse effects organized into gastrointestinal, central nervous system and aesthetic domains developed by a multidisciplinary physician group. Nephrologists employed this standardized adverse effect evaluation in stable renal transplant patients using physical exam, review of systems, recent laboratory results, and medication adherence assessment during a clinic visit. Stable renal transplant recipients in two clinical studies were evaluated and received immunosuppressive regimens comprised of either cyclosporine or tacrolimus with mycophenolic acid. Face, content, and construct validity were assessed to document these adverse effect evaluations. Inter-rater reliability was determined using the Kappa statistic and intra-class correlation. A total of 58 renal transplant recipients were assessed using the adverse effects scoring system confirming face validity. Nephrologists (subject matter experts) rated the 18 adverse effects as: 3.1 ± 0.75 out of 4 (maximum) regarding clinical importance to verify content validity. The adverse effects scoring system distinguished 1.75-fold increased gastrointestinal adverse effects (p=0.008) in renal transplant recipients receiving tacrolimus and mycophenolic acid compared to the cyclosporine regimen. This finding demonstrated construct validity. Intra-class correlation was 0.81 (95% confidence interval: 0.65-0.90) and Kappa statistic of 0.68 ± 0.25 for all 18 adverse effects and verified substantial inter-rater reliability. This immunosuppressive adverse effects scoring system in stable renal transplant recipients was evaluated and substantiated face, content and construct validity with inter-rater reliability. The scoring system may facilitate prospective, standardized clinical monitoring of immunosuppressive adverse drug effects in stable renal transplant recipients and improve medication adherence.

Reliability and Validity of an Internet-based Questionnaire Measuring Lifetime Physical Activity

PubMed Central

De Vera, Mary A.; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-01-01

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005–2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity. PMID:20876666

Reliability and validity of an internet-based questionnaire measuring lifetime physical activity.

PubMed

De Vera, Mary A; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek

2010-11-15

Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005-2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity.

Poor Validity of the DSM-IV Schizoid Personality Disorder Construct as a Diagnostic Category.

PubMed

Hummelen, Benjamin; Pedersen, Geir; Wilberg, Theresa; Karterud, Sigmund

2015-06-01

This study sought to evaluate the construct validity of schizoid personality disorder (SZPD) by investigating a sample of 2,619 patients from the Norwegian Network of Personality-Focused Treatment Programs by a variety of statistical techniques. Nineteen patients (0.7%) reached the diagnostic threshold of SZPD. Results from the factor analyses indicated that SZPD consists of three factors: social detachment, withdrawal, and restricted affectivity/ anhedonia. Overall, internal consistency and diagnostic efficiency were poor and best for the criteria that belong to the social detachment factor. These findings pose serious questions about the clinical utility of SZPD as a diagnostic category. On the other hand, the three factors were in concordance with findings from previous studies and with the trait model for personality disorders in DSM-5, supporting the validity of SZPD as a dimensional construct. The authors recommend that SZPD should be deleted as a diagnostic category in future editions of DSM-5.

Psychosocial Adjustment to Illness Scale: Factor structure, reliability, and validity assessment in a sample of Greek breast cancer patients.

PubMed

Kolokotroni, Philippa; Anagnostopoulos, Fotios; Missitzis, Ioannis

2017-07-01

The study and measurement of psychosocial adjustment is important for evaluating patients' well-being, and assessing the illness's course, treatment's success, and patients' recovery. In this study, internal consistency reliability and construct validity of the Greek version of the Psychosocial Adjustment to Illness Scale-Self-Report (PAIS-SR) were examined. Demographic and psychosocial data were collected from a sample of 243 women with breast cancer, recruited from September 2011 to December 2012. With some exceptions in specific items, the original conceptually-derived PAIS-SR subscales emerged in a seven-factor solution. Social Environment, Job and Household Duties, and Psychological Distress accounted for more of the total variance than other subscales. PAIS-SR showed good internal consistency reliability, with Cronbach's alpha coefficients >0.62. Correlations of PAIS-SR domains with measures of quality of life and posttraumatic stress symptoms supported the convergent validity of the PAIS-SR and its significance for cancer research. The Greek version of the PAIS-SR has acceptable internal consistency reliability and construct validity, as well as satisfactory convergent validity. Results provide some suggestions for the development of programs to evaluate adjustment status and implement psychosocial interventions among breast cancer survivors.

Evaluation and use of the Materials and Test (MATT) Data System for quality of construction and management review : final report.

DOT National Transportation Integrated Search

1985-12-01

This report documents the review of the MATerials and Test (MATT) Data System to check the validity of data within the system. A computer program to generate the quality level of a construction material was developed. Programs were also developed to ...

Measurement properties of questionnaires assessing participation in children and adolescents with a disability: a systematic review.

PubMed

Rainey, Linda; van Nispen, Ruth; van der Zee, Carlijn; van Rens, Ger

2014-12-01

To critically appraise the measurement properties of questionnaires measuring participation in children and adolescents (0-18 years) with a disability. Bibliographic databases were searched for studies evaluating the measurement properties of self-report or parent-report questionnaires measuring participation in children and adolescents (0-18 years) with a disability. The methodological quality of the included studies and the results of the measurement properties were evaluated using a checklist developed on consensus-based standards. The search strategy identified 3,977 unique publications, of which 22 were selected; these articles evaluated the development and measurement properties of eight different questionnaires. The Child and Adolescent Scale of Participation was evaluated most extensively, generally showing moderate positive results on content validity, internal consistency, reliability and construct validity. The remaining questionnaires also demonstrated positive results. However, at least 50 % of the measurement properties per questionnaire were not (or only poorly) assessed. Studies of high methodological quality, using modern statistical methods, are needed to accurately assess the measurement properties of currently available questionnaires. Moreover, consensus is required on the definition of the construct 'participation' to determine content validity and to enable meaningful interpretation of outcomes.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Multidimensional assessment of homework: an analysis of students with ADHD.

PubMed

Mautone, Jennifer A; Marshall, Stephen A; Costigan, Tracy E; Clarke, Angela T; Power, Thomas J

2012-10-01

Homework can have beneficial effects for students; however, it presents challenges, particularly for students with attention problems. Although effective homework interventions exist, intervention development and evaluation has been hampered by the lack of psychometrically sound measures. The primary purpose of this study was to evaluate the construct validity of the Homework Performance Questionnaire (HPQ), Parent and Teacher Versions, in a sample of children with ADHD. A secondary purpose was to examine variations in homework performance as a function of individual characteristics, such as academic achievement, quality of the family-school relationship, and child's diagnostic status. The sample included 91 children (34% female) with ADHD in Grades 2 to 6. Measures included parent and teacher ratings of homework performance and the quality of the parent-teacher relationship as well as direct assessment of child academic achievement and homework performance (i.e., samples of completed assignments). Correlational analyses were used to examine construct validity, and ANOVAs were used to evaluate group differences. Each factor of the HPQ had a significant relationship with other measures of relevant constructs. There were no significant differences in homework performance between groups for ADHD subtype, medication status, or comorbidity, with the exception of learning disability. Children with ADHD and learning disabilities had significantly lower teacher ratings of academic competence. Results of the present study suggest that HPQ scores may be used to make valid inferences about the homework performance of children with attention problems. These rating scales may be helpful in progress monitoring and evaluating intervention effectiveness.

Development and validation of a Malawian version of the primary care assessment tool.

PubMed

Dullie, Luckson; Meland, Eivind; Hetlevik, Øystein; Mildestvedt, Thomas; Gjesdal, Sturla

2018-05-16

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability. Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.

The Construct Validity of Teachers' Perceptions of Change in Schools Implementing Comprehensive School Reform Models

ERIC Educational Resources Information Center

Nunnery, John A.; Ross, Steven M.; Bol, Linda

2008-01-01

This study reports the results of a validation study of the Comprehensive School Restructuring Teacher Questionnaire (CSRTQ) and the School Observation Measure (SOM), which are intended for use in evaluating comprehensive school reform efforts. The CSRTQ, which putatively measures five factors related to school restructuring (internal focus,…

An Evaluation of the Psychache Scale on an Offender Population

ERIC Educational Resources Information Center

Mills, Jeremy F.; Green, Kate; Reddon, John R.

2005-01-01

This study examined the generalizability of a self-report measure of psychache to an offender population. The factor structure, construct validity, and criterion validity of the Psychache Scale was assessed on 136 male prison inmates. The results showed the Psychache Scale has a single underlying factor structure and to be strongly associated with…

Reliability and Validity of Finger Strength and Endurance Measurements in Rock Climbing

ERIC Educational Resources Information Center

Michailov, Michail Lubomirov; Baláš, Jirí; Tanev, Stoyan Kolev; Andonov, Hristo Stoyanov; Kodejška, Jan; Brown, Lee

2018-01-01

Purpose: An advanced system for the assessment of climbing-specific performance was developed and used to: (a) investigate the effect of arm fixation (AF) on construct validity evidence and reliability of climbing-specific finger-strength measurement; (b) assess reliability of finger-strength and endurance measurements; and (c) evaluate the…

Studying Cross-Cultural Differences in Temperament in the First Year of Life: United States and Italy

ERIC Educational Resources Information Center

Montirosso, Rosario; Cozzi, Patrizia; Putnam, Samuel P.; Gartstein, Maria A.; Borgatti, Renato

2011-01-01

An Italian translation of the Infant Behavior Questionnaire-Revised (IBQ-R) was developed and evaluated with 110 infants, demonstrating satisfactory internal consistency, discriminant validity, and construct validity in the form of gender and age differences, as well as factorial integrity. Cross-cultural differences were subsequently evaluated…

Initial Validation of the Teacher/Coach Role Conflict Scale

ERIC Educational Resources Information Center

Richards, K. Andrew R.; Levesque-Bristol, Chantal; Templin, Thomas J.

2014-01-01

The study of teacher/coach role conflict has a long history in the physical education literature. However, only a few studies have measured the construct using psychometric instrumentation. Ryan (2008) created one such instrument, but the survey was not validated prior to use. As such, the purpose of this investigation was to evaluate the…

Construct Validation of Three Nutrition Questions Using Health and Diet Ratings in Older Canadian Males Living in the Community.

PubMed

Akhtar, Usman; Keller, Heather H; Tate, Robert B; Lengyel, Christina O

2015-12-01

Brief nutrition screening tools are desired for research and practice. Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN-II, 14 items) and the abbreviated version SCREEN-II-AB (8 items) are valid and reliable nutrition screening tools for older adults. This exploratory study used a retrospective cross-sectional design to determine the construct validity of a subset of 3 items (weight loss, appetite, and swallowing difficulty) currently on the SCREEN-II and SCREEN-II-AB tools. Secondary data on community-dwelling senior males (n = 522, mean ± SD age = 86.7 ± 3.0 years) in the Manitoba Follow-up Study (MFUS) study were available for analysis. Participants completed the mailed MFUS Nutrition Survey that included SCREEN-II items and questions pertaining to self-rated health, diet healthiness, and rating of the importance of nutrition towards successful aging as the constructs for comparison. Self-perceived health status (F = 14.7, P < 0.001), diet healthiness (ρ = 0.17, P = 0.002) and the rating of nutrition's importance to aging (ρ = 0.10, P = 0.03) were correlated with the 3-item score. Inferences were consistent with associations between these construct variables and the full SCREEN-II. Three items from SCREEN-II and SCREEN-II-AB demonstrate initial construct validity with self-perceived health status and diet healthiness ratings by older males; further exploration for criterion and predictive validity in more diverse samples is needed.

Development and Psychometric Evaluation of a New Instrument for Measuring Sleep Length and Television and Computer Habits of Swedish School-Age Children

ERIC Educational Resources Information Center

Garmy, Pernilla; Jakobsson, Ulf; Nyberg, Per

2012-01-01

The aim was to develop a new instrument for measuring length of sleep as well as television and computer habits in school-age children. A questionnaire was constructed for use when children visit the school health care unit. Three aspects of the validity of the questionnaire were examined: its face validity, content validity, and construct…

Preliminary validation of the Yale Food Addiction Scale.

PubMed

Gearhardt, Ashley N; Corbin, William R; Brownell, Kelly D

2009-04-01

Previous research has found similarities between addiction to psychoactive substances and excessive food consumption. Further exploration is needed to evaluate the concept of "food addiction," as there is currently a lack of psychometrically validated measurement tools in this area. The current study represents a preliminary exploration of the Yale Food Addiction Scale (YFAS), designed to identify those exhibiting signs of addiction towards certain types of foods (e.g., high fat and high sugar). Survey data were collected from 353 respondents from a stratified random sample of young adults. In addition to the YFAS, the survey assessed eating pathology, alcohol consumption and other health behaviors. The YFAS exhibited adequate internal reliability, and showed good convergent validity with measures of similar constructs and good discriminant validity relative to related but dissimilar constructs. Additionally, the YFAS predicted binge-eating behavior above and beyond existing measures of eating pathology, demonstrating incremental validity. The YFAS is a sound tool for identifying eating patterns that are similar to behaviors seen in classic areas of addiction. Further evaluation of the scale is needed, especially due to a low response rate of 24.5% and a non-clinical sample, but confirmation of the reliability and validity of the scale has the potential to facilitate empirical research on the concept of "food addiction".

Cross-cultural evaluation of the French version of the LEIPAD, a health-related quality of life instrument for use in the elderly living at home.

PubMed

Jalenques, I; Auclair, C; Roblin, J; Morand, D; Tourtauchaux, R; May, R; Vaille-Perret, E; Watts, J; Gerbaud, L; De Leo, D

2013-04-01

To cross-culturally adapt a French version of the LEIPAD, a self-administered questionnaire assessing the health-related quality of life (HRQoL) in adults aged 65 years and over living at home, and to evaluate its psychometric properties. After having translated LEIPAD in accordance with guidelines, we studied psychometric properties: reliability and construct validity-factor analysis, relationships between items and scales, internal consistency, concurrent validity with the Medical Outcome Study Short-Form 36 and known-groups validity. The results obtained in a sample of 195 elderly from the general population showed very good acceptability, with response rates superior to 93 %. Exploratory factor analysis extracted eight factors providing a multidimensionality structure with five misclassifications of items in the seven theoretical scales. Good internal consistency (Cronbach's alpha ranging from 0.73 and 0.86) and strong test-retest reliability (ICCs higher than 0.80 for six scales and 0.70 for one) were demonstrated. Concurrent validity with the SF-36 showed small to strong expected correlations. This first evaluation of the French version of LEIPAD's psychometric properties provides evidence in construct validity and reliability. It would allow HRQoL assessment in clinical and common practice, and investigators would be able to take part in national and international research projects.

Spinal Cord Injury Pain Instrument and painDETECT questionnaire: Convergent construct validity in individuals with Spinal Cord Injury.

PubMed

Franz, S; Schuld, C; Wilder-Smith, E P; Heutehaus, L; Lang, S; Gantz, S; Schuh-Hofer, S; Treede, R-D; Bryce, T N; Wang, H; Weidner, N

2017-11-01

Neuropathic pain (NeuP) is a frequent sequel of spinal cord injury (SCI). The SCI Pain Instrument (SCIPI) was developed as a SCI-specific NeuP screening tool. A preliminary validation reported encouraging results requiring further evaluation in terms of psychometric properties. The painDETECT questionnaire (PDQ), a commonly applied NeuP assessment tool, was primarily validated in German, but not specifically developed for SCI and not yet validated according to current diagnostic guidelines. We aimed to provide convergent construct validity and to identify the optimal item combination for the SCIPI. The PDQ was re-evaluated according to current guidelines with respect to SCI-related NeuP. Prospective monocentric study. Subjects received a neurological examination according to the International Standards for Neurological Classification of SCI. After linguistic validation of the SCIPI, the IASP-grading system served as reference to diagnose NeuP, accompanied by the PDQ after its re-evaluation as binary classifier. Statistics were evaluated through ROC-analysis, with the area under the ROC curve (AUROC) as optimality criterion. The SCIPI was refined by systematic item permutation. Eighty-eight individuals were assessed with the German SCIPI. Of 127 possible combinations, a 4-item-SCIPI (cut-off-score = 1.5/sensitivity = 0.864/specificity = 0.839) was identified as most reasonable. The SCIPI showed a strong correlation (r sp  = 0.76) with PDQ. ROC-analysis of SCIPI/PDQ (AUROC = 0.877) revealed comparable results to SCIPI/IASP (AUROC = 0.916). ROC-analysis of PDQ/IASP delivered a score threshold of 10.5 (sensitivity = 0.727/specificity = 0.903). The SCIPI is a valid easy-to-apply NeuP screening tool in SCI. The PDQ is recommended as complementary NeuP assessment tool in SCI, e.g. to monitor pain severity and/or its time-dependent course. In SCI-related pain, both SCIPI and PainDETECT show strong convergent construct validity versus the current IASP-grading system. SCIPI is now optimized from a 7-item to an easy-to-apply 4-item screening tool in German and English. We provided evidence that the scope for PainDETECT can be expanded to individuals with SCI. © 2017 European Pain Federation - EFIC®.

Positive mental health literacy: development and validation of a measure among Norwegian adolescents.

PubMed

Bjørnsen, Hanne Nissen; Eilertsen, Mary Elizabeth Bradley; Ringdal, Regine; Espnes, Geir Arild; Moksnes, Unni Karin

2017-09-18

Mental health literacy (MHL), or the knowledge and abilities necessary to benefit mental health, is a significant determinant of mental health and has the potential to benefit both individual and public mental health. MHL and its measures have traditionally focused on knowledge and beliefs about mental -ill-health rather than on mental health. No measures of MHL addressing knowledge of good or positive mental health have been identified. This study aimed to develop and validate an instrument measuring adolescents' knowledge of how to obtain and maintain good mental health and to evaluate the psychometric properties of the instrument. More specifically, the factor structure, internal and construct validity, and test-retest reliability were assessed. The participants were Norwegian upper secondary school students aged 15-21 years. The development and validation of the instrument entailed three phases: 1) item generation based on the basic psychological needs theory (BPNT), focus group interviews, and a narrative literature review, 2) a pilot study (n = 479), and 3) test-retest (n = 149), known-groups validity (n = 44), and scale construction, item reduction through principal component analysis (PCA), and confirmatory factor analysis (CFA) for factor structure and psychometric properties assessment (n = 1888). Thirty-two items were initially generated, and 15 were selected for the pilot study. PCA identified cross-loadings, and a one-factor solution was examined. After removing five problematic items, CFA yielded a satisfactory fit for a 10-item one-factor model, referred to as the mental health-promoting knowledge (MHPK-10) measure. The test-retest evaluation supported the stability of the measure. McDonald's omega was 0.84, and known-groups validity test indicated good construct validity. A valid and reliable one-dimensional instrument measuring knowledge of factors promoting good mental health among adolescents was developed. The instrument has the potential to complement current measures of MHL and may be useful when planning mental health promotion activities and evaluating public mental health education initiatives in adolescents.

Beyond Description in Interpersonal Construct Validation: Methodological Advances in the Circumplex Structural Summary Approach.

PubMed

Zimmermann, Johannes; Wright, Aidan G C

2017-01-01

The interpersonal circumplex is a well-established structural model that organizes interpersonal functioning within the two-dimensional space marked by dominance and affiliation. The structural summary method (SSM) was developed to evaluate the interpersonal nature of other constructs and measures outside the interpersonal circumplex. To date, this method has been primarily descriptive, providing no way to draw inferences when comparing SSM parameters across constructs or groups. We describe a newly developed resampling-based method for deriving confidence intervals, which allows for SSM parameter comparisons. In a series of five studies, we evaluated the accuracy of the approach across a wide range of possible sample sizes and parameter values, and demonstrated its utility for posing theoretical questions on the interpersonal nature of relevant constructs (e.g., personality disorders) using real-world data. As a result, the SSM is strengthened for its intended purpose of construct evaluation and theory building. © The Author(s) 2015.

Validity and reproducibility of the Physical Activity Scale for the Elderly (PASE) questionnaire for the measurement of the physical activity level in patients after total knee arthroplasty.

PubMed

Bolszak, Sylvain; Casartelli, Nicola C; Impellizzeri, Franco M; Maffiuletti, Nicola A

2014-02-20

The need for valid and reproducible questionnaires to routinely assess the physical activity level of patients after total knee arthroplasty (TKA) is of particular concern in clinical settings. Aims of this study were to evaluate the validity and reproducibility of the physical activity scale for the elderly (PASE) questionnaire in TKA patients, with a particular view on gender differences. A total of 50 elderly patients (25 women and 25 men aged 70 ± 6 years) following primary unilateral TKA were recruited. The reproducibility was evaluated by administering the PASE questionnaire during two occasions separated by 7 days. The construct (criterion) validity was investigated by comparing the physical activity level reported by patients in the PASE questionnaire to that measured by accelerometry. Reproducibility was evaluated using intraclass correlation coefficients (ICC3,1) for reliability and standard error of measurement (SEM) and smallest detectable change (SDC) for agreement, while validity was investigated with Pearson correlation coefficients. Reliability of the PASE total score was acceptable for men (ICC = 0.77) but not for women (ICC = 0.58). Its agreement was low for both men and women, as witnessed by high SEM (32% and 35%, respectively) and SDC (89% and 97%, respectively). Construct validity of the PASE total score was low in both men (r = 0.45) and women (r = 0.06). The PASE questionnaire has several validity and reproducibility shortcomings, therefore its use is not recommended for the assessment of physical activity level in patients after TKA, particularly in women.

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men.

PubMed

Hussein, Ahmed A; Sexton, Kevin J; May, Paul R; Meng, Maxwell V; Hosseini, Abolfazl; Eun, Daniel D; Daneshmand, Siamak; Bochner, Bernard H; Peabody, James O; Abaza, Ronney; Skinner, Eila C; Hautmann, Richard E; Guru, Khurshid A

2018-04-13

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men. A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation. The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains. We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.

Validity and reliability of the robotic objective structured assessment of technical skills

PubMed Central

Siddiqui, Nazema Y.; Galloway, Michael L.; Geller, Elizabeth J.; Green, Isabel C.; Hur, Hye-Chun; Langston, Kyle; Pitter, Michael C.; Tarr, Megan E.; Martino, Martin A.

2015-01-01

Objective Objective structured assessments of technical skills (OSATS) have been developed to measure the skill of surgical trainees. Our aim was to develop an OSATS specifically for trainees learning robotic surgery. Study Design This is a multi-institutional study in eight academic training programs. We created an assessment form to evaluate robotic surgical skill through five inanimate exercises. Obstetrics/gynecology, general surgery, and urology residents, fellows, and faculty completed five robotic exercises on a standard training model. Study sessions were recorded and randomly assigned to three blinded judges who scored performance using the assessment form. Construct validity was evaluated by comparing scores between participants with different levels of surgical experience; inter- and intra-rater reliability were also assessed. Results We evaluated 83 residents, 9 fellows, and 13 faculty, totaling 105 participants; 88 (84%) were from obstetrics/gynecology. Our assessment form demonstrated construct validity, with faculty and fellows performing significantly better than residents (mean scores: 89 ± 8 faculty; 74 ± 17 fellows; 59 ± 22 residents, p<0.01). In addition, participants with more robotic console experience scored significantly higher than those with fewer prior console surgeries (p<0.01). R-OSATS demonstrated good inter-rater reliability across all five drills (mean Cronbach's α: 0.79 ± 0.02). Intra-rater reliability was also high (mean Spearman's correlation: 0.91 ± 0.11). Conclusions We developed an assessment form for robotic surgical skill that demonstrates construct validity, inter- and intra-rater reliability. When paired with standardized robotic skill drills this form may be useful to distinguish between levels of trainee performance. PMID:24807319

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers.

PubMed

Viester, Laura; Verhagen, Evert A L M; Bongers, Paulien M; van der Beek, Allard J

2014-11-01

To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions. Effectiveness was assessed on motivational stage-of-change, self-efficacy, and decisional balance for physical activity and dietary behavior. The external validity of the trial was satisfactory with representative reach of workers and adoption of workplace units in the participating construction company. The extent to which the program was implemented as intended was modest. The intervention was effective on participants' progress through stages of behavior change. Based on the RE-AIM dimensions, it is concluded that for construction workers, the program is feasible and potentially effective, but adjustments are required before widespread implementation.

Cross-cultural adaptation and validation of the Japanese version of the new Knee Society Scoring System for osteoarthritic knee with total knee arthroplasty.

PubMed

Hamamoto, Yosuke; Ito, Hiromu; Furu, Moritoshi; Ishikawa, Masahiro; Azukizawa, Masayuki; Kuriyama, Shinichi; Nakamura, Shinichiro; Matsuda, Shuichi

2015-09-01

The purposes of this study were to translate the new Knee Society Score (KSS) into Japanese and to evaluate the construct and content validity, test-retest reliability, and internal consistency of the Japanese version of the new KSS. The Japanese version of the KSS was developed according to cross-cultural guidelines by using the "translation-back translation" method to ensure content validity. KSS data were then obtained from patients who had undergone total knee arthroplasty (TKA). The psychometric properties evaluated were as follows: for feasibility, response rate, and floor and ceiling effects; for construct validity, internal consistency using Cronbach's alpha, and correlations with quality of life. Construct validity was evaluated by using Spearman's correlation coefficient to quantify the correlation between the KSS and the Japanese version of the Oxford 12-item Knee Score or Short Form 36 Health Survey (SF-36) questionnaires. The Japanese version of the KSS was sent to 93 consecutive osteoarthritic patients who underwent primary TKA in our institution. Fifty-five patients completed the questionnaires and were included in this study. Neither a floor nor ceiling effect was observed. The reliability proved excellent in the majority of domains, with intraclass correlation coefficients of 0.65-0.88. Internal consistency, assessed by Cronbach's alpha, was good to excellent for all domains (0.78-0.94). All of the four domains of the KSS correlated significantly with the Oxford 12-item Knee Score. The activity and satisfaction domains of the KSS correlated significantly with all and the majority of subscales of the SF-36, respectively, whereas symptoms and expectation domains showed significant correlations only with bodily pain and vitality subscales and with the physical function, bodily pain, and vitality subscales, respectively. The Japanese version of the new KSS is a valid, reliable, and responsive instrument to capture subjective aspects of the functional symptoms and abilities of patients who undergo TKA.

Intrarater Reliability and Other Psychometrics of the Health Promoting Activities Scale (HPAS).

PubMed

Muskett, Rachel; Bourke-Taylor, Helen; Hewitt, Alana

The Health Promoting Activities Scale (HPAS) measures the self-rated frequency with which adults participate in activities that promote health. We evaluated the internal consistency, construct validity, and intrarater reliability of the HPAS with a cohort of mothers (N = 56) of school-age children. We used an online survey that included the HPAS and measures of mental and physical health. Statistical analysis included intraclass correlation coefficients (ICCs), measurement error, error range, limits of agreement, and minimum detectable change (MDC). The HPAS showed good internal consistency (Cronbach's α = .73). Construct validity was supported by a significant difference in HPAS scores among participants grouped by physical activity level; no other differences were significant. Results included a high aggregate ICC of .90 and an MDC of 5 points. Our evaluation of the HPAS revealed good reliability and stability, suggesting suitability for ongoing evaluation as an outcome measure. Copyright © 2017 by the American Occupational Therapy Association, Inc.

Assessing the construct validity and reliability of the Parental Perception on Antibiotics (PAPA) scales.

PubMed

Alumran, Arwa; Hou, Xiang-Yu; Sun, Jiandong; Yousef, Abdullah A; Hurst, Cameron

2014-01-23

The overuse of antibiotics is becoming an increasing concern. Antibiotic resistance, which increases both the burden of disease, and the cost of health services, is perhaps the most profound impact of antibiotics overuse. Attempts have been made to develop instruments to measure the psychosocial constructs underlying antibiotics use, however, none of these instruments have undergone thorough psychometric validation. This study evaluates the psychometric properties of the Parental Perceptions on Antibiotics (PAPA) scales. The PAPA scales attempt to measure the factors influencing parental use of antibiotics in children. 1111 parents of children younger than 12 years old were recruited from primary schools' parental meetings in the Eastern Province of Saudi Arabia from September 2012 to January 2013. The structure of the PAPA instrument was validated using Confirmatory Factor Analysis (CFA) with measurement model fit evaluated using the raw and scaled χ2, Goodness of Fit Index, and Root Mean Square Error of Approximation. A five-factor model was confirmed with the model showing good fit. Constructs in the model include: Knowledge and Beliefs, Behaviors, Sources of information, Adherence, and Awareness about antibiotics resistance. The instrument was shown to have good internal consistency, and good discriminant and convergent validity. The availability of an instrument able to measure the psychosocial factors underlying antibiotics usage allows the risk factors underlying antibiotic use and overuse to now be investigated.

Methodology for Developing a New EFNEP Food and Physical Activity Behaviors Questionnaire.

PubMed

Murray, Erin K; Auld, Garry; Baker, Susan S; Barale, Karen; Franck, Karen; Khan, Tarana; Palmer-Keenan, Debra; Walsh, Jennifer

2017-10-01

Research methods are described for developing a food and physical activity behaviors questionnaire for the Expanded Food and Nutrition Education Program (EFNEP), a US Department of Agriculture nutrition education program serving low-income families. Mixed-methods observational study. The questionnaire will include 5 domains: (1) diet quality, (2) physical activity, (3) food safety, (4) food security, and (5) food resource management. A 5-stage process will be used to assess the questionnaire's test-retest reliability and content, face, and construct validity. Research teams across the US will coordinate questionnaire development and testing nationally. Convenience samples of low-income EFNEP, or EFNEP-eligible, adult participants across the US. A 5-stage process: (1) prioritize domain concepts to evaluate (2) question generation and content analysis panel, (3) question pretesting using cognitive interviews, (4) test-retest reliability assessment, and (5) construct validity testing. A nationally tested valid and reliable food and physical activity behaviors questionnaire for low-income adults to evaluate EFNEP's effectiveness. Cognitive interviews will be summarized to identify themes and dominant trends. Paired t tests (P ≤ .05) and Spearman and intra-class correlation coefficients (r > .5) will be conducted to assess reliability. Construct validity will be assessed using Wilcoxon t test (P ≤ .05), Spearman correlations, and Bland-Altman plots. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

The theoretical and psychometric properties of the Subjective Traumatic Outlook (STO) questionnaire.

PubMed

Palgi, Yuval; Shrira, Amit; Ben-Ezra, Menachem

2017-07-01

The present study aimed to develop the theoretical construct and examine the psychometric properties of a new scale for measuring subjective traumatic outlook (STO) among individuals exposed to traumatic events. The main idea behind this construct is to assess individual differences in the way people exposed to traumatic experiences subjectively perceive their trauma. Using four samples, we conducted five studies that examine the new questionnaire's exploratory/confirmatory factor analysis (EFA/CFA), test-retest reliability, and construct validity. The STO was best captured by a five-item factor construct. This construct was found to have good convergent validity with similar, related subjective evaluations of PTSD and PTSD-related constructs. Yet, the STO also has unique and divergent properties compared to other questionnaires. The STO is a new, short questionnaire with excellent psychometric properties. It may provide practitioners with a good screening tool for attaining first impression about one's inner traumatic world, and predicting future risk for developing PTSD. Copyright © 2017. Published by Elsevier B.V.

Evaluation of the psychometric properties of the main meal quality index when applied in the UK population.

PubMed

Gorgulho, B M; Pot, G K; Marchioni, D M

2017-05-01

The aim of this study was to evaluate the validity and reliability of the Main Meal Quality Index when applied on the UK population. The indicator was developed to assess meal quality in different populations, and is composed of 10 components: fruit, vegetables (excluding potatoes), ratio of animal protein to total protein, fiber, carbohydrate, total fat, saturated fat, processed meat, sugary beverages and desserts, and energy density, resulting in a score range of 0-100 points. The performance of the indicator was measured using strategies for assessing content validity, construct validity, discriminant validity and reliability, including principal component analysis, linear regression models and Cronbach's alpha. The indicator presented good reliability. The Main Meal Quality Index has been shown to be valid for use as an instrument to evaluate, monitor and compare the quality of meals consumed by adults in the United Kingdom.

Development of a Chinese version of the Western Ontario Meniscal Evaluation Tool: cross-cultural adaptation and psychometric evaluation.

PubMed

Tong, W W; Wang, W; Xu, W D

2016-08-15

The Western Ontario Meniscal Evaluation Tool (WOMET) is a questionnaire designed to evaluate the health-related quality of life (HRQOL) of patients with meniscal pathology. Our study aims to culturally adapt and validate the WOMET into a Chinese version. We translated the WOMET into Chinese. Then, a total of 121 patients with meniscal pathology were invited to participate in this study. To assess the test-retest reliability, the Chinese version WOMET was completed twice at 7-day intervals by the participants. The construct validity was assessed using Pearson's correlation coefficient or Spearman's correlation to test for correlations among the Chinese version WOMET and the eight domains of Short Form-36 (SF-36), the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), and the International Knee Documentation Committee (IKDC) score. Responsiveness was tested by comparison of the preoperative and postoperative scores of the Chinese version WOMET. The test-retest reliability of the overall scale and different domains were all found to be excellent. The Cronbach's α was 0.90. The Chinese version WOMET correlated well with other questionnaires which suggested good construct validity. We observed no ceiling and floor effects of the Chinese version WOMET. We also found good responsiveness for the effect size, and the standardized response mean values were 0.86 and 1.11. The Chinese version of the WOMET appears to be reliable and valid in evaluating patients with meniscal pathology.

Design of psychosocial factors questionnaires: a systematic measurement approach

PubMed Central

Vargas, Angélica; Felknor, Sarah A

2012-01-01

Background Evaluation of psychosocial factors requires instruments that measure dynamic complexities. This study explains the design of a set of questionnaires to evaluate work and non-work psychosocial risk factors for stress-related illnesses. Methods The measurement model was based on a review of literature. Content validity was performed by experts and cognitive interviews. Pilot testing was carried out with a convenience sample of 132 workers. Cronbach’s alpha evaluated internal consistency and concurrent validity was estimated by Spearman correlation coefficients. Results Three questionnaires were constructed to evaluate exposure to work and non-work risk factors. Content validity improved the questionnaires coherence with the measurement model. Internal consistency was adequate (α=0.85–0.95). Concurrent validity resulted in moderate correlations of psychosocial factors with stress symptoms. Conclusions Questionnaires´ content reflected a wide spectrum of psychosocial factors sources. Cognitive interviews improved understanding of questions and dimensions. The structure of the measurement model was confirmed. PMID:22628068

Validation of the trait anxiety scale for state-trait anxiety inventory in suicide victims and living controls of Chinese rural youths.

PubMed

Zhang, Jie; Gao, Qi

2012-01-01

This study evaluated the validation of STAI Trait-Anxiety Scale in suicide cases and community living controls in rural China. The participants were 392 suicides and 416 controls. Cronbach's Alpha was computed to evaluate the internal consistency. The Spearman Correlation Coefficient between Trait-Anxiety Scale and other instrument was calculated to evaluate the external validity, and the Exploratory Factor Analysis was used to evaluate the construct validity. The results showed the Cronbach's Alpha was .891 and .787 respectively in case and control groups. Most of the correlations between instruments were significant. We found 2 factors in cases and 3 factors in controls. We could cautiously infer that the Trait Anxiety Scale was an adequate tool to measure trait anxiety through proxy data in suicide victims and living controls in rural China.

The Factor Structure of the Spiritual Well-Being Scale in Veterans Experienced Chemical Weapon Exposure.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Boyle, Christopher; Yaghoobzadeh, Ameneh; Tahmasbi, Bahram; Rassool, G Hussein; Taebei, Mozhgan; Soleimani, Mohammad Ali

2018-04-01

This study aimed to determine the factor structure of the spiritual well-being among a sample of the Iranian veterans. In this methodological research, 211 male veterans of Iran-Iraq warfare completed the Paloutzian and Ellison spiritual well-being scale. Maximum likelihood (ML) with oblique rotation was used to assess domain structure of the spiritual well-being. The construct validity of the scale was assessed using confirmatory factor analysis (CFA), convergent validity, and discriminant validity. Reliability was evaluated with Cronbach's alpha, Theta (θ), and McDonald Omega (Ω) coefficients, intra-class correlation coefficient (ICC), and construct reliability (CR). Results of ML and CFA suggested three factors which were labeled "relationship with God," "belief in fate and destiny," and "life optimism." The ICC, coefficients of the internal consistency, and CR were >.7 for the factors of the scale. Convergent validity and discriminant validity did not fulfill the requirements. The Persian version of spiritual well-being scale demonstrated suitable validity and reliability among the veterans of Iran-Iraq warfare.

Five-level emergency triage systems: variation in assessment of validity.

PubMed

Kuriyama, Akira; Urushidani, Seigo; Nakayama, Takeo

2017-11-01

Triage systems are scales developed to rate the degree of urgency among patients who arrive at EDs. A number of different scales are in use; however, the way in which they have been validated is inconsistent. Also, it is difficult to define a surrogate that accurately predicts urgency. This systematic review described reference standards and measures used in previous validation studies of five-level triage systems. We searched PubMed, EMBASE and CINAHL to identify studies that had assessed the validity of five-level triage systems and described the reference standards and measures applied in these studies. Studies were divided into those using criterion validity (reference standards developed by expert panels or triage systems already in use) and those using construct validity (prognosis, costs and resource use). A total of 57 studies examined criterion and construct validity of 14 five-level triage systems. Criterion validity was examined by evaluating (1) agreement between the assigned degree of urgency with objective standard criteria (12 studies), (2) overtriage and undertriage (9 studies) and (3) sensitivity and specificity of triage systems (7 studies). Construct validity was examined by looking at (4) the associations between the assigned degree of urgency and measures gauged in EDs (48 studies) and (5) the associations between the assigned degree of urgency and measures gauged after hospitalisation (13 studies). Particularly, among 46 validation studies of the most commonly used triages (Canadian Triage and Acuity Scale, Emergency Severity Index and Manchester Triage System), 13 and 39 studies examined criterion and construct validity, respectively. Previous studies applied various reference standards and measures to validate five-level triage systems. They either created their own reference standard or used a combination of severity/resource measures. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Construct Validity of the Emotional Eating Scale Adapted for Children and Adolescents

PubMed Central

Vannucci, Anna; Tanofsky-Kraff, Marian; Shomaker, Lauren B.; Ranzenhofer, Lisa M.; Matheson, Brittany E.; Cassidy, Omni L.; Zocca, Jaclyn M.; Kozlosky, Merel; Yanovski, Susan Z.; Yanovski, Jack A.

2012-01-01

Background Emotional eating, defined as eating in response to a range of negative emotions, is common in youth. Yet, there are few easily administered and well-validated methods to assess emotional eating in pediatric populations. Objective The current study tested the construct validity of the Emotional Eating Scale Adapted for Children and Adolescents (EES-C) by examining its relationship to observed emotional eating at laboratory test meals. Method One hundred fifty-one youth (8-18 years) participated in two multi-item lunch buffet meals on separate days. They ate ad libitum after being instructed to “eat as much as you would at a normal meal” or to “let yourself go and eat as much as you want.” State negative affect was assessed immediately prior to each meal. The EES-C was completed three months, on average, prior to the first test meal. Results Among youth with high EES-C total scores, but not low EES-C scores, higher pre-meal state negative affect was related to greater total energy intake at both meals, with and without the inclusion of age, race, sex, and BMI-z as covariates (ps < 0.03). Discussion The EES-C demonstrates good construct validity for children and adolescents’ observed energy intake across laboratory test meals designed to capture both normal and disinhibited eating. Future research is required to evaluate the construct validity of the EES-C in the natural environment and the predictive validity of the EES-C longitudinally. PMID:22124451

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations.

PubMed

Nyongesa, Moses K; Sigilai, Antipa; Hassan, Amin S; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J R; Newton, Charles R J C; Abubakar, Amina

2017-01-01

Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach's α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region.

Construct and face validity of the American College of Surgeons/Association of Program Directors in Surgery laparoscopic troubleshooting team training exercise.

PubMed

Arain, Nabeel A; Hogg, Deborah C; Gala, Rajiv B; Bhoja, Ravi; Tesfay, Seifu T; Webb, Erin M; Scott, Daniel J

2012-01-01

Our aim was to develop an objective scoring system and evaluate construct and face validity for a laparoscopic troubleshooting team training exercise. Surgery and gynecology novices (n = 14) and experts (n = 10) participated. Assessments included the following: time-out, scenario decision making (SDM) score (based on essential treatments rendered and completion time), operating room communication assessment (investigator developed), line operations safety audits (teamwork), and National Aeronautics and Space Administration-Task Load Index (workload). Significant differences were detected for SDM scores for scenarios 1 (192 vs 278; P = .01) and 3 (129 vs 225; P = .004), operating room communication assessment (67 vs 91; P = .002), and line operations safety audits (58 vs 87; P = .001), but not for time-out (46 vs 51) or scenario 2 SDM score (301 vs 322). Workload was similar for both groups and face validity (8.8 on a 10-point scale) was strongly supported. Objective decision-making scoring for 2 of 3 scenarios and communication and teamwork ratings showed construct validity. Face validity and participant feedback were excellent. Copyright © 2012 Elsevier Inc. All rights reserved.

A newly developed tool for classifying study designs in systematic reviews of interventions and exposures showed substantial reliability and validity.

PubMed

Seo, Hyun-Ju; Kim, Soo Young; Lee, Yoon Jae; Jang, Bo-Hyoung; Park, Ji-Eun; Sheen, Seung-Soo; Hahn, Seo Kyung

2016-02-01

To develop a study Design Algorithm for Medical Literature on Intervention (DAMI) and test its interrater reliability, construct validity, and ease of use. We developed and then revised the DAMI to include detailed instructions. To test the DAMI's reliability, we used a purposive sample of 134 primary, mainly nonrandomized studies. We then compared the study designs as classified by the original authors and through the DAMI. Unweighted kappa statistics were computed to test interrater reliability and construct validity based on the level of agreement between the original and DAMI classifications. Assessment time was also recorded to evaluate ease of use. The DAMI includes 13 study designs, including experimental and observational studies of interventions and exposure. Both the interrater reliability (unweighted kappa = 0.67; 95% CI [0.64-0.75]) and construct validity (unweighted kappa = 0.63, 95% CI [0.52-0.67]) were substantial. Mean classification time using the DAMI was 4.08 ± 2.44 minutes (range, 0.51-10.92). The DAMI showed substantial interrater reliability and construct validity. Furthermore, given its ease of use, it could be used to accurately classify medical literature for systematic reviews of interventions although minimizing disagreement between authors of such reviews. Copyright © 2016 Elsevier Inc. All rights reserved.

[Preliminary construction of a questionnaire about knowledge of HIV/AIDS in Colombian veterans].

PubMed

Segura-Cardona, Angela; Berbesí-Fernández, Dedsy; Cardona-Arango, Doris; Ordóñez-Molina, Jaime

2011-01-01

In order to identify the level of knowledge about HIV/AIDS in Colombia veterans of war in the year 2009, a questionnaire was designed, built and validated, using a mixed design, for which three stages were followed: 1) Bibliographic review and construction of items of the questionnaire using a focus group, 2) Evaluation of content validity by a pannel of experts, 3) APLICACION of the final questionnaire, we selected non-randomly 323 people who were part of group of veterans in Colombia, and 4) Validation of the questionnaire through the evaluation of internal consistency and principal component analysis. We found that the questionnaire explored three factors: forms of infection, inadequate beliefs, and HIV prevention, which accounted for 52% of the variance. The survey showed adequate internal consistency values (Cronbach's α = 0.77). These results suggest the use of the questionnaire to assess knowledge level related to the form of infection, inaccurate beliefs and prevention of HIV-AIDS in this population.

[Validity and reliability of a scale to assess self-efficacy for physical activity in elderly].

PubMed

Borges, Rossana Arruda; Rech, Cassiano Ricardo; Meurer, Simone Teresinha; Benedetti, Tânia Rosane Bertoldo

2015-04-01

This study aimed to analyze the confirmatory factor validity and reliability of a self-efficacy scale for physical activity in a sample of 118 elderly (78% women) from 60 to 90 years of age. Mplus 6.1 was used to evaluate the confirmatory factor analysis. Reliability was tested by internal consistency and temporal stability. The original scale consisted of five items with dichotomous answers (yes/no), independently for walking and moderate and vigorous physical activity. The analysis excluded the item related to confidence in performing physical activities when on vacation. Two constructs were identified, called "self-efficacy for walking" and "self-efficacy for moderate and vigorous physical activity", with a factor load ≥ 0.50. Internal consistency was adequate both for walking (> 0.70) and moderate and vigorous physical activity (> 0.80), and temporal stability was adequate for all the items. In conclusion, the self-efficacy scale for physical activity showed adequate validity, reliability, and internal consistency for evaluating this construct in elderly Brazilians.

Evaluative frailty index for physical activity (EFIP): a reliable and valid instrument to measure changes in level of frailty.

PubMed

de Vries, Nienke M; Staal, J Bart; Olde Rikkert, Marcel G M; Nijhuis-van der Sanden, Maria W G

2013-04-01

Physical activity is assumed to be important in the prevention and treatment of frailty. It is unclear, however, to what extent frailty can be influenced because instruments designed to assess frailty have not been validated as evaluative outcome instruments in clinical practice. The aims of this study were: (1) to develop a frailty index (i.e., the evaluative frailty index for physical activity [EFIP]) based on the method of deficit accumulation and (2) to test the clinimetric properties of the EFIP. The content of the EFIP was determined using a written Delphi procedure. Intrarater reliability, interrater reliability, and construct validity were determined in an observational study (n=24). Intrarater reliability and interrater reliability were calculated using Cohen kappa and intraclass correlation coefficients (ICCs). Construct validity was determined by correlating the score on the EFIP with those on the timed "up & go" test (TUG), the performance-oriented mobility assessment (POMA), and the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Fifty items were included in the EFIP. Interrater reliability (Cohen kappa=0.72, ICC=.96) and intrarater reliability (Cohen kappa=0.77 and 0.80, ICC=.93 and .98) were good. As expected, a fair to moderate correlation with the TUG, POMA, and CIRS-G was found (.61, -.70, and .66, respectively). Reliability and validity of the EFIP have been tested in a small sample. These and other clinimetric properties, such as responsiveness, will be assessed or reassessed in a larger study population. The EFIP is a reliable and valid instrument to evaluate the effect of physical activity on frailty in research and in clinical practice.

Psychometric Evaluation of the Chinese Version of the Existential Anxiety Questionnaire in a Sample of Chinese Adolescents Living in Hong Kong

ERIC Educational Resources Information Center

To, Siu-ming; Chan, Wallace Chi-ho

2016-01-01

Background: While Western academia has increasingly recognized the importance of studying existential anxiety among adolescents, psychometrically valid and reliable tools for measuring this construct remain unavailable in Chinese societies. Objective: This research investigated the empirical viability of the construct of existential anxiety in…

What Is Measured in Mathematics Tests? Construct Validity of Curriculum-Based Mathematics Measures.

ERIC Educational Resources Information Center

Thurber, Robin Schul; Shinn, Mark R.; Smolkowski, Keith

2002-01-01

Mathematics curriculum-based measurement (M-CBM) is one tool that has been developed for formative evaluation in mathematics. This study examines what constructs M-CBM actually measures in the context of a range of other mathematics measures. Results indicated that a two-factor model of mathematics where Computation and Applications were distinct…

The Alliance Negotiation Scale: A psychometric investigation.

PubMed

Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

2016-08-01

This study investigates the utility and psychometric properties of a new measure of psychotherapy process, the Alliance Negotiation Scale (ANS; Doran, Safran, Waizmann, Bolger, & Muran, 2012). The ANS was designed to operationalize the theoretical construct of negotiation (Safran & Muran, 2000), and to extend our current understanding of the working alliance concept (Bordin, 1979). The ANS was also intended to improve upon existing measures such as the Working Alliance Inventory (WAI; Horvath & Greenberg, 1986, 1989) and its short form (WAI-S; Tracey & Kokotovic, 1989) by expanding the emphasis on negative therapy process. The present study investigates the psychometric validity of the ANS test scores and interpretation-including confirming its original factor structure and evaluating its internal consistency and construct validity. Construct validity was examined through the ANS' convergence and divergence with several existing scales that measure theoretically related constructs. The results bolster and extend previous findings about the psychometric integrity of the ANS, and begin to illuminate the relationship between negotiation and other important variables in psychotherapy research. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The Reliability, Validity, and Evaluation of the Objective Structured Clinical Examination in Podiatry (Chiropody).

ERIC Educational Resources Information Center

Woodburn, Jim; Sutcliffe, Nick

1996-01-01

The Objective Structured Clinical Examination (OSCE), initially developed for undergraduate medical education, has been adapted for assessment of clinical skills in podiatry students. A 12-month pilot study found the test had relatively low levels of reliability, high construct and criterion validity, and good stability of performance over time.…

Reliability and Validity of the Spanish Adaptation of EOSS, Comparing Normal and Clinical Samples

ERIC Educational Resources Information Center

Valero-Aguayo, Luis; Ferro-Garcia, Rafael; Lopez-Bermudez, Miguel Angel; de Huralde, Ma. Angeles Selva-Lopez

2012-01-01

The Experiencing of Self Scale (EOSS) was created for the evaluation of Functional Analytic Psychotherapy (Kohlenberg & Tsai, 1991, 2001, 2008) in relation to the concept of the experience of personal self as socially and verbally constructed. This paper presents a reliability and validity study of the EOSS with a Spanish sample (582…

Validation of the Chinese Version of the Social Emotional Health Survey-Primary

ERIC Educational Resources Information Center

Wang, Cixin; Yang, Chunyan; Jiang, Xu; Furlong, Michael

2018-01-01

The Social Emotional Health Survey-Primary (SEHS-P) was originally developed to assess U.S. elementary students' positive psychological traits: gratitude, zest, optimism, and persistence, and the higher-order latent construct of covitality. The present study evaluated the validity of a Chinese version of SEHS-P with a sample of 653 Chinese…

Validation of a Milk Consumption Stage of Change Algorithm among Adolescent Survivors of Childhood Cancer

ERIC Educational Resources Information Center

Mays, Darren; Gerfen, Elissa; Mosher, Revonda B.; Shad, Aziza T.; Tercyak, Kenneth P.

2012-01-01

Objective: To assess the construct validity of a milk consumption Stages of Change (SOC) algorithm among adolescent survivors of childhood cancer ages 11 to 21 years (n = 75). Methods: Baseline data from a randomized controlled trial designed to evaluate a health behavior intervention were analyzed. Assessments included a milk consumption SOC…

Differential Item Functioning Analysis of High-Stakes Test in Terms of Gender: A Rasch Model Approach

ERIC Educational Resources Information Center

Alavi, Seyed Mohammad; Bordbar, Soodeh

2017-01-01

Differential Item Functioning (DIF) analysis is a key element in evaluating educational test fairness and validity. One of the frequently cited sources of construct-irrelevant variance is gender which has an important role in the university entrance exam; therefore, it causes bias and consequently undermines test validity. The present study aims…

The Study Skills Questionnaire (SSQUES): Preliminary Validation of a Measure for Assessing Students' Perceived Areas of Weakness.

ERIC Educational Resources Information Center

McCombs, Barbara L.; Dobrovolny, Jacqueline L.

The potential reliability and construct and predictive validity of a 30-item Study Skills Questionnaire (SSQUES) was evaluated for its ability to: (1) predict student performance in a self-paced, individualized, or computer-managed instructional environment, and (2) identify students needing some type of study skills remediation. The study was…

Construct Validation of the Louisiana School Analysis Model (SAM) Instructional Staff Questionnaire

ERIC Educational Resources Information Center

Bray-Clark, Nikki; Bates, Reid

2005-01-01

The purpose of this study was to validate the Louisiana SAM Instructional Staff Questionnaire, a key component of the Louisiana School Analysis Model. The model was designed as a comprehensive evaluation tool for schools. Principle axis factoring with oblique rotation was used to uncover the underlying structure of the SISQ. (Contains 1 table.)

Validity Evidence for the Use of the Preventive Resources Inventory with College Students

ERIC Educational Resources Information Center

Lambert, Richard G.; McCarthy, Christopher J.; Gilbert, Trae; Sebree, Mikaela; Steinley-Bumgarner, Michelle

2006-01-01

Measurement properties of scores from the Preventive Resources Inventory (C. J. McCarthy & R. G. Lambert, 2001), a measure of stress-prevention resources, were evaluated. Sample-specific construct validity of 3 primary scales was supported. A 4th, Self-Acceptance, functioned as a higher order factor. Differences were found between those reporting…

The Impact of Model Parameterization and Estimation Methods on Tests of Measurement Invariance with Ordered Polytomous Data

ERIC Educational Resources Information Center

Koziol, Natalie A.; Bovaird, James A.

2018-01-01

Evaluations of measurement invariance provide essential construct validity evidence--a prerequisite for seeking meaning in psychological and educational research and ensuring fair testing procedures in high-stakes settings. However, the quality of such evidence is partly dependent on the validity of the resulting statistical conclusions. Type I or…

[Reliability and validity of the Chinese version on Comprehensive Scores for Financial Toxicity based on the patient-reported outcome measures].

PubMed

Yu, H H; Bi, X; Liu, Y Y

2017-08-10

Objective: To evaluate the reliability and validity of the Chinese version on comprehensive scores for financial toxicity (COST), based on the patient-reported outcome measures. Methods: A total of 118 cancer patients were face-to-face interviewed by well-trained investigators. Cronbach's α and Pearson correlation coefficient were used to evaluate reliability. Content validity index (CVI) and exploratory factor analysis (EFA) were used to evaluate the content validity and construct validity, respectively. Results: The Cronbach's α coefficient appeared as 0.889 for the whole questionnaire, with the results of test-retest were between 0.77 and 0.98. Scale-content validity index (S-CVI) appeared as 0.82, with item-content validity index (I-CVI) between 0.83 and 1.00. Two components were extracted from the Exploratory factor analysis, with cumulative rate as 68.04% and loading>0.60 on every item. Conclusion: The Chinese version of COST scale showed high reliability and good validity, thus can be applied to assess the financial situation in cancer patients.

INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD): development and validation.

PubMed

Juneja, Monica; Mishra, Devendra; Russell, Paul S S; Gulati, Sheffali; Deshmukh, Vaishali; Tudu, Poma; Sagar, Rajesh; Silberberg, Donald; Bhutani, Vinod K; Pinto, Jennifer M; Durkin, Maureen; Pandey, Ravindra M; Nair, M K C; Arora, Narendra K

2014-05-01

To develop and validate INCLEN Diagnostic Tool for Autism Spectrum Disorder (INDT-ASD). Diagnostic test evaluation by cross sectional design. Four tertiary pediatric neurology centers in Delhi and Thiruvanthapuram, India. Children aged 2-9 years were enrolled in the study. INDT-ASD and Childhood Autism Rating Scale (CARS) were administered in a randomly decided sequence by trained psychologist, followed by an expert evaluation by DSM-IV TR diagnostic criteria (gold standard). Psychometric parameters of diagnostic accuracy, validity (construct, criterion and convergent) and internal consistency. 154 children (110 boys, mean age 64.2 mo) were enrolled. The overall diagnostic accuracy (AUC=0.97, 95% CI 0.93, 0.99; P<0.001) and validity (sensitivity 98%, specificity 95%, positive predictive value 91%, negative predictive value 99%) of INDT-ASD for Autism spectrum disorder were high, taking expert diagnosis using DSM-IV-TR as gold standard. The concordance rate between the INDT-ASD and expert diagnosis for 'ASD group' was 82.52% [Cohen's k=0.89; 95% CI (0.82, 0.97); P=0.001]. The internal consistency of INDT-ASD was 0.96. The convergent validity with CARS (r = 0.73, P= 0.001) and divergent validity with Binet-Kamat Test of intelligence (r = -0.37; P=0.004) were significantly high. INDT-ASD has a 4-factor structure explaining 85.3% of the variance. INDT-ASD has high diagnostic accuracy, adequate content validity, good internal consistency high criterion validity and high to moderate convergent validity and 4-factor construct validity for diagnosis of Autistm spectrum disorder.

Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

PubMed

Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

2012-04-01

The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P < 0.01) were found with the assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

Validation of the Tuebingen CD-25 Inventory as a Measure of Postoperative Health-Related Quality of Life in Patients Treated for Cushing's Disease.

PubMed

Milian, Monika; Kreitschmann-Andermahr, Ilonka; Siegel, Sonja; Kleist, Bernadette; Führer-Sakel, Dagmar; Honegger, Juergen; Buchfelder, Michael; Psaras, Tsambika

2015-01-01

To evaluate the construct and criterion validity of the Tuebingen Cushing's disease quality of life inventory (Tuebingen CD-25) for application in patients treated for Cushing's disease (CD). A total of 176 patients with adrenocorticotropin hormone-dependent CD (144 of them female, overall mean age 46.1 ± 13.7 years) treated at 3 large tertiary referral centers in Germany were studied. Construct validity was assessed by hypothesis testing (self-perceived symptom reduction assessment) and contrasted groups (patients with vs. without hypercorticolism). For this purpose, already existing data from 55 CD patients was used, representing the hypercortisolemic group. Criterion validity (concurrent validity) was assessed in relation to the Cushing's quality of life questionnaire (CushingQoL), the Short Form 36 health survey (SF-36), and the body mass index (BMI). Patients with self-perceived remarkable symptom reduction had significant lower Tuebingen CD-25 scores (i.e. better health-related quality of life) than patients with self-perceived insufficient symptom reduction (p < 0.05). Similarly, the mean scores of the Tuebingen CD-25 scales were lower in patients without hypercortisolism (total score 27.0 ± 17.2) compared to those with hypercortisolism (total score 45.3 ± 22.1; each p < 0.05), providing evidence for construct validity. Criterion validity was confirmed by the correlations between the Tuebingen CD-25 total score and the CushingQoL (Spearman's coefficient -0.733), as well as all scales of the SF-36 (Spearman's coefficient between -0.447 and -0.700). The analyses presented in this large-sample study provide robust evidence for the construct and criterion validity of the Tuebingen CD-25. © 2015 S. Karger AG, Basel.

Psychometric properties concerning four instruments measuring job satisfaction, strain, and stress of conscience in a residential care context.

PubMed

Orrung Wallin, Anneli; Edberg, Anna-Karin; Beck, Ingela; Jakobsson, Ulf

2013-01-01

There are many instruments assessing the wellbeing of staff, but far from all have been psychometrically investigated. When evaluating supportive interventions directed toward nurse assistants in residential care, valid and reliable instruments are needed in order to detect possible changes. The aim of the study was to investigate validity in terms of data quality, construct validity, convergent and divergent validity and reliability in terms of the internal consistency and stability of the Job Satisfaction Questionnaire, the Psychosocial Aspects of Job Satisfaction, the Strain in Dementia Care Scale (SDCS), and the Stress of Conscience Questionnaire (SCQ) in a residential care context. The psychometric properties of the instruments were investigated in terms of data quality, construct validity, convergent and divergent validity and reliability, including test-retest reliability, in a residential care context with a sample consisting of nurse assistants (n=114). The four instruments responded with different psychometric-related problems such as internal missing data, floor and ceiling effects, problems with construct validity and low test-retest reliability, especially when assessed on the item level. These problems were however reduced or disappeared completely when assessed for total and factor scores. From a psychometric perspective, the SDCS seemed to stand out as the best instrument. However, it should be modified in order to reduce floor effects on item level and thereby gain sensitivity. The Job Satisfaction Questionnaire seemed to have problems both with the construct validity and test-retest reliability. The final choice of instrument must, however, be made dependent on what one intends to measure. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Intratester Reliability and Construct Validity of a Hip Abductor Eccentric Strength Test.

PubMed

Brindle, Richard A; Ebaugh, David; Milner, Clare E

2018-06-06

Side-lying hip abductor strength tests are commonly used to evaluate muscle strength. In a "break" test, the tester applies sufficient force to lower the limb to the table while the patient resists. The peak force is postulated to occur while the leg is lowering, thus representing the participant's eccentric muscle strength. However, it is unclear whether peak force occurs before or after the leg begins to lower. To determine intrarater reliability and construct validity of a hip abductor eccentric strength test. Intrarater reliability and construct validity study. Twenty healthy adults (26 [6] y; 1.66 [0.06] m; 62.2 [8.0] kg) made 2 visits to the laboratory at least 1 week apart. During the hip abductor eccentric strength test, a handheld dynamometer recorded peak force and time to peak force, and limb position was recorded via a motion capture system. Intrarater reliability was determined using intraclass correlation, SEM, and minimal detectable difference. Construct validity was assessed by determining if peak force occurred after the start of the lowering phase using a 1-sample t test. The hip abductor eccentric strength test had substantial intrarater reliability (intraclass correlation (3,3)  = .88; 95% confidence interval, .65-.95), SEM of 0.9 %BWh, and a minimal detectable difference of 2.5 %BWh. Construct validity was established as peak force occurred 2.1 (0.6) seconds (range: 0.7-3.7 s) after the start of the lowering phase of the test (P ≤ .001). The hip abductor eccentric strength test is a valid and reliable measure of eccentric muscle strength. This test may be used clinically to assess changes in eccentric muscle strength over time.

Self-defense and martial arts evaluation for college women: preliminary validation of perceptions of dangerous situations scale.

PubMed

Hughes, Patricia Paulsen; Sherrill, Claudine; Myers, Bettye; Rowe, Nancy; Marshall, David

2003-06-01

Martial arts and self-defense programs train fearful people, especially women, to be more competent and confident to defend themselves in dangerous situations. However, there are no validated instruments to evaluate the effectiveness of programs purporting to teach self-protection. The Perceptions of Dangerous Situations Scale (PDSS), composed of fear, likelihood and confidence subscales, was developed and validated for university women. Participants were 368 university women, ages 17 to 45 years (M age = 20.7 years). Content validity of the PDSS was established through an expert panel, and construct validity was established through principal components analysis and determination of instructional sensitivity. Reliability was established through alpha coefficients. The PDSS, when used with university women, offers promising measurement opportunities in self-defense and martial arts settings.

Cross-cultural validation of the St. Louis Inventory of Community Living Skills for Chinese patients with schizophrenia in Hong Kong.

PubMed

Au, Raymond Wing Cheong; Tam, Peter Wai Chung; Tam, Gladys Wai Chi; Ungvari, Gabor Sander

2005-01-01

The study validated a culturally sensitive community living skills rating scale for Chinese patients by adapting the St. Louis Inventory of Community Living Skills (SLICLS). The Chinese version (SLICLS-C) was produced by forward and backward translation. An expert panel evaluated its content validity. Its internal consistency, inter-rater reliability, construct and concurrent validity were tested on 80 DSM-IV schizophrenia inpatients in a long-term facility. For predictive validity, the above sample was extended to ensure at least 20 subjects discharged to each of three levels of community care were included in the study sample. The SLICLS-C was psychometrically sound and could be used for predicting level of community care, program evaluation and measuring outcome.

Longitudinal construct validity of the minimum data set health status index.

PubMed

Jones, Aaron; Feeny, David; Costa, Andrew P

2018-05-24

The Minimum Data Set Health Status Index (MDS-HSI) is a generic, preference-based health-related quality of life (HRQOL) measure derived by mapping items from the Resident Assessment Instrument - Minimum Data Set (RAI-MDS) assessment onto the Health Utilities Index Mark 2 classification system. While the validity of the MDS-HSI has been examined in cross-sectional settings, the longitudinal validity has not been explored. The objective of this study was to investigate the longitudinal construct validity of the MDS-HSI in a home care population. This study utilized a retrospective cohort of home care patients in the Hamilton-Niagara-Haldimand-Brant health region of Ontario, Canada with at least two RAI-MDS Home Care assessments between January 2010 and December 2014. Convergent validity was assessed by calculating Spearman rank correlations between the change in MDS-HSI and changes in six validated indices of health domains that can be calculated from the RAI-MDS assessment. Known-groups validity was investigated by fitting multivariable linear regression models to estimate the mean change in MDS-HSI associated with clinically important changes in the six health domain indices and 15 disease symptoms from the RAI-MDS Home Care assessment, controlling for age and sex. The cohort contained 25,182 patients with two RAI-MDS Home Care assessments. Spearman correlations between the MDS-HSI change and changes in the health domain indices were all statistically significant and in the hypothesized small to moderate range [0.1 < ρ < 0.5]. Clinically important changes in all of the health domain indices and 13 of the 15 disease symptoms were significantly associated with clinically important changes in the MDS-HSI. The findings of this study support the longitudinal construct validity of the MDS-HSI in home care populations. In addition to evaluating changes in HRQOL among home care patients in clinical research, economic evaluation, and health technology assessment, the MDS-HSI may be used in system-level applications using routinely collected population-level data.

Development and validation of a VISA tendinopathy questionnaire for greater trochanteric pain syndrome, the VISA-G.

PubMed

Fearon, A M; Ganderton, C; Scarvell, J M; Smith, P N; Neeman, T; Nash, C; Cook, J L

2015-12-01

Greater trochanteric pain syndrome (GTPS) is common, resulting in significant pain and disability. There is no condition specific outcome score to evaluate the degree of severity of disability associated with GTPS in patients with this condition. To develop a reliable and valid outcome measurement capable of evaluating the severity of disability associated with GTPS. A phenomenological framework using in-depth semi structured interviews of patients and medical experts, and focus groups of physiotherapists was used in the item generation. Item and format clarification was undertaken via piloting. Multivariate analysis provided the basis for item reduction. The resultant VISA-G was tested for reliability with the inter class co-efficient (ICC), internal consistency (Cronbach's Alpha), and construct validity (correlation co-efficient) on 52 naïve participants with GTPS and 31 asymptomatic participants. The resultant outcome measurement tool is consistent in style with existing tendinopathy outcome measurement tools, namely the suite of VISA scores. The VISA-G was found to be have a test-retest reliability of ICC2,1 (95% CI) of 0.827 (0.638-0.923). Internal consistency was high with a Cronbach's Alpha of 0.809. Construct validity was demonstrated: the VISA-G measures different constructs than tools previously used in assessing GTPS, the Harris Hip Score and the Oswestry Disability Index (Spearman Rho:0.020 and 0.0205 respectively). The VISA-G did not demonstrate any floor or ceiling effect in symptomatic participants. The VISA-G is a reliable and valid score for measuring the severity of disability associated GTPS. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Training Evaluation Inventory (TEI)--Evaluation of Training Design and Measurement of Training Outcomes for Predicting Training Success

ERIC Educational Resources Information Center

Ritzmann, Sandrina; Hagemann, Vera; Kluge, Annette

2014-01-01

Training evaluation in research and organisational contexts is vital to ensure informed decisions regarding the value of training. The present study describes the development of a valid and reliable training evaluation inventory (TEI), as it does not exist so far. The objectives were a) to construct an instrument that is theoretically and…

Reliability and validity of the Persian versions of the fear avoidance beliefs questionnaire and Tampa Scale of Kinesiophobia in patients with neck pain.

PubMed

Askary-Ashtiani, Ahmadreza; Ebrahimi-Takamejani, Ismail; Torkaman, Giti; Amiri, Mohsen; Mousavi, Seyed Javad

2014-08-15

Validation of 2 self-report questionnaires. To evaluate the internal consistency, reliability, and construct validity of the Persian versions of the fear avoidance beliefs questionnaire (FABQ) and the Tampa Scale of Kinesiophobia (TSK) in patients with acute and chronic neck pain. The FABQ and TSK are 2 important measures to evaluate fear of pain and fear avoidance beliefs in patients with spinal pain. To date, the psychometric properties of these questionnaires have not been demonstrated in Persian-speaking patients with neck pain in Iran. One hundred sixty-six patients with acute and chronic neck pain participated in the study. The construct validity of the questionnaires was evaluated by measuring convergent and known-groups validity. The visual analogue scale measure of pain, neck disability index, hospital anxiety and depression scale, and the physical (PCS-12) and mental (MCS-12) summary scores of the Short Form health survey (SF-12) were used to test construct validity of the Persian FABQ and TSK. In addition, 50 randomly selected patients with chronic neck pain were asked to complete the questionnaires 48 hours later for the second time. Cronbach α coefficient for the FABQ and TSK in patients with acute and chronic pain was in the range from 0.77 to 0.92 and 0.77 to 0.78, respectively. The Persian FABQ and TSK showed satisfactory test-retest reliability with intraclass correlation coefficient of more than 0.80. There were moderate to strong correlations between the Persian FABQ and TSK scores and the neck disability index (r = 0.44-0.55), Depression subscales of the hospital anxiety and depression scale (r = 0.42-0.48), and PCS-12 (r =-0.34 to -0.62). The Persian FABQ and TSK have acceptable reliability and validity for measuring pain related fear and avoidance beliefs among Persian-speaking patients with acute and chronic neck pain. However, considering the study limitations, the findings should be interpreted with caution. 3.

Evidence of validity of the Stress-Producing Life Events (SPLE) instrument.

PubMed

Rizzini, Marta; Santos, Alcione Miranda Dos; Silva, Antônio Augusto Moura da

2018-01-01

OBJECTIVE Evaluate the construct validity of a list of eight Stressful Life Events in pregnant women. METHODS A cross-sectional study was conducted with 1,446 pregnant women in São Luís, MA, and 1,364 pregnant women in Ribeirão Preto, SP (BRISA cohort), from February 2010 to June 2011. In the exploratory factorial analysis, the promax oblique rotation was used and for the calculation of the internal consistency, we used the compound reliability. The construct validity was determined by means of the confirmatory factorial analysis with the method of estimation of weighted least squares adjusted by the mean and variance. RESULTS The model with the best fit in the exploratory analysis was the one that retained three factors with a cumulative variance of 61.1%. The one-factor model did not obtain a good fit in both samples in the confirmatory analysis. The three-factor model called Stress-Producing Life Events presented a good fit (RMSEA < 0.05; CFI/TLI > 0.90) for both samples. CONCLUSIONS The Stress-Producing Life Events constitute a second order construct with three dimensions related to health, personal and financial aspects and violence. This study found evidence that confirms the construct validity of a list of stressor events, entitled Stress-Producing Life Events Inventory.

A systematic review on the quality of measurement techniques for the assessment of burn wound depth or healing potential.

PubMed

Jaspers, Mariëlle E H; van Haasterecht, Ludo; van Zuijlen, Paul P M; Mokkink, Lidwine B

2018-06-22

Reliable and valid assessment of burn wound depth or healing potential is essential to treatment decision-making, to provide a prognosis, and to compare studies evaluating different treatment modalities. The aim of this review was to critically appraise, compare and summarize the quality of relevant measurement properties of techniques that aim to assess burn wound depth or healing potential. A systematic literature search was performed using PubMed, EMBASE and Cochrane Library. Two reviewers independently evaluated the methodological quality of included articles using an adapted version of the Consensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A synthesis of evidence was performed to rate the measurement properties for each technique and to draw an overall conclusion on quality of the techniques. Thirty-six articles were included, evaluating various techniques, classified as (1) laser Doppler techniques; (2) thermography or thermal imaging; (3) other measurement techniques. Strong evidence was found for adequate construct validity of laser Doppler imaging (LDI). Moderate evidence was found for adequate construct validity of thermography, videomicroscopy, and spatial frequency domain imaging (SFDI). Only two studies reported on the measurement property reliability. Furthermore, considerable variation was observed among comparator instruments. Considering the evidence available, it appears that LDI is currently the most favorable technique; thereby assessing burn wound healing potential. Additional research is needed into thermography, videomicroscopy, and SFDI to evaluate their full potential. Future studies should focus on reliability and measurement error, and provide a precise description of which construct is aimed to measure. Copyright © 2018 Elsevier Ltd and ISBI. All rights reserved.

Dimensionality of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): a condition-specific questionnaire.

PubMed

Comins, J D; Krogsgaard, M R; Kreiner, S; Brodersen, J

2013-10-01

The benefit of anterior cruciate ligament (ACL) reconstruction has been questioned based on patient-reported outcome measures (PROMs). Valid interpretation of such results requires confirmation of the psychometric properties of the PROM. Rasch analysis is the gold standard for validation of PROMs, yet PROMs used for ACL reconstruction have not been validated using Rasch analysis. We used Rasch analysis to investigate the psychometric properties of the Knee Numeric-Entity Evaluation Score (KNEES-ACL), a newly developed PROM for patients treated for ACL deficiency. Two-hundred forty-two patients pre- and post-ACL reconstruction completed the pilot PROM. Rasch models were used to assess the psychometric properties (e.g., unidimensionality, local response dependency, and differential item functioning). Forty-one items distributed across seven unidimensional constructs measuring impairment, functional limitations, and psychosocial consequences were confirmed to fit Rasch models. Fourteen items were removed because of statistical lack of fit and inadequate face validity. Local response dependency and differential item functioning were identified and adjusted. The KNEES-ACL is the first Rasch-validated condition-specific PROM constructed for patients with ACL deficiency and patients with ACL reconstruction. Thus, this instrument can be used for within- and between-group comparisons. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Development and validation of a cancer awareness questionnaire for Malaysian undergraduate students of Chinese ethnicity.

PubMed

Loo, Jo Lin; Ang, Yee Kwang; Yim, Hip Seng

2013-01-01

To describe the development and validation of a cancer awareness questionnaire (CAQ) based on a literature review of previous studies, focusing on cancer awareness and prevention. A total of 388 Chinese undergraduate students in a private university in Kuala Lumpur, Malaysia, were recruited to evaluate the developed self-administered questionnaire. The CAQ consisted of four sections: awareness of cancer warning signs and screening tests; knowledge of cancer risk factors; barriers in seeking medical advice; and attitudes towards cancer and cancer prevention. The questionnaire was evaluated for construct validity using principal component analysis and internal consistency using Cronbach's alpha (α) coefficient. Test-retest reliability was assessed with a 10-14 days interval and measured using Pearson product-moment correlation. The initial 77-item CAQ was reduced to 63 items, with satisfactory construct validity, and a high total internal consistency (Cronbach's α=0.77). A total of 143 students completed the questionnaire for the test-retest reliability obtaining a correlation of 0.72 (p<0.001) overall. The CAQ could provide a reliable and valid measure that can be used to assess cancer awareness among local Chinese undergraduate students. However, further studies among students from different backgrounds (e.g. ethnicity) are required in order to facilitate the use of the cancer awareness questionnaire among all university students.

Virtual reality simulator training for laparoscopic colectomy: what metrics have construct validity?

PubMed

Shanmugan, Skandan; Leblanc, Fabien; Senagore, Anthony J; Ellis, C Neal; Stein, Sharon L; Khan, Sadaf; Delaney, Conor P; Champagne, Bradley J

2014-02-01

Virtual reality simulation for laparoscopic colectomy has been used for training of surgical residents and has been considered as a model for technical skills assessment of board-eligible colorectal surgeons. However, construct validity (the ability to distinguish between skill levels) must be confirmed before widespread implementation. This study was designed to specifically determine which metrics for laparoscopic sigmoid colectomy have evidence of construct validity. General surgeons that had performed fewer than 30 laparoscopic colon resections and laparoscopic colorectal experts (>200 laparoscopic colon resections) performed laparoscopic sigmoid colectomy on the LAP Mentor model. All participants received a 15-minute instructional warm-up and had never used the simulator before the study. Performance was then compared between each group for 21 metrics (procedural, 14; intraoperative errors, 7) to determine specifically which measurements demonstrate construct validity. Performance was compared with the Mann-Whitney U-test (p < 0.05 was significant). Fifty-three surgeons; 29 general surgeons, and 24 colorectal surgeons enrolled in the study. The virtual reality simulators for laparoscopic sigmoid colectomy demonstrated construct validity for 8 of 14 procedural metrics by distinguishing levels of surgical experience (p < 0.05). The most discriminatory procedural metrics (p < 0.01) favoring experts were reduced instrument path length, accuracy of the peritoneal/medial mobilization, and dissection of the inferior mesenteric artery. Intraoperative errors were not discriminatory for most metrics and favored general surgeons for colonic wall injury (general surgeons, 0.7; colorectal surgeons, 3.5; p = 0.045). Individual variability within the general surgeon and colorectal surgeon groups was not accounted for. The virtual reality simulators for laparoscopic sigmoid colectomy demonstrated construct validity for 8 procedure-specific metrics. However, using virtual reality simulator metrics to detect intraoperative errors did not discriminate between groups. If the virtual reality simulator continues to be used for the technical assessment of trainees and board-eligible surgeons, the evaluation of performance should be limited to procedural metrics.

Validation of an Arabic version of the Diabetes Treatment Satisfaction Questionnaire in Qatar.

PubMed

Wilbur, Kerry; Al Hammaq, Abdulla O

2016-03-01

Several instruments evaluate patient-reported outcomes in diabetes mellitus (DM), but almost none are validated for use in Arabic language. The aim of this study is to test the psychometric properties and responsiveness of the Arabic version of the Diabetes Treatment Satisfaction Questionnaire (DTSQs) in Qatar. Ambulatory Arabic speaking DM patients were interviewed at two consecutive time points in Doha, Qatar. The 8-item DTSQs was administered in conjunction with the Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36) and the World Health Organization Quality of Life Measure (WHOQOL-Bref) to assess convergent validity. Reliability was evaluated by internal consistency and item analysis. Construct validity was evaluated using "known groups" comparisons (including gender, insulin use, and HbA1c). Sensitivity of DTSQs scores to the subject's metabolic conditions was determined. One hundred subjects (mean age 50.7) participated. Half (54%) were female. The majority (93%) had Type 2 DM, but 39 (42%) were using insulin. Results revealed satisfactory internal consistency. Metabolic measures (fasting blood glucose and AIC) had significant inverse correlations with DTSQs scores (interview 1, Pearson's r=-0.333 and r=-0.401, respectively, p<0.01). Scale criterion and construct validity were found to be satisfactory. Most sub-dimensions of the SF-36 and WHOQOL-Bref were correlated with the DTSQ, indicating a good concurrent validity. As in prior studies, women demonstrated poorer treatment satisfaction. The Qatar Arabic DTSQs version was found to be a reliable and valid instrument for the assessment of treatment satisfaction in Arabic diabetes mellitus patients in the country. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Development and psychometric properties rating scale of “clinical competency evaluation in mental health nurses”: Exploratory factor analysis

PubMed Central

Moskoei, Sara; Mohtashami, Jamileh; Ghalenoeei, Mahdie; Nasiri, Maliheh; Tafreshi, Mansoreh Zaghari

2017-01-01

Introduction Evaluation of clinical competency in nurses has a distinct importance in healthcare due to its significant impact on improving the quality of patient care and creation of opportunities for professional promotion. This is a psychometric study for development of the “Clinical Competency of Mental Health Nursing”(CCMHN) rating scale. Methods In this methodological research that was conducted in 2015, in Tehran, Iran, the main items were developed after literature review and the validity and reliability of the tool were identified. The face, content (content validity ratio and content validity index) and construct validities were calculated. For face and content validity, experts’ comments were used. Exploratory factor analysis was used to determine the construct validity. The reliability of scale was determined by the internal consistency and inter-rater correlation. The collected data were analyzed by SPSS version 16, using descriptive statistical analysis. Results A scale with 45 items in two parts including Emotional/Moral and Specific Care competencies was developed. Content validity ratio and content validity index were 0.88, 0.97 respectively. Exploratory factor analysis indicated two factors: The first factor with 23.93 eigenvalue and second factor with eigenvalue 2.58. Cronbach’s alpha coefficient for determination of internal consistency was 0.98 and the ICC for confirmation inter-rater correlation was 0.98. Conclusion A scale with 45 items and two areas was developed with appropriate validity and reliability. This scale can be used to assess the clinical competency in nursing students and mental health nurses. PMID:28607650

Validation of the Japanese version of the job crafting scale.

PubMed

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-06-16

The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context.

Validation of the Japanese version of the job crafting scale

PubMed Central

Eguchi, Hisashi; Shimazu, Akihito; Bakker, Arnold B.; Tims, Maria; Kamiyama, Kimika; Hara, Yujiro; Namba, Katsuyuki; Inoue, Akiomi; Ono, Masakatsu; Kawakami, Norito

2016-01-01

Objectives: The aim of this study was to validate the Japanese version of the job crafting scale (JCS-J). JCS measures four independent job crafting dimensions, namely increasing structural job resources, decreasing hindering job demands, increasing social job resources, and increasing challenging job demands. Methods: The translated and back-translated JCS-J questionnaires were administered online to 972 employees of a Japanese manufacturing company. The data were then divided into independent explorative and confirmative samples. Exploratory and confirmatory factor analyses were performed to evaluate the factorial validity of JCS-J. The relationship with potential consequences of job crafting (e.g., job demands, job resources, and psychological well-being) was investigated to evaluate construct validity. Internal consistency was examined to evaluate the reliability of the four JCSs. Results: An exploratory factor analysis extracted a five-factor solution. Decreasing hindering job demands was further split into two separate dimensions supporting a five- rather than four-factor structure. A series of confirmatory factor analyses revealed that the modified five-factor model that allows covariance between items fits the data best. Construct validity was generally supported by the expected correlations of each job crafting dimension with each corresponding job resource (+), job demand (+), and psychological well-being (+). Cronbach's α coefficient was sufficient for each of the four dimensions of job crafting (α ranged between 0.76 and 0.90). Conclusions: This study confirmed that JCS-J is an adequate measure of job crafting that can be used in the Japanese context. PMID:27108643

Translation and validation of the German version of the Bournemouth Questionnaire for Neck Pain.

PubMed

Soklic, Marina; Peterson, Cynthia; Humphreys, B Kim

2012-01-25

Clinical outcome measures are important tools to monitor patient improvement during treatment as well as to document changes for research purposes. The short-form Bournemouth questionnaire for neck pain patients (BQN) was developed from the biopsychosocial model and measures pain, disability, cognitive and affective domains. It has been shown to be a valid and reliable outcome measure in English, French and Dutch and more sensitive to change compared to other questionnaires. The purpose of this study was to translate and validate a German version of the Bournemouth questionnaire for neck pain patients. German translation and back translation into English of the BQN was done independently by four persons and overseen by an expert committee. Face validity of the German BQN was tested on 30 neck pain patients in a single chiropractic practice. Test-retest reliability was evaluated on 31 medical students and chiropractors before and after a lecture. The German BQN was then assessed on 102 first time neck pain patients at two chiropractic practices for internal consistency, external construct validity, external longitudinal construct validity and sensitivity to change compared to the German versions of the Neck Disability Index (NDI) and the Neck Pain and Disability Scale (NPAD). Face validity testing lead to minor changes to the German BQN. The Intraclass Correlation Coefficient for the test-retest reliability was 0.99. The internal consistency was strong for all 7 items of the BQN with Cronbach α's of .79 and .80 for the pre and post-treatment total scores. External construct validity and external longitudinal construct validity using Pearson's correlation coefficient showed statistically significant correlations for all 7 scales of the BQN with the other questionnaires. The German BQN showed greater responsiveness compared to the other questionnaires for all scales. The German BQN is a valid and reliable outcome measure that has been successfully translated and culturally adapted. It is shorter, easier to use, and more responsive to change than the NDI and NPAD.

A Specific Construction of a Conic from an Ellipse

ERIC Educational Resources Information Center

Lee, J. Todd

2004-01-01

The interesting construction of a conic from an ellipse given by Manuel Santos-Trigo is evaluated. The validity of the conclusion that the locus is a conic section, the nature of which is determined in a simple way by the location of the variable point R relative to its center point O and the major vertices of the ellipse are proved.

Construct Validity of Fluency and Implications for the Factorial Structure of Memory

ERIC Educational Resources Information Center

Jewsbury, Paul A.; Bowden, Stephen C.

2017-01-01

Fluency is an important construct in clinical assessment and in cognitive taxonomies. In the Cattell-Horn-Carroll (CHC) model, Fluency is represented by several narrow factors that form a subset of the long-term memory encoding and retrieval (Glr) broad factor. The CHC broad classification of Fluency was evaluated in five data sets, and the CHC…

Toward Establishing the Validity of the Transformative Optimism Construct Measurement for Tsunami Preparedness: A Structural Equation Model for Visitors of the Pacific Northwest Coast

ERIC Educational Resources Information Center

Rios-Uribe, Carlos Andres

2009-01-01

Measurements of social constructs that evaluate natural hazard preparedness are important to decrease natural hazard vulnerability. Preparedness reduces natural hazard impacts and human vulnerability. Investment in education and education research contribute to human sustainable development and natural hazard preparedness. Faced with other needs,…

Measures of Searcher Performance: A Psychometric Evaluation.

ERIC Educational Resources Information Center

Wildemuth, Barbara M.; And Others

1993-01-01

Describes a study of medical students that was conducted to evaluate measures of performance on factual searches of INQUIRER, a full-text database in microbiology. Measures relating to recall, precision, search term overlap, and efficiency are discussed; reliability and construct validity are considered; and implications for future research are…

Validation of a moral distress instrument in nurses of primary health care 1

PubMed Central

Barth, Priscila Orlandi; Ramos, Flávia Regina Souza; Barlem, Edison Luiz Devos; Dalmolin, Graziele de Lima; Schneider, Dulcinéia Ghizoni

2018-01-01

ABSTRACT Objective: to validate an instrument to identify situations that trigger moral distress in relation to intensity and frequency in primary health care nurses. Method: this is a methodological study carried out with 391 nurses of primary health care, applied to the Brazilian Scale of Moral Distress in Nurses with 57 questions. Validation for primary health care was performed through expert committee evaluation, pre-test, factorial analysis, and Cronbach’s alpha. Results: there were 46 questions validated divided into six constructs: Health Policies, Working Conditions, Nurse Autonomy, Professional ethics, Disrespect to patient autonomy and Work Overload. The instrument had satisfactory internal consistency, with Cronbach’s alpha 0.98 for the instrument, and between 0.96 and 0.88 for the constructs. Conclusion: the instrument is valid and reliable to be used in the identification of the factors that trigger moral distress in primary care nurses, providing subsidies for new research in this field of professional practice. PMID:29791671

Psychometric properties of the Portuguese version of place attachment scale for youth in residential care.

PubMed

Magalhães, Eunice; Calheiros, María M

2015-01-01

Although the significant scientific advances on place attachment literature, no instruments exist specifically developed or adapted to residential care. 410 adolescents (11 - 18 years old) participated in this study. The place attachment scale evaluates five dimensions: Place identity, Place dependence, Institutional bonding, Caregivers bonding and Friend bonding. Data analysis included descriptive statistics, content validity, construct validity (Confirmatory Factor Analysis), concurrent validity with correlations with satisfaction with life and with institution, and reliability evidences. The relationship with individual characteristics and placement length was also verified. Content validity analysis revealed that more than half of the panellists perceive all the items as relevant to assess the construct in residential care. The structure with five dimensions revealed good fit statistics and concurrent validity evidences were found, with significant correlations with satisfaction with life and with the institution. Acceptable values of internal consistence and specific gender differences were found. The preliminary psychometric properties of this scale suggest it potential to be used with youth in care.

Development and Validation of Triarchic Construct Scales from the Psychopathic Personality Inventory

PubMed Central

Hall, Jason R.; Drislane, Laura E.; Patrick, Christopher J.; Morano, Mario; Lilienfeld, Scott O.; Poythress, Norman G.

2014-01-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy—the Psychopathic Personality Inventory (PPI). A consensus rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and non-offender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy. PMID:24447280

Development and validation of Triarchic construct scales from the psychopathic personality inventory.

PubMed

Hall, Jason R; Drislane, Laura E; Patrick, Christopher J; Morano, Mario; Lilienfeld, Scott O; Poythress, Norman G

2014-06-01

The Triarchic model of psychopathy describes this complex condition in terms of distinct phenotypic components of boldness, meanness, and disinhibition. Brief self-report scales designed specifically to index these psychopathy facets have thus far demonstrated promising construct validity. The present study sought to develop and validate scales for assessing facets of the Triarchic model using items from a well-validated existing measure of psychopathy-the Psychopathic Personality Inventory (PPI). A consensus-rating approach was used to identify PPI items relevant to each Triarchic facet, and the convergent and discriminant validity of the resulting PPI-based Triarchic scales were evaluated in relation to multiple criterion variables (i.e., other psychopathy inventories, antisocial personality disorder features, personality traits, psychosocial functioning) in offender and nonoffender samples. The PPI-based Triarchic scales showed good internal consistency and related to criterion variables in ways consistent with predictions based on the Triarchic model. Findings are discussed in terms of implications for conceptualization and assessment of psychopathy.

Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments.

PubMed

Liang, M H

2000-09-01

Although widely used and reported in research for the evaluation of groups, measures of health status and health-related quality of life have had little application in clinical practice for the assessment of individual patients. One of the principal barriers is the demonstration that these measures add clinically significant information to measures of function or symptoms alone. Here, we review the methods for evaluation of construct validity in longitudinal studies and make recommendations for nomenclature, reporting of study results, and future research agenda. Analytical review. The terms "sensitivity" and "responsiveness" have been used interchangeably, and there are few studies that evaluate the extent to which health status or health-related quality-of life measures capture clinically important changes ("responsiveness"). Current methods of evaluating responsiveness are not standardized or evaluated. Approaches for the assessment of a clinically significant or meaningful change are described; rather than normative information, however, standardized transition questions are proposed. They would be reported routinely and as separate axes of description to capture individual perceptions. Research in methods to assess the subject's evaluation of the importance and magnitude of a measured change are critical if health status and health-related quality-of-life measures are to have an impact on patient care.

Six Years of Comprehensive, Clinical, Performance-Based Assessment Using Standardized Patients at the Southern Illinois University School of Medicine.

ERIC Educational Resources Information Center

Vu, Nu Viet; And Others

1992-01-01

The use of a performance-based assessment of senior medical students' clinical skills utilizing standardized patients was evaluated, with 6,804 student-patient encounters involving 405 students over 6 years. Results provide evidence for test security, content validity, construct validity, reliability, and test ability to discriminate a wide range…

Reliability, Validity, and Sensitivity to Change of Turkish Activities-Specific Balance Confidence Scale in Patients with Unilateral Peripheral Vestibular Disease

ERIC Educational Resources Information Center

Karapolat, Hale; Eyigor, Sibel; Kirazli, Yesim; Celebisoy, Nese; Bilgen, Cem; Kirazli, Tayfun

2010-01-01

The aim of this study is to evaluate the internal consistency, test-retest reliability, construct validity, and sensitivity to change of the Activities-specific Balance Confidence Scale (ABC) in people with peripheral vestibular disorder. Thirty-three patients with unilateral peripheral vestibular disease were included in the study. Patients were…

Construct Validity of ADHD/ODD Rating Scales: Recommendations for the Evaluation of Forthcoming DSM-V ADHD/ODD Scales

ERIC Educational Resources Information Center

Burns, G. Leonard; Walsh, James A.; Servera, Mateu; Lorenzo-Seva, Urbano; Cardo, Esther; Rodriguez-Fornells, Antoni

2013-01-01

Exploratory structural equation modeling (SEM) was applied to a multiple indicator (26 individual symptom ratings) by multitrait (ADHD-IN, ADHD-HI and ODD factors) by multiple source (mothers, fathers and teachers) model to test the invariance, convergent and discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with 872…

A National Study of the Validity and Utility of the Comprehensive Assessment of School Environment (CASE) Survey

ERIC Educational Resources Information Center

McGuffey, Amy R.

2016-01-01

A healthy school climate is necessary for improvement. The purpose of this study was to evaluate the construct validity and usability of the Comprehensive Assessment of School Environment (CASE) as it was purportedly realigned to the three dimensions of the Breaking Ranks Framework developed by the National Association of Secondary School…

Self-Efficacy for Science Teaching Scale Development: Construct Validation with Elementary School Teachers

ERIC Educational Resources Information Center

Yangin, Selami; Sidekli, Sabri

2016-01-01

The measurement of teacher self-efficacy has a history of more than 30 years. The purpose of this research is to evaluate the development and validation of a new scale to measure the science teaching self-efficacy of elementary school teachers. Therefore, a scale has been created to measure elementary teachers' science teaching self-efficacy and…

Cross-cultural adaptation of an Arabic version of the 10-item hearing handicap inventory.

PubMed

Weinstein, Barbara E; Rasheedy, Doha; Taha, Hend M; Fatouh, Fathy N

2015-05-01

The purpose of this study was to translate and culturally adapt an Arabic version of the hearing handicap inventory for the elderly - screening (HHIE-S). The HHIE-S was translated following cross-cultural adaptation guidelines, and pretested in 20 elderly patients with hearing impairment. Next, the adapted Arabic HHIE-S underwent psychometric evaluation. The results were confirmed by pure-tone audiometer (PTA) examination. The patients completed the HHIE-S again after one hour. The validation of the questionnaire using Cronbach's alpha (internal consistency), (construct validity), and intraclass correlation coefficients (repeatability) was performed. Twenty elderly subjects with hearing impairment were recruited for the pretesting stage, and 100 elderly subjects were recruited for the psychometric evaluation stage. Patients with acute illness, functional dependency, cognitive impairment, and previous users of hearing aids were excluded. The adapted Arabic HHIE-S showed good internal consistency (α = 0.902). Construct validity was good, as high correlations were found between the scale and the PTA outcome (r = 0.688, p = 0.000). Repeatability was high (ICC = 0.986). This study showed that the adapted Arabic HHIE-S is a valid and reliable questionnaire for the assessment of handicapping hearing impairment in Egyptian elderly patients.

[Psychometric properties of a self-efficacy scale for physical activity in Brazilian adults].

PubMed

Rech, Cassiano Ricardo; Sarabia, Tais Taiana; Fermino, Rogério César; Hallal, Pedro Curi; Reis, Rodrigo Siqueira

2011-04-01

To test the validity and reliability of a self-efficacy scale for physical activity (PA) in Brazilian adults. A self-efficacy scale was applied jointly with a multidimensional questionnaire through face-to-face interviews with 1,418 individuals (63.4% women) aged ≥ 18 years. The scale was submitted to validity (factorial and construct) and reliability analysis (internal consistency and temporal stability). A test-retest procedure was conducted with 74 individuals to evaluate temporal stability. Exploratory factor analyses revealed two independent factors: self-efficacy for walking and self-efficacy for moderate and vigorous PA (MVPA). Together, these two factors explained 65.4% of the total variance of the scale (20.9% and 44.5% for walking and MVPA, respectively). Cronbach's alpha values were 0.83 for walking and 0.90 for MVPA, indicating high internal consistency. Both factors were significantly and positively correlated (rho ≥ 0.17, P < 0.001) with quality of life indicators (health perception, self-satisfaction, and energy for daily activities), indicating an adequate construct validity. The scale's validity, internal consistency, and reliability were adequate to evaluate self-efficacy for PA in Brazilian adults.

Testing the Construct Validity of a Virtual Reality Hip Arthroscopy Simulator.

PubMed

Khanduja, Vikas; Lawrence, John E; Audenaert, Emmanuel

2017-03-01

To test the construct validity of the hip diagnostics module of a virtual reality hip arthroscopy simulator. Nineteen orthopaedic surgeons performed a simulated arthroscopic examination of a healthy hip joint using a 70° arthroscope in the supine position. Surgeons were categorized as either expert (those who had performed 250 hip arthroscopies or more) or novice (those who had performed fewer than this). Twenty-one specific targets were visualized within the central and peripheral compartments; 9 via the anterior portal, 9 via the anterolateral portal, and 3 via the posterolateral portal. This was immediately followed by a task testing basic probe examination of the joint in which a series of 8 targets were probed via the anterolateral portal. During the tasks, the surgeon's performance was evaluated by the simulator using a set of predefined metrics including task duration, number of soft tissue and bone collisions, and distance travelled by instruments. No repeat attempts at the tasks were permitted. Construct validity was then evaluated by comparing novice and expert group performance metrics over the 2 tasks using the Mann-Whitney test, with a P value of less than .05 considered significant. On the visualization task, the expert group outperformed the novice group on time taken (P = .0003), number of collisions with soft tissue (P = .001), number of collisions with bone (P = .002), and distance travelled by the arthroscope (P = .02). On the probe examination, the 2 groups differed only in the time taken to complete the task (P = .025) with no significant difference in other metrics. Increased experience in hip arthroscopy was reflected by significantly better performance on the virtual reality simulator across 2 tasks, supporting its construct validity. This study validates a virtual reality hip arthroscopy simulator and supports its potential for developing basic arthroscopic skills. Level III. Copyright © 2016 Arthroscopy Association of North America. All rights reserved.

Unforgiveness: Refining theory and measurement of an understudied construct.

PubMed

Stackhouse, Madelynn R D; Jones Ross, Rachel W; Boon, Susan D

2018-01-01

This research presents a multidimensional conceptualization of unforgiveness and the development and validation of the unforgiveness measure (UFM). The scale was developed based on a qualitative study of people's experiences of unforgiven interpersonal offences (Study 1). Three dimensions of unforgiveness emerged (Study 2): emotional-ruminative unforgiveness, cognitive-evaluative unforgiveness, and offender reconstrual. We supported the scale's factor structure, reliability, and validity (Study 3). We also established the convergent and discriminant validity of the UFM with measures of negative affect, rumination, forgiveness, cognitive reappraisal, and emotional suppression (Study 4). Together, our results suggest that the UFM can capture variability in victims' unforgiving experiences in the aftermath of interpersonal transgressions. Implications for understanding the construct of unforgiveness and directions for future research are discussed. © 2017 The British Psychological Society.

Validity and reliability of the persian version of templer death anxiety scale in family caregivers of cancer patients.

PubMed

Soleimani, Mohammad Ali; Bahrami, Nasim; Yaghoobzadeh, Ameneh; Banihashemi, Hedieh; Nia, Hamid Sharif; Haghdoost, Ali Akbar

2016-01-01

Due to increasing recognition of the importance of death anxiety for understanding human nature, it is important that researchers who investigate death anxiety have reliable and valid methodology to measure. The purpose of this study was to evaluate the validity and reliability of the Persian version of Templer Death Anxiety Scale (TDAS) in family caregivers of cancer patients. A sample of 326 caregivers of cancer patients completed a 15-item questionnaire. Principal components analysis (PCA) followed by a varimax rotation was used to assess factor structure of the DAS. The construct validity of the scale was assessed using exploratory and confirmatory factor analyses. Convergent and discriminant validity were also examined. Reliability was assessed with Cronbach's alpha coefficients and construction reliability. Based on the results of the PCA and consideration of the meaning of our items, a three-factor solution, explaining 60.38% of the variance, was identified. A confirmatory factor analysis (CFA) then supported the adequacy of the three-domain structure of the DAS. Goodness-of-fit indices showed an acceptable fit overall with the full model {χ(2)(df) = 262.32 (61), χ(2)/df = 2.04 [adjusted goodness of fit index (AGFI) = 0.922, parsimonious comparative fit index (PCFI) = 0.703, normed fit Index (NFI) = 0.912, CMIN/DF = 2.048, root mean square error of approximation (RMSEA) = 0.055]}. Convergent and discriminant validity were shown with construct fulfilled. The Cronbach's alpha and construct reliability were greater than 0.70. The findings show that the Persian version of the TDAS has a three-factor structure and acceptable validity and reliability.

Construct Validity of the Nepalese School Leaving English Reading Test

ERIC Educational Resources Information Center

Dawadi, Saraswati; Shrestha, Prithvi N.

2018-01-01

There has been a steady interest in investigating the validity of language tests in the last decades. Despite numerous studies on construct validity in language testing, there are not many studies examining the construct validity of a reading test. This paper reports on a study that explored the construct validity of the English reading test in…

Social validity in single-case research: A systematic literature review of prevalence and application.

PubMed

Snodgrass, Melinda R; Chung, Moon Y; Meadan, Hedda; Halle, James W

2018-03-01

Single-case research (SCR) has been a valuable methodology in special education research. Montrose Wolf (1978), an early pioneer in single-case methodology, coined the term "social validity" to refer to the social importance of the goals selected, the acceptability of procedures employed, and the effectiveness of the outcomes produced in applied investigations. Since 1978, many contributors to SCR have included social validity as a feature of their articles and several authors have examined the prevalence and role of social validity in SCR. We systematically reviewed all SCR published in six highly-ranked special education journals from 2005 to 2016 to establish the prevalence of social validity assessments and to evaluate their scientific rigor. We found relatively low, but stable prevalence with only 28 publications addressing all three factors of the social validity construct (i.e., goals, procedures, outcomes). We conducted an in-depth analysis of the scientific rigor of these 28 publications. Social validity remains an understudied construct in SCR, and the scientific rigor of social validity assessments is often lacking. Implications and future directions are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Developing a tool to measure satisfaction among health professionals in sub-Saharan Africa

PubMed Central

2013-01-01

Background In sub-Saharan Africa, lack of motivation and job dissatisfaction have been cited as causes of poor healthcare quality and outcomes. Measurement of health workers’ satisfaction adapted to sub-Saharan African working conditions and cultures is a challenge. The objective of this study was to develop a valid and reliable instrument to measure satisfaction among health professionals in the sub-Saharan African context. Methods A survey was conducted in Senegal and Mali in 2011 among 962 care providers (doctors, midwives, nurses and technicians) practicing in 46 hospitals (capital, regional and district). The participation rate was very high: 97% (937/962). After exploratory factor analysis (EFA), construct validity was assessed through confirmatory factor analysis (CFA). The discriminant validity of our subscales was evaluated by comparing the average variance extracted (AVE) for each of the constructs with the squared interconstruct correlation (SIC), and finally for criterion validity, each subscale was tested with two hypotheses. Two dimensions of reliability were assessed: internal consistency with Cronbach’s alpha subscales and stability over time using a test-retest process. Results Eight dimensions of satisfaction encompassing 24 items were identified and validated using a process that combined psychometric analyses and expert opinions: continuing education, salary and benefits, management style, tasks, work environment, workload, moral satisfaction and job stability. All eight dimensions demonstrated significant discriminant validity. The final model showed good performance, with a root mean square error of approximation (RMSEA) of 0.0508 (90% CI: 0.0448 to 0.0569) and a comparative fit index (CFI) of 0.9415. The concurrent criterion validity of the eight dimensions was good. Reliability was assessed based on internal consistency, which was good for all dimensions but one (moral satisfaction < 0.70). Test-retest showed satisfactory temporal stability (intra class coefficient range: 0.60 to 0.91). Conclusions Job satisfaction is a complex construct; this study provides a multidimensional instrument whose content, construct and criterion validities were verified to ensure its suitability for the sub-Saharan African context. When using these subscales in further studies, the variability of the reliability of the subscales should be taken in to account for calculating the sample sizes. The instrument will be useful in evaluative studies which will help guide interventions aimed at improving both the quality of care and its effectiveness. PMID:23826720

Family relationships as an explanatory variable in childhood dental caries: a systematic review of measures.

PubMed

Duijster, D; O'Malley, L; Elison, S; Van Loveren, C; Marcenes, W; Adair, P M; Pine, C M

2013-01-01

It is widely acknowledged that parental beliefs (self-efficacy) about oral health and parental oral health-related behaviours play a fundamental role in the establishment of preventative behaviours that will mitigate against the development of childhood dental caries. However, little attention has been given to the wider perspective of family functioning and family relationships on child oral health. For oral health researchers, exploration of this association requires the use of reliable, valid and appropriate assessment tools to measure family relationships. In order to promote methodologically sound research in oral health, this systematic review aims to provide a guide on self-report psychometric measures of family functioning that may be suitable to utilize when exploring childhood dental caries. This systematic review has identified 29 self-report measures of family functioning and evaluated them in terms of their psychometric support, constructs measured and potential utility for oral health research. The majority of the measures reported adequate levels of reliability and construct validity. Construct evaluation of the measures identified five core domains of family functioning, namely 'communication', 'cohesion/engagement', 'control', 'involvement' and 'authoritative/rigid parenting style'. The constructs were subsequently evaluated with respect to their potential relevance to child oral health. Herewith this review provides a framework to guide future research to explore family functioning in furthering our understanding of the development of childhood dental caries. © 2013 S. Karger AG, Basel.

Validation of the da Vinci Surgical Skill Simulator across three surgical disciplines: A pilot study

PubMed Central

Alzahrani, Tarek; Haddad, Richard; Alkhayal, Abdullah; Delisle, Josée; Drudi, Laura; Gotlieb, Walter; Fraser, Shannon; Bergman, Simon; Bladou, Frank; Andonian, Sero; Anidjar, Maurice

2013-01-01

Objective: In this paper, we evaluate face, content and construct validity of the da Vinci Surgical Skills Simulator (dVSSS) across 3 surgical disciplines. Methods: In total, 48 participants from urology, gynecology and general surgery participated in the study as novices (0 robotic cases performed), intermediates (1–74) or experts (≥75). Each participant completed 9 tasks (Peg board level 2, match board level 2, needle targeting, ring and rail level 2, dots and needles level 1, suture sponge level 2, energy dissection level 1, ring walk level 3 and tubes). The Mimic Technologies software scored each task from 0 (worst) to 100 (best) using several predetermined metrics. Face and content validity were evaluated by a questionnaire administered after task completion. Wilcoxon test was used to perform pair wise comparisons. Results: The expert group comprised of 6 attending surgeons. The intermediate group included 4 attending surgeons, 3 fellows and 5 residents. The novices included 1 attending surgeon, 1 fellow, 13 residents, 13 medical students and 2 research assistants. The median number of robotic cases performed by experts and intermediates were 250 and 9, respectively. The median overall realistic score (face validity) was 8/10. Experts rated the usefulness of the simulator as a training tool for residents (content validity) as 8.5/10. For construct validity, experts outperformed novices in all 9 tasks (p < 0.05). Intermediates outperformed novices in 7 of 9 tasks (p < 0.05); there were no significant differences in the energy dissection and ring walk tasks. Finally, experts scored significantly better than intermediates in only 3 of 9 tasks (matchboard, dots and needles and energy dissection) (p < 0.05). Conclusions: This study confirms the face, content and construct validities of the dVSSS across urology, gynecology and general surgery. Larger sample size and more complex tasks are needed to further differentiate intermediates from experts. PMID:23914275

Instrument translation and initial psychometric evaluation of the Danish Body Image Quality of Life Inventory.

PubMed

Rasmussen, Trine Bernholdt; Berg, Selina Kikkenborg; Dixon, Jane; Moons, Philip; Konradsen, Hanne

2016-12-01

Negative body perception has been reported in a number of patient populations. No instrument in Danish for measuring body image-related concerns has been available. Without such an instrument, understanding of the phenomenon in Danish-speaking populations is limited. The purpose of the study was thus to translate and validate a Danish version of the Body Image Quality of Life Inventory (BIQLI), in order to obtain a valid instrument applicable for healthcare research. The study consisted of two phases: (i) instrument adaptation, including forward and back translation, expert committee comparisons and cognitive interviewing, and (ii) empirical testing of the Danish version (BIQLI-DA) with subsequent psychometric evaluation. Hypothesised correlations to other measures, including body mass index (BMI), Medical Outcome Short Form-8 (SF-8), Patient Health Questionnaire-9 (PHQ-9), General Anxiety Disorder-7 and Symptom Check List-90-Revised (SCL-90-R ® ) were tested. In addition, exploratory factor structure analysis (EFA) and internal consistency on item and scale level were performed. The adapted instrument was found to be semantically sound, yet concerns about face validity did arise through cognitive interviews. Danish college students (n = 189, 65 men, M age = 21.1 years) participated in the piloting of the BIQLI-DA. Convergent construct validity was demonstrated through associations to related constructs. Exploratory factor analysis revealed a potential subscale structure. Finally, results showed a high internal consistency (Cronbach's alpha = 0.92). Support for the validity of the BIQLI-DA might have been strengthened by repeating cognitive interviews after layout alterations, by piloting the instrument on a larger sample. This study demonstrated tentative support for the validity of the Danish Body Image Quality of Life (BIQLI-DA) and found the measure to be reliable in terms of internal consistency. Further exploration of response processes and construct validity is needed. © 2016 Nordic College of Caring Science.

[Development of an evaluation instrument for service quality in nursing homes].

PubMed

Lee, Jia; Ji, Eun Sun

2011-08-01

The purposes of this study were to identify the factors influencing service quality in nursing homes, and to develop an evaluation instrument for service quality. A three-phase process was employed for the study. 1) The important factors to evaluate the service quality in nursing homes were identified through a literature review, panel discussion and focus group interview, 2) the evaluation instrument was developed, and 3) validity and reliability of the study instrument were tested by factor analysis, Pearson correlation coefficient, Cronbach's α and Cohen's Kappa. Factor analysis showed that the factors influencing service quality in nursing homes were healthcare, diet/assistance, therapy, environment and staff. To improve objectivity of the instrument, quantitative as well as qualitative evaluation approaches were adopted. The study instrument was developed with 30 items and showed acceptable construct validity. The criterion-related validity was a Pearson correlation coefficient of .85 in 151 care facilities. The internal consistency was Cronbach's α=.95. The instrument has acceptable validity and a high degree of reliability. Staff in nursing homes can continuously improve and manage their services using the results of the evaluation instrument.

Assessment of tinnitus-related impairments and disabilities using the German THI-12: sensitivity and stability of the scale over time.

PubMed

Görtelmeyer, Roman; Schmidt, Jürgen; Suckfüll, Markus; Jastreboff, Pawel; Gebauer, Alexander; Krüger, Hagen; Wittmann, Werner

2011-08-01

To evaluate the reliability, dimensionality, predictive validity, construct validity, and sensitivity to change of the THI-12 total and sub-scales as diagnostic aids to describe and quantify tinnitus-evoked reactions and evaluate treatment efficacy. Explorative analysis of the German tinnitus handicap inventory (THI-12) to assess potential sensitivity to tinnitus therapy in placebo-controlled randomized studies. Correlation analysis, including Cronbach's coefficient α and explorative common factor analysis (EFA), was conducted within and between assessments to demonstrate the construct validity, dimensionality, and factorial structure of the THI-12. N = 618 patients suffering from subjective tinnitus who were to be screened to participate in a randomized, placebo-controlled, 16-week, longitudinal study. The THI-12 can reliably diagnose tinnitus-related impairments and disabilities and assess changes over time. The test-retest coefficient for neighboured visits was r > 0.69, the internal consistency of the THI-12 total score was α ≤ 0.79 and α ≤ 0.89 at subsequent visits. Predictability of THI-12 total score and overall variance increased with successive measurements. The three-factorial structure allowed for evaluation of factors that affect aspects of patients' health-related quality of life. The THI-12, with its three-factorial structure, is a simple, reliable, and valid instrument for the diagnosis and assessment of tinnitus and associated impairment over time.

Clinical Functional Capacity Testing in Patients With Facioscapulohumeral Muscular Dystrophy: Construct Validity and Interrater Reliability of Antigravity Tests.

PubMed

Rijken, Noortje H; van Engelen, Baziel G; Weerdesteyn, Vivian; Geurts, Alexander C

2015-12-01

To evaluate the construct validity and interrater reliability of 4 simple antigravity tests in a small group of patients with facioscapulohumeral muscular dystrophy (FSHD). Case-control study. University medical center. Patients with various severity levels of FSHD (n=9) and healthy control subjects (n=10) were included (N=19). Not applicable. A 4-point ordinal scale was designed to grade performance on the following 4 antigravity tests: sit to stance, stance to sit, step up, and step down. In addition, the 6-minute walk test, 10-m walking test, Berg Balance Scale, and timed Up and Go test were administered as conventional tests. Construct validity was determined by linear regression analysis using the Clinical Severity Score (CSS) as the dependent variable. Interrater agreement was tested using a κ analysis. Patients with FSHD performed worse on all 4 antigravity tests compared with the controls. Stronger correlations were found within than between test categories (antigravity vs conventional). The antigravity tests revealed the highest explained variance with regard to the CSS (R(2)=.86, P=.014). Interrater agreement was generally good. The results of this exploratory study support the construct validity and interrater reliability of the proposed antigravity tests for the assessment of functional capacity in patients with FSHD taking into account the use of compensatory strategies. Future research should further validate these results in a larger sample of patients with FSHD. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Construct Validation of the Physics Metacognition Inventory

NASA Astrophysics Data System (ADS)

Taasoobshirazi, Gita; Farley, John

2013-02-01

The 24-item Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. Items were classified into eight subcomponents subsumed under two broader components: knowledge of cognition and regulation of cognition. The students' scores on the inventory were found to be reliable and related to students' physics motivation and physics grade. An exploratory factor analysis provided evidence of construct validity, revealing six components of students' metacognition when solving physics problems including: knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. Although women and men differed on the components, they had equivalent overall metacognition for problem solving. The implications of these findings for future research are discussed.

Construction of prediction intervals for Palmer Drought Severity Index using bootstrap

NASA Astrophysics Data System (ADS)

Beyaztas, Ufuk; Bickici Arikan, Bugrayhan; Beyaztas, Beste Hamiye; Kahya, Ercan

2018-04-01

In this study, we propose an approach based on the residual-based bootstrap method to obtain valid prediction intervals using monthly, short-term (three-months) and mid-term (six-months) drought observations. The effects of North Atlantic and Arctic Oscillation indexes on the constructed prediction intervals are also examined. Performance of the proposed approach is evaluated for the Palmer Drought Severity Index (PDSI) obtained from Konya closed basin located in Central Anatolia, Turkey. The finite sample properties of the proposed method are further illustrated by an extensive simulation study. Our results revealed that the proposed approach is capable of producing valid prediction intervals for future PDSI values.

Short version of the Depression Anxiety Stress Scale-21: is it valid for Brazilian adolescents?

PubMed Central

da Silva, Hítalo Andrade; dos Passos, Muana Hiandra Pereira; de Oliveira, Valéria Mayaly Alves; Palmeira, Aline Cabral; Pitangui, Ana Carolina Rodarti; de Araújo, Rodrigo Cappato

2016-01-01

ABSTRACT Objective To evaluate the interday reproducibility, agreement and validity of the construct of short version of the Depression Anxiety Stress Scale-21 applied to adolescents. Methods The sample consisted of adolescents of both sexes, aged between 10 and 19 years, who were recruited from schools and sports centers. The validity of the construct was performed by exploratory factor analysis, and reliability was calculated for each construct using the intraclass correlation coefficient, standard error of measurement and the minimum detectable change. Results The factor analysis combining the items corresponding to anxiety and stress in a single factor, and depression in a second factor, showed a better match of all 21 items, with higher factor loadings in their respective constructs. The reproducibility values for depression were intraclass correlation coefficient with 0.86, standard error of measurement with 0.80, and minimum detectable change with 2.22; and, for anxiety/stress: intraclass correlation coefficient with 0.82, standard error of measurement with 1.80, and minimum detectable change with 4.99. Conclusion The short version of the Depression Anxiety Stress Scale-21 showed excellent values of reliability, and strong internal consistency. The two-factor model with condensation of the constructs anxiety and stress in a single factor was the most acceptable for the adolescent population. PMID:28076595

Evaluation of English Achievement Test: A Comparison between High and Low Achievers amongst Selected Elementary School Students of Pakistan

ERIC Educational Resources Information Center

Haider, Zubair; Latif, Farah; Akhtar, Samina; Mushtaq, Maria

2012-01-01

Validity, reliability and item analysis are critical to the process of evaluating the quality of an educational measurement. The present study evaluates the quality of an assessment constructed to measure elementary school student's achievement in English. In this study, the survey model of descriptive research was used as a research method.…

Measurement properties of patient-reported outcome measures (PROMs) used in adult patients with chronic kidney disease: A systematic review

PubMed Central

Kyte, Derek; Cockwell, Paul; Marshall, Tom; Gheorghe, Adrian; Keeley, Thomas; Slade, Anita; Calvert, Melanie

2017-01-01

Background Patient-reported outcome measures (PROMs) can provide valuable information which may assist with the care of patients with chronic kidney disease (CKD). However, given the large number of measures available, it is unclear which PROMs are suitable for use in research or clinical practice. To address this we comprehensively evaluated studies that assessed the measurement properties of PROMs in adults with CKD. Methods Four databases were searched; reference list and citation searching of included studies was also conducted. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to appraise the methodological quality of the included studies and to inform a best evidence synthesis for each PROM. Results The search strategy retrieved 3,702 titles/abstracts. After 288 duplicates were removed, 3,414 abstracts were screened and 71 full-text articles were retrieved for further review. Of these, 24 full-text articles were excluded as they did not meet the eligibility criteria. Following reference list and citation searching, 19 articles were retrieved bringing the total number of papers included in the final analysis to 66. There was strong evidence supporting internal consistency and moderate evidence supporting construct validity for the Kidney Disease Quality of Life-36 (KDQOL-36) in pre-dialysis patients. In the dialysis population, the KDQOL-Short Form (KDQOL-SF) had strong evidence for internal consistency and structural validity and moderate evidence for test-retest reliability and construct validity while the KDQOL-36 had moderate evidence of internal consistency, test-retest reliability and construct validity. The End Stage Renal Disease-Symptom Checklist Transplantation Module (ESRD-SCLTM) demonstrated strong evidence for internal consistency and moderate evidence for test-retest reliability, structural and construct validity in renal transplant recipients. Conclusions We suggest considering the KDQOL-36 for use in pre-dialysis patients; the KDQOL-SF or KDQOL-36 for dialysis patients and the ESRD-SCLTM for use in transplant recipients. However, further research is required to evaluate the measurement error, structural validity, responsiveness and patient acceptability of PROMs used in CKD. PMID:28636678

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations

PubMed Central

Sigilai, Antipa; Hassan, Amin S.; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J. R.; Newton, Charles R. J. C.; Abubakar, Amina

2017-01-01

Background Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. Aims We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. Methods The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. Results In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach’s α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. Conclusion The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region. PMID:28380073

Development of Evaluation Indicators for Hospice and Palliative Care Professionals Training Programs in Korea.

PubMed

Kang, Jina; Park, Kyoung-Ok

2017-01-01

The importance of training for Hospice and Palliative Care (HPC) professionals has been increasing with the systemization of HPC in Korea. Hence, the need and importance of training quality for HPC professionals are growing. This study evaluated the construct validity and reliability of the Evaluation Indicators for standard Hospice and Palliative Care Training (EIHPCT) program. As a framework to develop evaluation indicators, an invented theoretical model combining Stufflebeam's CIPP (Context-Input-Process-Product) evaluation model with PRECEDE-PROCEED model was used. To verify the construct validity of the EIHPCT program, a structured survey was performed with 169 professionals who were the HPC training program administrators, trainers, and trainees. To examine the validity of the areas of the EIHPCT program, exploratory factor analysis and confirmatory factor analysis were conducted. First, in the exploratory factor analysis, the indicators with factor loadings above 0.4 were chosen as desirable items, and some cross-loaded items that loaded at 0.4 or higher on two or more factors were adjusted as the higher factor. Second, the model fit of the modified EIHPCT program was quite good in the confirmatory factor analysis (Goodness-of-Fit Index > 0.70, Comparative Fit Index > 0.80, Normed Fit Index > 0.80, Root Mean square of Residuals < 0.05). The modified model of the EIHPCT comprised 4 areas, 13 subdomains, and 61 indicators. The evaluation indicators of the modified model will be valuable references for improving the HPC professional training program.

Development and validation of a mass casualty conceptual model.

PubMed

Culley, Joan M; Effken, Judith A

2010-03-01

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events. The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research. Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions. Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale). Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care. This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

Construct validity and reliability of a real-time multidimensional smartphone app to assess pain in children and adolescents with cancer.

PubMed

Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Hopyan, Sevan; Alman, Benjamin A; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L

2015-12-01

We evaluated the construct validity (including responsiveness), reliability, and feasibility of the Pain Squad multidimensional smartphone-based pain assessment application (app) in children and adolescents with cancer, using 2 descriptive studies with repeated measures. Participants (8-18 years) undergoing cancer treatment were drawn from 4 pediatric cancer centers. In study 1, 92 participants self-reported their level of pain twice daily for 2 weeks using the Pain Squad app to assess app construct validity and reliability. In study 2, 14 participants recorded their level of pain twice a day for 1 week before and 2 weeks after cancer-related surgery to determine app responsiveness. Participants in both studies completed multiple measures to determine the construct validity and feasibility of the Pain Squad app. Correlations between average weekly pain ratings on the Pain Squad app and recalled least, average, and worst weekly pain were moderate to high (0.43-0.68). Correlations with health-related quality of life and pain coping (measured with PedsQL Inventory 4.0, PedsQL Cancer Module, and Pain Coping Questionnaire) were -0.46 to 0.29. The app showed excellent internal consistency (α = 0.96). Pain ratings changed because of surgery with large effect sizes between baseline and the first week postsurgery (>0.85) and small effect sizes between baseline and the second week postsurgery (0.13-0.32). These findings provide evidence of the construct validity, reliability, and feasibility of the Pain Squad app in children and adolescents with cancer. Use of real-time data capture approaches should be considered in future studies of childhood cancer pain. A video accompanying this abstract is available online as Supplemental Digital Content at http://links.lww.com/PAIN/A169.

An instrument to assess subjective task value beliefs regarding the decision to pursue postgraduate training.

PubMed

Hagemeier, Nicholas E; Murawski, Matthew M

2014-02-12

To develop and validate an instrument to assess subjective ratings of the perceived value of various postgraduate training paths followed using expectancy-value as a theoretical framework; and to explore differences in value beliefs across type of postgraduate training pursued and type of pharmacy training completed prior to postgraduate training. A survey instrument was developed to sample 4 theoretical domains of subjective task value: intrinsic value, attainment value, utility value, and perceived cost. Retrospective self-report methodology was employed to examine respondents' (N=1,148) subjective task value beliefs specific to their highest level of postgraduate training completed. Exploratory and confirmatory factor analytic techniques were used to evaluate and validate value belief constructs. Intrinsic, attainment, utility, cost, and financial value constructs resulted from exploratory factor analysis. Cross-validation resulted in a 26-item instrument that demonstrated good model fit. Differences in value beliefs were noted across type of postgraduate training pursued and pharmacy training characteristics. The Postgraduate Training Value Instrument demonstrated evidence of reliability and construct validity. The survey instrument can be used to assess value beliefs regarding multiple postgraduate training options in pharmacy and potentially inform targeted recruiting of individuals to those paths best matching their own value beliefs.

Development and psychometric evaluation of supportive leadership scales.

PubMed

McGilton, Katherine S

2003-12-01

The purpose of this study was to develop and evaluate the psychometric properties of 2 supportive leadership scales, the Charge Nurse Support Scale and the Unit Manager Support Scale, designed for long-term-care environments. These 6-item self-report scales were administered to 70 nursing staff and their internal consistency reliability, test-retest reliability, content validity, factor structure, and construct validity investigated. Content validity was established with the assistance of experts. Both scales were deemed reliable. As hypothesized, a significant relationship was found between the measure of how nursing staff related to residents and measures of charge nurses' supportive behaviours (r = .42, p = .05). Reliable and valid measures of supportive leadership could be developed for use in identifying the quality of support provided to staff in long-term-care environments.

Nursing Job Rotation Stress Scale development and psychometric evaluation.

PubMed

Huang, Shan; Lin, Yu-Hua; Kao, Chia-Chan; Yang, Hsing-Yu; Anne, Ya-Li; Wang, Cheng-Hua

2016-01-01

The aim of this study was to develop and assess the reliability and validity of the Nurse Job Rotation Stress Scale (NJRS). A convenience sampling method was utilized to recruit two groups of nurses (n = 150 and 253) from a 2751 bed medical center in southern Taiwan. The NJRS scale was developed and used to evaluate the NJRS. Explorative factor analysis revealed that three factors accounted for 74.11% of the explained variance. Confirmatory factor analysis validity testing supported the three factor structure and the construct validity. Cronbach's alpha for the 10 item model was 0.87 and had high linearity. The NJRS can be considered a reliable and valid scale for the measurement of nurse job rotation stress for nursing management and research purposes. © 2015 Japan Academy of Nursing Science.

Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

PubMed

Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

2014-05-01

In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method of assessing and reporting whether items assess the intended theoretical construct and only that construct. In three studies, DCV was applied to measures of illness perceptions, control cognitions, and theory of planned behaviour response formats. Appendix S1 gives content validity indices for each item of each questionnaire investigated. Discriminant content validity is ideally applied while the measure is being developed, before using to measure the construct(s), but can also be applied after using a measure. © 2014 The British Psychological Society.

Psychometric evaluation of the Chinese version of the fear of intimacy with helping professionals scale

PubMed Central

Chan, Kin Sun

2018-01-01

Objectives This study aimed to evaluate the internal consistency, reliability, convergent validity, known-group comparisons, and structural validity of the Chinese version of Fear of Intimacy with Helping Professionals (C–FIS–HP) scale in Macau. Methods A cross-sectional design was used on a sample of 593 older people in 6 health centers. We used Chinese version of Exercise of Self-Care Agency Scale (C-ESCAS) and Morisky 4-item medication adherence scale to evaluate self-care actions and medication adherence. The internal consistency and reliability of C–FIS–HP were analyzed using the Spearman-Brown split-half reliability, Cronbach’s alpha, and test–retest reliability. Convergent validity was tested the construct of C–FIS–HP and self-care actions. Known-group comparisons differentiated predefined groups in an expected direction. Two separated samples were used to test the structural validity. An exploratory factor analysis (EFA) tested the factor structure of C–FISHP using the principal axis factoring. A confirmatory factor analysis (CFA) was further conducted to confirm the factor structure constructed in the prior EFA. Results The C–FIS–HP had a Spearman-Brown split-half coefficient, Cronbach’s alpha, and intraclass correlation coefficient of 0.96, 0.93, and 0.96, respectively. Convergent validity was satisfactory with significantly correlations between the C-FIS-HP and C-ESCAS. C–FIS–HP to differentiate the differences between high-, moderate-, and low- medication adherence groups. EFA demonstrated a two-factor structure among 297 older people. A first-order CFA was performed to confirm the construct dimensionality of C–FIS–HP with satisfactory fit indices (NFI = 0.92; IFI = 0.95; TLI = 0.94; CFI = 0.95 and RMSEA = 0.07) among 296 older people. Conclusions C–FIS–HP is a reliable and valid test for assessing helping relationships in older Chinese people. Health professionals can use C–FIS–HP as a clinical tool to assess the comfort level of patients in a helping relationship, and use this information to develop culturally sensitive therapeutic interventions and treatment plans. Further studies need to be conducted concerning the different psychometric properties, as well as the application of C–FIS–HP in various regions. PMID:29795563

Chinese Adaptation of the Bad Sobernheim Stress Questionnaire for Patients With Adolescent Idiopathic Scoliosis Under Brace Treatment.

PubMed

Xu, Ximing; Wang, Fei; Yang, Mingyuan; Huang, Qikai; Chang, Yifan; Wei, Xianzhao; Bai, Yushu; Li, Ming

2015-08-01

Bad Sobernheim Stress Questionnaire (BSSQ)-Deformity and BSSQ-Brace are the most widely used instruments for evaluating stress levels in adolescent idiopathic scoliosis (AIS) patients under brace treatment, and good reliability and validity have been demonstrated across different cultures. Great stress has been found among many adolescents, becoming a major concern for professionals. However, no previous research has addressed the cultural adaptations and psychometric testing of BSSQ-Deformity and BSSQ-Brace in China or the stress levels in AIS patients. The purposes of our study were to evaluate the cross-cultural adaptation and validation of the BSSQ-Deformity and BSSQ-Brace and to investigate stress levels in Chinese (AIS) patients under brace treatment.The original (German) versions of BSSQ-Deformity and BSSQ-Brace were cross-culturally translated according to international guidelines. Psychometric properties such as reliability and construct validity were tested. Eighty-six AIS patients were included in our study, and 50 patients paid a second visit 3 to 7 days later to test reproducibility. Cronbach α and the intraclass coefficient were determined to assess internal consistency and reproducibility. Scoliosis Research Society patient questionnaire-22 (SRS-22) was applied to evaluate construct validity.The mean BSSQ-Deformity and BSSQ-Brace scores were 15.3 and 13.4 points, respectively. Severe stress was observed in 12% of patients due to brace treatment. Item analysis demonstrated that each item was scored under a normal distribution with no redundancy. Psychometric analysis revealed excellent internal consistency (Cronbach α = 0.85 and 0.80, respectively) and reproducibility (intraclass correlation coefficient = 0.85 and 0.90, respectively) for BSSQ-Deformity and BSSQ-Brace. The correlation coefficients of BSSQ-Deformity, BSSQ-Brace and SRS-22 were 0.48 and 0.63, respectively.In conclusion, BSSQ-Deformity and BSSQ-Brace have been successfully adapted to a Chinese background and psychometrically validated with excellent reliability and construct validity. Brace wearing is considered the main cause of stress in AIS patients under brace treatment.

Chinese Adaptation of the Bad Sobernheim Stress Questionnaire for Patients With Adolescent Idiopathic Scoliosis Under Brace Treatment

PubMed Central

Xu, Ximing; Wang, Fei; Yang, Mingyuan; Huang, Qikai; Chang, Yifan; Wei, Xianzhao; Bai, Yushu; Li, Ming

2015-01-01

Abstract Bad Sobernheim Stress Questionnaire (BSSQ)-Deformity and BSSQ-Brace are the most widely used instruments for evaluating stress levels in adolescent idiopathic scoliosis (AIS) patients under brace treatment, and good reliability and validity have been demonstrated across different cultures. Great stress has been found among many adolescents, becoming a major concern for professionals. However, no previous research has addressed the cultural adaptations and psychometric testing of BSSQ-Deformity and BSSQ-Brace in China or the stress levels in AIS patients. The purposes of our study were to evaluate the cross-cultural adaptation and validation of the BSSQ-Deformity and BSSQ-Brace and to investigate stress levels in Chinese (AIS) patients under brace treatment. The original (German) versions of BSSQ-Deformity and BSSQ-Brace were cross-culturally translated according to international guidelines. Psychometric properties such as reliability and construct validity were tested. Eighty-six AIS patients were included in our study, and 50 patients paid a second visit 3 to 7 days later to test reproducibility. Cronbach α and the intraclass coefficient were determined to assess internal consistency and reproducibility. Scoliosis Research Society patient questionnaire-22 (SRS-22) was applied to evaluate construct validity. The mean BSSQ-Deformity and BSSQ-Brace scores were 15.3 and 13.4 points, respectively. Severe stress was observed in 12% of patients due to brace treatment. Item analysis demonstrated that each item was scored under a normal distribution with no redundancy. Psychometric analysis revealed excellent internal consistency (Cronbach α = 0.85 and 0.80, respectively) and reproducibility (intraclass correlation coefficient = 0.85 and 0.90, respectively) for BSSQ-Deformity and BSSQ-Brace. The correlation coefficients of BSSQ-Deformity, BSSQ-Brace and SRS-22 were 0.48 and 0.63, respectively. In conclusion, BSSQ-Deformity and BSSQ-Brace have been successfully adapted to a Chinese background and psychometrically validated with excellent reliability and construct validity. Brace wearing is considered the main cause of stress in AIS patients under brace treatment. PMID:26252283

Assessing Measurement Invariance for Spanish Sentence Repetition and Morphology Elicitation Tasks

ERIC Educational Resources Information Center

Kapantzoglou, Maria; Thompson, Marilyn S.; Gray, Shelley; Restrepo, M. Adelaida

2016-01-01

Purpose: The purpose of this study was to evaluate evidence supporting the construct validity of two grammatical tasks (sentence repetition, morphology elicitation) included in the Spanish Screener for Language Impairment in Children (Restrepo, Gorin, & Gray, 2013). We evaluated if the tasks measured the targeted grammatical skills in the same…

Approaches for Combining Multiple Measures of Teacher Performance: Reliability, Validity, and Implications for Evaluation Policy

ERIC Educational Resources Information Center

Martínez, José Felipe; Schweig, Jonathan; Goldschmidt, Pete

2016-01-01

A key question facing teacher evaluation systems is how to combine multiple measures of complex constructs into composite indicators of performance. We use data from the Measures of Effective Teaching (MET) study to investigate the measurement properties of composite indicators obtained under various conjunctive, disjunctive (or complementary),…

The Law Enforcement Officer Stress Survey (LEOSS): Evaluation of Psychometric Properties

ERIC Educational Resources Information Center

Van Hasselt, Vincent B.; Sheehan, Donald C.; Malcolm, Abigail S.; Sellers, Alfred H.; Baker, Monty T.; Couwels, Judy

2008-01-01

This study establishes the reliability and validity of the Law Enforcement Officer Stress Survey (LEOSS), a short early-warning stress-screening measure for law enforcement officers. The initial phase of LEOSS development employed the behavioral-analytic model to construct a 25-item instrument specifically geared toward evaluation of stress in…

Development of a survey instrument to measure connectivity to evaluate national public health preparedness and response performance.

PubMed

Dorn, Barry C; Savoia, Elena; Testa, Marcia A; Stoto, Michael A; Marcus, Leonard J

2007-01-01

Survey instruments for evaluating public health preparedness have focused on measuring the structure and capacity of local, state, and federal agencies, rather than linkages among structure, process, and outcomes. To focus evaluation on the latter, we evaluated the linkages among individuals, organizations, and systems using the construct of "connectivity" and developed a measurement instrument. Results from focus groups of emergency preparedness first responders generated 62 items used in the development sample of 187 respondents. Item reduction and factors analyses were conducted to confirm the scale's components. The 62 items were reduced to 28. Five scales explained 70% of the total variance (number of items, percent variance explained, Cronbach's alpha) including connectivity with the system (8, 45%, 0.94), coworkers (7, 7%, 0.91), organization (7, 12%, 0.93), and perceptions (6, 6%, 0.90). Discriminant validity was found to be consistent with the factor structure. We developed a Connectivity Measurement Tool for the public health workforce consisting of a 34-item questionnaire found to be a reliable measure of connectivity with preliminary evidence of construct validity.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda.

PubMed

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-12-02

The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda.

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda

PubMed Central

Roberts, Bayard; Browne, John; Ocaka, Kaducu Felix; Oyok, Thomas; Sondorp, Egbert

2008-01-01

Background The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. Methods A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. Results The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. Conclusion This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda. PMID:19055716

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals 1

PubMed Central

Oliveira, Lanuza Borges; Soares, Fernanda Amaral; Silveira, Marise Fagundes; de Pinho, Lucinéia; Caldeira, Antônio Prates; Leite, Maísa Tavares de Souza

2016-01-01

ABSTRACT Objective: to develop and validate an instrument to evaluate the knowledge of health professionals about domestic violence on children. Method: this was a study conducted with 194 physicians, nurses and dentists. A literature review was performed for preparation of the items and identification of the dimensions. Apparent and content validation was performed using analysis of three experts and 27 professors of the pediatric health discipline. For construct validation, Cronbach's alpha was used, and the Kappa test was applied to verify reproducibility. The criterion validation was conducted using the Student's t-test. Results: the final instrument included 56 items; the Cronbach alpha was 0.734, the Kappa test showed a correlation greater than 0.6 for most items, and the Student t-test showed a statistically significant value to the level of 5% for the two selected variables: years of education and using the Family Health Strategy. Conclusion: the instrument is valid and can be used as a promising tool to develop or direct actions in public health and evaluate knowledge about domestic violence on children. PMID:27556878

Web-Based Assessment of Visual and Visuospatial Symptoms in Parkinson's Disease

PubMed Central

Amick, Melissa M.; Miller, Ivy N.; Neargarder, Sandy; Cronin-Golomb, Alice

2012-01-01

Visual and visuospatial dysfunction is prevalent in Parkinson's disease (PD). To promote assessment of these often overlooked symptoms, we adapted the PD Vision Questionnaire for Internet administration. The questionnaire evaluates visual and visuospatial symptoms, impairments in activities of daily living (ADLs), and motor symptoms. PD participants of mild to moderate motor severity (n = 24) and healthy control participants (HC, n = 23) completed the questionnaire in paper and web-based formats. Reliability was assessed by comparing responses across formats. Construct validity was evaluated by reference to performance on measures of vision, visuospatial cognition, ADLs, and motor symptoms. The web-based format showed excellent reliability with respect to the paper format for both groups (all P′s < 0.001; HC completing the visual and visuospatial section only). Demonstrating the construct validity of the web-based questionnaire, self-rated ADL and visual and visuospatial functioning were significantly associated with performance on objective measures of these abilities (all P′s < 0.01). The findings indicate that web-based administration may be a reliable and valid method of assessing visual and visuospatial and ADL functioning in PD. PMID:22530162

Driving simulator validation of driver behavior with limited safe vantage points for data collection in work zones.

PubMed

Bham, Ghulam H; Leu, Ming C; Vallati, Manoj; Mathur, Durga R

2014-06-01

This study is aimed at validating a driving simulator (DS) for the study of driver behavior in work zones. A validation study requires field data collection. For studies conducted in highway work zones, the availability of safe vantage points for data collection at critical locations can be a significant challenge. A validation framework is therefore proposed in this paper, demonstrated using a fixed-based DS that addresses the issue by using a global positioning system (GPS). The validation of the DS was conducted using objective and subjective evaluations. The objective validation was divided into qualitative and quantitative evaluations. The DS was validated by comparing the results of simulation with the field data, which were collected using a GPS along the highway and video recordings at specific locations in a work zone. The constructed work zone scenario in the DS was subjectively evaluated with 46 participants. The objective evaluation established the absolute and relative validity of the DS. The mean speeds from the DS data showed excellent agreement with the field data. The subjective evaluation indicated realistic driving experience by the participants. The use of GPS showed that continuous data collected along the highway can overcome the challenges of unavailability of safe vantage points especially at critical locations. Further, a validated DS can be used for examining driver behavior in complex situations by replicating realistic scenarios. Copyright © 2014 Elsevier Ltd. All rights reserved.

Simulated Driving Assessment (SDA) for Teen Drivers: Results from a Validation Study

PubMed Central

McDonald, Catherine C.; Kandadai, Venk; Loeb, Helen; Seacrist, Thomas S.; Lee, Yi-Ching; Winston, Zachary; Winston, Flaura K.

2015-01-01

Background Driver error and inadequate skill are common critical reasons for novice teen driver crashes, yet few validated, standardized assessments of teen driving skills exist. The purpose of this study was to evaluate the construct and criterion validity of a newly developed Simulated Driving Assessment (SDA) for novice teen drivers. Methods The SDA's 35-minute simulated drive incorporates 22 variations of the most common teen driver crash configurations. Driving performance was compared for 21 inexperienced teens (age 16–17 years, provisional license ≤90 days) and 17 experienced adults (age 25–50 years, license ≥5 years, drove ≥100 miles per week, no collisions or moving violations ≤3 years). SDA driving performance (Error Score) was based on driving safety measures derived from simulator and eye-tracking data. Negative driving outcomes included simulated collisions or run-off-the-road incidents. A professional driving evaluator/instructor reviewed videos of SDA performance (DEI Score). Results The SDA demonstrated construct validity: 1.) Teens had a higher Error Score than adults (30 vs. 13, p=0.02); 2.) For each additional error committed, the relative risk of a participant's propensity for a simulated negative driving outcome increased by 8% (95% CI: 1.05–1.10, p<0.01). The SDA demonstrated criterion validity: Error Score was correlated with DEI Score (r=−0.66, p<0.001). Conclusions This study supports the concept of validated simulated driving tests like the SDA to assess novice driver skill in complex and hazardous driving scenarios. The SDA, as a standard protocol to evaluate teen driver performance, has the potential to facilitate screening and assessment of teen driving readiness and could be used to guide targeted skill training. PMID:25740939

Instruments to Identify Prescription Medication Misuse, Abuse, and Related Events in Clinical Trials: An ACTTION Systematic Review.

PubMed

Smith, Shannon M; Paillard, Florence; McKeown, Andrew; Burke, Laurie B; Edwards, Robert R; Katz, Nathaniel P; Papadopoulos, Elektra J; Rappaport, Bob A; Slagle, Ashley; Strain, Eric C; Wasan, Ajay D; Turk, Dennis C; Dworkin, Robert H

2015-05-01

Measurement of inappropriate medication use events (eg, abuse or misuse) in clinical trials is important in characterizing a medication's abuse potential. However, no gold standard assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (ie, content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and nonopioid prescription medications to identify any that meet U.S. and European regulatory agencies' rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the life span rather than current use, including items that did not directly assess inappropriate use (eg, questions about anger), or failing to capture information pertinent to inappropriate use events (eg, intention and route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, nonstandardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. This systematic review evaluates the measurement properties of inappropriate medication use (eg, abuse or misuse) instruments to determine whether any meet regulatory standards for clinical trial outcome measures to assess abuse potential. Copyright © 2015 American Pain Society. All rights reserved.

Development and psychometric properties of a self-regulation scale about leisure time physical activity in Iranian male adolescents

PubMed Central

Abasi, Mohammad Hadi; Eslami, Ahmad Ali; Rakhshani, Fatemeh; Shiri, Mansoor

2016-01-01

Background: Self-regulation is one of the current psychological concepts that have been known as a determinant of leisure time physical activity. Due to cultural and social diversity in different societies and age groups, application of specific questionnaires is essential to perform investigations about physical activities. The aim of this study is development and evaluation of psychometric properties of a self-regulation questionnaire about leisure time physical activity in Iranian male adolescents. Materials and Methods: This cross-sectional study was conducted in 2013, and data of 603 male students from 12 high schools in Isfahan were collected. A comprehensive literature review and similar questionnaire review were conducted and 25 items were selected or developed to measure self-regulation. Comprehensibility of items was evaluated in a pilot study and an expert panel evaluated face and content validity. Exploratory factors analysis (EFA) was used for evaluation of construct validity and extraction of sub-constructs of self-regulation. Leisure time physical activity was assessed using International Physical Activity Questionnaire (IPAQ). Results: The mean age of the participants was 16.3 years (SD =1.0) and the range was 15-19 years. Cronbach's α coefficient of the questionnaire in the pilot and main study was 0.84 and 0.90, respectively. EFA resulted in four sub-constructs including “enlistment of social support”, “goal setting”, “self-construction”, and “self-monitoring”, which explained 63.6% of the variance of self-regulation. Conclusions: Results of this investigation provide some support to the validity and reliability of the 16-item questionnaire of self-regulation abut leisure time physical activity in the target group. PMID:27095993

Development and evaluation of an instrument to measure parental satisfaction with quality of care in neonatal follow-up.

PubMed

Butt, Michelle L; Pinelli, Janet; Boyle, Michael H; Thomas, Helen; Hunsberger, Mabel; Saigal, Saroj; Lee, David S; Fanning, Jamie K; Austin, Patricia

2009-02-01

The goal of this study was to develop and subsequently evaluate the psychometric properties of a new discriminative instrument to measure parental satisfaction with the quality of care provided in neonatal follow-up (NFU) programs. The methodological framework for developing and evaluating measurement scales described by Streiner and Norman (Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York: Oxford University Press; 2003) was used for the study. Informing the phases of the research was a sample of 24 health care professionals and 381 parents who use NFU services. A comprehensive list of items representing the construct, parental satisfaction with quality of care, was generated from published reliable and valid instruments, research studies, focus groups with health care experts, and focus groups with parents. Using a clinimetric approach, the 62 items generated were reduced to 39 items based on parents' ratings of importance and refinement of the items by the research team. After content validation and pretesting, the instrument was tested with parents and underwent item-analysis. The resulting 16-item instrument was composed of 2 subscales, Process and Outcomes. Evaluation of the instrument's psychometric properties indicated adequate test-retest reliability (intraclass correlation coefficient = 0.72) and internal consistency (Process subscale, alpha = 0.77; Outcomes subscale, alpha = 0.90; overall instrument, alpha = 0.90), as well as good content and construct validity. A confirmatory factor analysis supported the multidimensionality of the construct. This new instrument provides clinicians and policy-makers with a tool to assess parental satisfaction with the quality of care in NFU, so areas of dissatisfaction can be identified and changes implemented to optimize service provision.

Modeling complex treatment strategies: construction and validation of a discrete event simulation model for glaucoma.

PubMed

van Gestel, Aukje; Severens, Johan L; Webers, Carroll A B; Beckers, Henny J M; Jansonius, Nomdo M; Schouten, Jan S A G

2010-01-01

Discrete event simulation (DES) modeling has several advantages over simpler modeling techniques in health economics, such as increased flexibility and the ability to model complex systems. Nevertheless, these benefits may come at the cost of reduced transparency, which may compromise the model's face validity and credibility. We aimed to produce a transparent report on the construction and validation of a DES model using a recently developed model of ocular hypertension and glaucoma. Current evidence of associations between prognostic factors and disease progression in ocular hypertension and glaucoma was translated into DES model elements. The model was extended to simulate treatment decisions and effects. Utility and costs were linked to disease status and treatment, and clinical and health economic outcomes were defined. The model was validated at several levels. The soundness of design and the plausibility of input estimates were evaluated in interdisciplinary meetings (face validity). Individual patients were traced throughout the simulation under a multitude of model settings to debug the model, and the model was run with a variety of extreme scenarios to compare the outcomes with prior expectations (internal validity). Finally, several intermediate (clinical) outcomes of the model were compared with those observed in experimental or observational studies (external validity) and the feasibility of evaluating hypothetical treatment strategies was tested. The model performed well in all validity tests. Analyses of hypothetical treatment strategies took about 30 minutes per cohort and lead to plausible health-economic outcomes. There is added value of DES models in complex treatment strategies such as glaucoma. Achieving transparency in model structure and outcomes may require some effort in reporting and validating the model, but it is feasible.

Validation of the Chinese version of the CogState computerised cognitive assessment battery in Taiwanese patients with heart failure.

PubMed

Chou, Cheng-Chen; Pressler, Susan J; Giordani, Bruno; Fetzer, Susan Jane

2015-11-01

To evaluate the validity of the Chinese version of the CogState battery, a computerised cognitive testing among patients with heart failure in Taiwan. Cognitive deficits are common in patients with heart failure and a validated Chinese measurement is required for assessing cognitive change for this population. The CogState computerised battery is a measurement of cognitive function and has been validated in many languages, but not Chinese. A cross-sectional study. A convenience sample consisted of 76 women with heart failure and 64 healthy women in northern Taiwan. Women completed the Chinese version of the CogState battery and the Montreal Cognitive Assessment. Construct validity of the Chinese version of the battery was evaluated by exploratory factor analysis and known-group comparisons. Convergent validity of the CogState tasks was examined by Pearson correlation coefficients. Principal components factor analysis with promax rotation showed two factors reflecting the speed and memory dimensions of the tests. Scores for CogState battery tasks showed significant differences between the heart failure and healthy control group. Examination of convergent validity of the CogState found a significant association with the Montreal Cognitive Assessment. The Chinese CogState Battery has satisfactory construct and convergent validity to measure cognitive deficits in patients with heart failure in Taiwan. The Chinese CogState battery is a valid instrument for detecting cognitive deficits that may be subtle in the early stages, and identifying changes that provide insights into patients' abilities to implement treatment accurately and consistently. Better interventions tailored to the needs of the cognitive impaired population can be developed. © 2015 John Wiley & Sons Ltd.

[Measurement properties of self-report questionnaires published in Korean nursing journals].

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Kim, Eun Jung; Chae, Hyun-Ju; Cho, Soo-Yeon

2013-02-01

The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Noncognitive constructs in graduate admissions: an integrative review of available instruments.

PubMed

Megginson, Lucy

2009-01-01

In the graduate admission process, both cognitive and noncognitive instruments evaluate a candidate's potential success in a program of study. Traditional cognitive measures include the Graduate Record Examination or graduate grade point average, while noncognitive constructs such as personality, attitude, and motivation are generally measured through letters of recommendation, interviews, or personality inventories. Little consensus exists as to what criteria constitute valid and effective measurements of graduate student potential. This integrative review of available tools to measure noncognitive constructs will assist graduate faculty in identifying valid and reliable instruments that will enhance a more holistic assessment of nursing graduate candidates. Finally, as evidence-based practice begins to penetrate academic processes and as graduate faculty realize the predictive significance of noncognitive attributes, faculty can use the information in this integrative review to guide future research.

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents

PubMed Central

Coffey, Dean M.; Javier, Joyce R.; Schrager, Sheree M.

2016-01-01

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12- year old Filipino children (N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (pre-intervention α =.91; post-intervention α =.95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest (r = .54, p < .01) and posttest (r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children. PMID:27087739

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents.

PubMed

Coffey, Dean M; Javier, Joyce R; Schrager, Sheree M

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12- year old Filipino children ( N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (pre-intervention α =.91; post-intervention α =.95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest ( r = .54, p < .01) and posttest ( r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children.

Conceptual dissonance: evaluating the efficacy of natural language processing techniques for validating translational knowledge constructs.

PubMed

Payne, Philip R O; Kwok, Alan; Dhaval, Rakesh; Borlawsky, Tara B

2009-03-01

The conduct of large-scale translational studies presents significant challenges related to the storage, management and analysis of integrative data sets. Ideally, the application of methodologies such as conceptual knowledge discovery in databases (CKDD) provides a means for moving beyond intuitive hypothesis discovery and testing in such data sets, and towards the high-throughput generation and evaluation of knowledge-anchored relationships between complex bio-molecular and phenotypic variables. However, the induction of such high-throughput hypotheses is non-trivial, and requires correspondingly high-throughput validation methodologies. In this manuscript, we describe an evaluation of the efficacy of a natural language processing-based approach to validating such hypotheses. As part of this evaluation, we will examine a phenomenon that we have labeled as "Conceptual Dissonance" in which conceptual knowledge derived from two or more sources of comparable scope and granularity cannot be readily integrated or compared using conventional methods and automated tools.

The Japanese version of the overall assessment of the speaker's experience of stuttering for adults (OASES-A-J): Translation and psychometric evaluation.

PubMed

Sakai, Naomi; Chu, Shin Ying; Mori, Koichi; Yaruss, J Scott

2017-03-01

This study evaluates the psychometric performance of the Japanese version of the Overall Assessment of the Speaker's Experience of Stuttering for Adults (OASES-A), a comprehensive assessment tool of individuals who stutter. The OASES-A-J was administered to 200 adults who stutter in Japan. All respondents also evaluated their own speech (SA scale), satisfaction of their own speech (SS scale) and the Japanese translation version of the Modified Erickson Communication Attitude scale (S-24). The test-retest reliability and internal consistency of the OASES-A-J were assessed. To examine the concurrent validity of the questionnaire, Pearson correlation was conducted between the OASES-A-J Impact score and the S-24 scale, SA scale and SS scale. In addition, Pearson correlation among the impact scores of each section and total were calculated to examine the construct validity. The OASES-A-J showed a good test-retest reliability (r=0.81-0.95) and high internal consistency (α>0.80). Concurrent validity was moderate to high (0.55-0.75). Construct validity was confirmed by the relation between internal consistency in each section and correlation among sections' impact scores. Japanese adults showed higher negative impact for 'General Information', 'Reactions to Stuttering' and 'Quality of Life' sections. These results suggest that the OASES-A-J is a reliable and valid instrument to measure the impact of stuttering on Japanese adults who stutter. The OASES-A-J could be used as a clinical tool in Japanese stuttering field. Copyright © 2016 Elsevier Inc. All rights reserved.

Assessing the validity and reliability of the Malagasy version of Oral Impacts on Daily Performance (OIDP): a cross-sectional study.

PubMed

Razanamihaja, Noeline; Ranivoharilanto, Eva

2017-01-01

Evaluating health needs includes measures of the impact of state of health on the quality of life. This entails evaluating the psychosocial aspects of health. To achieve this, several tools for measuring the quality of life related to oral health have been developed. However, it is vital to evaluate the psychometric properties of these tools so they can be used in a new context and on a new population. The purpose of this study was to evaluate the reliability and validity of the Malagasy version of a questionnaire for studying the impacts of oral-dental health on daily activities (Oral Impacts on Daily Performance), and analyse the interrelations between the scores obtained and the oral health indicators. A cross-sectional study was performed for the transcultural adaptation of the Oral Impacts on Daily Performance questionnaire forward translated and back-translated from English to Malagasy and from Malagasy to English, respectively. The psychometric characteristics of the Malagasy version of the Oral Impacts on Daily Performance were then evaluated in terms of internal reliability, test-retest, and construct, criteria and discriminant validity. Four hundred and six adults responded in face-to-face interviews to the Malagasy version of the Oral Impacts on Daily Performance questionnaire. Nearly 74% of the participants indicated impacts of their oral health on their performance in their daily lives during the 6 months prior to the survey. The activities most affected were: "smiling", "eating" and "sleeping and relaxing". Cronbach's alpha was 0.87. The construct validity was demonstrated by a significant association between the Oral Impacts on Daily Performance scores and the subjective evaluation of oral health ( p <0.001). Discriminant validity was demonstrated by the fact that the Oral Impacts on Daily Performance scores were significantly higher in subjects with more than ten missing teeth, compared to those with fewer than ten missing teeth ( p  < 0.001). The Malagasy version of the Oral Impacts on Daily Performance index is a valid and reliable measure for use in Malagasy adults over 55 years old.

Proposal and validation of a clinical trunk control test in individuals with spinal cord injury.

PubMed

Quinzaños, J; Villa, A R; Flores, A A; Pérez, R

2014-06-01

One of the problems that arise in spinal cord injury (SCI) is alteration in trunk control. Despite the need for standardized scales, these do not exist for evaluating trunk control in SCI. To propose and validate a trunk control test in individuals with SCI. National Institute of Rehabilitation, Mexico. The test was developed and later evaluated for reliability and criteria, content, and construct validity. We carried out 531 tests on 177 patients and found high inter- and intra-rater reliability. In terms of criterion validity, analysis of variance demonstrated a statistically significant difference in the test score of patients with adequate or inadequate trunk control according to the assessment of a group of experts. A receiver operating characteristic curve was plotted for optimizing the instrument's cutoff point, which was determined at 13 points, with a sensitivity of 98% and a specificity of 92.2%. With regard to construct validity, the correlation between the proposed test and the spinal cord independence measure (SCIM) was 0.873 (P=0.001) and that with the evolution time was 0.437 (P=0.001). For testing the hypothesis with qualitative variables, the Kruskal-Wallis test was performed, which resulted in a statistically significant difference between the scores in the proposed scale of each group defined by these variables. It was proven experimentally that the proposed trunk control test is valid and reliable. Furthermore, the test can be used for all patients with SCI despite the type and level of injury.

Validation of a French-Canadian adaptation of the Intuitive Eating Scale-2 for the adult population.

PubMed

Carbonneau, Elise; Carbonneau, Noémie; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Bradette-Laplante, Maude; Laramée, Catherine; Lemieux, Simone

2016-10-01

Intuitive eating is an adaptive eating style based on the reliance on physiological cues to determine when, what, and how much to eat. The Intuitive Eating Scale-2 (IES-2) is a validated four-subscale tool measuring the degree of adherence to intuitive eating principles. The present series of studies aimed at evaluating the psychometric properties of a French-Canadian adaptation of the IES-2 for the adult population. The factor structure, the reliability (internal consistency and test-retest), the construct validity, and the discriminant validity were evaluated in 334 women and 75 men from the Province of Québec, Canada, across two studies. A confirmatory factor analysis upheld that the four-factor structure of the original IES-2 was adequate for the present sample of French-Canadians. The scale demonstrated adequate internal consistency and test-retest reliability. Construct validity evidence was obtained with the significant associations between intuitive eating and psychological and eating-related variables. Intuitive eating was negatively associated with eating disorder symptomatology and with food- and weight-preoccupation, and positively associated with body-esteem and well-being. The French-Canadian IES-2 was also able to discriminate between genders and body mass index categories. The properties of this new version of the IES-2 are demonstrative of a reliable and valid tool to assess intuitive eating in the French-Canadian adult population of the Province of Québec. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cross-cultural adaptation of Kerlan-Jobe Orthopaedic Clinic shoulder and elbow score: Reliability and validity in Turkish-speaking overhead athletes.

PubMed

Turgut, Elif; Tunay, Volga Bayrakci

2018-03-09

Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow Score (KJOC-SES) is a subjective assessment tool to measure functional status of the upper extremities in overhead athletes. The aim was to translate and culturally adapt the KJOC-SES and to evaluate the psychometric properties of the Turkish version (KJOC-SES-Tr) in overhead athletes. The forward and back-translation method was followed. One hundred and twenty-three overhead athletes completed the KJOC-SES-Tr, the Disabilities of the Arm, Shoulder, and Hand (DASH), and the American Shoulder and Elbow Surgeons Evaluation Form (ASES). Participants were assigned to one of the following subgroups: asymptomatic (playing without pain) or symptomatic (playing with pain, or not playing due to pain). Internal consistency, reliability, construct validity, discriminant validity, and content validity of the KJOC-SES-Tr were tested. The test-retest reliability of the KJOC-SES-Tr was excellent with an interclass coefficient of 0.93. There was a strong correlation between the KJOC-SES-Tr and the DASH and the ASES, indicating that the construct validity was good for all participants. Results of the KJOC-SES-Tr significantly differed between different subgroups and categories of athletes. The floor and ceiling effects were acceptable for symptomatic athletes. The KJOC-SES-Tr was shown to be valid, reliable tool to monitor the return to sports following injuries in athletes. Copyright © 2018 Turkish Association of Orthopaedics and Traumatology. Production and hosting by Elsevier B.V. All rights reserved.

The use of concept mapping for scale development and validation in evaluation.

PubMed

Rosas, Scott R; Camphausen, Lauren C

2007-05-01

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a fully integrated part of scale development. As part of a multi-site evaluation of family support programs, we integrated concept mapping with traditional scale-development processes to strengthen the creation of a scale for inclusion in an evaluation instrument. Using concept mapping, we engaged staff and managers in the development of a framework of intended benefits of program participation and used the information to systematically select the scale's content. The psychometric characteristics of the scale were then formally assessed using a sample of program participants. The implications of the approach for supporting construct validity, inclusion of staff and managers, and theory-driven evaluation are discussed.

The cross-cultural adaptation of the DASH questionnaire in Thai (DASH-TH).

PubMed

Tongprasert, Siam; Rapipong, Jeeranan; Buntragulpoontawee, Montana

2014-01-01

Clinical measurement. Currently there are no self-report questionnaires in Thai to evaluate disability levels in patients suffering from upper extremity musculoskeletal disorders. To translate and cross-cultural adaptation the disabilities of the arm, shoulder and hand (DASH) questionnaire to Thai version and to evaluate content validity, construct validity and internal consistency of the questionnaire. The DASH-TH was produced by following cross-cultural adaptation guidelines stated by the Institute for Work and Health (IWH). Forty Thai patients with arm, shoulder or hand problems participated in field testing of the questionnaire. Content validity was determined by obtaining the item-objective congruence (IOC) value for each questionnaire item. Correlation between the DASH-TH score and numeric rating scale was used to assess construct validity. Internal consistency of DASH-TH was measured using Cronbach's alpha coefficient. Forty patients (14 males, 26 females) with arm, shoulder or hand problems enrolled in the present study. The average age of patients was 44.8 years. The index of item-objective congruence (IOC) of each item ranged from 0.7 to 1.0. The Cronbach's alpha coefficient of the questionnaire was 0.938. There was no correlation between DASH-TH score and numeric rating scale. The DASH-TH has high content validity and internal consistency. N/A. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Reliability and validity of young adults’ anonymous online reports of marijuana use and thoughts about use

PubMed Central

Ramo, Danielle E.; Liu, Howard; Prochaska, Judith J.

2012-01-01

With growing interest in online assessment of substance abuse behaviors, there is a need to formally evaluate the validity of the data gathered. The current investigation evaluated the reliability and validity of anonymous, online reports of young adults’ marijuana use and related cognitions. Young adults age 18 to 25 who had smoked at least one cigarette in the past 30 days were recruited over 14 months to complete an anonymous online survey. Of 3106 eligible cases, 1617 (52%) completed the entire survey. Of those, 54% (n = 884) reported past-month marijuana use (65% male, 70% Caucasian, mean age was 20.4 years [SD = 2.0]). Prevalence of marijuana use was reported reliably across three similar items, and inter-item correlations ranged from fair to excellent for measures of marijuana dependence symptoms and thoughts about marijuana use. Marijuana use frequency demonstrated good construct validity through expected correlations with marijuana use constructs, and non-significant correlations with thoughts about tobacco use. Marijuana frequency distinguished among stages of change for marijuana use and goals for use, but not among gender, ethnicity, or employment groups. Marijuana use and thoughts about use differed by stage of change in the hypothesized directions. Self-reported marijuana use and associated cognitions reported anonymously online from young adults are generally reliable and valid. Online assessments of substance use broaden the reach of addictions research. PMID:22082344

Severity of illness index for surgical departments in a Cuban hospital: a revalidation study.

PubMed

Armas-Bencomo, Amadys; Tamargo-Barbeito, Teddy Osmin; Fuentes-Valdés, Edelberto; Jiménez-Paneque, Rosa Eugenia

2017-03-08

In the context of the evaluation of hospital services, the incorporation of severity indices allows an essential control variable for performance comparisons in time and space through risk adjustment. The severity index for surgical services was developed in 1999 and validated as a general index for surgical services. Sixteen years later the hospital context is different in many ways and a revalidation was considered necessary to guarantee its current usefulness. To evaluate the validity and reliability of the surgical services severity index to warrant its reasonable use under current conditions. A descriptive study was carried out in the General Surgery service of the "Hermanos Ameijeiras" Clinical Surgical Hospital of Havana, Cuba during the second half of 2010. We reviewed the medical records of 511 patients discharged from this service. Items were the same as the original index as were their weighted values. Conceptual or construct validity, criterion validity and inter-rater reliability as well as internal consistency of the proposed index were evaluated. Construct validity was expressed as a significant association between the value of the severity index for surgical services and discharge status. A significant association was also found, although weak, with length of hospital stay. Criterion validity was demonstrated through the correlations between the severity index for surgical services and other similar indices. Regarding criterion validity, the Horn index showed a correlation of 0.722 (95% CI: 0.677-0.761) with our index. With the POSSUM score, correlation was 0.454 (95% CI: 0.388-0.514) with mortality risk and 0.539 (95% CI: 0.462-0.607) with morbidity risk. Internal consistency yielded a standardized Cronbach's alpha of 0.8; inter-rater reliability resulted in a reliability coefficient of 0.98 for the quantitative index and a weighted global Kappa coefficient of 0.87 for the ordinal surgical index of severity for surgical services (IGQ). The validity and reliability of the proposed index was satisfactory in all aspects evaluated. The surgical services severity index may be used in the original context and is easily adaptable to other contexts as well.

Cross-Cultural Adaptation of the Profile Fitness Mapping Neck Questionnaire to Brazilian Portuguese: Internal Consistency, Reliability, and Construct and Structural Validity.

PubMed

Ferreira, Mariana Cândido; Björklund, Martin; Dach, Fabiola; Chaves, Thais Cristina

The purpose of this study was to adapt and evaluate the psychometric properties of the ProFitMap-neck to Brazilian Portuguese. The cross-cultural adaptation consisted of 5 stages, and 180 female patients with chronic neck pain participated in the study. A subsample (n = 30) answered the pretest, and another subsample (n = 100) answered the questionnaire a second time. Internal consistency, test-retest reliability, and construct validity (hypothesis testing and structural validity) were estimated. For construct validity, the scores of the questionnaire were correlated with the Neck Disability Index (NDI), and the Hospital Anxiety and Depression Scale (HADS), the Tampa Scale of Kinesiophobia (TSK), and the 36-item Short-Form Health Survey (SF-36). Internal consistency was determined by adequate Cronbach's α values (α > 0.70). Strong reliability was identified by high intraclass correlation coefficients (ICC > 0.75). Construct validity was identified by moderate and strong correlations of the Br-ProFitMap-neck with total NDI score (-0.56 50%, Kaiser-Meyer-Olkin index > 0.50, eigenvalue > 1, and factor loadings > 0.2. Br-ProFitMap-neck had adequate psychometric properties and can be used in clinical settings, as well as research, in patients with chronic neck pain. Copyright © 2017. Published by Elsevier Inc.

External validation of Global Evaluative Assessment of Robotic Skills (GEARS).

PubMed

Aghazadeh, Monty A; Jayaratna, Isuru S; Hung, Andrew J; Pan, Michael M; Desai, Mihir M; Gill, Inderbir S; Goh, Alvin C

2015-11-01

We demonstrate the construct validity, reliability, and utility of Global Evaluative Assessment of Robotic Skills (GEARS), a clinical assessment tool designed to measure robotic technical skills, in an independent cohort using an in vivo animal training model. Using a cross-sectional observational study design, 47 voluntary participants were categorized as experts (>30 robotic cases completed as primary surgeon) or trainees. The trainee group was further divided into intermediates (≥5 but ≤30 cases) or novices (<5 cases). All participants completed a standardized in vivo robotic task in a porcine model. Task performance was evaluated by two expert robotic surgeons and self-assessed by the participants using the GEARS assessment tool. Kruskal-Wallis test was used to compare the GEARS performance scores to determine construct validity; Spearman's rank correlation measured interobserver reliability; and Cronbach's alpha was used to assess internal consistency. Performance evaluations were completed on nine experts and 38 trainees (14 intermediate, 24 novice). Experts demonstrated superior performance compared to intermediates and novices overall and in all individual domains (p < 0.0001). In comparing intermediates and novices, the overall performance difference trended toward significance (p = 0.0505), while the individual domains of efficiency and autonomy were significantly different between groups (p = 0.0280 and 0.0425, respectively). Interobserver reliability between expert ratings was confirmed with a strong correlation observed (r = 0.857, 95 % CI [0.691, 0.941]). Experts and participant scoring showed less agreement (r = 0.435, 95 % CI [0.121, 0.689] and r = 0.422, 95 % CI [0.081, 0.0672]). Internal consistency was excellent for experts and participants (α = 0.96, 0.98, 0.93). In an independent cohort, GEARS was able to differentiate between different robotic skill levels, demonstrating excellent construct validity. As a standardized assessment tool, GEARS maintained consistency and reliability for an in vivo robotic surgical task and may be applied for skills evaluation in a broad range of robotic procedures.

Portuguese version of the EUROPEP questionnaire: contributions to the psychometric validation

PubMed Central

Roque, Hugo; Veloso, Ana; Ferreira, Pedro L

2016-01-01

ABSTRACT OBJECTIVE To assess the construct validity and reliability of the Portuguese version of the European Task Force on Patient Evaluation of General Practice Care questionnaire. METHODS We applied the Portuguese version of the European Task Force on Patient Evaluation of General Practice Care to 392 users of 20 Family Health Units from the North of Portugal. The validity of the construct was evaluated by exploratory factor analysis, with the Principal Axis Factoring method, by orthogonal rotation (varimax procedure), by the Kaiser normalization criteria (eigenvalue ≥ 1). The factorability of the data matrix was verified by the Kaiser-Meyer-Olkin and Bartlett’s sphericity test. We estimated the reliability by the indicator of internal consistency Cronbach’s alpha. To analyze the correlations between satisfaction and loyalty, we used the Pearson correlations. The predictor effect of satisfaction on loyalty was analyzed by simple linear regression. RESULTS Satisfaction presented five robust and well individualized dimensions – medical care, nursing care, clinical secretariat services, accessibility, and organization of services – with alpha values between 0.86 and 0.97, good levels of internal consistency. The loyalty showed alpha value of 0.72, considered a reasonable internal consistency. The satisfaction was predictive of loyalty. CONCLUSIONS The Portuguese European Task Force on Patient Evaluation of General Practice Care questionnaire is a robust and reliable instrument to measure the satisfaction and loyalty of users of the Family Health Units. PMID:27706374

Development and psychometric testing of the nursing student mentors' competence instrument (MCI): A cross-sectional study.

PubMed

Tuomikoski, Anna-Maria; Ruotsalainen, Heidi; Mikkonen, Kristina; Miettunen, Jouko; Kääriäinen, Maria

2018-06-05

Mentors require competence at a diverse array of skills to mentor students during clinical practice. According to the latest evidence, competence at mentoring includes: knowledge, skills and attributes of individual students' learning objectives, core elements of nursing, learning processes, a reciprocal and trustful relationship, feedback, evaluation, cooperation with stakeholders, and the mentor's personal qualities. The purpose of the study was to test psychometric properties of a mentor's competence instrument developed to self-evaluate mentors' competence at mentoring nursing students in clinical practice. A cross-sectional, descriptive, explorative study design was used. Data were collected from mentors at five university hospitals in Finland in 2016. A total of 576 mentors participated in this study. The instrument was developed through systematic review, experts' evaluations, and pilot versions of the instrument tested in previous studies. The construct validity and reliability of the instrument were tested using exploratory factor analysis (EFA) with promax rotation and Cronbach's alpha. A 10-factor model showed that the instrument has acceptable construct validity. Cronbach's alpha values for the subscales observed ranged from 0.76 to 0.90. The instrument exhibited acceptable psychometric properties, thereby proving itself a valuable tool for evaluating mentors' competence at mentoring students. Further assessments of its reliability, validity and generality for measuring mentor's competence for mentoring students in different contexts and cultures are recommended. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluating the Inter-Respondent (Consumer vs. Staff) Reliability and Construct Validity (SIS vs. Vineland) of the Supports Intensity Scale on a Dutch Sample

ERIC Educational Resources Information Center

Claes, C.; Van Hove, G.; van Loon, J.; Vandevelde, S.; Schalock, R. L.

2009-01-01

Background: Despite various reliability studies on the Supports Intensity Scale (SIS), to date there has not been an evaluation of the reliability of client vs. staff judgments. Such determination is important, given the increasing consumer-driven approach to services. Additionally, there has not been an evaluation of the instrument's construct…

Critical thinking evaluation in reflective writing: Development and testing of Carter Assessment of Critical Thinking in Midwifery (Reflection).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-11-01

develop and test a tool designed for use by academics to evaluate pre-registration midwifery students' critical thinking skills in reflective writing. a descriptive cohort design was used. a random sample (n = 100) of archived student reflective writings based on a clinical event or experience during 2014 and 2015. a staged model for tool development was used to develop a fifteen item scale involving item generation; mapping of draft items to critical thinking concepts and expert review to test content validity; inter-rater reliability testing; pilot testing of the tool on 100 reflective writings; and psychometric testing. Item scores were analysed for mean, range and standard deviation. Internal reliability, content and construct validity were assessed. expert review of the tool revealed a high content validity index score of 0.98. Using two independent raters to establish inter-rater reliability, good absolute agreement of 72% was achieved with a Kappa coefficient K = 0.43 (p<0.0001). Construct validity via exploratory factor analysis revealed three factors: analyses context, reasoned inquiry, and self-evaluation. The mean total score for the tool was 50.48 (SD = 12.86). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of .93. this study establishedthe reliability and validity of the CACTiM (reflection) for use by academics to evaluate midwifery students' critical thinking in reflective writing. Validation with large diverse samples is warranted. reflective practice is a key learning and teaching strategy in undergraduate Bachelor of Midwifery programmes and essential for safe, competent practice. There is the potential to enhance critical thinking development by assessingreflective writing with the CACTiM (reflection) tool to provide formative and summative feedback to students and inform teaching strategies. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Validation of the Bulgarian version of Scales for Outcomes in Parkinson's Disease - Autonomic (SCOPA-AUT-BG).

PubMed

Mantarova, Stefka G; Velcheva, Irena V; Georgieva, Spaska O; Stambolieva, Katerina I

2013-01-01

The last twenty years have witnessed a surge of interest in the autonomic symptoms in Parkinson's disease (PD) and the possibilities to diagnose and treat them. The specialized questionnaire assessing the autonomic symptoms in Parkinson's disease (SCOPA-AUT) has been validated and available in English, Dutch and Spanish. In this study we aim at evaluating the validity, reliability and applicability of the Bulgarian version of SCOPA-AUT (SCOPA-AUT-BG). The study included 55 patients with idiopathic PD (mean age 64.4 +/- 8.9 yrs), and 40 healthy controls (mean age 58.5 +/- 9.4 yrs). Clinical severity and disease stage were assessed by United Parkinson's disease rating scale (UPRDS) and Hoen and Yahr (H&Y). Thirty-two of the PD patients completed SCOPA-AUT-BG again after a 7-day interval. Questionnaire reliability was analyzed by determining the internal consistency, homogeneity, discriminatory and construct validity and test-retest reliability. Analyses showed good internal consistency of the summary evaluation of SCOPA-AUT-BG (coefficient alpha of Cronbach = 0.79), which indicates the high reliability of the questionnaire. The lowest Cronbach's alpha coefficient (0.53) was found for the subscale "cardiovascular functions". A dominant role belongs to the subscales for gastrointestinal and urinary functions (Cronbach's Alpha > 0.7), where a significantly high correlation of PD with the UPDRS scale was observed. We found high test-retest reliability based on the responses associated with dysfunction of the gastrointestinal, urinary, thermoregulatory and pupillary autonomic systems. The correlation of the results of SCOPA-AUT-BG with UPDRS is higher than that with H&Y, and the construct validity is high except for the cardiovascular and pupillomotor functions subscales. The results of this study show that SCOPA-AUT-BG is a valid and reliable specialized questionnaire to evaluate autonomic function in patients with Parkinson's disease. Using it allows for more detailed clinical evaluation of these patients and justifies the need to refer them to specialized examination of autonomic functions.

Development and validation of a composite scoring system for robot-assisted surgical training--the Robotic Skills Assessment Score.

PubMed

Chowriappa, Ashirwad J; Shi, Yi; Raza, Syed Johar; Ahmed, Kamran; Stegemann, Andrew; Wilding, Gregory; Kaouk, Jihad; Peabody, James O; Menon, Mani; Hassett, James M; Kesavadas, Thenkurussi; Guru, Khurshid A

2013-12-01

A standardized scoring system does not exist in virtual reality-based assessment metrics to describe safe and crucial surgical skills in robot-assisted surgery. This study aims to develop an assessment score along with its construct validation. All subjects performed key tasks on previously validated Fundamental Skills of Robotic Surgery curriculum, which were recorded, and metrics were stored. After an expert consensus for the purpose of content validation (Delphi), critical safety determining procedural steps were identified from the Fundamental Skills of Robotic Surgery curriculum and a hierarchical task decomposition of multiple parameters using a variety of metrics was used to develop Robotic Skills Assessment Score (RSA-Score). Robotic Skills Assessment mainly focuses on safety in operative field, critical error, economy, bimanual dexterity, and time. Following, the RSA-Score was further evaluated for construct validation and feasibility. Spearman correlation tests performed between tasks using the RSA-Scores indicate no cross correlation. Wilcoxon rank sum tests were performed between the two groups. The proposed RSA-Score was evaluated on non-robotic surgeons (n = 15) and on expert-robotic surgeons (n = 12). The expert group demonstrated significantly better performance on all four tasks in comparison to the novice group. Validation of the RSA-Score in this study was carried out on the Robotic Surgical Simulator. The RSA-Score is a valid scoring system that could be incorporated in any virtual reality-based surgical simulator to achieve standardized assessment of fundamental surgical tents during robot-assisted surgery. Copyright © 2013 Elsevier Inc. All rights reserved.

[Reliability and validity studies of Turkish translation of Eysenck Personality Questionnaire Revised-Abbreviated].

PubMed

Karanci, A Nuray; Dirik, Gülay; Yorulmaz, Orçun

2007-01-01

The aim of the present study was to examine the reliability and the validity of the Turkish translation of the Eysneck Personality Questionnaire Revised-abbreviated Form (EPQR-A) (Francis et al., 1992), which consists of 24 items that assess neuroticism, extraversion, psychoticism, and lying. The questionnaire was first translated into Turkish and then back translated. Subsequently, it was administered to 756 students from 4 different universities. The Fear Survey Inventory-III (FSI-III), Rosenberg Self-Esteem Scales (RSES), and Egna Minnen Betraffande Uppfostran (EMBU-C) were also administered in order to assess the questionnaire's validity. The internal consistency, test-retest reliability, and validity were subsequently evaluated. Factor analysis, similar to the original scale, yielded 4 factors; the neuroticism, extraversion, psychoticism, and lie scales. Kuder-Richardson alpha coefficients for the extraversion, neuroticism, psychoticism, and lie scales were 0.78, 0.65, 0.42, and 0.64, respectively, and the test-retest reliability of the scales was 0.84, 0.82, 0.69, and 0.69, respectively. The relationships between EPQR-A-48, FSI-III, EMBU-C, and RSES were examined in order to evaluate the construct validity of the scale. Our findings support the construct validity of the questionnaire. To investigate gender differences in scores on the subscales, MANOVA was conducted. The results indicated that there was a gender difference only in the lie scale scores. Our findings largely supported the reliability and validity of the questionnaire in a Turkish student sample. The psychometric characteristics of the Turkish version of the EPQR-A were discussed in light of the relevant literature.

The Work Instability Scale for Rheumatoid Arthritis (RA-WIS): Does it work in osteoarthritis?

PubMed

Tang, Kenneth; Beaton, Dorcas E; Lacaille, Diane; Gignac, Monique A M; Zhang, Wei; Anis, Aslam H; Bombardier, Claire

2010-09-01

To validate the 23-item Work Instability Scale for Rheumatoid Arthritis (RA-WIS) for use in osteoarthritis (OA) using both classical test theory and item response theory approaches. Baseline and 12-month follow-up data were collected from workers with OA recruited from community and clinical settings (n = 130). Fit of RA-WIS data to the Rasch model was evaluated by item- and person-fit statistics (size of residual, chi-sq), assessments of differential item functioning, and tests of unidimensionality and local independence. Internal consistency was assessed by KR-20. Convergent construct validity (Spearman r, known-groups) was evaluated against theoretical constructs that assess impact of health on work. Responsiveness to global indicators of change was assessed by standardized response means (SRM) and area under the receiver operating characteristic curves. Data structure of the RA-WIS showed adequate fit to the Rasch model (chi-sq = 83.2, P = 0.03) after addressing local dependency in three item pairs by creating testlets. High internal consistency (KR-20 = 0.93) and convergent validity with work-oriented constructs (|r| = 0.55-0.77) were evident. The RA-WIS correlated most strongly with the concept of illness intrusiveness (r = 0.77) and was highly responsive to changes (SRM = 1.05 [deterioration]; -0.78 [improvement]). Although developed for RA, the RA-WIS is psychometrically sound for OA and demonstrates interval-level property.

Training safer orthopedic surgeons. Construct validation of a virtual-reality simulator for hip fracture surgery.

PubMed

Akhtar, Kashif; Sugand, Kapil; Sperrin, Matthew; Cobb, Justin; Standfield, Nigel; Gupte, Chinmay

2015-01-01

Virtual-reality (VR) simulation in orthopedic training is still in its infancy, and much of the work has been focused on arthroscopy. We evaluated the construct validity of a new VR trauma simulator for performing dynamic hip screw (DHS) fixation of a trochanteric femoral fracture. 30 volunteers were divided into 3 groups according to the number of postgraduate (PG) years and the amount of clinical experience: novice (1-4 PG years; less than 10 DHS procedures); intermediate (5-12 PG years; 10-100 procedures); expert (> 12 PG years; > 100 procedures). Each participant performed a DHS procedure and objective performance metrics were recorded. These data were analyzed with each performance metric taken as the dependent variable in 3 regression models. There were statistically significant differences in performance between groups for (1) number of attempts at guide-wire insertion, (2) total fluoroscopy time, (3) tip-apex distance, (4) probability of screw cutout, and (5) overall simulator score. The intermediate group performed the procedure most quickly, with the lowest fluoroscopy time, the lowest tip-apex distance, the lowest probability of cutout, and the highest simulator score, which correlated with their frequency of exposure to running the trauma lists for hip fracture surgery. This study demonstrates the construct validity of a haptic VR trauma simulator with surgeons undertaking the procedure most frequently performing best on the simulator. VR simulation may be a means of addressing restrictions on working hours and allows trainees to practice technical tasks without putting patients at risk. The VR DHS simulator evaluated in this study may provide valid assessment of technical skill.

Validation of the oesophageal hypervigilance and anxiety scale for chronic oesophageal disease.

PubMed

Taft, T H; Triggs, J R; Carlson, D A; Guadagnoli, L; Tomasino, K N; Keefer, L; Pandolfino, J E

2018-05-01

Oesophageal hypervigilance and anxiety can drive symptom experience in chronic oesophageal conditions, including gastro-oesophageal reflux disease, achalasia and functional oesophageal disorders. To date, no validated self-report measure exists to evaluate oesophageal hypervigilance and anxiety. This study aims to develop a brief and reliable questionnaire assessing these constructs, the oesophageal hypervigilance and anxiety scale (EHAS). Questions for the EHAS were drawn from 4 existing validated measures that assessed hypervigilance and anxiety adapted for the oesophagus. Patients who previously underwent high-resolution manometry testing at a university-based oesophageal motility clinic were retrospectively identified. Patients were included in the analysis if they completed the EHAS as well as questionnaires assessing symptom severity and health-related quality of life at the time of the high-resolution manometry. Nine hundred and eighty-two patients aged 18-85 completed the study. The EHAS demonstrates excellent internal consistency (α = 0.93) and split-half reliability (Guttman = 0.87). Inter-item correlations indicated multicollinearity was not achieved; thus, no items were removed from the original 15-item scale. Principal components factor analysis revealed two subscales measuring symptom-specific anxiety and symptom-specific hypervigilance. Construct validity for total and subscale scores was supported by positive correlations with symptom severity and negative correlations with health-related quality of life. The EHAS is a 15-item scale assessing oesophageal hypervigilance and symptom-specfic anxiety. The EHAS could be useful in evaluating the role of these constructs in several oesophageal conditions in which hypersensitivity, hypervigilance and anxiety may contribute to symptoms and impact treatment outcomes. © 2018 John Wiley & Sons Ltd.

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health

PubMed Central

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Background Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. Study Design We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Results Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Conclusion Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness. PMID:26938990

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health.

PubMed

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness.

Developing an instrument to measure effective factors on Clinical Learning.

PubMed

Dadgaran, Ideh; Shirazi, Mandana; Mohammadi, Aeen; Ravari, Ali

2016-07-01

Although nursing students spend a large part of their learning period in the clinical environment, clinical learning has not been perceived by its nature yet. To develop an instrument to measure effective factors on clinical learning in nursing students. This is a mixed methods study performed in 2 steps. First, the researchers defined "clinical learning" in nursing students through qualitative content analysis and designed items of the questionnaire based on semi-structured individual interviews with nursing students. Then, as the second step, psychometric properties of the questionnaire were evaluated using the face validity, content validity, construct validity, and internal consistency evaluated on 227 students from fourth or higher semesters. All the interviews were recorded and transcribed, and then, they were analyzed using Max Qualitative Data Analysis and all of qualitative data were analyzed using SPSS 14. To do the study, we constructed the preliminary questionnaire containing 102 expressions. After determination of face and content validities by qualitative and quantitative approaches, the expressions of the questionnaire were reduced to 45. To determine the construct validity, exploratory factor analysis was applied. The results indicated that the maximum variance percentage (40.55%) was defined by the first 3 factors while the rest of the total variance percentage (59.45%) was determined by the other 42 factors. Results of exploratory factor analysis of this questionnaire indicated the presence of 3 instructor-staff, students, and educational related factors. Finally, 41 expressions were kept in 3 factor groups. The α-Cronbach coefficient (0.93) confirmed the high internal consistency of the questionnaire. Results indicated that the prepared questionnaire was an efficient instrument in the study of the effective factors on clinical learning as viewed by nursing students since it involves 41 expressions and properties such as instrument design based on perception and experiences of the nursing students about effective factors on clinical learning, definition of facilitator and preventive factors of the clinical learning, simple scoring, suitable validity and reliability, and applicability in different occasions.

Laparoscopic Common Bile Duct Exploration Four-Task Training Model: Construct Validity

PubMed Central

Otaño, Natalia; Rodríguez, Omaira; Sánchez, Renata; Benítez, Gustavo; Schweitzer, Michael

2012-01-01

Background: Training models in laparoscopic surgery allow the surgical team to practice procedures in a safe environment. We have proposed the use of a 4-task, low-cost inert model to practice critical steps of laparoscopic common bile duct exploration. Methods: The performance of 3 groups with different levels of expertise in laparoscopic surgery, novices (A), intermediates (B), and experts (C), was evaluated using a low-cost inert model in the following tasks: (1) intraoperative cholangiography catheter insertion, (2) transcystic exploration, (3) T-tube placement, and (4) choledochoscope management. Kruskal-Wallis and Mann-Whitney tests were used to identify differences among the groups. Results: A total of 14 individuals were evaluated: 5 novices (A), 5 intermediates (B), and 4 experts (C). The results involving intraoperative cholangiography catheter insertion were similar among the 3 groups. As for the other tasks, the expert had better results than the other 2, in which no significant differences occurred. The proposed model is able to discriminate among individuals with different levels of expertise, indicating that the abilities that the model evaluates are relevant in the surgeon's performance in CBD exploration. Conclusions: Construct validity for tasks 2 and 3 was demonstrated. However, task 1 was no capable of distinguishing between groups, and task 4 was not statistically validated. PMID:22906323

The Construction of Mathematical Literacy Problems for Geometry

NASA Astrophysics Data System (ADS)

Malasari, P. N.; Herman, T.; Jupri, A.

2017-09-01

The students of junior high school should have mathematical literacy ability to formulate, apply, and interpret mathematics in problem solving of daily life. Teaching these students are not enough by giving them ordinary mathematics problems. Teaching activities for these students brings consequence for teacher to construct mathematical literacy problems. Therefore, the aim of this study is to construct mathematical literacy problems to assess mathematical literacy ability. The steps of this study that consists of analysing, designing, theoretical validation, revising, limited testing to students, and evaluating. The data was collected with written test to 38 students of grade IX at one of state junior high school. Mathematical literacy problems consist of three essays with three indicators and three levels at polyhedron subject. The Indicators are formulating and employing mathematics. The results show that: (1) mathematical literacy problems which are constructed have been valid and practical, (2) mathematical literacy problems have good distinguishing characteristics and adequate distinguishing characteristics, (3) difficulty levels of problems are easy and moderate. The final conclusion is mathematical literacy problems which are constructed can be used to assess mathematical literacy ability.

Psychometric assessment of the IBS-D Daily Symptom Diary and Symptom Event Log.

PubMed

Rosa, Kathleen; Delgado-Herrera, Leticia; Zeiher, Bernie; Banderas, Benjamin; Arbuckle, Rob; Spears, Glen; Hudgens, Stacie

2016-12-01

Diarrhea-predominant irritable bowel syndrome (IBS-D) can considerably impact patients' lives. Patient-reported symptoms are crucial in understanding the diagnosis and progression of IBS-D. This study psychometrically evaluates the newly developed IBS-D Daily Symptom Diary and Symptom Event Log (hereafter, "Event Log") according to US regulatory recommendations. A US-based observational field study was conducted to understand cross-sectional psychometric properties of the IBS-D Daily Symptom Diary and Event Log. Analyses included item descriptive statistics, item-to-item correlations, reliability, and construct validity. The IBS-D Daily Symptom Diary and Event Log had no items with excessive missing data. With the exception of two items ("frequency of gas" and "accidents"), moderate to high inter-item correlations were observed among all items of the IBS-D Daily Symptom Diary and Event Log (day 1 range 0.67-0.90). Item scores demonstrated reliability, with the exception of the "frequency of gas" and "accidents" items of the Diary and "incomplete evacuation" item of the Event Log. The pattern of correlations of the IBS-D Daily Symptom Diary and Event Log item scores with generic and disease-specific measures was as expected, moderate for similar constructs and low for dissimilar constructs, supporting construct validity. Known-groups methods showed statistically significant differences and monotonic trends in each of the IBS-D Daily Symptom Diary item scores among groups defined by patients' IBS-D severity ratings ("none"/"mild," "moderate," or "severe"/"very severe"), supporting construct validity. Initial psychometric results support the reliability and validity of the items of the IBS-D Daily Symptom Diary and Event Log.

Eco-tourism Education Effectiveness Indicator System Research for Macau SAR in Practice

NASA Astrophysics Data System (ADS)

Ge, Mei

2018-01-01

The study of education in Ecotourism is one of the many important focuses among the field of Ecotourism; and the evaluation of Ecotourism education effectiveness in Ecotourism is a key topic in it. The result of this study can be very useful in the development of Ecotourism education. In addition, affect greatly in its improvement in the future. The Delphi method had been used in this study to establish a valid indicator system of evaluation in Ecotourism education; then followed by the analytic hierarchy process (AHP) with 11 paired-comparison matrices being constructed. Weights of these evaluation indicators were then determined by using Matlab 7.1. Throughout, data was obtained by doing sampling surveys, and the fuzzy comprehensive evaluation method was used to calculate the validity of Ecotourism education, where validity was classified into different levels. As the result, the evaluation model of the education effectiveness in Ecotourism was constructed. The Macau Special Administrative Region (Macau SAR) was chosen in this case for the empirical stage. Data of ecological knowledge, ecological cultural level, ecological consciousness, ecological ethics and ecological behaviors of tourists, who had entered and exited Macau SAR, was collected and analyzed in SPSS. Differences and impact of these indicators were studied to conclude the effect of its education in Ecotourism of this region. In addition, the results of education effectiveness in Ecotourism were also compared among different population subgroups and observations were given accordingly.

[Evaluation and application of the Korean version of the sexuality attitudes and beliefs survey for nurses].

PubMed

Kim, Hae Won; Jung, Yeon Yi; Park, Seungmi

2012-12-01

This study was conducted to evaluate the validity and reliability of the Korean version of the Sexuality Attitudes and Beliefs Survey (SABS) and to assess SABS for Korean nurses. The Korean version of SABS was developed through forward-backward translation techniques. Internal consistency reliability and construct validity using confirmatory factor analysis were conducted using PASW+ PC Win (18.0) and AMOS (18.0). Data were collected from 567 nurses who worked in one of six general hospitals across the country. The Korean version of SABS showed a reliable internal consistency with Cronbach's α of subscales ranging from .59 to .73. Factor loadings of the 10 items of three subscales ranged from .38 to .83. The three subscales model were validated by confirmatory factor analysis (GFI>.97, RMSEA<.05). Sexuality attitudes and beliefs for Korean nurses were more negative than that of European or American nurses. The SABS scores for Korean nurses were significantly different according to age, marriage, education, clinical experiences, and feeling about sexuality. The Korean version of SABS has satisfactory construct validity and reliability to measure Korean nurses' attitudes and belief toward sexuality. Education is essential to enhance importance and self-efficacy and to relieve barriers to addressing patients' sexuality.

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

PubMed

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

Pre-donation cognitions of potential living organ donors: the development of the Donation Cognition Instrument in potential kidney donors.

PubMed

Wirken, Lieke; van Middendorp, Henriët; Hooghof, Christina W; Sanders, Jan-Stephan F; Dam, Ruth E; van der Pant, Karlijn A M I; Berendsen, Elsbeth C M; Wellink, Hiske; Dackus, Henricus J A; Hoitsma, Andries J; Hilbrands, Luuk B; Evers, Andrea W M

2017-03-01

Cognitions surrounding living organ donation, including the motivation to donate, expectations of donation and worries about donation, are relevant themes during living donor evaluation. However, there is no reliable psychometric instrument assessing all these different cognitions. This study developed and validated a questionnaire to assess pre-donation motivations, expectations and worries regarding donation, entitled the Donation Cognition Instrument (DCI). Psychometric properties of the DCI were examined using exploratory factor analysis for scale structure and associations with validated questionnaires for construct validity assessment. From seven Dutch transplantation centres, 719 potential living kidney donors were included. The DCI distinguishes cognitions about donor benefits, recipient benefits, idealistic incentives, gratitude and worries about donation (Cronbach's alpha 0.76-0.81). Scores on pre-donation cognitions differed with regard to gender, age, marital status, religion and donation type. With regard to construct validity, the DCI was moderately correlated with expectations regarding donor's personal well-being and slightly to moderately to health-related quality of life. The DCI is found to be a reliable instrument assessing cognitions surrounding living organ donation, which might add to pre-donation quality of life measures in facilitating psychosocial donor evaluation by healthcare professionals. © The Author 2017. Published by Oxford University Press on behalf of ERA-EDTA. All rights reserved.

The Chinese version of hospital anxiety and depression scale: Psychometric properties in Chinese cancer patients and their family caregivers.

PubMed

Li, Qiuping; Lin, Yi; Hu, Caiping; Xu, Yinghua; Zhou, Huiya; Yang, Liping; Xu, Yongyong

2016-12-01

The Hospital Anxiety and Depression Scale (HADS) acts as one of the most frequently used self-reported measures in cancer practice. The evidence for construct validity of HADS, however, remains inconclusive. The objective of this study is to evaluate the psychometric properties of the Chinese version HADS (C-HADS) in terms of construct validity, internal consistency reliability, and concurrent validity in dyads of Chinese cancer patients and their family caregivers. This was a cross-sectional study, conducted in multiple centers: one hospital in each of the seven different administrative regions in China from October 2014 to May 2015. A total of 641 dyads, consisting of cancer patients and family caregivers, completed a survey assessing their demographic and background information, anxiety and depression using C-HADS, and quality of life (QOL) using Chinese version SF-12. Data analysis methods included descriptive statistics, confirmatory factor analysis (CFA), and Pearson correlations. Both the two-factor and one-factor models offered the best and adequate fit to the data in cancer patients and family caregivers respectively. The comparison of the two-factor and single-factor models supports the basic assumption of two-factor construct of C-HADS. The overall and two subscales of C-HADS in both cancer patients and family caregivers had good internal consistency and acceptable concurrent validity. The Chinese version of the HADS may be a reliable and valid screening tool, as indicated by its original two-factor structure. The finding supports the basic assumption of two-factor construct of HADS. Copyright © 2016 Elsevier Ltd. All rights reserved.

Towards Virtual FLS: Development of a Peg Transfer Simulator

PubMed Central

Arikatla, Venkata S; Ahn, Woojin; Sankaranarayanan, Ganesh; De, Suvranu

2014-01-01

Background Peg transfer is one of five tasks in the Fundamentals of Laparoscopic Surgery (FLS), program. We report the development and validation of a Virtual Basic Laparoscopic Skill Trainer-Peg Transfer (VBLaST-PT©) simulator for automatic real-time scoring and objective quantification of performance. Methods We have introduced new techniques in order to allow bi-manual manipulation of pegs and automatic scoring/evaluation while maintaining high quality of simulation. We performed a preliminary face and construct validation study with 22 subjects divided into two groups: experts (PGY 4–5, fellow and practicing surgeons) and novice (PGY 1–3). Results Face validation shows high scores for all the aspects of the simulation. A two-tailed Mann-Whitney U-test scores showed significant difference between the two groups on completion time (p=0.003), FLS score (p=0.002) and the VBLaST-PT© score (p=0.006). Conclusions VBLaST-PT© is a high quality virtual simulator that showed both face and construct validity. PMID:24030904

Development and psychometric testing of the Knowledge, Attitudes and Practices (KAP) questionnaire among student Tuberculosis (TB) Patients (STBP-KAPQ) in China.

PubMed

Fan, Yahui; Zhang, Shaoru; Li, Yan; Li, Yuelu; Zhang, Tianhua; Liu, Weiping; Jiang, Hualin

2018-05-08

TB outbreaking in schools is extremely complex, and presents a major challenge for public health. Understanding the knowledge, attitudes and practices among student TB patients in such settings is fundamental when it comes to decreasing future TB cases. The objective of this study was to develop a Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ), and evaluate its psychometric properties. This study was conducted in three stages: item construction, pilot testing in 10 student TB patients and psychometric testing, including reliability and validity. The item pool for the questionnaire was compiled from literature review and early individual interviews. The questionnaire items were evaluated by the Delphi method based on 12 experts. Reliability and validity were assessed using student TB patients (n = 416) and healthy students (n = 208). Reliability was examined with internal consistency reliability and test-retest reliability. Content validity was calculated by content validity index (CVI); Construct validity was examined using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA); The Public Tuberculosis Knowledge, Attitudes and Practices Questionnaire (PTB-KAPQ) was applied to evaluate criterion validity; As concerning discriminant validity, T-test was performed. The final STBP-KAPQ consisted of three dimensions and 25 items. Cronbach's α coefficient and intraclass correlation coefficient (ICC) was 0.817 and 0.765, respectively. Content validity index (CVI) was 0.962. Seven common factors were extracted by principal factor analysis and varimax rotation, with a cumulative contribution of 66.253%. The resulting CFA model of the STBP-KAPQ exhibited an appropriate model fit (χ2/df = 1.74, RMSEA = 0.082, CFI = 0.923, NNFI = 0.962). STBP-KAPQ and PTB-KAPQ had a strong correlation in the knowledge part, and the correlation coefficient was 0.606 (p < 0.05). Discriminant validity was supported through a significant difference between student TB patients and healthy students across all domains (p < 0.05). An instrument, "Knowledge, Attitudes and Practices Questionnaire among Student Tuberculosis Patients (STBP-KAPQ)" was developed. Psychometric testing indicated that it had adequate validity and reliability for use in KAP researches with student TB patients in China. The new tool might help public health researchers evaluate the level of KAP in student TB patients, and it could also be used to examine the effects of TB health education.

Psychometric Evaluation of the Patient Health Questionnaire-4 in Hispanic Americans.

PubMed

Mills, Sarah D; Fox, Rina S; Pan, Tonya M; Malcarne, Vanessa L; Roesch, Scott C; Sadler, Georgia Robins

2015-11-01

The present study evaluated the psychometric properties of the Patient Health Questionnaire-4 (PHQ-4), a screener of psychological distress, in English- and Spanish-speaking Hispanic Americans. Hispanic American adults ( N = 436) completed the PHQ-4, which yields two subscales (anxiety and depression) that can be summed to create a total score. Multiple-group confirmatory factor analysis was used to evaluate structural validity. The two-factor structure was the best fit to the data for both English- and Spanish-speaking Hispanic Americans and items loaded equivalently across groups, demonstrating measurement invariance. Internal consistency reliability was good as measured by coefficient alpha. Construct validity was evidenced by significant expected relationships with perceived stress. These findings provide support for the reliability and validity of the PHQ-4 as a brief measure of psychological distress for English- or Spanish-speaking Hispanic Americans.

Rural Parents’ Perceived Stigma of Seeking Mental Health Services for their Children: Development and Evaluation of a New Instrument

PubMed Central

Williams, Stacey L.; Polaha, Jodi

2014-01-01

The purpose of this paper was to examine the validity of score interpretations of an instrument developed to measure parents’ perceptions of stigma about seeking mental health services for their children. The validity of the score interpretations of the instrument was tested in two studies. Study 1 examined confirmatory factor analysis (CFA) employing a split half approach, and construct and criterion validity using the entire sample of parents in rural Appalachia whose children were experiencing psychosocial concerns (N=347), while Study 2 further examined CFA, construct and criterion validity, as well as predictive validity of the scores on the new scale using a general sample of parents in rural Appalachia (N=184). Results of exploratory and confirmatory factor analyses revealed support for a two factor model of parents’ perceived stigma, which represented both self and public forms of stigma associated with seeking mental health services for their children, and correlated with existing measures of stigma and other psychosocial variables. Further, the new self and public stigma scale significantly predicted parents’ willingness to seek services for children. PMID:24749752

Defining physicians' readiness to screen and manage intimate partner violence in Greek primary care settings.

PubMed

Papadakaki, Maria; Prokopiadou, Dimitra; Petridou, Eleni; Kogevinas, Manolis; Lionis, Christos

2012-06-01

The current article aims to translate the PREMIS (Physician Readiness to Manage Intimate Partner Violence) survey into the Greek language and test its validity and reliability in a sample of primary care physicians. The validation study was conducted in 2010 and involved all the general practitioners serving two adjacent prefectures of Greece (n = 80). Maximum-likelihood factor analysis (MLF) was used to extract key survey factors. The instrument was further assessed for the following psychometric properties: (a) scale reliability, (b) item-specific reliability, (c) test-retest reliability, (d) scale construct validity, and (e) internal predictive validity. The MLF analysis of 23 opinion items revealed a seven-factor solution (preparation, constraint, workplace issues, screening, self-efficacy, alcohol/drugs, victim understanding), which was statistically sound (p = .293). Most of the newly derived scales displayed satisfactory internal consistency (α ≥ .60), high item-specific reliability, strong construct, and internal predictive validity (F = 2.82; p = .004), and high repeatability when retested with 20 individuals (intraclass correlation coefficient [ICC] > .70). The tool was found appropriate to facilitate the identification of competence deficits and the evaluation of training initiatives.

Exploring Methods for Developing Behaviorally Anchored Rating Scales for Evaluating Structured Interview Performance. Research Report. ETS RR-17-28

ERIC Educational Resources Information Center

Kell, Harrison J.; Martin-Raugh, Michelle P.; Carney, Lauren M.; Inglese, Patricia A.; Chen, Lei; Feng, Gary

2017-01-01

Behaviorally anchored rating scales (BARS) are an essential component of structured interviews. Use of BARS to evaluate interviewees' performance is associated with greater predictive validity and reliability and less bias. BARS are time-consuming and expensive to construct, however. This report explores the feasibility of gathering participants'…

Development of a Postacute Hospital Item Bank for the New Pediatric Evaluation of Disability Inventory-Computer Adaptive Test

ERIC Educational Resources Information Center

Dumas, Helene M.

2010-01-01

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Motivation and Engagement in the Workplace: Examining a Multidimensional Framework and Instrument from a Measurement and Evaluation Perspective

ERIC Educational Resources Information Center

Martin, Andrew J.

2009-01-01

This investigation conducts measurement and evaluation of a multidimensional model of workplace motivation and engagement from a construct validation perspective. Two studies were conducted, one using the multi-item multidimensional Motivation and Engagement Scale-Work (N = 637 school personnel) and one using a parallel short form (N = 574 school…

Egocentrism in Children: Its Generality and Correlates. Head Start Evaluation and Research Center.

ERIC Educational Resources Information Center

Shantz, Carolyn U.

The construct of egocentrism within Piaget's theory of intellectual development was evaluated as to its convergent, discriminant, and predictive validity within the concrete-operational stage. A total of eighty Negro children drawn from grades one through four in low and middle socioeconomic level schools, were tested individually on a total of…

[Turkish validity and reliability study of fear of pain questionnaire-III].

PubMed

Ünver, Seher; Turan, Fatma Nesrin

2018-01-01

This study aimed to develop a Turkish version of the Fear of Pain Questionnaire-III developed by McNeil and Rainwater (1998) and examine its validity and reliability indicators. The study was conducted with 459 university students studying in the nursing department. The Turkish translation of the scale was conducted by language experts and the original scale owner. Expert opinions were taken for language validity, and the Lawshe's content validity ratio formula was used to calculate the content validity. Exploratory factor analysis was used to assess the construct validity. The factors were rotated using the Varimax rotation (orthogonal) method. For reliability indicators of the questionnaire, the internal consistency coefficient and test re-test reliability were utilized. Explanatory factor analyses using the three-factor model (explaining 50.5% of the total variance) revealed that the item factor loads varied were above the limit value of 0.30 which indicated that the questionnaire had good construct validity. The Cronbach's alpha value for the total questionnaire was 0.938, and test re-test value was 0.846 for the total scale. The Turkish version of the Fear of Pain Questionnaire-III had sufficiently high reliability and validity to be used as a tool in evaluating the fear of pain among the young Turkish population.

[Construct validity of the Medical Outcomes Study's social support scale adapted to Portuguese in the Pró-Saúde Study].

PubMed

Griep, Rosane Harter; Chor, Dóra; Faerstein, Eduardo; Werneck, Guilherme L; Lopes, Cláudia S

2005-01-01

This paper evaluates the construct validity of the Medical Outcomes Study's social support scale adapted to Portuguese, when utilized in a cohort study among non-faculty civil servants at a university in Rio de Janeiro, Brazil (Pró-Saúde Study). Baseline data were obtained in 1999, when 4,030 participants (92.0% of those eligible) completed a multidimensional self-administered questionnaire at the workplace. From the original scale's five social support dimensions, factor analysis of the data extracted only three dimensions: positive social interaction/affective support; emotional/information support; and material support. We estimated associations between social support dimensions and socio-demographic, health, and well being-related characteristics. We confirmed the hypotheses that less isolated individuals, those with better self-rated health, those who reported more participation in group activities, and those with no evidence of common mental disorders reported better perception of social support. In conclusion, we found good evidence for a high construct validity of this scale, supporting its use in future analyses in the Pró-Saúde Study and in similar population groups.

Measuring Access to Information and Technology: Environmental Factors Affecting Persons With Neurologic Disorders.

PubMed

Hahn, Elizabeth A; Garcia, Sofia F; Lai, Jin-Shei; Miskovic, Ana; Jerousek, Sara; Semik, Patrick; Wong, Alex; Heinemann, Allen W

2016-08-01

To develop and validate a patient-reported measure of access to information and technology (AIT) for persons with spinal cord injury, stroke, or traumatic brain injury. A mixed-methods approach was used to develop items, refine them through cognitive interviews, and evaluate their psychometric properties. Item responses were evaluated with the Rasch rating scale model. Correlational and analysis-of-variance methods were used to evaluate construct validity. Community-dwelling individuals participated in telephone interviews or traveled to the academic medical centers where this research took place. Individuals with a diagnosis of spinal cord injury, stroke, or traumatic brain injury (aged ≥18y, English speaking) participated in cognitive interviews (n=12 persons), field testing of the items (n=305 persons), and validation testing of the final set of items (n=604 persons). Not applicable. A set of items to measure AIT for people with disabilities. A user-friendly multimedia touchscreen was used for self-administration of the items. A 23-item AIT measure demonstrated good evidence of internal consistency reliability, and content and construct validity. This new AIT measure will enable researchers and clinicians to determine to what extent environmental factors influence health outcomes and social participation in people with disabilities. The AIT measure could also provide disability advocates with more specific and detailed information about environmental factors to lobby for elimination of barriers. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric properties and clinical utility of the Scale for Suicidal Ideation (SSI) in adolescents

PubMed Central

Holi, Matti M; Pelkonen, Mirjami; Karlsson, Linnea; Kiviruusu, Olli; Ruuttu, Titta; Heilä, Hannele; Tuisku, Virpi; Marttunen, Mauri

2005-01-01

Background Accurate assessment of suicidality is of major importance in both clinical and research settings. The Scale for Suicidal Ideation (SSI) is a well-established clinician-rating scale but its suitability to adolescents has not been studied. The aim of this study was to evaluate the reliability and validity, and to test an appropriate cutoff threshold for the SSI in a depressed adolescent outpatient population and controls. Methods 218 adolescent psychiatric outpatient clinic patients suffering from depressive disorders and 200 age- and sex-matched school-attending controls were evaluated by the SSI for presence and severity of suicidal ideation. Internal consistency, discriminative-, concurrent-, and construct validity as well as the screening properties of the SSI were evaluated. Results Cronbach's α for the whole SSI was 0.95. The SSI total score differentiated patients and controls, and increased statistically significantly in classes with increasing severity of suicidality derived from the suicidality items of the K-SADS-PL diagnostic interview. Varimax-rotated principal component analysis of the SSI items yielded three theoretically coherent factors suggesting construct validity. Area under the receiver operating characteristic (ROC) curve was 0.84 for the whole sample and 0.80 for the patient sample. The optimal cutoff threshold for the SSI total score was 3/4 yielding sensitivity of 75% and specificity of 88.9% in this population. Conclusions SSI appears to be a reliable and a valid measure of suicidal ideation for depressed adolescents. PMID:15691388

Psychometric properties and clinical utility of the Scale for Suicidal Ideation (SSI) in adolescents.

PubMed

Holi, Matti M; Pelkonen, Mirjami; Karlsson, Linnea; Kiviruusu, Olli; Ruuttu, Titta; Heilä, Hannele; Tuisku, Virpi; Marttunen, Mauri

2005-02-03

Accurate assessment of suicidality is of major importance in both clinical and research settings. The Scale for Suicidal Ideation (SSI) is a well-established clinician-rating scale but its suitability to adolescents has not been studied. The aim of this study was to evaluate the reliability and validity, and to test an appropriate cutoff threshold for the SSI in a depressed adolescent outpatient population and controls. 218 adolescent psychiatric outpatient clinic patients suffering from depressive disorders and 200 age- and sex-matched school-attending controls were evaluated by the SSI for presence and severity of suicidal ideation. Internal consistency, discriminative-, concurrent-, and construct validity as well as the screening properties of the SSI were evaluated. Cronbach's alpha for the whole SSI was 0.95. The SSI total score differentiated patients and controls, and increased statistically significantly in classes with increasing severity of suicidality derived from the suicidality items of the K-SADS-PL diagnostic interview. Varimax-rotated principal component analysis of the SSI items yielded three theoretically coherent factors suggesting construct validity. Area under the receiver operating characteristic (ROC) curve was 0.84 for the whole sample and 0.80 for the patient sample. The optimal cutoff threshold for the SSI total score was 3/4 yielding sensitivity of 75% and specificity of 88.9% in this population. SSI appears to be a reliable and a valid measure of suicidal ideation for depressed adolescents.

Systematic Development and Validation of a Theory-Based Questionnaire to Assess Toddler Feeding12

PubMed Central

Hurley, Kristen M.; Pepper, M. Reese; Candelaria, Margo; Wang, Yan; Caulfield, Laura E.; Latta, Laura; Hager, Erin R.; Black, Maureen M.

2013-01-01

This paper describes the development and validation of a 27-item caregiver-reported questionnaire on toddler feeding. The development of the Toddler Feeding Behavior Questionnaire was based on a theory of interactive feeding that incorporates caregivers’ responses to concerns about their children’s dietary intake, appetite, size, and behaviors rather than relying exclusively on caregiver actions. Content validity included review by an expert panel (n = 7) and testing in a pilot sample (n = 105) of low-income mothers of toddlers. Construct validity and reliability were assessed among a second sample of low-income mothers of predominately African-American (70%) toddlers aged 12–32 mo (n = 297) participating in the baseline evaluation of a toddler overweight prevention study. Internal consistency (Cronbach’s α: 0.64–0.87) and test-retest (0.57–0.88) reliability were acceptable for most constructs. Exploratory and confirmatory factor analyses revealed 5 theoretically derived constructs of feeding: responsive, forceful/pressuring, restrictive, indulgent, and uninvolved (root mean square error of approximation = 0.047, comparative fit index = 0.90, standardized root mean square residual = 0.06). Statistically significant (P < 0.05) convergent validity results further validated the scale, confirming established relations between feeding behaviors, toddler overweight status, perceived toddler fussiness, and maternal mental health. The Toddler Feeding Behavior Questionnaire adds to the field by providing a brief instrument that can be administered in 5 min to examine how caregiver-reported feeding behaviors relate to toddler health and behavior. PMID:24068792

Systematic development and validation of a theory-based questionnaire to assess toddler feeding.

PubMed

Hurley, Kristen M; Pepper, M Reese; Candelaria, Margo; Wang, Yan; Caulfield, Laura E; Latta, Laura; Hager, Erin R; Black, Maureen M

2013-12-01

This paper describes the development and validation of a 27-item caregiver-reported questionnaire on toddler feeding. The development of the Toddler Feeding Behavior Questionnaire was based on a theory of interactive feeding that incorporates caregivers' responses to concerns about their children's dietary intake, appetite, size, and behaviors rather than relying exclusively on caregiver actions. Content validity included review by an expert panel (n = 7) and testing in a pilot sample (n = 105) of low-income mothers of toddlers. Construct validity and reliability were assessed among a second sample of low-income mothers of predominately African-American (70%) toddlers aged 12-32 mo (n = 297) participating in the baseline evaluation of a toddler overweight prevention study. Internal consistency (Cronbach's α: 0.64-0.87) and test-retest (0.57-0.88) reliability were acceptable for most constructs. Exploratory and confirmatory factor analyses revealed 5 theoretically derived constructs of feeding: responsive, forceful/pressuring, restrictive, indulgent, and uninvolved (root mean square error of approximation = 0.047, comparative fit index = 0.90, standardized root mean square residual = 0.06). Statistically significant (P < 0.05) convergent validity results further validated the scale, confirming established relations between feeding behaviors, toddler overweight status, perceived toddler fussiness, and maternal mental health. The Toddler Feeding Behavior Questionnaire adds to the field by providing a brief instrument that can be administered in 5 min to examine how caregiver-reported feeding behaviors relate to toddler health and behavior.

Simple construct evaluation with latent class analysis: An investigation of Facebook addiction and the development of a short form of the Facebook Addiction Test (F-AT).

PubMed

Dantlgraber, Michael; Wetzel, Eunike; Schützenberger, Petra; Stieger, Stefan; Reips, Ulf-Dietrich

2016-09-01

In psychological research, there is a growing interest in using latent class analysis (LCA) for the investigation of quantitative constructs. The aim of this study is to illustrate how LCA can be applied to gain insights on a construct and to select items during test development. We show the added benefits of LCA beyond factor-analytic methods, namely being able (1) to describe groups of participants that differ in their response patterns, (2) to determine appropriate cutoff values, (3) to evaluate items, and (4) to evaluate the relative importance of correlated factors. As an example, we investigated the construct of Facebook addiction using the Facebook Addiction Test (F-AT), an adapted version of the Internet Addiction Test (I-AT). Applying LCA facilitates the development of new tests and short forms of established tests. We present a short form of the F-AT based on the LCA results and validate the LCA approach and the short F-AT with several external criteria, such as chatting, reading newsfeeds, and posting status updates. Finally, we discuss the benefits of LCA for evaluating quantitative constructs in psychological research.

Development and Feasibility of a Virtual Reality Task for the Cognitive Assessment of Older Adults: The ECO-VR.

PubMed

Oliveira, Camila R; Lopes Filho, Brandel José P; Sugarman, Michael A; Esteves, Cristiane S; Lima, Margarida Maria B M P; Moret-Tatay, Carmen; Irigaray, Tatiana Q; Argimon, Irani Iracema L

2016-12-13

Cognitive assessment with virtual reality (VR) may have superior ecological validity for older adults compared to traditional pencil-and-paper cognitive assessment. However, few studies have reported the development of VR tasks. The aim of this study was to present the development, feasibility, content validity, and preliminary evidence of construct validity of an ecological task of cognitive assessment for older adults in VR (ECO-VR). The tasks were prepared based on theoretical and clinical backgrounds. We had 29 non-expert judges identify virtual visual stimuli and three-dimensional scenarios, and five expert judges assisted with content analysis and developing instructions. Finally, six older persons participated in three pilot studies and thirty older persons participated in the preliminary study to identify construct validity evidence. Data were analyzed by descriptive statistics and partial correlation. Target stimuli and three-dimensional scenarios were judged adequate and the content analysis demonstrated that ECO-VR evaluates temporo-spatial orientation, memory, language and executive functioning. We made significant changes to the instructions after the pilot studies to increase comprehensibility and reduce the completion time. The total score of ECO-VR was positively correlated mainly with performance in executive function (r = .172, p < .05) and memory tests (r = .488, p ≤ .01). The ECO-VR demonstrated feasibility for cognitive assessment in older adults, as well as content and construct validity evidences.

Measuring the contribution of art therapy in multidisciplinary treatment of personality disorders: The construction of the Self‐expression and Emotion Regulation in Art Therapy Scale (SERATS)

PubMed Central

van Hooren, Susan; van der Veld, William M.; Hutschemaekers, Giel

2017-01-01

Abstract Despite the use of art therapy in clinical practice, its appreciation and reported beneficial results, no instruments are available to measure specific effects of art therapy among patients with personality disorders cluster B/C in multidisciplinary treatment. In the present study, we described the development and psychometric evaluation of the Self‐expression and Emotion Regulation in Art Therapy Scale (SERATS). Structural validity (exploratory and confirmatory factor analysis), reliability, construct validity and sensitivity to change were examined using two independent databases (n = 335; n = 34) of patients diagnosed with personality disorders cluster B/C. This resulted in a nine‐item effect scale with a single factor with a high internal reliability and high test–retest reliability; it demonstrated discriminant validity and sensitivity to change. In conclusion, the SERATS is brief and content‐valid and offers objective and reliable information on self‐expression and emotion regulation in art therapy among patients with personality disorders cluster B/C. Although more research on construct validity is needed, the SERATS is a promising tool to be applied as an effect scale and as a monitoring tool during art therapy treatment. © 2017 The Authors Personality and Mental Health Published by John Wiley & Sons Ltd PMID:28730717

Validating Self-Report Measures of Pain and Function in Patients Undergoing Hip or Knee Arthroplasty

PubMed Central

Dogra, Moneet; Woodhouse, Linda; Kennedy, Deborah M.; Spadoni, Greg F.

2009-01-01

ABSTRACT Purpose: To investigate the factorial and construct validity of a four-item pain intensity scale, the P4, in patients awaiting primary total hip or knee arthroplasty secondary to osteoarthritis. Method: A construct validation design was applied to a sample of convenience of 117 patients (mean age 65.6 [SD = 11.2] years) at their preoperative visit. All patients completed the P4 and the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). Exploratory and confirmatory factor analyses were used to examine the factorial structure of the P4 and WOMAC. To evaluate construct validity, we examined the correlation between the P4 and WOMAC pain sub-scales and the ability of the P4 to differentiate between patients awaiting hip and knee replacement. Results: Two distinct factors consistent with the themes of pain and function were identified with P4 and WOMAC physical function items, but not with the WOMAC pain and physical function items. The P4 correlates more with the WOMAC pain scores (r = 0.67) than with the WOMAC physical function scores (r = 0.60). Conclusion: The P4's validity was supported in this patient group. The use of the P4 with the WOMAC physical function sub-scale provides a more distinct assessment of pain and function than the WOMAC pain and physical function scales. PMID:20808479

A multicenter prospective cohort study on camera navigation training for key user groups in minimally invasive surgery.

PubMed

Graafland, Maurits; Bok, Kiki; Schreuder, Henk W R; Schijven, Marlies P

2014-06-01

Untrained laparoscopic camera assistants in minimally invasive surgery (MIS) may cause suboptimal view of the operating field, thereby increasing risk for errors. Camera navigation is often performed by the least experienced member of the operating team, such as inexperienced surgical residents, operating room nurses, and medical students. The operating room nurses and medical students are currently not included as key user groups in structured laparoscopic training programs. A new virtual reality laparoscopic camera navigation (LCN) module was specifically developed for these key user groups. This multicenter prospective cohort study assesses face validity and construct validity of the LCN module on the Simendo virtual reality simulator. Face validity was assessed through a questionnaire on resemblance to reality and perceived usability of the instrument among experts and trainees. Construct validity was assessed by comparing scores of groups with different levels of experience on outcome parameters of speed and movement proficiency. The results obtained show uniform and positive evaluation of the LCN module among expert users and trainees, signifying face validity. Experts and intermediate experience groups performed significantly better in task time and camera stability during three repetitions, compared to the less experienced user groups (P < .007). Comparison of learning curves showed significant improvement of proficiency in time and camera stability for all groups during three repetitions (P < .007). The results of this study show face validity and construct validity of the LCN module. The module is suitable for use in training curricula for operating room nurses and novice surgical trainees, aimed at improving team performance in minimally invasive surgery. © The Author(s) 2013.

First evaluation of the Behavioral Addiction Indoor Tanning Screener (BAITS) in a nationwide representative sample.

PubMed

Diehl, K; Görig, T; Breitbart, E W; Greinert, R; Hillhouse, J J; Stapleton, J L; Schneider, S

2018-01-01

Evidence suggests that indoor tanning may have addictive properties. However, many instruments for measuring indoor tanning addiction show poor validity and reliability. Recently, a new instrument, the Behavioral Addiction Indoor Tanning Screener (BAITS), has been developed. To test the validity and reliability of the BAITS by using a multimethod approach. We used data from the first wave of the National Cancer Aid Monitoring on Sunbed Use, which included a cognitive pretest (August 2015) and a Germany-wide representative survey (October to December 2015). In the cognitive pretest 10 users of tanning beds were interviewed and 3000 individuals aged 14-45 years were included in the representative survey. Potential symptoms of indoor tanning addiction were measured using the BAITS, a brief screening survey with seven items (answer categories: yes vs. no). Criterion validity was assessed by comparing the results of BAITS with usage parameters. Additionally, we tested internal consistency and construct validity. A total of 19·7% of current and 1·8% of former indoor tanning users were screened positive for symptoms of a potential indoor tanning addiction. We found significant associations between usage parameters and the BAITS (criterion validity). Internal consistency (reliability) was good (Kuder-Richardson-20, 0·854). The BAITS was shown to be a homogeneous construct (construct validity). Compared with other short instruments measuring symptoms of a potential indoor tanning addiction, the BAITS seems to be a valid and reliable tool. With its short length and the binary items the BAITS is easy to use in large surveys. © 2017 British Association of Dermatologists.

[Development of an instrument to measure psychosocial determinants of physical activity behavior among coronary heart disease patients].

PubMed

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Cornélio, Marilia Estevam; Gallani, Maria Cecília Bueno Jayme; Godin, Gaston

2010-09-01

The aim of this study was to report the development and the analysis of content validity and reliability of the Psychosocial Determinants of Physical Activity among Coronary Heart Disease Patients Questionnaire, based on an extension of the Theory of Planned Behavior. In the content validity step, three experts evaluated the instrument which was, afterwards, pre-tested with five subjects in order to obtain a conceptually appropriate and easily understood instrument. Fifty-one patients participated in the evaluation of internal consistency of the reviewed instrument. Cronbach's alpha coefficients above 0.75 were observed for the constructs: Intention, Attitude, Subjective Norm, Self-efficacy and Habit. The new instrument demonstrated acceptable evidence of content validity and reliability.

Applying the transtheoretical model to tobacco cessation and prevention: a review of literature.

PubMed

Spencer, Leslie; Pagell, Francie; Hallion, Maria Elena; Adams, Troy B

2002-01-01

To comprehensively review all published, peer-reviewed research on the Transtheoretical Model (TTM) and tobacco cessation and prevention by exploring the validity of its constructs, the evidence for use of interventions based on the TTM, the description of populations using TTM constructs, and the identification of areas for further research. The three research questions answered were: "How is the validity of the TTM as applied to tobacco supported by research?" "How does the TTM describe special populations regarding tobacco use?" "What is the nature of evidence supporting the use of stage-matched tobacco interventions?" Computer Database search (PsychInfo, Medline, Current Contents, ERIC, CINAHL-Allied Health, and Pro-Quest Nursing) and manual journal search. INCLUSION/EXCLUSION CRITERIA: All English, original, research articles on the TTM as it relates to tobacco use published in peer-reviewed journals prior to March 1, 2001, were included. Commentaries, editorials, and books were not included. Articles were categorized as TTM construct validation, population descriptions using TTM constructs, or intervention evaluation using TTM constructs. Summary tables including study design, research rating, purpose, methods, findings, and implications were created. Articles were further divided into groups according to their purpose. Considering both the findings and research quality of each, the three research questions were addressed. The 148 articles reviewed included 54 validation studies, 73 population studies, and 37 interventions (some articles fit two categories). Overall, the evidence in support of the TTM as applied to tobacco use was strong, with supportive studies being more numerous and of a better design than nonsupportive studies. Using established criteria, we rated the construct validity of the entire body of literature as good; however, notable concerns exist about the staging construct. A majority of stage-matched intervention studies provided positive results and were of a better quality than those not supportive of stage-matched interventions; thus, we rated the body of literature using stage-matched tobacco interventions as acceptable and the body of literature using non-stage-matched interventions as suggestive. Population studies indicated that TTM constructs are applicable to a wide variety of general and special populations both in and outside of the United States, although a few exceptions exist. Evidence for the validity of the TTM as it applies to tobacco use is strong and growing; however, it is not conclusive. Eight different staging mechanisms were identified, raising the question of which are most valid and reliable. Interventions tailored to a smoker's stage were successful more often than nontailored interventions in promoting forward stage movement. Stage distribution is well-documented for U.S. populations; however, more research is needed for non-U.S. populations, for special populations, and on other TTM constructs.

Reliability and validity of a semi-structured DSM-based diagnostic interview module for the assessment of Attention Deficit Hyperactivity Disorder in adult psychiatric outpatients.

PubMed

Gorlin, Eugenia I; Dalrymple, Kristy; Chelminski, Iwona; Zimmerman, Mark

2016-08-30

Despite growing recognition that the symptoms and functional impairments of Attention Deficit/Hyperactivity Disorder (ADHD) persist into adulthood, only a few psychometrically sound diagnostic measures have been developed for the assessment of ADHD in adults, and none have been validated for use in a broad treatment-seeking psychiatric sample. The current study presents the reliability and validity of a semi-structured DSM-based diagnostic interview module for ADHD, which was administered to 1194 adults presenting to an outpatient psychiatric practice. The module showed excellent internal consistency and interrater reliability, good convergent and discriminant validity (as indexed by relatively high correlations with self-report measures of ADHD and ADHD-related constructs and little or no correlation with other, non-ADHD symptom domains), and good construct validity (as indexed by significantly higher rates of psychosocial impairment and self-reported family history of ADHD in individuals who meet criteria for an ADHD diagnosis). This instrument is thus a reliable and valid diagnostic tool for the detection of ADHD in adults presenting for psychiatric evaluation and treatment. Published by Elsevier Ireland Ltd.

Validation of a global scale to assess the quality of interprofessional teamwork in mental health settings.

PubMed

Tomizawa, Ryoko; Yamano, Mayumi; Osako, Mitue; Hirabayashi, Naotugu; Oshima, Nobuo; Sigeta, Masahiro; Reeves, Scott

2017-12-01

Few scales currently exist to assess the quality of interprofessional teamwork through team members' perceptions of working together in mental health settings. The purpose of this study was to revise and validate an interprofessional scale to assess the quality of teamwork in inpatient psychiatric units and to use it multi-nationally. A literature review was undertaken to identify evaluative teamwork tools and develop an additional 12 items to ensure a broad global focus. Focus group discussions considered adaptation to different care systems using subjective judgements from 11 participants in a pre-test of items. Data quality, construct validity, reproducibility, and internal consistency were investigated in the survey using an international comparative design. Exploratory factor analysis yielded five factors with 21 items: 'patient/community centred care', 'collaborative communication', 'interprofessional conflict', 'role clarification', and 'environment'. High overall internal consistency, reproducibility, adequate face validity, and reasonable construct validity were shown in the USA and Japan. The revised Collaborative Practice Assessment Tool (CPAT) is a valid measure to assess the quality of interprofessional teamwork in psychiatry and identifies the best strategies to improve team performance. Furthermore, the revised scale will generate more rigorous evidence for collaborative practice in psychiatry internationally.

Validation and cross cultural adaptation of the Italian version of the Harris Hip Score.

PubMed

Dettoni, Federico; Pellegrino, Pietro; La Russa, Massimo R; Bonasia, Davide E; Blonna, Davide; Bruzzone, Matteo; Castoldi, Filippo; Rossi, Roberto

2015-01-01

The Harris Hip Score (HHS) is one of the most widely used health related quality of life (HRQOL) measures for the assessment of hip pathology: in spite of this, a validation study, and an official Italian version have not been provided yet. The aim of this study was to create an Italian valid and reliable version of the HHS. The score was translated and modified in Italian; then 103 patients with different hip pathologies were evaluated using this HHS version and also with the WOMAC and the SF-12 questionnaires. Content, construct and criterion validities were tested, such as interobserver reliability, test-retest reliability and internal consistency. Cross-cultural adaptation was easy, and only minor adaptation was required in the translation process. Construct and criterion validity of the HHS Italian Version were confirmed by satisfactory values of Spearman's Rho for correlation between specific domains of HHS and Womac and SF12 scores. Interobserver and test-retest reliabilities obtained values of 0.996 and 0.975 respectively; Cronbach's alpha for internal consistency was 0.816. Statistical and clinical analysis showed that HHS is highly valid and reliable in this new Italian version.

A comparison of the psychometric properties of the psychopathic personality inventory full-length and short-form versions.

PubMed

Kastner, Rebecca M; Sellbom, Martin; Lilienfeld, Scott O

2012-03-01

The Psychopathic Personality Inventory (PPI) has shown promising construct validity as a measure of psychopathy. Because of its relative efficiency, a short-form version of the PPI (PPI-SF) was developed and has proven useful in many psychopathy studies. The validity of the PPI-SF, however, has not been thoroughly examined, and no studies have directly compared the validity of the short form with that of the full-length version. The current study was designed to compare the psychometric properties of both PPI versions, with an emphasis on convergent and discriminant validity in predicting external criteria conceptually relevant to psychopathy. We used both prison (n = 558) and college samples (n = 322) for this investigation. PPI scale scores were more reliable and more strongly correlated with the conceptually relevant criterion measures compared with the PPI-SF, particularly in the prison sample. There were no differences in relative discriminant validity. Thus, overall, the PPI full-length version showed more evidence of construct validity than did the short form, and the consequences of this psychometric difference should be considered when evaluating the clinical utility of each measure.

Identification student’s misconception of heat and temperature using three-tier diagnostic test

NASA Astrophysics Data System (ADS)

Suliyanah; Putri, H. N. P. A.; Rohmawati, L.

2018-03-01

The objective of this research is to develop a Three-Tier Diagnostic Test (TTDT) to identify the student's misconception of heat and temperature. Stages of development include: analysis, planning, design, development, evaluation and revise. The results of this study show that (1) the quality of the three-tier type diagnostic test instrument developed has been expressed well with the following details: (a) Internal validity of 88.19% belonging to the valid category. (b) External validity of empirical construct validity test using Pearson Product Moment obtained 0.43 is classified and result of empirical construct validity test obtained false positives 6.1% and false negatives 5.9% then the instrument was valid. (c) Test reliability by using Cronbach’s Alpha of 0.98 which means acceptable. (d) The 80% difficulty level test is quite difficult. (2) Student misconceptions on the temperature of heat and displacement materials based on the II test the highest (84%), the lowest (21%), and the non-misconceptions (7%). (3) The highest cause of misconception among students is associative thinking (22%) and the lowest is caused by incomplete or incomplete reasoning (11%). Three-Tier Diagnostic Test (TTDT) could identify the student's misconception of heat and temperature.

Development and initial validation of primary care provider mental illness management and team-based care self-efficacy scales.

PubMed

Loeb, Danielle F; Crane, Lori A; Leister, Erin; Bayliss, Elizabeth A; Ludman, Evette; Binswanger, Ingrid A; Kline, Danielle M; Smith, Meredith; deGruy, Frank V; Nease, Donald E; Dickinson, L Miriam

Develop and validate self-efficacy scales for primary care provider (PCP) mental illness management and team-based care participation. We developed three self-efficacy scales: team-based care (TBC), mental illness management (MIM), and chronic medical illness (CMI). We developed the scales using Bandura's Social Cognitive Theory as a guide. The survey instrument included items from previously validated scales on team-based care and mental illness management. We administered a mail survey to 900 randomly selected Colorado physicians. We conducted exploratory principal factor analysis with oblique rotation. We constructed self-efficacy scales and calculated standardized Cronbach's alpha coefficients to test internal consistency. We calculated correlation coefficients between the MIM and TBC scales and previously validated measures related to each scale to evaluate convergent validity. We tested correlations between the TBC and the measures expected to correlate with the MIM scale and vice versa to evaluate discriminant validity. PCPs (n=402, response rate=49%) from diverse practice settings completed surveys. Items grouped into factors as expected. Cronbach's alphas were 0.94, 0.88, and 0.83 for TBC, MIM, and CMI scales respectively. In convergent validity testing, the TBC scale was correlated as predicted with scales assessing communications strategies, attitudes toward teams, and other teamwork indicators (r=0.25 to 0.40, all statistically significant). Likewise, the MIM scale was significantly correlated with several items about knowledge and experience managing mental illness (r=0.24 to 41, all statistically significant). As expected in discriminant validity testing, the TBC scale had only very weak correlations with the mental illness knowledge and experience managing mental illness items (r=0.03 to 0.12). Likewise, the MIM scale was only weakly correlated with measures of team-based care (r=0.09 to.17). This validation study of MIM and TBC self-efficacy scales showed high internal validity and good construct validity. Copyright © 2016 Elsevier Inc. All rights reserved.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

Evaluating service user pedagogy in UK higher education: Validating the Huddersfield Service User Pedagogy Scale.

PubMed

Tobbell, Jane; Boduszek, Daniel; Kola-Palmer, Susanna; Vaughan, Joanne; Hargreaves, Janet

2018-04-01

There is global recognition that the inclusion of service users in the education of health and social care students in higher education can lead to more compassionate professional identities which will enable better decision making. However, to date there is no systematic tool to explore learning and service user involvement in the curriculum. To generate and validate a psychometric instrument which will allow educators to evaluate service user pedagogy. Construction and validation of a new scale. 365 undergraduate students from health and social care departments in two universities. A two correlated factor scale. Factor 1 - perceived presence of service users in the taught curriculum and factor 2 - professionals and service users working together (correlation between factor 1 and factor 2 - r = 0.32). The Huddersfield Service User Pedagogy Scale provides a valid instrument for educators to evaluate student learning. In addition, the tool can contribute to student reflections on their shifting professional identities as they progress through their studies. Copyright © 2018 Elsevier Ltd. All rights reserved.

Adaptation and validation of the Evidence-Based Practice Belief and Implementation scales for French-speaking Swiss nurses and allied healthcare providers.

PubMed

Verloo, Henk; Desmedt, Mario; Morin, Diane

2017-09-01

To evaluate two psychometric properties of the French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales, namely their internal consistency and construct validity. The Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales developed by Melnyk et al. are recognised as valid, reliable instruments in English. However, no psychometric validation for their French versions existed. Secondary analysis of a cross sectional survey. Source data came from a cross-sectional descriptive study sample of 382 nurses and other allied healthcare providers. Cronbach's alpha was used to evaluate internal consistency, and principal axis factor analysis and varimax rotation were computed to determine construct validity. The French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales showed excellent reliability, with Cronbach's alphas close to the scores established by Melnyk et al.'s original versions. Principal axis factor analysis showed medium-to-high factor loading scores without obtaining collinearity. Principal axis factor analysis with varimax rotation of the 16-item Evidence-Based Practice Beliefs scale resulted in a four-factor loading structure. Principal axis factor analysis with varimax rotation of the 17-item Evidence-Based Practice Implementation scale revealed a two-factor loading structure. Further research should attempt to understand why the French Evidence-Based Practice Implementation scale showed a two-factor loading structure but Melnyk et al.'s original has only one. The French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales can both be considered valid and reliable instruments for measuring Evidence-Based Practice beliefs and implementation. The results suggest that the French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales are valid and reliable and can therefore be used to evaluate the effectiveness of organisational strategies aimed at increasing professionals' confidence in Evidence-Based Practice, supporting its use and implementation. © 2017 John Wiley & Sons Ltd.

[Validity and Reliability of the Korean Version Scale of the Clinical Learning Environment, Supervision and Nurse Teacher Evaluation Scale (CLES+T)].

PubMed

Kim, Sun Hee; Yoo, So Yeon; Kim, Yae Young

2018-02-01

This study was conducted to evaluate the validity and reliability of the Korean version of the clinical learning environment, supervision and nurse teacher evaluation scale (CLES+T) that measures the clinical learning environment and the conditions associated with supervision and nurse teachers. The English CLES+T was translated into Korean with forward and back translation. Survey data were collected from 434 nursing students who had more than four days of clinical practice in Korean hospitals. Internal consistency reliability and construct validity using confirmatory and exploratory factor analysis were conducted. SPSS 20.0 and AMOS 22.0 programs were used for data analysis. The exploratory factor analysis revealed seven factors for the thirty three-item scale. Confirmatory factor analysis supported good convergent and discriminant validities. The Cronbach's alpha for the overall scale was .94 and for the seven subscales ranged from .78 to .94. The findings suggest that the 33-items Korean CLES+T is an appropriate instrument to measure Korean nursing students'clinical learning environment with good validity and reliability. © 2018 Korean Society of Nursing Science.

The revised Bristol Rheumatoid Arthritis Fatigue measures and the Rheumatoid Arthritis Impact of Disease scale: validation in six countries

PubMed Central

Kirwan, John; Bode, Christina; Cramp, Fiona; Carmona, Loreto; Dures, Emma; Englbrecht, Matthias; Fransen, Jaap; Greenwood, Rosemary; Hagel, Sofia; van de Laar, Maart; Molto, Anna; Nicklin, Joanna; Petersson, Ingemar F; Redondo, Marta; Schett, Georg; Gossec, Laure

2018-01-01

Abstract Objective To evaluate the Bristol Rheumatoid Arthritis Fatigue Multidimensional Questionnaire (BRAF-MDQ), the revised Bristol Rheumatoid Arthritis Numerical Rating Scales (BRAF-NRS V2) and the Rheumatoid Arthritis Impact of Disease (RAID) scale in six countries. Methods We surveyed RA patients in France, Germany, The Netherlands, Spain, Sweden and the UK, including the HAQ, 36-item Short Form Health Survey (SF-36) and potential revisions of the BRAF-NRS coping and Spanish RAID coping items. Factor structure and internal consistency were examined by factor analysis and Cronbach’s α and construct validity by Spearman’s correlation. Results A total of 1276 patients participated (76% female, 25% with a disease duration <5 years, median HAQ 1.0). The original BRAF-MDQ four-factor structure and RAID single-factor structure were confirmed in every country with ⩾66% of variation in items explained by each factor and all item factor loadings of 0.71–0.98. Internal consistency for the BRAF-MDQ total and subscales was a Cronbach’s α of 0.75–0.96 and for RAID, 0.93–0.96. Fatigue construct validity was shown for the BRAF-MDQ and BRAF-NRS severity and effect scales, correlated internally with SF-36 vitality and with RAID fatigue (r = 0.63–0.93). Broader construct validity for the BRAFs and RAID was shown by correlation with each other, HAQ and SF-36 domains (r = 0.46–0.82), with similar patterns in individual countries. The revised BRAF-NRS V2 Coping item had stronger validity than the original in all analyses. The revised Spanish RAID coping item performed as well as the original. Conclusion Across six European countries, the BRAF-MDQ identifies the same four aspects of fatigue, and along with the RAID, shows strong factor structure and internal consistency and moderate–good construct validity. The revised BRAF-NRS V2 shows improved construct validity and replaces the original. PMID:29087507

The revised Bristol Rheumatoid Arthritis Fatigue measures and the Rheumatoid Arthritis Impact of Disease scale: validation in six countries.

PubMed

Hewlett, Sarah; Kirwan, John; Bode, Christina; Cramp, Fiona; Carmona, Loreto; Dures, Emma; Englbrecht, Matthias; Fransen, Jaap; Greenwood, Rosemary; Hagel, Sofia; van de Laar, Maart; Molto, Anna; Nicklin, Joanna; Petersson, Ingemar F; Redondo, Marta; Schett, Georg; Gossec, Laure

2018-02-01

To evaluate the Bristol Rheumatoid Arthritis Fatigue Multidimensional Questionnaire (BRAF-MDQ), the revised Bristol Rheumatoid Arthritis Numerical Rating Scales (BRAF-NRS V2) and the Rheumatoid Arthritis Impact of Disease (RAID) scale in six countries. We surveyed RA patients in France, Germany, The Netherlands, Spain, Sweden and the UK, including the HAQ, 36-item Short Form Health Survey (SF-36) and potential revisions of the BRAF-NRS coping and Spanish RAID coping items. Factor structure and internal consistency were examined by factor analysis and Cronbach's α and construct validity by Spearman's correlation. A total of 1276 patients participated (76% female, 25% with a disease duration <5 years, median HAQ 1.0). The original BRAF-MDQ four-factor structure and RAID single-factor structure were confirmed in every country with ⩾66% of variation in items explained by each factor and all item factor loadings of 0.71-0.98. Internal consistency for the BRAF-MDQ total and subscales was a Cronbach's α of 0.75-0.96 and for RAID, 0.93-0.96. Fatigue construct validity was shown for the BRAF-MDQ and BRAF-NRS severity and effect scales, correlated internally with SF-36 vitality and with RAID fatigue (r = 0.63-0.93). Broader construct validity for the BRAFs and RAID was shown by correlation with each other, HAQ and SF-36 domains (r = 0.46-0.82), with similar patterns in individual countries. The revised BRAF-NRS V2 Coping item had stronger validity than the original in all analyses. The revised Spanish RAID coping item performed as well as the original. Across six European countries, the BRAF-MDQ identifies the same four aspects of fatigue, and along with the RAID, shows strong factor structure and internal consistency and moderate-good construct validity. The revised BRAF-NRS V2 shows improved construct validity and replaces the original. © The Author 2017. Published by Oxford University Press on behalf of the British Society for Rheumatology.

Relationship status: Scales for assessing the vitality of late adolescents' relationships with their parents.

PubMed

Klos, D S; Paddock, J R

1978-12-01

Three criteria for assessing relationship status were proposed: self-disclosure despite the risk of parental disapproval; openness to critical feedback from parents; constructive confrontation when angry with parents. These concepts were operationalized as narratives of nine interpersonal dilemmas, to which late adolescents responded by indicating "What would you do if you were in this situation?" Reliable example-anchored scales were constructed from the responses of one sample of college students and then cross-validated with two other samples. Social class had a significant but small effect on the relationship status scores; but age and sex of adolescent and sex of parent did not. The patterns of correlations of the Relationship Status Scales among themselves and with the Parent-Child Relations Questionnaire, the College Self-Expression Scale, the Fear of Negative Evaluation Scale, and Hogan's Empathy Scale were interpreted as evidence of construct validity.

Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle.

PubMed

Ruuska, Salla; Hämäläinen, Wilhelmiina; Kajava, Sari; Mughal, Mikaela; Matilainen, Pekka; Mononen, Jaakko

2018-03-01

The aim of the present study was to evaluate empirically confusion matrices in device validation. We compared the confusion matrix method to linear regression and error indices in the validation of a device measuring feeding behaviour of dairy cattle. In addition, we studied how to extract additional information on classification errors with confusion probabilities. The data consisted of 12 h behaviour measurements from five dairy cows; feeding and other behaviour were detected simultaneously with a device and from video recordings. The resulting 216 000 pairs of classifications were used to construct confusion matrices and calculate performance measures. In addition, hourly durations of each behaviour were calculated and the accuracy of measurements was evaluated with linear regression and error indices. All three validation methods agreed when the behaviour was detected very accurately or inaccurately. Otherwise, in the intermediate cases, the confusion matrix method and error indices produced relatively concordant results, but the linear regression method often disagreed with them. Our study supports the use of confusion matrix analysis in validation since it is robust to any data distribution and type of relationship, it makes a stringent evaluation of validity, and it offers extra information on the type and sources of errors. Copyright © 2018 Elsevier B.V. All rights reserved.

Reliability and validity of the Modified Erikson Psychosocial Stage Inventory in diverse samples.

PubMed

Leidy, N K; Darling-Fisher, C S

1995-04-01

The Modified Erikson Psychosocial Stage Inventory (MEPSI) is a relatively simple survey measure designed to assess the strength of psychosocial attributes that arise from progression through Erikson's eight stages of development. The purpose of this study was to employ secondary analysis to evaluate the internal-consistency reliability and construct validity of the MEPSI across four diverse samples: healthy young adults, hemophilic men, healthy older adults, and older adults with chronic obstructive pulmonary disease. Special attention was given to the performance of the measure across gender, with exploratory analyses examining possible age cohort and health status effects. Internal-consistency estimates for the aggregate measure were high, whereas subscale reliability levels varied across age groups. Construct validity was supported across samples. Gender, cohort, and health effects offered interesting psychometric and theoretical insights and direction for further research. Findings indicated that the MEPSI might be a useful instrument for operationalizing and testing Eriksonian developmental theory in adults.

Reliability and Validity of Ambulatory Cognitive Assessments

PubMed Central

Sliwinski, Martin J.; Mogle, Jacqueline A.; Hyun, Jinshil; Munoz, Elizabeth; Smyth, Joshua M.; Lipton, Richard B.

2017-01-01

Mobile technologies are increasingly used to measure cognitive function outside of traditional clinic and laboratory settings. Although ambulatory assessments of cognitive function conducted in people’s natural environments offer potential advantages over traditional assessment approaches, the psychometrics of cognitive assessment procedures have been understudied. We evaluated the reliability and construct validity of ambulatory assessments of working memory and perceptual speed administered via smartphones as part of an ecological momentary assessment (EMA) protocol in a diverse adult sample (N=219). Results indicated excellent between-person reliability (≥.97) for average scores, and evidence of reliable within-person variability across measurement occasions (.41–.53). The ambulatory tasks also exhibited construct validity, as evidence by their loadings on working memory and perceptual speed factors defined by the in-lab assessments. Our findings demonstrate that averaging across brief cognitive assessments made in uncontrolled naturalistic settings provide measurements that are comparable in reliability to assessments made in controlled laboratory environments. PMID:27084835

Psychopathy in Bulgaria: The cross-cultural generalizability of the Hare Psychopathy Checklist

PubMed Central

Wilson, Michael J.; Abramowitz, Carolyn; Vasilev, Georgi; Bozgunov, Kiril; Vassileva, Jasmin

2014-01-01

The generalizability of the psychopathy construct to Eastern European cultures has not been well-studied, and no prior studies have evaluated psychopathy in non-offender samples from this population. The current validation study examines the factor structure, internal consistency, and external validity of the Bulgarian translation of the Hare Psychopathy Checklist: Screening Version. Two hundred sixty-two Bulgarian adults from the general community were assessed, of which 185 had a history of substance dependence. Confirmatory factor analysis indicated good fit for the two-, three-, and four-factor models of psychopathy. Zero-order and partial correlation analyses were conducted between the two factors of psychopathy and criterion measures of antisocial behavior, internalizing and externalizing psychopathology, personality traits, addictive disorders and demographic characteristics. Relationships to external variables provided evidence for the convergent and discriminant validity of the psychopathy construct in a Bulgarian community sample. PMID:25313268

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

Construct validity of the Iowa Gambling Task.

PubMed

Buelow, Melissa T; Suhr, Julie A

2009-03-01

The Iowa Gambling Task (IGT) was created to assess real-world decision making in a laboratory setting and has been applied to various clinical populations (i.e., substance abuse, schizophrenia, pathological gamblers) outside those with orbitofrontal cortex damage, for whom it was originally developed. The current review provides a critical examination of lesion, functional neuroimaging, developmental, and clinical studies in order to examine the construct validity of the IGT. The preponderance of evidence provides support for the use of the IGT to detect decision making deficits in clinical populations, in the context of a more comprehensive evaluation. The review includes a discussion of three critical issues affecting the validity of the IGT, as it has recently become available as a clinical instrument: the lack of a concise definition as to what aspect of decision making the IGT measures, the lack of data regarding reliability of the IGT, and the influence of personality and state mood on IGT performance.

Evaluation of magical thinking: validation of the Illusory Beliefs Inventory.

PubMed

Shihata, Sarah; Egan, Sarah J; Rees, Clare S

2014-01-01

Magical thinking has been related to obsessive-compulsive disorder; yet, little research has examined this construct in other anxiety disorders. The Illusory Beliefs Inventory (IBI) is a recently developed measure of magical thinking. The aim of this study was to investigate the psychometric properties of this new measure and to determine if magical thinking accounts for pathological worry beyond the well-researched constructs of intolerance of uncertainty (IU) and perfectionism. A sample of 502 participants completed an online survey. Confirmatory factor analysis identified a three-factor solution for the IBI, and the measure had good internal consistency (α = .92), test-retest reliability (r = .94) and discriminant validity. Magical thinking, IU, and perfectionism all predicted pathological worry; however, magical thinking accounted for less than 1% of unique variance in worry, suggesting that it is not strongly related to worry. Further investigation regarding the validity and clinical utility of the IBI is required.

A Study to Design, Develop, Implement, Evaluate, and Revise Specific, Measurable Performance Objectives to Serve as a Model to Individualize Instruction for Secondary Schools. Final Report.

ERIC Educational Resources Information Center

Wendt, Marilynn S.; Jacobson, Marjory E.

Specific objectives of this two-phase study included: (1) assessment of design of the behavioral objectives in all secondary level courses; (2) construction of criteria for evaluation of the design; (3) testing of objectives against the evaluative criteria and/or the specifications of the curriculum design; and (4) determination of the validity of…

Introducing the Professionalism Mini-Evaluation Exercise (P-MEX) in Japan: results from a multicenter, cross-sectional study.

PubMed

Tsugawa, Yusuke; Ohbu, Sadayoshi; Cruess, Richard; Cruess, Sylvia; Okubo, Tomoya; Takahashi, Osamu; Tokuda, Yasuharu; Heist, Brian S; Bito, Seiji; Itoh, Toshiyuki; Aoki, Akiko; Chiba, Tsutomu; Fukui, Tsuguya

2011-08-01

Despite the growing importance of and interest in medical professionalism, there is no standardized tool for its measurement. The authors sought to verify the validity, reliability, and generalizability of the Professionalism Mini-Evaluation Exercise (P-MEX), a previously developed and tested tool, in the context of Japanese hospitals. A multicenter, cross-sectional evaluation study was performed to investigate the validity, reliability, and generalizability of the P-MEX in seven Japanese hospitals. In 2009-2010, 378 evaluators (attending physicians, nurses, peers, and junior residents) completed 360-degree assessments of 165 residents and fellows using the P-MEX. The content validity and criterion-related validity were examined, and the construct validity of the P-MEX was investigated by performing confirmatory factor analysis through a structural equation model. The reliability was tested using generalizability analysis. The contents of the P-MEX achieved good acceptance in a preliminary working group, and the poststudy survey revealed that 302 (79.9%) evaluators rated the P-MEX items as appropriate, indicating good content validity. The correlation coefficient between P-MEX scores and external criteria was 0.78 (P < .001), demonstrating good criterion-related validity. Confirmatory factor analysis verified high path coefficient (0.60-0.99) and adequate goodness of fit of the model. The generalizability analysis yielded a high dependability coefficient, suggesting good reliability, except when evaluators were peers or junior residents. Findings show evidence of adequate validity, reliability, and generalizability of the P-MEX in Japanese hospital settings. The P-MEX is the only evaluation tool for medical professionalism verified in both a Western and East Asian cultural context.

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review.

PubMed

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-05-21

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments.

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review

PubMed Central

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-01-01

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments. PMID:29791603

The construct validity and reliability of the Turkish version of Spreitzer's psychological empowerment scale

PubMed Central

2010-01-01

Background Today, many organizations have adopted some kind of empowerment initiative for at least part of their workforce. Over the last two decades, two complementary perspectives on empowerment at work have emerged: structural and psychological empowerment. Psychological empowerment is a motivational construct manifested in four cognitions: meaning, competence, self-determination and impact. The aim of this article is to examine the construct validity and reliability of the Turkish translation of Spreitzer's psychological empowerment scale in a culturally diverse environment. Methods The scale contains four dimensions over 12 statements. Data were gathered from 260 nurses and 161 physicians. The dimensionality of the scale was evaluated by exploratory factor analyses. To investigate the multidimensional nature of the empowerment construct and the validity of the scale, first- and second-order confirmatory factor analysis was conducted. Furthermore, Cronbach alpha coefficients were assessed to investigate reliability. Results Exploratory factor analyses revealed that four factors in both solutions. The first- and second-order factor analysis indicated an acceptable fit between the data and the theoretical model for nurses and physicians. Cronbach alpha coefficients varied between 0.81-0.94 for both groups, which may be considered satisfactory. Conclusions The analyses indicated that the psychometric properties of the Turkish version of the scale can be considered satisfactory. PMID:20214770

A model of scientific attitudes assessment by observation in physics learning based scientific approach: case study of dynamic fluid topic in high school

NASA Astrophysics Data System (ADS)

Yusliana Ekawati, Elvin

2017-01-01

This study aimed to produce a model of scientific attitude assessment in terms of the observations for physics learning based scientific approach (case study of dynamic fluid topic in high school). Development of instruments in this study adaptation of the Plomp model, the procedure includes the initial investigation, design, construction, testing, evaluation and revision. The test is done in Surakarta, so that the data obtained are analyzed using Aiken formula to determine the validity of the content of the instrument, Cronbach’s alpha to determine the reliability of the instrument, and construct validity using confirmatory factor analysis with LISREL 8.50 program. The results of this research were conceptual models, instruments and guidelines on scientific attitudes assessment by observation. The construct assessment instruments include components of curiosity, objectivity, suspended judgment, open-mindedness, honesty and perseverance. The construct validity of instruments has been qualified (rated load factor > 0.3). The reliability of the model is quite good with the Alpha value 0.899 (> 0.7). The test showed that the model fits the theoretical models are supported by empirical data, namely p-value 0.315 (≥ 0.05), RMSEA 0.027 (≤ 0.08)

Quantification of construction waste prevented by BIM-based design validation: Case studies in South Korea.

PubMed

Won, Jongsung; Cheng, Jack C P; Lee, Ghang

2016-03-01

Waste generated in construction and demolition processes comprised around 50% of the solid waste in South Korea in 2013. Many cases show that design validation based on building information modeling (BIM) is an effective means to reduce the amount of construction waste since construction waste is mainly generated due to improper design and unexpected changes in the design and construction phases. However, the amount of construction waste that could be avoided by adopting BIM-based design validation has been unknown. This paper aims to estimate the amount of construction waste prevented by a BIM-based design validation process based on the amount of construction waste that might be generated due to design errors. Two project cases in South Korea were studied in this paper, with 381 and 136 design errors detected, respectively during the BIM-based design validation. Each design error was categorized according to its cause and the likelihood of detection before construction. The case studies show that BIM-based design validation could prevent 4.3-15.2% of construction waste that might have been generated without using BIM. Copyright © 2015 Elsevier Ltd. All rights reserved.

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

PedsQLTM 4.0 Generic Core Scales for adolescents in the Yoruba language: translation and general psychometric properties.

PubMed

Atilola, Olayinka; Stevanović, Dejan

2014-04-01

Quality of life (QOL) is a universally accepted concept for measuring the impact of different aspects of life on general well-being. Adaptation of existing QOL instruments to local cultures has been identified as a better strategy than development of new ones. To translate and adapt the Paediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales (PedsQL™) to the Yoruba language and culture and to test the psychometric properties of the adapted instrument among adolescents. Psychometric properties including internal consistency reliability, construct and factorial validity of the Yoruba version of PedsQL™ were evaluated using standard procedures. The self report and proxy scales of the Yoruba PedsQL™ were developed with good cultural relevance and semantic/conceptual equivalence. Results from 527 adolescents revealed a Cronbach's coefficient which exceeded 0.7 for internal consistency reliability for all scores. The healthy subjects reported higher PedsQL™ scores than those with mental health and physical problems, which confirmed construct validity. Confirmatory factor analysis revealed a good model fit for the Psychosocial Health score, but not for the other measures. The Yoruba PedsQL™ is culturally appropriate and with good internal consistency, reliability and construct validity. More work is needed regarding its factorial validity.

Psychometric properties of the Dresden Body Image Questionnaire: A multiple-group confirmatory factor analysis across sex and age in a Dutch non-clinical sample

PubMed Central

Scheffers, Mia; van Duijn, Marijtje A. J.; Bosscher, Ruud J.; Wiersma, Durk; Schoevers, Robert A.; van Busschbach, Jooske T.

2017-01-01

Background Body image has implications for psychosocial functioning and quality of life and its disturbance is reported in a broad range of psychiatric disorders. In view of the lack of instruments in Dutch measuring body image as a broad concept, we set out to make an instrument available that reflects the multidimensional character of this construct by including more dimensions than physical appearance. The Dresden Körperbildfragebogen (DBIQ, Dresden Body Image Questionnaire) particularly served this purpose. The DBIQ consists of 35 items and five subscales: body acceptance, sexual fulfillment, physical contact, vitality, and self-aggrandizement. The main objective of the present study was to evaluate the psychometric properties of the Dutch translation of the Dresden Body Image Questionnaire (DBIQ-NL) in a non-clinical sample. Methods The psychometric properties of the DBIQ-NL were examined in a non-clinical sample of 988 respondents aged between 18 and 65. We investigated the subscales' internal consistency and test-retest reliability. In order to establish construct validity we evaluated the association with a related construct, body cathexis, and with indices of self-esteem and psychological wellbeing. The factor structure of the DBIQ-NL was examined via confirmatory factor analysis (CFA). The equivalence of the measurement model across sex and age was evaluated by multiplegroup confirmatory factor analyses. Results Confirmatory factor analyses showed a structure in accordance with the original scale, where model fit was improved significantly by moving one item to another subscale. Multiple group confirmatory factor analysis across sex and age demonstrated partial strong invariance. Internal consistency was good with little overlap between the subscales. Temporal reliability and construct validity were satisfactory. Conclusion Results indicate that the DBIQ-NL is a reliable and valid instrument for non-clinical subjects. This provides a sound basis for further investigation of the DBIQ-NL in a clinical sample. PMID:28746387

Psychometric evaluations of the efficacy expectations and Outcome Expectations for Exercise Scales in African American women.

PubMed

Murrock, Carolyn J; Gary, Faye

2014-01-01

This secondary analysis tested the reliability and validity of the Self-Efficacy for Exercise (SEE) and the Outcome Expectations for Exercise (OEE) scales in 126 community dwelling, middle aged African American women. Social Cognitive Theory postulates self-efficacy is behavior age, gender and culture specific. Therefore, it is important to determine ifself-efficacy scales developed and tested in older Caucasian female adults are reliable and valid in middle aged, minority women. Cronbach's alpha and construct validity using hypothesis testing and confirmatory factor analysis supported the reliability and validity of the SEE and OEE scales in community dwelling, middle aged African American women.

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

PubMed Central

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs’ cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care. PMID:26641876

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

PubMed

Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fraile-Garcia, Esteban, E-mail: esteban.fraile@unirioja.es; Ferreiro-Cabello, Javier, E-mail: javier.ferreiro@unirioja.es; Qualiberica S.L.

The European Committee for Standardization (CEN) through its Technical Committee CEN/TC-350 is developing a series of standards for assessing the building sustainability, at both product and building levels. The practical application of the selection (decision making) of structural alternatives made by one-way slabs leads to an intermediate level between the product and the building. Thus the present study addresses this problem of decision making, following the CEN guidelines and incorporating relevant aspects of architectural design into residential construction. A life cycle assessment (LCA) is developed in order to obtain valid information for the decision making process (the LCA was developedmore » applying CML methodology although Ecoindicator99 was used in order to facilitate the comparison of the values); this information (the carbon footprint values) is contrasted with other databases and with the information from the Environmental Product Declaration (EPD) of one of the lightening materials (expanded polystyrene), in order to validate the results. Solutions of different column disposition and geometries are evaluated in the three pillars of sustainable construction on residential construction: social, economic and environmental. The quantitative analysis of the variables used in this study enables and facilitates an objective comparison in the design stage by a responsible technician; the application of the proposed methodology reduces the possible solutions to be evaluated by the expert to 12.22% of the options in the case of low values of the column index and to 26.67% for the highest values. - Highlights: • Methodology for selection of structural alternatives in buildings with one-way slabs • Adapted to CEN guidelines (CEN/TC-350) for assessing the building sustainability • LCA is developed in order to obtain valid information for the decision making process. • Results validated comparing carbon footprint, databases and Env. Product Declarations • The proposal reduces the solutions to be evaluated to between 12.22 and 26.67%.« less

[Validity of the Child Psychiatric Hospital Teacher Questionnaire for the assessment of ADHD. Teacher's version].

PubMed

Ulloa, R E; Narváez, M R; Arroyo, E; del Bosque, J; de la Peña, F

2009-01-01

Teacher's rating scales for the evaluation of attention deficit and superactivity disorder (TDAH) and conduct disorders have been shown to be useful and valid tools. The Child Psychiatric Hospital Teacher Questionnaire (CPHTQ) of the Hospital Psiquiátrico Infantil Dr. Juan N. Navarro was designed for the assessment of ADHD symptoms, externalizing symptoms and school functioning difficulties of children and adolescents. Internal consistency, criterion validity, construct validity and sensitivity of the scale to changes in symptom severity were evaluated in this study. The scale was administered to 282 teachers of children and adolescents aged 5 to 17 years who came to a unit specialized in child psychiatry. The validity analysis of the instrument showed that the internal consistency measured by Cronbach's alpha was 0.94. The factorial analysis yielded 5 factors accounting for 59.1% of the variance: hyperactivity and conduct symptoms, predatory, conduct disorder, inattentive, poor functioning and motor disturbances. The CPHTQ scores on the scale showed positive correlation with the Clinical Global impression (CGI) scale in the patients' response to drug treatment. The CPHTQ shows adequate validity characteristics that demonstrate its utility in the evaluation of patients with ADHD and its comorbidity with other behavior disorders.

The adaptation of the Sheffield Profile for Assessment and Referral for Care (SPARC) to the Polish clinical setting for needs assessment of advanced cancer patients.

PubMed

Leppert, Wojciech; Majkowicz, Mikolaj; Ahmedzai, Sam H

2012-12-01

Assessment of the needs of advanced cancer patients is a very important issue in palliative care. The aim of the study was to adapt the Sheffield Profile for Assessment and Referral for Care (SPARC) to the Polish environment and evaluate its usefulness in needs assessment of patients with advanced cancer. A forward-back translation of the SPARC to Polish was done. The SPARC was used once in 58 consecutive patients with advanced cancer during follow-up. The patients were enrolled from a palliative care unit (25 patients), home care (18 patients), and a day care center (15 patients). The reliability was evaluated by establishing the internal consistency using Cronbach's alpha coefficients. Content validity was analyzed in accordance with the theories of needs by Murray and Maslow as a nonstatistical method of validity assessment. Factor analysis with principal components extraction and varimax rotation of raw data was used to reduce the set of data and assess the construct validity. There were differences regarding religious and spiritual issues and independence and activity between patients in the palliative care unit (worse results) and those at the day care center (better scores). Communication and need for more information items were associated with psychological, social, spiritual, and treatment issues. Cronbach's alpha coefficients and factor analysis demonstrated, respectively, satisfactory reliability and construct validity of the tool. The study demonstrated that the Polish version of the SPARC is a valid and reliable tool recommended for the needs assessment and symptom evaluation of patients with advanced cancer. Copyright © 2012 U.S. Cancer Pain Relief Committee. Published by Elsevier Inc. All rights reserved.

Translation, Cross-Cultural Adaptation, and Validation of the Activity Rating Scale for Disorders of the Knee.

PubMed

Flosadottir, Vala; Roos, Ewa M; Ageberg, Eva

2017-09-01

The Activity Rating Scale (ARS) for disorders of the knee evaluates the level of activity by the frequency of participation in 4 separate activities with high demands on knee function, with a score ranging from 0 (none) to 16 (pivoting activities 4 times/wk). To translate and cross-culturally adapt the ARS into Swedish and to assess measurement properties of the Swedish version of the ARS. Cohort study (diagnosis); Level of evidence, 2. The COSMIN guidelines were followed. Participants (N = 100 [55 women]; mean age, 27 years) who were undergoing rehabilitation for a knee injury completed the ARS twice for test-retest reliability. The Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale (TAS), and modernized Saltin-Grimby Physical Activity Level Scale (SGPALS) were administered at baseline to validate the ARS. Construct validity and responsiveness of the ARS were evaluated by testing predefined hypotheses regarding correlations between the ARS, KOOS, TAS, and SGPALS. The Cronbach alpha, intraclass correlation coefficients, absolute reliability, standard error of measurement, smallest detectable change, and Spearman rank-order correlation coefficients were calculated. The ARS showed good internal consistency (α ≈ 0.96), good test-retest reliability (intraclass correlation coefficient >0.9), and no systematic bias between measurements. The standard error of measurement was less than 2 points, and the smallest detectable change was less than 1 point at the group level and less than 5 points at the individual level. More than 75% of the hypotheses were confirmed, indicating good construct validity and good responsiveness of the ARS. The Swedish version of the ARS is valid, reliable, and responsive for evaluating the level of activity based on the frequency of participation in high-demand knee sports activities in young adults with a knee injury.

Development and validation of an instrument for rapidly assessing symptoms: the general symptom distress scale.

PubMed

Badger, Terry A; Segrin, Chris; Meek, Paula

2011-03-01

Symptom assessment has increasingly focused on the evaluation of total symptom distress or burden rather than assessing only individual symptoms. The challenge for clinicians and researchers alike is to assess symptoms, and to determine the symptom distress associated with the symptoms and the patient's ability for symptom management without a lengthy and burdensome assessment process. The objective of this article was to discuss the psychometric evaluation of a brief general symptom distress scale (GSDS) developed to assess specific symptoms and how they rank in relation to each other, the overall symptom distress associated with the symptom schema, and provide an assessment of how well or poorly that symptom schema is managed. Results from a pilot study about the initial development of the GSDS with 76 hospitalized patients are presented, followed by a more complete psychometric evaluation of the GSDS using three samples of cancer patients (n=190) and their social network members, called partners in these studies (n=94). Descriptive statistics were used to describe the GSDS symptoms, symptom distress, and symptom management. Point biserial correlations indexed the associations between dichotomous symptoms and continuous measures, and conditional probabilities were used to illustrate the substantial comorbidities of this sample. Internal consistency was examined using the KR-20 coefficient, and test-retest reliability was examined. Construct validity and predictive validity also were examined. The GSDS demonstrated satisfactory internal consistency and test-retest reliability, and good construct validity and predictive validity. The total score on the GSDS, symptom distress, and symptom management correlated significantly with related constructs of depression, positive and negative affect, and general health. The GSDS was able to demonstrate its ability to distinguish between those with or without chronic illness, and was able to significantly predict scores on criterion measures such as depression. Collectively, these results suggest that the GSDS is a straightforward and useful instrument for rapidly assessing symptoms that can disrupt health-related quality of life. Copyright © 2011 U.S. Cancer Pain Relief Committee. Published by Elsevier Inc. All rights reserved.

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct validity. Factor analysis demonstrated that patient care is a distinct domain in surgical skill. Although the interobserver reliability for some patient care items reached statistical significance, it was not high enough for "high stakes testing" purposes. Using reliability and factor analysis results, we propose a simplified instrument for use in evaluating trainees in otolaryngologic surgery.

Validation of a Spanish version of the psychological inflexibility in pain scale (PIPS) and an evaluation of its relation with acceptance of pain and mindfulness in sample of persons with fibromyalgia

PubMed Central

2013-01-01

Background Psychological flexibility has been suggested as a fundamental process in health. The Psychological Inflexibility in Pain Scale (PIPS) is one of the scales employed for assessing psychological inflexibility in pain patients. The aim of this study was to validate the Spanish version of the PIPS and secondly, to compare it to two other psychological constructs, the acceptance of pain and mindfulness scales. Methods The PIPS was translated into Spanish by two bilingual linguistic experts, and then, back-translated into English to assess for equivalence. The final Spanish version was administered along with the Pain Visual Analogue Scale, Fibromyalgia Impact Questionnaire, Hospital Anxiety Depression Scale, Pain Catastrophizing Scale, Chronic Pain Acceptance Questionnaire and the Mindful Attention Awareness Scale, to 250 Spanish patients with fibromyalgia. Face validity, construct validity, reliability (internal consistency and test-retest) and convergent validity were tested. Also a multiple regression analysis was carried out.The usual guidelines have been followed for cross-cultural adaptations. Results Data were very similar to the ones obtained in the original PIPS version. The construct validity confirmed the original two-components solution which explained 61.6% of the variance. The Spanish PIPS had good test-retest reliability (intraclass correlation coefficient 0.97) and internal consistency reliability (Cronbach’s alpha: 0.90). The Spanish PIPS’ score correlated significantly with worse global functioning (r = 0.55), anxiety (r = 0.54), depression (r = 0.66), pain catastrophizing (r = 0.62), pain acceptance (r = −0.72) and mindfulness (r = −0.47), as well as correlating modestly with pain intensity (r = 0.12). The multiple regression analyses showed that psychological inflexibility, acceptance and mindfulness are not overlapped. Conclusions The Spanish PIPS scale appears to be a valid and reliable instrument for the evaluation of psychological inflexibility among a sample of fibromyalgia patients. These results ensure the use of this scale in research as well as in clinical practice. Psychological inflexibility measures processes different from other related components such as acceptance and mindfulness. PMID:23594367

The Dutch Review Process for Evaluating the Quality of Psychological Tests: History, Procedure, and Results

ERIC Educational Resources Information Center

Evers, Arne; Sijtsma, Klaas; Lucassen, Wouter; Meijer, Rob R.

2010-01-01

This article describes the 2009 revision of the Dutch Rating System for Test Quality and presents the results of test ratings from almost 30 years. The rating system evaluates the quality of a test on seven criteria: theoretical basis, quality of the testing materials, comprehensiveness of the manual, norms, reliability, construct validity, and…

Lost in Translation? Psychometric Properties and Construct Validity of the English Essen Climate Evaluation Schema (EssenCES) Social Climate Questionnaire

ERIC Educational Resources Information Center

Tonkin, Matthew; Howells, Kevin; Ferguson, Eamonn; Clark, Amanda; Newberry, Michelle; Schalast, Norbert

2012-01-01

The social climate of correctional (forensic) settings is likely to have a significant impact on the outcome of treatment and the overall functioning of these units. The Essen Climate Evaluation Schema (EssenCES) provides an objective way of measuring social climate that overcomes the content, length, and psychometric limitations of other…

Differences in How Mothers and Fathers Monitor Sugar-Sweetened Beverages for Their Young Children (7-12 Years)

ERIC Educational Resources Information Center

Branscum, Paul; Housely, Alexandra

2018-01-01

The purpose of this study was to evaluate differences between how mothers and fathers monitor their children's sugar-sweetened beverages (SSBs; 7-12 years) using constructs from the integrated behavioral model (IBM). Mothers (n = 167) and fathers (n = 117) completed a valid and reliable survey evaluating the extent that they monitored their…

Development of the SIT, an Instrument to Evaluate the Transfer Effects of Adult Education Programs for Social Inclusion

ERIC Educational Resources Information Center

de Greef, Maurice; Segers, Mien; Verte, Dominique

2010-01-01

To date, hardly any evidence is available on the quality of adult education programs for vulnerable adults. Evaluation instruments or models mostly focussed on regular education and less on programs of adult education aiming to enhance social inclusion. This study presents a first exploration of the construct validity of a newly developed…

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Instruments to identify prescription medication misuse, abuse, and related events in clinical trials: an ACTTION systematic review

PubMed Central

Smith, Shannon M.; Paillard, Florence; McKeown, Andrew; Burke, Laurie B.; Edwards, Robert R.; Katz, Nathaniel P.; Papadopoulos, Elektra J.; Rappaport, Bob A.; Slagle, Ashley; Strain, Eric C.; Wasan, Ajay D.; Turk, Dennis C.; Dworkin, Robert H.

2017-01-01

Measurement of inappropriate medication use events (e.g., abuse, misuse) in clinical trials is important in characterizing a medication’s abuse potential. However, no “gold standard” assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (i.e., content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and non-opioid prescription medications to identify any that meet U.S. and European regulatory agencies’ rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the lifespan rather than current use, including items that did not directly assess inappropriate use (e.g., questions about anger), or failing to capture information pertinent to inappropriate use events (e.g., intention, route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, non-standardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. PMID:25660826

Constructal thermodynamics combined with infrared experiments to evaluate temperature differences in cells

PubMed Central

Lucia, Umberto; Grazzini, Giuseppe; Montrucchio, Bartolomeo; Grisolia, Giulia; Borchiellini, Romano; Gervino, Gianpiero; Castagnoli, Carlotta; Ponzetto, Antonio; Silvagno, Francesca

2015-01-01

The aim of this work was to evaluate differences in energy flows between normal and immortalized cells when these distinct biological systems are exposed to environmental stimulation. These differences were considered using a constructal thermodynamic approach, and were subsequently verified experimentally. The application of constructal law to cell analysis led to the conclusion that temperature differences between cells with distinct behaviour can be amplified by interaction between cells and external fields. Experimental validation of the principle was carried out on two cellular models exposed to electromagnetic fields. By infrared thermography we were able to assess small changes in heat dissipation measured as a variation in cell internal energy. The experimental data thus obtained are in agreement with the theoretical calculation, because they show a different thermal dispersion pattern when normal and immortalized cells are exposed to electromagnetic fields. By using two methods that support and validate each other, we have demonstrated that the cell/environment interaction can be exploited to enhance cell behavior differences, in particular heat dissipation. We propose infrared thermography as a technique effective in discriminating distinct patterns of thermal dispersion and therefore able to distinguish a normal phenotype from a transformed one. PMID:26100383

Constructal thermodynamics combined with infrared experiments to evaluate temperature differences in cells.

PubMed

Lucia, Umberto; Grazzini, Giuseppe; Montrucchio, Bartolomeo; Grisolia, Giulia; Borchiellini, Romano; Gervino, Gianpiero; Castagnoli, Carlotta; Ponzetto, Antonio; Silvagno, Francesca

2015-06-23

The aim of this work was to evaluate differences in energy flows between normal and immortalized cells when these distinct biological systems are exposed to environmental stimulation. These differences were considered using a constructal thermodynamic approach, and were subsequently verified experimentally. The application of constructal law to cell analysis led to the conclusion that temperature differences between cells with distinct behaviour can be amplified by interaction between cells and external fields. Experimental validation of the principle was carried out on two cellular models exposed to electromagnetic fields. By infrared thermography we were able to assess small changes in heat dissipation measured as a variation in cell internal energy. The experimental data thus obtained are in agreement with the theoretical calculation, because they show a different thermal dispersion pattern when normal and immortalized cells are exposed to electromagnetic fields. By using two methods that support and validate each other, we have demonstrated that the cell/environment interaction can be exploited to enhance cell behavior differences, in particular heat dissipation. We propose infrared thermography as a technique effective in discriminating distinct patterns of thermal dispersion and therefore able to distinguish a normal phenotype from a transformed one.

Evaluation of an immunosuppressant side effect instrument.

PubMed

Winsett, Rebecca P; Arheart, Kris; Stratta, Robert J; Alloway, Rita; Wicks, Mona N; Gaber, A Osama; Hathaway, Donna K

2004-09-01

Clinicians continue to be compelled to evaluate the impact of immunosuppressive medication side effects on the quality of life of transplant recipients. We Were asked to develop an instrument to measure side effects in immunosuppressed transplant recipients. To construct an instrument that measures the impact and severity of side effects of immunosuppressive medications used in transplantation and to assess the reliability and validity of the newly developed instrument called the Memphis Survey. The instrument was constructed by a panel of physicians, nurses, and pharmacists with experience in treating transplant recipients. A small group of kidney transplant recipients (n= 13) provided pilot data for refining and testing the instrument. A national sample of kidney, liver, and heart transplant recipients (n = 505) provided data that were used to further develop the instrument. Factor analysis was used to determine the psychological dimensions underlying the instrument and to guide the construction of scales from the survey items. The instrument scales were then computed from the dataset of 505 transplant recipients to quantify the impact of immunosuppressant side effects on the quality of life of transplant recipients. Analyses showed the final instrument scales to be valid and reliable. Exploratory analysis suggests the need for further testing of the instrument to determine gender differences.

Comparison of the goals and MISTELS scores for the evaluation of surgeons on training benches.

PubMed

Wolf, Rémi; Medici, Maud; Fiard, Gaëlle; Long, Jean-Alexandre; Moreau-Gaudry, Alexandre; Cinquin, Philippe; Voros, Sandrine

2018-01-01

Evaluation of surgical technical abilities is a major issue in minimally invasive surgery. Devices such as training benches offer specific scores to evaluate surgeons but cannot transfer in the operating room (OR). A contrario, several scores measure performance in the OR, but have not been evaluated on training benches. Our aim was to demonstrate that the GOALS score, which can effectively grade in the OR the abilities involved in laparoscopy, can be used for evaluation on a laparoscopic testbench (MISTELS). This could lead to training systems that can identify more precisely the skills that have been acquired or must still be worked on. 32 volunteers (surgeons, residents and medical students) performed the 5 tasks of the MISTELS training bench and were simultaneously video-recorded. Their performance was evaluated with the MISTELS score and with the GOALS score based on the review of the recording by two experienced, blinded laparoscopic surgeons. The concurrent validity of the GOALS score was assessed using Pearson and Spearman correlation coefficients with the MISTELS score. The construct validity of the GOALS score was assessed with k-means clustering and accuracy rates. Lastly, abilities explored by each MISTELS task were identified with multiple linear regression. GOALS and MISTELS scores are strongly correlated (Pearson correlation coefficient = 0.85 and Spearman correlation coefficient = 0.82 for the overall score). The GOALS score proves to be valid for construction for the tasks of the training bench, with a better accuracy rate between groups of level after k-means clustering, when compared to the original MISTELS score (accuracy rates, respectively, 0.75 and 0.56). GOALS score is well suited for the evaluation of the performance of surgeons of different levels during the completion of the tasks of the MISTELS training bench.

Prospective safety performance evaluation on construction sites.

PubMed

Wu, Xianguo; Liu, Qian; Zhang, Limao; Skibniewski, Miroslaw J; Wang, Yanhong

2015-05-01

This paper presents a systematic Structural Equation Modeling (SEM) based approach for Prospective Safety Performance Evaluation (PSPE) on construction sites, with causal relationships and interactions between enablers and the goals of PSPE taken into account. According to a sample of 450 valid questionnaire surveys from 30 Chinese construction enterprises, a SEM model with 26 items included for PSPE in the context of Chinese construction industry is established and then verified through the goodness-of-fit test. Three typical types of construction enterprises, namely the state-owned enterprise, private enterprise and Sino-foreign joint venture, are selected as samples to measure the level of safety performance given the enterprise scale, ownership and business strategy are different. Results provide a full understanding of safety performance practice in the construction industry, and indicate that the level of overall safety performance situation on working sites is rated at least a level of III (Fair) or above. This phenomenon can be explained that the construction industry has gradually matured with the norms, and construction enterprises should improve the level of safety performance as not to be eliminated from the government-led construction industry. The differences existing in the safety performance practice regarding different construction enterprise categories are compared and analyzed according to evaluation results. This research provides insights into cause-effect relationships among safety performance factors and goals, which, in turn, can facilitate the improvement of high safety performance in the construction industry. Copyright © 2015 Elsevier Ltd. All rights reserved.

Develop nondestructive rapid pavement quality assurance/quality control evaluation test methods and supporting technology : project summary.

DOT National Transportation Integrated Search

2017-01-01

The findings from the proof of concept with mechanics-based models for flexible base suggest additional validation work should be performed, draft construction specification frameworks should be developed, and work extending the technology to stabili...

Develop nondestructive rapid pavement quality Assurance/quality control evaluation test methods and supporting technology : project summary.

DOT National Transportation Integrated Search

2017-01-01

The findings from the proof of concept with mechanics-based models for flexible base suggest additional validation work should be performed, draft construction specification frameworks should be developed, and work extending the technology to stabili...

Construct validity test of evaluation tool for professional behaviors of entry-level occupational therapy students in the United States.

PubMed

Yuen, Hon K; Azuero, Andres; Lackey, Kaitlin W; Brown, Nicole S; Shrestha, Sangita

2016-01-01

This study aimed to test the construct validity of an instrument to measure student professional behaviors in entry-level occupational therapy (OT) students in the academic setting. A total of 718 students from 37 OT programs across the United States answered a self-assessment survey of professional behavior that we developed. The survey consisted of ranking 28 attributes, each on a 5-point Likert scale. A split-sample approach was used for exploratory and then confirmatory factor analysis. A three-factor solution with nine items was extracted using exploratory factor analysis [EFA] (n=430, 60%). The factors were 'Commitment to Learning' (2 items), 'Skills for Learning' (4 items), and 'Cultural Competence' (3 items). Confirmatory factor analysis (CFA) on the validation split (n=288, 40%) indicated fair fit for this three-factor model (fit indices: CFI=0.96, RMSEA=0.06, and SRMR=0.05). Internal consistency reliability estimates of each factor and the instrument ranged from 0.63 to 0.79. Results of the CFA in a separate validation dataset provided robust measures of goodness-of-fit for the three-factor solution developed in the EFA, and indicated that the three-factor model fitted the data well enough. Therefore, we can conclude that this student professional behavior evaluation instrument is a structurally validated tool to measure professional behaviors reported by entry-level OT students. The internal consistency reliability of each individual factor and the whole instrument was considered to be adequate to good.

Developing and validating a nutrition knowledge questionnaire: key methods and considerations.

PubMed

Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina

2017-10-01

To outline key statistical considerations and detailed methodologies for the development and evaluation of a valid and reliable nutrition knowledge questionnaire. Literature on questionnaire development in a range of fields was reviewed and a set of evidence-based guidelines specific to the creation of a nutrition knowledge questionnaire have been developed. The recommendations describe key qualitative methods and statistical considerations, and include relevant examples from previous papers and existing nutrition knowledge questionnaires. Where details have been omitted for the sake of brevity, the reader has been directed to suitable references. We recommend an eight-step methodology for nutrition knowledge questionnaire development as follows: (i) definition of the construct and development of a test plan; (ii) generation of the item pool; (iii) choice of the scoring system and response format; (iv) assessment of content validity; (v) assessment of face validity; (vi) purification of the scale using item analysis, including item characteristics, difficulty and discrimination; (vii) evaluation of the scale including its factor structure and internal reliability, or Rasch analysis, including assessment of dimensionality and internal reliability; and (viii) gathering of data to re-examine the questionnaire's properties, assess temporal stability and confirm construct validity. Several of these methods have previously been overlooked. The measurement of nutrition knowledge is an important consideration for individuals working in the nutrition field. Improved methods in the development of nutrition knowledge questionnaires, such as the use of factor analysis or Rasch analysis, will enable more confidence in reported measures of nutrition knowledge.

Preliminary data on validity of the Drug Addiction Treatment Efficacy Questionnaire.

PubMed

Kastelic, Andrej; Mlakar, Janez; Pregelj, Peter

2013-09-01

This study describes the validation process for the Slovenian version of the Drug Addiction Treatment Efficacy Questionnaire (DATEQ). DATEQ was constructed from the questionnaires used at the Centre for the Treatment of Drug Addiction, Ljubljana University Psychiatric Hospital, and within the network of Centres for the Prevention and Treatment of Drug Addiction in Slovenia during the past 14 years. The Slovenian version of the DATEQ was translated to English using the 'forward-backward' procedure by its authors and their co-workers. The validation process included 100 male and female patients with established addiction to illicit drugs who had been prescribed opioid substitution therapy. The DATEQ questionnaire was used in the study, together with clinical evaluation to measure psychological state and to evaluate the efficacy of treatment in the last year. To determinate the validity of DATEQ the correlation with the clinical assessments of the outcome was calculated using one-way ANOVA. The F value was 44.4, p<0.001 (sum of squares: between groups 210.4, df=2, within groups 229.7, df=97, total 440.1, df=99). At the cut-off 4 the sensitivity is 81% and specificity 83%. The validation process for the Slovenian DATEQ version shows metric properties similar to those found in international studies of similar questionnaires, suggesting that it measures the same constructs, in the same way and as similar questionnaires. However, the relatively low sensitivity and specificity suggests caution when using DATEQ as the only measure of outcome.

Cross-cultural adaptation and clinimetric property of Korean version of the Chronic Pain Coping Inventory-42 in patients with chronic low back pain.

PubMed

Ko, Young-Mi; Park, Won-Beom; Lim, Jae-Young

2010-03-15

Validation of a translated, culturally adapted questionnaire. We developed a Korean version of the Chronic Pain Coping Inventory-42 (CPCI-42) by performing a cross-cultural adaptation, and evaluated its reliability and validity. The CPCI is widely used and validated instruments for measuring coping strategies in chronic pain. However, no validated and culturally adapted version was available in Asian countries. We assessed 142 patients with chronic low back pain using the CPCI-42 and measures of physical disability, pain, and quality of life. Results for 93 of the 142 patients exhibited test-retest reliability. The interval time of collecting retest data varied from 2 weeks to 1 month. Criterion validity was evaluated using correlations between the CPCI-42 and the Oswestry Disability Index, the Brief Pain Inventory, and the Short Form 36-item Health Survey (version 2.0). Construct validity was computed using exploratory factor analysis. The Korean version of the CPCI-42 had a high internal consistency (Cronbach's alpha >0.70) with the exception of results for task persistence and relaxation. Illness-focused coping (guarding, resting, asking for assistance) and other-focused coping (seeking social support) were most significantly correlated with Oswestry Disability Index, Brief Pain Inventory, and Short Form 36-item Health Survey, respectively. Outcomes for task persistence were contrary to other subscales in wellness-focused coping. Construct validity by factor analysis produced similar results to the original CPCI subscale. However, several factors showed cross-loading in 8 factor solutions. Despite linguistic and cultural differences, the Korean version of the CPCI-42 is overall a meaningful tool, and produces results sufficiently similar to the original CPCI-42.

Measurement Properties of the Persian Translated Version of Graves Orbitopathy Quality of Life Questionnaire: A Validation Study.

PubMed

Kashkouli, Mohsen Bahmani; Karimi, Nasser; Aghamirsalim, Mohamadreza; Abtahi, Mohammad Bagher; Nojomi, Marzieh; Shahrad-Bejestani, Hadi; Salehi, Masoud

2017-02-01

To determine the measurement properties of the Persian language version of the Graves orbitopathy quality of life questionnaire (GO-QOL). Following a systematic translation and cultural adaptation process, 141 consecutive unselected thyroid eye disease (TED) patients answered the Persian GO-QOL and underwent complete ophthalmic examination. The questionnaire was again completed by 60 patients on the second visit, 2-4 weeks later. Construct validity (cross-cultural validity, structural validity and hypotheses testing), reliability (internal consistency and test-retest reliability), and floor and ceiling effects of the Persian version of the GO-QOL were evaluated. Furthermore, Rasch analysis was used to assess its psychometric properties. Cross-cultural validity was established by back-translation techniques, committee review and pretesting techniques. Bi-dimensionality of the questionnaire was confirmed by factor analysis. Construct validity was also supported through confirmation of 6 out of 8 predefined hypotheses. Cronbach's α and intraclass correlation coefficient (ICC) were 0.650 and 0.859 for visual functioning and 0.875 and 0.896 for appearance subscale, respectively. Mean quality of life (QOL) scores for visual functioning and appearance were 78.18 (standard deviation, SD, 21.57) and 56.25 (SD 26.87), respectively. Person reliabilities from the Rasch rating scale model for both visual functioning and appearance revealed an acceptable internal consistency for the Persian GO-QOL. The Persian GO-QOL questionnaire is a valid and reliable tool with good psychometric properties in evaluation of Persian-speaking patients with TED. Applying Rasch analysis to future versions of the GO-QOL is recommended in order to perform tests for linearity between the estimated item measures in different versions.

Development and validation of the Multidimensional Home Environment Scale (MHES) for adolescents and their mothers.

PubMed

Tabbakh, Tamara; Freeland-Graves, Jeanne

2016-08-01

The home environment is an important setting for the development of weight status in adolescence. At present a limited number of valid and reliable tools are available to evaluate the weight-related comprehensive home environment of this population. The goal of this research was to develop the Multidimensional Home Environment Scale which measures multiple components of the home. It includes psychological, social, and environmental domains from the perspective of an adolescent and the mother. Items were generated based on a literature review and then assessed for content validity by an expert panel and focus group in the target population. Internal consistency reliability was determined using Cronbach's α. Principal components analysis with varimax rotation was employed for assessment of construct validity. Temporal stability was evaluated using paired sample t-tests and bivariate correlations between responses at two different times, 1-2weeks apart. Associations between adolescent and mother responses were utilized for convergent validity. The final versions contained 32-items for adolescents and 36-items for mothers; these were administered to 218 adolescents and mothers. The subscales on the questionnaires exhibited high construct validity, internal consistency reliability (adolescent: α=0.82, mother: α=0.83) and test-retest reliability (adolescent: r=0.90, p<0.01; mother: r=0.91, p<0.01). Total home environment scores were computed, with greater scores reflecting a better health environment. These results verify the utility of the MHES as a valid and reliable instrument. This promising tool can be utilized to capture the comprehensive home environment of young adolescents (11-14years old). Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating process in child and family interventions: aggression prevention as an example.

PubMed

Tolan, Patrick H; Hanish, Laura D; McKay, Mary M; Dickey, Mitchell H

2002-06-01

This article reports on 2 studies designed to develop and validate a set of measures for use in evaluating processes of child and family interventions. In Study 1 responses from 187 families attending an outpatient clinic for child behavior problems were factor analyzed to identify scales, consistent across sources: Alliance (Satisfactory Relationship with Interventionist and Program Satisfaction), Parenting Skill Attainment, Child Cooperation During Session, Child Prosocial Behavior, and Child Aggressive Behavior. Study 2 focused on patterns of scale scores among 78 families taking part in a 22-week preventive intervention designed to affect family relationships, parenting, and child antisocial and prosocial behaviors. The factor structure identified in Study 1 was replicated. Scale construct validity was demonstrated through across-source convergence, sensitivity to intervention change, and ability to discriminate individual differences. Path analysis validated the scales' utility in explaining key aspects of the intervention process. Implications for evaluating processes in family interventions are discussed.

Validation of the respiratory toxics exposure score (RTES) for chronic obstructive pulmonary disease screening.

PubMed

Salameh, Pascale; Khayat, Georges; Waked, Mirna

2011-12-01

Our aim is to evaluate the validity of exhaled carbon monoxide (CO) and of a newly-created score as markers of Chronic Obstructive Pulmonary Disease (COPD). The CO level was measured in a derivation subsample of a cross-sectional study and linked to COPD diagnosis; its predictors were evaluated, and a scale was constructed. It was evaluated in a validation subsample and in a clinical setting. Individuals with COPD had higher CO levels than healthy individuals. CO level significant predictors were cigarettes per day, waterpipes per week, lower age, male gender, living close to diesel exhaust, heating home with the use of diesel, and having indoor family smokers. A score composed of CO predictors was able to significantly predict COPD (Ora = 4-7.5). Coupled with the clinical judgment of physicians, this scale would be an excellent low-cost tool for screening COPD, in absence of spirometry.

Psychometric Evaluation of the Patient Health Questionnaire–4 in Hispanic Americans

PubMed Central

Mills, Sarah D.; Fox, Rina S.; Pan, Tonya M.; Malcarne, Vanessa L.; Roesch, Scott C.; Sadler, Georgia Robins

2017-01-01

The present study evaluated the psychometric properties of the Patient Health Questionnaire-4 (PHQ-4), a screener of psychological distress, in English- and Spanish-speaking Hispanic Americans. Hispanic American adults (N = 436) completed the PHQ-4, which yields two subscales (anxiety and depression) that can be summed to create a total score. Multiple-group confirmatory factor analysis was used to evaluate structural validity. The two-factor structure was the best fit to the data for both English- and Spanish-speaking Hispanic Americans and items loaded equivalently across groups, demonstrating measurement invariance. Internal consistency reliability was good as measured by coefficient alpha. Construct validity was evidenced by significant expected relationships with perceived stress. These findings provide support for the reliability and validity of the PHQ-4 as a brief measure of psychological distress for English- or Spanish-speaking Hispanic Americans. PMID:29097834

Validation of Multilevel Constructs: Validation Methods and Empirical Findings for the EDI

ERIC Educational Resources Information Center

Forer, Barry; Zumbo, Bruno D.

2011-01-01

The purposes of this paper are to highlight the foundations of multilevel construct validation, describe two methodological approaches and associated analytic techniques, and then apply these approaches and techniques to the multilevel construct validation of a widely-used school readiness measure called the Early Development Instrument (EDI;…

Mindfulness: A systematic review of instruments to measure an emergent patientreported outcome (PRO)

PubMed Central

Park, Taehwan; Reilly-Spong, Maryanne

2013-01-01

Purpose Mindfulness has emerged as an important health concept based on evidence that mindfulness interventions reduce symptoms and improve health-related quality of life. The objectives of this study were to systematically assess and compare the properties of instruments to measure self-reported mindfulness. Methods Ovid Medline®, CINAHL®, and PsycINFO® were searched through May 2012, and articles were selected if their primary purpose was development or evaluation of the measurement properties (validity, reliability, responsiveness) of a self-report mindfulness scale. Two reviewers independently evaluated the methodological quality of the selected studies using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. Discrepancies were discussed with a third reviewer, and scored by consensus. Finally, a level of evidence approach was used to synthesize results and study quality. Results Our search strategy identified a total of 2,588 articles. Forty-six articles, reporting 79 unique studies, met inclusion criteria. Ten instruments quantifying mindfulness as a unidimensional scale (n=5) or as a set of 2 to 5 subscales (n=5) were reviewed. The Mindful Attention Awareness Scale (MAAS) was evaluated by the most studies (n=27), and had positive overall quality ratings for most of the psychometric properties reviewed. The Five Facet Mindfulness Questionnaire (FFMQ) received the highest possible rating (“consistent findings in multiple studies of good methodological quality”) for two properties, internal consistency and construct validation by hypothesis testing. However, none of the instruments had sufficient evidence of content validity. Comprehensiveness of construct coverage had not been assessed; qualitative methods to confirm understanding and relevance were absent. In addition, estimates of test-retest reliability, responsiveness, or measurement error to guide users in protocol development or interpretation of scores were lacking. Conclusions Current mindfulness scales have important conceptual differences, and none can be strongly recommended based solely on superior psychometric properties. Important limitations in the field are the absence of qualitative evaluations and accepted external referents to support construct validity. Investigators need to proceed cautiously before optimizing any mindfulness intervention based on the existing scales. PMID:23539467

Construction of the descriptive system for the assessment of quality of life AQoL-6D utility instrument

PubMed Central

2012-01-01

Background Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument. Methods The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements. Results and Discussion The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model. Conclusions The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs. PMID:22507254

Construction of the descriptive system for the Assessment of Quality of Life AQoL-6D utility instrument.

PubMed

Richardson, Jeffrey R J; Peacock, Stuart J; Hawthorne, Graeme; Iezzi, Angelo; Elsworth, Gerald; Day, Neil A

2012-04-17

Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument. The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements. The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model. The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs.

Validity and reliability of an application review process using dedicated reviewers in one stage of a multi-stage admissions model.

PubMed

Zeeman, Jacqueline M; McLaughlin, Jacqueline E; Cox, Wendy C

2017-11-01

With increased emphasis placed on non-academic skills in the workplace, a need exists to identify an admissions process that evaluates these skills. This study assessed the validity and reliability of an application review process involving three dedicated application reviewers in a multi-stage admissions model. A multi-stage admissions model was utilized during the 2014-2015 admissions cycle. After advancing through the academic review, each application was independently reviewed by two dedicated application reviewers utilizing a six-construct rubric (written communication, extracurricular and community service activities, leadership experience, pharmacy career appreciation, research experience, and resiliency). Rubric scores were extrapolated to a three-tier ranking to select candidates for on-site interviews. Kappa statistics were used to assess interrater reliability. A three-facet Many-Facet Rasch Model (MFRM) determined reviewer severity, candidate suitability, and rubric construct difficulty. The kappa statistic for candidates' tier rank score (n = 388 candidates) was 0.692 with a perfect agreement frequency of 84.3%. There was substantial interrater reliability between reviewers for the tier ranking (kappa: 0.654-0.710). Highest construct agreement occurred in written communication (kappa: 0.924-0.984). A three-facet MFRM analysis explained 36.9% of variance in the ratings, with 0.06% reflecting application reviewer scoring patterns (i.e., severity or leniency), 22.8% reflecting candidate suitability, and 14.1% reflecting construct difficulty. Utilization of dedicated application reviewers and a defined tiered rubric provided a valid and reliable method to effectively evaluate candidates during the application review process. These analyses provide insight into opportunities for improving the application review process among schools and colleges of pharmacy. Copyright © 2017 Elsevier Inc. All rights reserved.

Measuring the Sensitivity and Construct Validity of 6 Utility Instruments in 7 Disease Areas.

PubMed

Richardson, Jeff; Iezzi, Angelo; Khan, Munir A; Chen, Gang; Maxwell, Aimee

2016-02-01

Health services that affect quality of life (QoL) are increasingly evaluated using cost utility analyses (CUA). These commonly employ one of a small number of multiattribute utility instruments (MAUI) to assess the effects of the health service on utility. However, the MAUI differ significantly, and the choice of instrument may alter the outcome of an evaluation. The present article has 2 objectives: 1) to compare the results of 3 measures of the sensitivity of 6 MAUI and the results of 6 tests of construct validity in 7 disease areas and 2) to rank the MAUI by each of the test results in each disease area and by an overall composite index constructed from the tests. Patients and the general public were administered a battery of instruments, which included the 6 MAUI, disease-specific QoL instruments (DSI), and 6 other comparator instruments. In each disease area, instrument sensitivity was measured 3 ways: by the unadjusted mean difference in utility between public and patient groups, by the value of the effect size, and by the correlation between MAUI and DSI scores. Content and convergent validity were tested by comparison of MAUI utilities and scores from the 6 comparator instruments. These included 2 measures of health state preferences, measures of subjective well-being and capabilities, and generic measures of physical and mental QoL derived from the SF-36. The apparent sensitivity of instruments varied significantly with the measurement method and by disease area. Validation test results varied with the comparator instruments. Notwithstanding this variability, the 15D, AQoL-8D, and the SF-6D generally achieved better test results than the QWB and EQ-5D-5L. © The Author(s) 2015.

Construct Validity of the Spanish Versions of the Memorial Symptom Assessment Scale Short Form and Condensed Form: Rasch Analysis of Responses in Oncology Outpatients.

PubMed

Llamas-Ramos, Inés; Llamas-Ramos, Rocío; Buz, José; Cortés-Rodríguez, María; Martín-Nogueras, Ana María

2018-06-01

The Memorial Symptom Assessment Scale (MSAS) is a self-rating instrument for the assessment of symptom distress in cancer patients. The Spanish version of the MSAS has recently been validated. However, we lack evidence of the internal construct validity of the shorter versions (short form [MSAS-SF] and condensed form [CMSAS]). In addition, rigorous testing of these scales with modern psychometric methods is needed. The aim of this study was to evaluate the internal construct validity and reliability of the Spanish versions of the MSAS-SF and CMSAS in oncology outpatients using Rasch analysis. Data from a convenience sample of oncology outpatients receiving chemotherapy (n = 306; mean age 60 years; 63% women) at a university hospital were analyzed. The Rasch unidimensional measurement model was used to examine response category functioning, item hierarchy, targeting, unidimensionality, reliability, and differential item functioning by age, gender, and marital status. The response category structure of the symptom distress items was improved by collapsing two categories. The scales were adequately targeted to the study patients, showed overall Rasch model fit (mean Infit MnSq ranged from 0.98 to 1.05), met criteria for unidimensionality, and the reliability of scores was good (person reliability > 0.80), except for the CMSAS prevalence scale. Only four items showed differential item functioning. The present study demonstrated that the Spanish versions of the MSAS-SF and CMSAS have adequate psychometric properties to evaluate symptom distress in oncology outpatients. Additional studies of the CMSAS are recommended. Copyright © 2018 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric properties of self-reported questionnaires for the evaluation of symptoms and functional limitations in individuals with rotator cuff disorders: a systematic review.

PubMed

St-Pierre, Corinne; Desmeules, François; Dionne, Clermont E; Frémont, Pierre; MacDermid, Joy C; Roy, Jean-Sébastien

2016-01-01

To conduct a systematic review of the psychometric properties (reliability, validity and responsiveness) of self-report questionnaires used to assess symptoms and functional limitations of individuals with rotator cuff (RC) disorders. A systematic search in three databases (Cinahl, Medline and Embase) was conducted. Data extraction and critical methodological appraisal were performed independently by three raters using structured tools, and agreement was achieved by consensus. A descriptive synthesis was performed. One-hundred and twenty articles reporting on 11 questionnaires were included. All questionnaires were highly reliable and responsive to change, and showed construct validity; seven questionnaires also shown known-group validity. The minimal detectable change ranged from 6.4% to 20.8% of total score; only two questionnaires (American Shoulder and Elbow Surgeon questionnaire [ASES] and Upper Limb Functional Index [ULFI]) had a measurement error below 10% of global score. Minimal clinically important differences were established for eight questionnaires, and ranged from 8% to 20% of total score. Overall, included questionnaires showed acceptable psychometric properties for individuals with RC disorders. The ASES and ULFI have the smallest absolute error of measurement, while the Western Ontario RC Index is one of the most responsive questionnaires for individuals suffering from RC disorders. All included questionnaires are reliable, valid and responsive for the evaluation of individuals with RC disorders. As all included questionnaires showed good psychometric properties for the targeted population, the choice should be made according to the purpose of the evaluation and to the construct being evaluated by the questionnaire. The WORC, a RC-specific questionnaire, appeared to be more responsive. It should therefore be used to evaluate change in time. If the evaluation is time-limited, shorter questionnaires or short versions should be considered (such as Quick DASH or SST).

Using Negotiated Joining to Construct and Fill Open-ended Roles in Elite Culinary Groups.

PubMed

Tan, Vaughn

2015-03-01

This qualitative study examines membership processes in groups operating in an uncertain environment that prevents them from fully predefining new members' roles. I describe how nine elite high-end, cutting-edge culinary groups in the U.S. and Europe, ranging from innovative restaurants to culinary R&D groups, use negotiated joining-a previously undocumented process-to systematically construct and fill these emergent, open-ended roles. I show that negotiated joining is a consistently patterned, iterative process that begins with a role that both aspirant and target group explicitly understand to be provisional. This provisional role is then jointly modified and constructed by the aspirant and target group through repeated iterations of proposition, validation through trial and evaluation, and selective integration of validated role components. The initially provisional role stabilizes and the aspirant achieves membership if enough role components are validated; otherwise the negotiated joining process is abandoned. Negotiated joining allows the aspirant and target group to learn if a mutually desirable role is likely and, if so, to construct such a role. In addition, the provisional roles in negotiated joining can support absorptive capacity by allowing novel role components to enter target groups through aspirants' efforts to construct stable roles for themselves, while the internal adjustment involved in integrating newly validated role components can have the unintended side effect of supporting adaptation by providing opportunities for the groups to use these novel role components to modify their role structure and goals to suit a changing and uncertain environment. Negotiated joining thus reveals role ambiguity's hitherto unexamined beneficial consequences and provides a foundation for a contingency theory of new-member acquisition.

Using Negotiated Joining to Construct and Fill Open-ended Roles in Elite Culinary Groups

PubMed Central

Tan, Vaughn

2015-01-01

This qualitative study examines membership processes in groups operating in an uncertain environment that prevents them from fully predefining new members’ roles. I describe how nine elite high-end, cutting-edge culinary groups in the U.S. and Europe, ranging from innovative restaurants to culinary R&D groups, use negotiated joining—a previously undocumented process—to systematically construct and fill these emergent, open-ended roles. I show that negotiated joining is a consistently patterned, iterative process that begins with a role that both aspirant and target group explicitly understand to be provisional. This provisional role is then jointly modified and constructed by the aspirant and target group through repeated iterations of proposition, validation through trial and evaluation, and selective integration of validated role components. The initially provisional role stabilizes and the aspirant achieves membership if enough role components are validated; otherwise the negotiated joining process is abandoned. Negotiated joining allows the aspirant and target group to learn if a mutually desirable role is likely and, if so, to construct such a role. In addition, the provisional roles in negotiated joining can support absorptive capacity by allowing novel role components to enter target groups through aspirants’ efforts to construct stable roles for themselves, while the internal adjustment involved in integrating newly validated role components can have the unintended side effect of supporting adaptation by providing opportunities for the groups to use these novel role components to modify their role structure and goals to suit a changing and uncertain environment. Negotiated joining thus reveals role ambiguity’s hitherto unexamined beneficial consequences and provides a foundation for a contingency theory of new-member acquisition. PMID:26273105

The Validity and Reliability Test of the Indonesian Version of Gastroesophageal Reflux Disease Quality of Life (GERD-QOL) Questionnaire.

PubMed

Siahaan, Laura A; Syam, Ari F; Simadibrata, Marcellus; Setiati, Siti

2017-01-01

to obtain a valid and reliable GERD-QOL questionnaire for Indonesian application. at the initial stage, the GERD-QOL questionnaire was first translated into Indonesian language and the translated questionnaire was subsequently translated back into the original language (back-to-back translation). The results were evaluated by the researcher team and therefore, an Indonesian version of GERD-QOL questionnaire was developed. Ninety-one patients who had been clinically diagnosed with GERD based on the Montreal criteria were interviewed using the Indonesian version of GERD-QOL questionnaire and the SF 36 questionnaire. The validity was evaluated using a method of construct validity and external validity, and reliability can be tested by the method of internal consistency and test retest. the Indonesian version of GERD-QOL questionnaire had a good internal consistency reliability with a Cronbach Alpha of 0.687-0.842 and a good test retest reliability with an intra-class correlation coefficient of 0.756-0.936; p<0.05). The questionnaire had also been demonstrated to have a good validity with a proven high correlation to each question of SF-36 (p<0.05). the Indonesian version of GERD-QOL questionnaire has been proven valid and reliable to evaluate the quality of life of GERD patients.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

PubMed

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Educational testing validity and reliability in pharmacy and medical education literature.

PubMed

Hoover, Matthew J; Jung, Rose; Jacobs, David M; Peeters, Michael J

2013-12-16

To evaluate and compare the reliability and validity of educational testing reported in pharmacy education journals to medical education literature. Descriptions of validity evidence sources (content, construct, criterion, and reliability) were extracted from articles that reported educational testing of learners' knowledge, skills, and/or abilities. Using educational testing, the findings of 108 pharmacy education articles were compared to the findings of 198 medical education articles. For pharmacy educational testing, 14 articles (13%) reported more than 1 validity evidence source while 83 articles (77%) reported 1 validity evidence source and 11 articles (10%) did not have evidence. Among validity evidence sources, content validity was reported most frequently. Compared with pharmacy education literature, more medical education articles reported both validity and reliability (59%; p<0.001). While there were more scholarship of teaching and learning (SoTL) articles in pharmacy education compared to medical education, validity, and reliability reporting were limited in the pharmacy education literature.

Pressure ulcers: development and psychometric evaluation of the attitude towards pressure ulcer prevention instrument (APuP).

PubMed

Beeckman, D; Defloor, T; Demarré, L; Van Hecke, A; Vanderwee, K

2010-11-01

Pressure ulcers continue to be a significant problem in hospitals, nursing homes and community care settings. Pressure ulcer incidence is widely accepted as an indicator for the quality of care. Negative attitudes towards pressure ulcer prevention may result in suboptimal preventive care. A reliable and valid instrument to assess attitudes towards pressure ulcer prevention is lacking. Development and psychometric evaluation of the Attitude towards Pressure ulcer Prevention instrument (APuP). Prospective psychometric instrument validation study. A literature review was performed to design the instrument. Content validity was evaluated by nine European pressure ulcer experts and five experts in psychometric instrument validation in a double Delphi procedure. A convenience sample of 258 nurses and 291 nursing students from Belgium and The Netherlands participated in order to evaluate construct validity and stability reliability of the instrument. The data were collected between February and May 2008. A factor analysis indicated the construct of a 13 item instrument in a five factor solution: (1) attitude towards personal competency to prevent pressure ulcers (three items); (2) attitude towards the priority of pressure ulcer prevention (three items); (3) attitude towards the impact of pressure ulcers (three items); (4) attitude towards personal responsibility in pressure ulcer prevention (two items); and (5) attitude towards confidence in the effectiveness of prevention (two items). This five factor solution accounted for 61.4% of the variance in responses related to attitudes towards pressure ulcer prevention. All items demonstrated factor loadings over 0.60. The instrument produced similar results during stability testing [ICC=0.88 (95% CI=0.84-0.91, P<0.001)]. For the total instrument, the internal consistency (Cronbachs alpha) was 0.79. The APuP is a psychometrically sound instrument that can be used to effectively assess attitudes towards pressure ulcer prevention in patient care, education, and research. In further research, the association between attitude, knowledge and clinical performance should be explored. Copyright 2010 Elsevier Ltd. All rights reserved.

Cross-cultural adaptation, evaluation and validation of the Spouse Response Inventory: a study protocol.

PubMed

Kaiser, Ulrike; Steinmetz, Dorit; Scharnagel, Rüdiger; Jensen, Mark P; Balck, Friedrich; Sabatowski, Rainer

2014-10-14

Since the response of spouses has been proven to be an important reinforcement of pain behaviour and disability it has been addressed in research and therapy. Fordyce suggested pain behaviour and well behaviour be considered in explaining suffering in chronic pain patients. Among existing instruments concerning spouse's responses the aspect of well behaviour has not been examined so far. The SRI (Spouse Response Inventory) tries to consider pain behaviour and well behaviour and appears to be acceptable because of its brevity and close proximity to daily language. The aim of the study is the translation into German, followed by evaluation and validation, of the SRI on a German sample of patients with chronic pain. The study is comprehensively designed: initially, the focus will lie on the translation of the instrument following the guidelines for cross-cultural translation and adaptation and evaluation of the German version according to the source study. Subsequently, a validation referring to predictive, incremental and construct validation will be conducted using instruments based on similar or close but different constructs. Evaluation of the resulting SRI-G (SRI-German) will be conducted on a sample of at least 30 patients with chronic pain attending a comprehensive pain centre. For validation at least 120 patients with chronic headache, back pain, cancer related pain and somatoform pain disorder shall be included, for a total of 480 patients. Separate analyses according to specific pain diagnoses will be performed to ensure psychometric property, interpretability and control of diagnosis of specific limitations. Analyses will include comprehensive investigation of psychometric property of the scale by hierarchical regression analyses, correlation analyses, multivariate analysis of variance and exploratory factor analyses (SPSS). The study protocol was approved by the Ethics Committee of the University of Dresden (EK 335 122008) based on the Helsinki declaration. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales (NCAPS)

DTIC Science & Technology

2006-10-01

Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D...Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) Christina M. Underhill, Ph.D. Reviewed and Approved by Jacqueline A. Mottern...and Construct Validity of the Navy Computer Adaptive Personality Scales ( NCAPS ) 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 0602236N and 0603236N 6

The reliability and validity of three questionnaires: The Student Satisfaction and Self-Confidence in Learning Scale, Simulation Design Scale, and Educational Practices Questionnaire.

PubMed

Unver, Vesile; Basak, Tulay; Watts, Penni; Gaioso, Vanessa; Moss, Jacqueline; Tastan, Sevinc; Iyigun, Emine; Tosun, Nuran

2017-02-01

The purpose of this study was to adapt the "Student Satisfaction and Self-Confidence in Learning Scale" (SCLS), "Simulation Design Scale" (SDS), and "Educational Practices Questionnaire" (EPQ) developed by Jeffries and Rizzolo into Turkish and establish the reliability and the validity of these translated scales. A sample of 87 nursing students participated in this study. These scales were cross-culturally adapted through a process including translation, comparison with original version, back translation, and pretesting. Construct validity was evaluated by factor analysis, and criterion validity was evaluated using the Perceived Learning Scale, Patient Intervention Self-confidence/Competency Scale, and Educational Belief Scale. Cronbach's alpha values were found as 0.77-0.85 for SCLS, 0.73-0.86 for SDS, and 0.61-0.86 for EPQ. The results of this study show that the Turkish versions of all scales are validated and reliable measurement tools.

Psychometric Properties of the Death Anxiety Scale-Extended among Patients with End-Stage Renal Disease.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Koocher, Gerald P; Yaghoobzadeh, Ameneh; Haghdoost, Ali Akbar; Mar Win, Ma Thin; Soleimani, Mohammad Ali

2017-01-01

This study aimed to evaluate the validity and reliability of the Persian version of Death Anxiety Scale-Extended (DAS-E). A total of 507 patients with end-stage renal disease completed the DAS-E. The factor structure of the scale was evaluated using exploratory factor analysis with an oblique rotation and confirmatory factor analysis. The content and construct validity of the DAS-E were assessed. Average variance extracted, maximum shared squared variance, and average shared squared variance were estimated to assess discriminant and convergent validity. Reliability was assessed using Cronbach's alpha coefficient (α = .839 and .831), composite reliability (CR = .845 and .832), Theta (θ = .893 and .867), and McDonald Omega (Ω = .796 and .743). The analysis indicated a two-factor solution. Reliability and discriminant validity of the factors was established. Findings revealed that the present scale was a valid and reliable instrument that can be used in assessment of death anxiety in Iranian patients with end-stage renal disease.

Validation of the Mobile Information Software Evaluation Tool (MISET) With Nursing Students.

PubMed

Secco, M Loretta; Furlong, Karen E; Doyle, Glynda; Bailey, Judy

2016-07-01

This study evaluated the Mobile Information Software Evaluation Tool (MISET) with a sample of Canadian undergraduate nursing students (N = 240). Psychometric analyses determined how well the MISET assessed the extent that nursing students find mobile device-based information resources useful and supportive of learning in the clinical and classroom settings. The MISET has a valid three-factor structure with high explained variance (74.7%). Internal consistency reliabilities were high for the MISET total (.90) and three subscales: Usefulness/Helpfulness, Information Literacy Support, and Use of Evidence-Based Sources (.87 to .94). Construct validity evidence included significantly higher mean total MISET, Helpfulness/Usefulness, and Information Literacy Support scores for senior students and those with higher computer competence. The MISET is a promising tool to evaluate mobile information technologies and information literacy support; however, longitudinal assessment of changes in scores over time would determine scale sensitivity and responsiveness. [J Nurs Educ. 2016;55(7):385-390.]. Copyright 2016, SLACK Incorporated.

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal

PubMed Central

2011-01-01

Background The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings. Methods Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n = 64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion. Results The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC) = 0.82, sensitivity = 0.71, specificity = 0.81, cutoff score ≥ 14); CPSS (AUC = 0.77, sensitivity = 0.68, specificity = 0.73, cutoff score ≥ 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14). Conclusions Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions. PMID:21816045

U.S.A.B.I.L.I.T.Y. Framework for Older Adults.

PubMed

Caboral-Stevens, Meriam; Whetsell, Martha V; Evangelista, Lorraine S; Cypress, Brigitte; Nickitas, Donna

2015-01-01

The purpose of the current study was to present a framework to determine potential usability of health websites by older adults. Review of the literature showed paucity of nursing theory related to the use of technology and usability, particularly in older adults. The Roy Adaptation Model, a widely used nursing theory, was chosen to provide framework for the new model. Technology constructs from the Technology Acceptance Model and United Theory of Acceptance and Use of Technology and behavioral control construct from the Theory of Planned Behavior were integrated into the construction of the derived model. The Use of Technology for Adaptation by Older Adults and/or Those With Limited Literacy (U.S.A.B.I.L.I.T.Y.) Model was constructed from the integration of diverse theoretical/conceptual perspectives. The four determinants of usability in the conceptual model include (a) efficiency, (b) learnability, (c) perceived user experience, and (d) perceived control. Because of the lack of well-validated survey questionnaires to measure these determinants, a U.S.A.B.I.L.I.T.Y. Survey was developed. A panel of experts evaluated face and content validity of the new instrument. Internal consistency of the new instrument was 0.96. Usability is key to accepting technology. The derived U.S.A.B.I.L.I.T.Y. framework could serve as a guide for nurses in formative evaluation of technology. Copyright 2015, SLACK Incorporated.

Validity and Reliability of a General Nutrition Knowledge Questionnaire for Japanese Adults.

PubMed

Matsumoto, Mai; Tanaka, Rie; Ikemoto, Shinji

2017-01-01

Nutrition knowledge is necessary for individuals to adopt appropriate dietary habits, and needs to be evaluated before nutrition education is provided. However, there is no tool to assess general nutrition knowledge of adults in Japan. Our aims were to determine the validity and reliability of a general nutrition knowledge questionnaire for Japanese adults. We developed the pilot version of the Japanese general nutrition knowledge questionnaire (JGNKQ) and administered the pilot study to assess content validity and internal reliability to 1,182 Japanese adults aged 18-64 y. The JGNKQ was further modified based on the pilot study and the final version consisted of 5 sections and 147 items. The JGNKQ was administered to female undergraduate Japanese students in their senior year twice in 2015 to assess construct validity and test-retest reliability. Ninety-six students majoring in nutrition and 44 students in other majors who studied at the same university completed the first questionnaire. Seventy-five students completed the questionnaire twice. The responses from the first questionnaire and both questionnaires were used to assess construct validity and test-retest reliability, respectively. The students in nutrition major had significantly higher scores than the students in other majors on all sections of the questionnaire (p=0.000); therefore, the questionnaire had good construct validity. The test-retest reliability correlation coefficient value of overall and each section except "The use of dietary information to make dietary choices" were 0.75, 0.67, 0.67, 0.68 and 0.61, respectively. We suggest that the JGNKQ is an effective tool to assess the nutrition knowledge level of Japanese adults.