Concurrent validity and reliability of the Alberta Infant Motor Scale in premature infants.

PubMed

Almeida, Kênnea Martins; Dutra, Maria Virginia Peixoto; Mello, Rosane Reis de; Reis, Ana Beatriz Rodrigues; Martins, Priscila Silveira

2008-01-01

To verify the concurrent validity and interobserver reliability of the Alberta Infant Motor Scale (AIMS) in premature infants followed-up at the outpatient clinic of Instituto Fernandes Figueira, Fundação Oswaldo Cruz (IFF/Fiocruz), in Rio de Janeiro, Brazil. A total of 88 premature infants were enrolled at the follow-up clinic at IFF/Fiocruz, between February and December of 2006. For the concurrent validity study, 46 infants were assessed at either 6 (n = 26) or 12 (n = 20) months' corrected age using the AIMS and the second edition of the Bayley Scales of Infant Development, by two different observers, and applying Pearson's correlation coefficient to analyze the results. For the reliability study, 42 infants between 0 and 18 months were assessed using the Alberta Infant Motor Scale, by two different observers and the results analyzed using the intraclass correlation coefficient. The concurrent validity study found a high level of correlation between the two scales (r = 0.95) and one that was statistically significant (p < 0.01) for the entire population of infants, with higher values at 12 months (r = 0.89) than at 6 months (r = 0.74). The interobserver reliability study found satisfactory intraclass correlation coefficients at all ages tested, varying from 0.76 to 0.99. The AIMS is a valid and reliable instrument for the evaluation of motor development in high-risk infants within the Brazilian public health system.

Validating Neuro-QoL short forms and targeted scales with people who have multiple sclerosis.

PubMed

Miller, Deborah M; Bethoux, Francois; Victorson, David; Nowinski, Cindy J; Buono, Sarah; Lai, Jin-Shei; Wortman, Katy; Burns, James L; Moy, Claudia; Cella, David

2016-05-01

Multiple sclerosis (MS) is a chronic, progressive, and disabling disease of the central nervous system with dramatic variations in the combination and severity of symptoms it can produce. The lack of reliable disease-specific health-related quality of life (HRQL) measures for use in clinical trials prompted the development of the Neurology Quality of Life (Neuro-QOL) instrument, which includes 13 scales that assess physical, emotional, cognitive, and social domains, for use in a variety of neurological illnesses. The objective of this research paper is to conduct an initial assessment of the reliability and validation of the Neuro-QOL short forms (SFs) in MS. We assessed reliability, concurrent validity, known groups validity, and responsiveness between cross-sectional and longitudinal data in 161 recruited MS patients. Internal consistency was high for all measures (α = 0.81-0.95) and ICCs were within the acceptable range (0.76-0.91); concurrent and known groups validity were highest with the Global HRQL question. Longitudinal assessment was limited by the lack of disease progression in the group. The Neuro-QOL SFs demonstrate good internal consistency, test-re-test reliability, and concurrent and known groups validity in this MS population, supporting the validity of Neuro-QOL in adults with MS. © The Author(s), 2015.

The Reliability and Validity of Zimbardo Time Perspective Inventory Scores in Academically Talented Adolescents

ERIC Educational Resources Information Center

Worrell, Frank C.; Mello, Zena R.

2007-01-01

In this study, the authors examined the reliability, structural validity, and concurrent validity of Zimbardo Time Perspective Inventory (ZTPI) scores in a group of 815 academically talented adolescents. Reliability estimates of the purported factors' scores were in the low to moderate range. Exploratory factor analysis supported a five-factor…

Reliability and concurrent validity of postural asymmetry measurement in adolescent idiopathic scoliosis

PubMed Central

Prowse, Ashleigh; Aslaksen, Berit; Kierkegaard, Marie; Furness, James; Gerdhem, Paul; Abbott, Allan

2017-01-01

AIM To investigate the reliability and concurrent validity of the Baseline® Body Level/Scoliosis meter for adolescent idiopathic scoliosis postural assessment in three anatomical planes. METHODS This is an observational reliability and concurrent validity study of adolescent referrals to the Orthopaedic department for scoliosis screening at Karolinska University Hospital, Stockholm, Sweden between March-May 2012. A total of 31 adolescents with idiopathic scoliosis (13.6 ± 0.6 years old) of mild-moderate curvatures (25° ± 12°) were consecutively recruited. Measurement of cervical, thoracic and lumbar curvatures, pelvic and shoulder tilt, and axial thoracic rotation (ATR) were performed by two trained physiotherapists in one day. The intraclass correlation coefficient (ICC) was used to determine the inter-examiner reliability (ICC2,1) and the intra-rater reliability (ICC3,3) of the Baseline® Body Level/Scoliosis meter. Spearman’s correlation analyses were used to estimate concurrent validity between the Baseline® Body Level/Scoliosis meter and Gold Standard Cobb angles from radiographs and the Orthopaedic Systems Inc. Scoliometer. RESULTS There was excellent reliability between examiners for thoracic kyphosis (ICC2,1 = 0.94), ATR (ICC2,1 = 0.92) and lumbar lordosis (ICC2,1 = 0.79). There was adequate reliability between examiners for cervical lordosis (ICC2,1 = 0.51), however poor reliability for pelvic and shoulder tilt. Both devices were reproducible in the measurement of ATR when repeated by one examiner (ICC3,3 0.98-1.00). The device had a good correlation with the Scoliometer (rho = 0.78). When compared with Cobb angle from radiographs, there was a moderate correlation for ATR (rho = 0.627). CONCLUSION The Baseline® Body Level/Scoliosis meter provides reliable transverse and sagittal cervical, thoracic and lumbar measurements and valid transverse plan measurements of mild-moderate scoliosis deformity. PMID:28144582

Validation of new psychosocial factors questionnaires: a Colombian national study.

PubMed

Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

2013-01-01

The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

The Reliability and Validity of Measures of Gait Variability in Community-Dwelling Older Adults

PubMed Central

Brach, Jennifer S.; Perera, Subashan; Studenski, Stephanie; Newman, Anne B.

2009-01-01

Objective To examine the test-retest reliability and concurrent validity of variability of gait characteristics. Design Cross-sectional study. Setting Research laboratory. Participants Older adults (N=558) from the Cardiovascular Health Study. Interventions Not applicable. Main Outcome Measures Gait characteristics were measured using a 4-m computerized walkway. SD determined from the steps recorded were used as the measures of variability. Intraclass correlation coefficients (ICC) were calculated to examine test-retest reliability of a 4-m walk and two 4-m walks. To establish concurrent validity, the measures of gait variability were compared across levels of health, functional status, and physical activity using independent t tests and analysis of variances. Results Gait variability measures from the two 4-m walks demonstrated greater test-retest reliability than those from the single 4-m walk (ICC=.22–.48 and ICC=.40–.63, respectively). Greater step length and stance time variability were associated with poorer health, functional status and physical activity (P<.05). Conclusions Gait variability calculated from a limited number of steps has fair to good test-retest reliability and concurrent validity. Reliability of gait variability calculated from a greater number of steps should be assessed to determine if the consistency can be improved. PMID:19061741

The Arthroscopic Surgical Skill Evaluation Tool (ASSET)

PubMed Central

Koehler, Ryan J.; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J.; Nicandri, Gregg T.

2014-01-01

Background Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. Hypothesis The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability, when used to assess the technical ability of surgeons performing diagnostic knee arthroscopy on cadaveric specimens. Study Design Cross-sectional study; Level of evidence, 3 Methods Content validity was determined by a group of seven experts using a Delphi process. Intra-articular performance of a right and left diagnostic knee arthroscopy was recorded for twenty-eight residents and two sports medicine fellowship trained attending surgeons. Subject performance was assessed by two blinded raters using the ASSET. Concurrent criterion-oriented validity, inter-rater reliability, and test-retest reliability were evaluated. Results Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in total ASSET score (p<0.05) between novice, intermediate, and advanced experience groups were identified. Inter-rater reliability: The ASSET scores assigned by each rater were strongly correlated (r=0.91, p <0.01) and the intra-class correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: there was a significant correlation between ASSET scores for both procedures attempted by each individual (r = 0.79, p<0.01). Conclusion The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopy in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live OR and other simulated environments. PMID:23548808

Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan.

PubMed

Moore, Amy Lawson; Miller, Terissa M

2018-01-01

The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills. This study included 2,737 participants aged 5-85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test-retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement. Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test-retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93. The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan.

Establishing the reliability and concurrent validity of physical performance tests using virtual reality equipment for community-dwelling healthy elders.

PubMed

Griswold, David; Rockwell, Kyle; Killa, Carri; Maurer, Michael; Landgraff, Nancy; Learman, Ken

2015-01-01

The aim of this study was to determine the reliability and concurrent validity of commonly used physical performance tests using the OmniVR Virtual Rehabilitation System for healthy community-dwelling elders. Participants (N = 40) were recruited by the authors and were screened for eligibility. The initial method of measurement was randomized to either virtual reality (VR) or clinically based measures (CM). Physical performance tests included the five times sit to stand, Timed Up and Go (TUG), Forward Functional Reach (FFR) and 30-s stand test. A random number generator determined the testing order. The test-re-test reliability for the VR and CM was determined. Furthermore, concurrent validity was determined using a Pearson product moment correlation (Pearson r). The VR demonstrated excellent reliability for 5 × STS intraclass correlation coefficient (ICC) = 0.931(3,1), FFR ICC = 0.846(3,1) and the TUG ICC = 0.944(3,1). The concurrent validity data for the VR and CM (ICC 3, k) were moderate for FFR ICC = 0.682, excellent 5 × STS ICC = 0.889 and excellent for the TUG ICC = 0.878. The concurrent validity of the 30-s stand test was good ICC = 0.735(3,1). This study supports the use of VR equipment for measuring physical performance tests in the clinic for healthy community-dwelling elders. Virtual reality equipment is not only used to treat balance impairments but it is also used to measure and determine physical impairments through the use of physical performance tests. Virtual reality equipment is a reliable and valid tool for collecting physical performance data for the 5 × STS, FFR, TUG and 30-s stand test for healthy community-dwelling elders.

Reliability and validity of the symptoms of major depressive illness.

PubMed

Mazure, C; Nelson, J C; Price, L H

1986-05-01

In two consecutive studies, we examined the interrater reliability and then the concurrent validity of interview ratings for individual symptoms of major depressive illness. The concurrent validity of symptoms was determined by assessing the degree to which symptoms observed or reported during an interview were observed in daily behavior. Results indicated that most signs and symptoms of major depression and melancholia can be reliably rated by clinicians during a semistructured interview. Ratings of observable symptoms (signs) assessed during the interview were valid indicators of dysfunction observed in daily behavior. Several but not all ratings based on patient report of symptoms were at variance with observation. These discordant patient-reported symptoms may have value as subjective reports but were not accurate descriptions of observed dysfunction.

A Spanish validation of the Coma Recovery Scale-Revised (CRS-R).

PubMed

Tamashiro, Mercedes; Rivas, Maria Elisa; Ron, Melania; Salierno, Fernando; Dalera, Marisol; Olmos, Lisandro

2014-01-01

Analysis of inter-rater reliability and concurrent validity. To determine measurement properties of a Spanish version of The Coma Recovery Scale-Revised (CRS-R). A sample of 35 in-patients with severe acquired brain injury. To test concurrent validity of the translated scale, the Glasgow Coma Scale (GSC) and Disability Rating Scale (DRS) were also administered. Two experts in the field were recruited to assess inter-rater agreement. Inter-rater reliability was good for total CRS-R scores (Cronbach α = 0.973, p = 0.001). Sub-scale analysis showed moderate-to-high inter-rater agreement. Total CRS-R scores correlated significantly (p < 0.05) with total GCS (r = 0.74) and DRS (r = 0.54) scores, indicating acceptable concurrent validity. The Spanish version of CRS-R can be administered reliably by trained and experienced examiners. CRS-R appears capable of differentiating patients in Emergence from Minimally Conscious State (EMCS) or in Minimally Conscious State (MCS) from those in a Vegetative State (VS).

The Reliability and Concurrent Validity of the Figure-of-Eight Method of Measuring Hand Edema in Patients with Burns

DTIC Science & Technology

2007-02-01

Travis L. Hedman, MPT, OCS, Ted T. Chapman, OTR/L, Steven E. Wolf, MD, FACS, John B. Holcomb, MD, FACS Objective: Water volumetry is considered the...hand, using the figure-of-eight technique. A third tester per- formed two measurements, using water volumetry . An independent investigator recorded...all measurements. Intratester and intertester reliability were analyzed. Concurrent validity was examined and compared with water volumetry

Evaluation of the psychometric properties of the phlebitis and infiltration scales for the assessment of complications of peripheral vascular access devices.

PubMed

Groll, Dianne; Davies, Barbara; Mac Donald, Joan; Nelson, Susanne; Virani, Tazim

2010-01-01

To prevent complications from peripheral vascular access device (PVAD) therapy, the Infusion Nurses Society (INS) developed 2 scales to measure the extent and severity of phlebitis and infiltration in PVADs. This study evaluated the psychometric properties of these scales to validate them with respect to their interrater reliability, concurrent validity, feasibility, and acceptability. A total of 182 patients at 2 sites were enrolled, and 416 observations of PVAD sites were made. Two nurses independently rated each PVAD site for the presence or absence of phlebitis and/or infiltration by using the INS scales. The interrater reliability was calculated, as was the agreement of the observed versus charted incidence of phlebitis and infiltration (concurrent validity) and the ease of use of the scales (feasibility, acceptability). Interrater reliability for both the Phlebitis and Infiltration scales and concurrent validity were found to be statistically significant (P < .05). The study nurses reported the scales to be easy to use, taking an average of 1.3 minutes to complete both. The importance of valid measures for use in research cannot be underestimated. The INS Phlebitis and Infiltration scales have been shown to be easy to use, valid, and reliable scales.

Reliability and validity of a smartphone pulse rate application for the assessment of resting and elevated pulse rate.

PubMed

Mitchell, Katy; Graff, Megan; Hedt, Corbin; Simmons, James

2016-08-01

Purpose/hypothesis: This study was designed to investigate the test-retest reliability, concurrent validity, and the standard error of measurement (SEm) of a pulse rate assessment application (Azumio®'s Instant Heart Rate) on both Android® and iOS® (iphone operating system) smartphones as compared to a FT7 Polar® Heart Rate monitor. Number of subjects: 111. Resting (sitting) pulse rate was assessed twice and then the participants were asked to complete a 1-min standing step test and then immediately re-assessed. The smartphone assessors were blinded to their measurements. Test-retest reliability (intraclass correlation coefficient [ICC 2,1] and 95% confidence interval) for the three tools at rest (time 1/time 2): iOS® (0.76 [0.67-0.83]); Polar® (0.84 [0.78-0.89]); and Android® (0.82 [0.75-0.88]). Concurrent validity at rest time 2 (ICC 2,1) with the Polar® device: IOS® (0.92 [0.88-0.94]) and Android® (0.95 [0.92-0.96]). Concurrent validity post-exercise (time 3) (ICC) with the Polar® device: iOS® (0.90 [0.86-0.93]) and Android® (0.94 [0.91-0.96]). The SEm values for the three devices at rest: iOS® (5.77 beats per minute [BPM]), Polar® (4.56 BPM) and Android® (4.96 BPM). The Android®, iOS®, and Polar® devices showed acceptable test-retest reliability at rest and post-exercise. Both the smartphone platforms demonstrated concurrent validity with the Polar® at rest and post-exercise. The Azumio® Instant Heart Rate application when used by either platform appears to be a reliable and valid tool to assess pulse rate in healthy individuals.

Reliability and concurrent validity of the Infant Motor Profile.

PubMed

Heineman, Kirsten R; Middelburg, Karin J; Bos, Arend F; Eidhof, Lieke; La Bastide-Van Gemert, Sacha; Van Den Heuvel, Edwin R; Hadders-Algra, Mijna

2013-06-01

The Infant Motor Profile (IMP) is a qualitative assessment of motor behaviour in infancy. It consists of five domains: movement variation, variability, fluency, symmetry, and performance. The aim of this study was to assess interobserver reliability and concurrent validity of the IMP with the Alberta Infant Motor Scale (AIMS) and an age-specific neurological examination. Fifty-nine preterm infants (25 females, 34 males; median gestational age 29.7wks, median birthweight 1285g) and 146 term infants (74 females, 72 males; median gestational age 40.1wks, birthweight 3500g) were included. Assessments were performed at corrected ages of 4, 6, 10, 12, and 18 months and consisted of the IMP, AIMS, and an age-specific neurological examination. Interobserver reliability was investigated on a sample of 25 video recordings. Non-parametric statistics were used to analyse the data. Interobserver reliability was high (intraclass correlation coefficient 0.95). At all ages, AIMS scores correlated weakly to fairly with total IMP scores (Spearman's ρ 0.36-0.55), but moderately to strongly with scores on the performance domain of the IMP (Spearman's ρ 0.47-0.84). A clear relation was found between total IMP score and outcome of the neurological examination (Kruskal-Wallis p<0.001 at all ages). Interobserver reliability of the IMP is good. Concurrent validity with the AIMS is best for the IMP performance domain. Concurrent validity with age-specific neurological examination is very good. © The Authors. Developmental Medicine & Child Neurology © 2013 Mac Keith Press.

Concurrent validity and interrater reliability of a new smartphone application to assess 3D active cervical range of motion in patients with neck pain.

PubMed

Stenneberg, Martijn S; Busstra, Harm; Eskes, Michel; van Trijffel, Emiel; Cattrysse, Erik; Scholten-Peeters, Gwendolijne G M; de Bie, Rob A

2018-04-01

There is a lack of valid, reliable, and feasible instruments for measuring planar active cervical range of motion (aCROM) and associated 3D coupling motions in patients with neck pain. Smartphones have advanced sensors and appear to be suitable for these measurements. To estimate the concurrent validity and interrater reliability of a new iPhone application for assessing planar aCROM and associated 3D coupling motions in patients with neck pain, using an electromagnetic tracking device as a reference test. Cross-sectional study. Two samples of neck pain patients were recruited; 30 patients for the validity study and 26 patients for the reliability study. Validity was estimated using intraclass correlation coefficients (ICCs), and by calculating 95% limits of agreement (LoA). To estimate interrater reliability, ICCs were calculated. Cervical 3D coupling motions were analyzed by calculating the cross-correlation coefficients and ratio between the main motions and coupled motions for both instruments. ICCs for concurrent validity and interrater reliability ranged from 0.90 to 0.99. The width of the 95% LoA ranged from about 5° for right lateral bending to 11° for total rotation. No significant differences were found between both devices for associated coupling motion analysis. The iPhone application appears to be a useful discriminative tool for the measurement of planar aCROM and associated coupling motions in patients with neck pain. It fulfills the need for a valid, reliable, and feasible instrument in clinical practice and research. Therapists and researchers should consider measurement error when interpreting scores. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation

PubMed Central

2014-01-01

Background A balance test provides important information such as the standard to judge an individual’s functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Methods Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). Results The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. Conclusion The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment. PMID:24912769

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation.

PubMed

Park, Dae-Sung; Lee, GyuChang

2014-06-10

A balance test provides important information such as the standard to judge an individual's functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment.

Reliability and concurrent validity of the Microsoft Xbox One Kinect for assessment of standing balance and postural control.

PubMed

Clark, Ross A; Pua, Yong-Hao; Oliveira, Cristino C; Bower, Kelly J; Thilarajah, Shamala; McGaw, Rebekah; Hasanki, Ksaniel; Mentiplay, Benjamin F

2015-07-01

The Microsoft Kinect V2 for Windows, also known as the Xbox One Kinect, includes new and potentially far improved depth and image sensors which may increase its accuracy for assessing postural control and balance. The aim of this study was to assess the concurrent validity and reliability of kinematic data recorded using a marker-based three dimensional motion analysis (3DMA) system and the Kinect V2 during a variety of static and dynamic balance assessments. Thirty healthy adults performed two sessions, separated by one week, consisting of static standing balance tests under different visual (eyes open vs. closed) and supportive (single limb vs. double limb) conditions, and dynamic balance tests consisting of forward and lateral reach and an assessment of limits of stability. Marker coordinate and joint angle data were concurrently recorded using the Kinect V2 skeletal tracking algorithm and the 3DMA system. Task-specific outcome measures from each system on Day 1 and 2 were compared. Concurrent validity of trunk angle data during the dynamic tasks and anterior-posterior range and path length in the static balance tasks was excellent (Pearson's r>0.75). In contrast, concurrent validity for medial-lateral range and path length was poor to modest for all trials except single leg eyes closed balance. Within device test-retest reliability was variable; however, the results were generally comparable between devices. In conclusion, the Kinect V2 has the potential to be used as a reliable and valid tool for the assessment of some aspects of balance performance. Copyright © 2015 Elsevier B.V. All rights reserved.

Agreement between the spatio-temporal gait parameters from treadmill-based photoelectric cell and the instrumented treadmill system in healthy young adults and stroke patients.

PubMed

Lee, Myungmo; Song, Changho; Lee, Kyoungjin; Shin, Doochul; Shin, Seungho

2014-07-14

Treadmill gait analysis was more advantageous than over-ground walking because it allowed continuous measurements of the gait parameters. The purpose of this study was to investigate the concurrent validity and the test-retest reliability of the OPTOGait photoelectric cell system against the treadmill-based gait analysis system by assessing spatio-temporal gait parameters. Twenty-six stroke patients and 18 healthy adults were asked to walk on the treadmill at their preferred speed. The concurrent validity was assessed by comparing data obtained from the 2 systems, and the test-retest reliability was determined by comparing data obtained from the 1st and the 2nd session of the OPTOGait system. The concurrent validity, identified by the intra-class correlation coefficients (ICC [2, 1]), coefficients of variation (CVME), and 95% limits of agreement (LOA) for the spatial-temporal gait parameters, were excellent but the temporal parameters expressed as a percentage of the gait cycle were poor. The test-retest reliability of the OPTOGait System, identified by ICC (3, 1), CVME, 95% LOA, standard error of measurement (SEM), and minimum detectable change (MDC95%) for the spatio-temporal gait parameters, was high. These findings indicated that the treadmill-based OPTOGait System had strong concurrent validity and test-retest reliability. This portable system could be useful for clinical assessments.

Quality of life and psychological health indicators in the national social life, health, and aging project.

PubMed

Shiovitz-Ezra, Sharon; Leitsch, Sara; Graber, Jessica; Karraker, Amelia

2009-11-01

The National Social Life, Health, and Aging Project (NSHAP) measures seven indicators of quality of life (QoL) and psychological health. The measures used for happiness, self-esteem, depression, and loneliness are well established in the literature. Conversely, measures of anxiety, stress, and self-reported emotional health were modified for their use in this unique project. The purpose of this paper is to provide (a) an overview of NSHAP's QoL assessment and (b) evidence for the adequacy of the modified measures. First, we examined the psychometric properties of the modified measures. Second, the established QoL measures were used to examine the concurrent validity of the modified measures. Finally, gender- and age-group differences were examined for each modified measure. The anxiety index exhibited good internal reliability and concurrent validity. Consistent with the literature, a single-factor structure best fit the data. Stress was satisfactory in terms of concurrent validity but with only fair internal consistency. Self-reported emotional health exhibited good concurrent validity and moderate external validity. The modified indices used in NSHAP tended to exhibit good internal reliability and concurrent validity. These measures can confidently be used in the exploration of QoL and psychological health in later life and its many correlates.

A validation study of the Keyboard Personal Computer Style instrument (K-PeCS) for use with children.

PubMed

Green, Dido; Meroz, Anat; Margalit, Adi Edit; Ratzon, Navah Z

2012-11-01

This study examines a potential instrument for measurement of typing postures of children. This paper describes inter-rater, test-retest reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS), an observational measurement of postures and movements during keyboarding, for use with children. Two trained raters independently rated videos of 24 children (aged 7-10 years). Six children returned one week later for identifying test-retest reliability. Concurrent validity was assessed by comparing ratings obtained using the K-PECS to scores from a 3D motion analysis system. Inter-rater reliability was moderate to high for 12 out of 16 items (Kappa: 0.46 to 1.00; correlation coefficients: 0.77-0.95) and test-retest reliability varied across items (Kappa: 0.25 to 0.67; correlation coefficients: r = 0.20 to r = 0.95). Concurrent validity compared favourably across arm pathlength, wrist extension and ulnar deviation. In light of the limitations of other tools the K-PeCS offers a fairly affordable, reliable and valid instrument to address the gap for measurement of typing styles of children, despite the shortcomings of some items. However further research is required to refine the instrument for use in evaluating typing among children. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Development of an Agility Test for Badminton Players and Assessment of Its Validity and Test-Retest Reliability.

PubMed

Loureiro, Luiz de França Bahia; de Freitas, Paulo Barbosa

2016-04-01

Badminton requires open and fast actions toward the shuttlecock, but there is no specific agility test for badminton players with specific movements. To develop an agility test that simultaneously assesses perception and motor capacity and examine the test's concurrent and construct validity and its test-retest reliability. The Badcamp agility test consists of running as fast as possible to 6 targets placed on the corners and middle points of a rectangular area (5.6 × 4.2 m) from the start position located in the center of it, following visual stimuli presented in a luminous panel. The authors recruited 43 badminton players (17-32 y old) to evaluate concurrent (with shuttle-run agility test--SRAT) and construct validity and test-retest reliability. Results revealed that Badcamp presents concurrent and construct validity, as its performance is strongly related to SRAT (ρ = 0.83, P < .001), with performance of experts being better than nonexpert players (P < .01). In addition, Badcamp is reliable, as no difference (P = .07) and a high intraclass correlation (ICC = .93) were found in the performance of the players on 2 different occasions. The findings indicate that Badcamp is an effective, valid, and reliable tool to measure agility, allowing coaches and athletic trainers to evaluate players' athletic condition and training effectiveness and possibly detect talented individuals in this sport.

Measuring the needs of mental health patients in Greece: reliability and validity of the Greek version of the Camberwell assessment of need.

PubMed

Stefanatou, Pentagiotissa; Giannouli, Eleni; Konstantakopoulos, George; Vitoratou, Silia; Mavreas, Venetsanos

2014-11-01

Evaluation of mental health services based on patients' needs assessments has never taken place in Greece, although it is a crucial factor for the efficient use of their limited resources. To examine the inter-rater and test-retest reliability and the concurrent/convergent validity of the Greek research version of the Camberwell Assessment of Need-Research (CAN-R). A total of 53 schizophrenic patient-staff pairs were interviewed twice to test the inter-rater and test-retest reliability of the Greek version of the CAN-R. The World Health Organization Quality of Life-Brief Form (WHOQOL-BREF) and World Health Organization Disability Assessment Schedule-2.0 (WHODAS-2.0) were administered to the patients to examine concurrent validity. The inter-rater and test-retest reliability of patient and staff interviews for the 22 individual items and the eight summary scores of the instrument's four sections were good to excellent. Significant correlations emerged between CAN scores and the WHOQOL-BREF and WHODAS-2.0 domains for both patient and staff ratings, indicating good concurrent validity. Our results suggest that the Greek version of the CAN-R is a reliable instrument for assessing mental health patients' needs. Moreover, it is the first CAN-R validity study with satisfactory results using WHOQOL-BREF and WHODAS-2.0 as criterion variables. © The Author(s) 2013.

The validation of a swimming turn wall-contact-time measurement system: a touchpad application reliability study.

PubMed

Brackley, Victoria; Ball, Kevin; Tor, Elaine

2018-05-12

The effectiveness of the swimming turn is highly influential to overall performance in competitive swimming. The push-off or wall contact, within the turn phase, is directly involved in determining the speed the swimmer leaves the wall. Therefore, it is paramount to develop reliable methods to measure the wall-contact-time during the turn phase for training and research purposes. The aim of this study was to determine the concurrent validity and reliability of the Pool Pad App to measure wall-contact-time during the freestyle and backstroke tumble turn. The wall-contact-times of nine elite and sub-elite participants were recorded during their regular training sessions. Concurrent validity statistics included the standardised typical error estimate, linear analysis and effect sizes while the intraclass correlating coefficient (ICC) was used for the reliability statistics. The standardised typical error estimate resulted in a moderate Cohen's d effect size with an R 2 value of 0.80 and the ICC between the Pool Pad and 2D video footage was 0.89. Despite these measurement differences, the results from this concurrent validity and reliability analyses demonstrated that the Pool Pad is suitable for measuring wall-contact-time during the freestyle and backstroke tumble turn within a training environment.

Reliability and Validity of a Scale for Rating Memory Impairment in Hospitalized Amnesiacs.

ERIC Educational Resources Information Center

Knight, Robert G.; Godfrey, Hamish P. D.

1984-01-01

Investigated the reliability and concurrent validity of the Inpatient Memory Impairment Scale (IMIS), using a group of memory-impaired chronic alcoholic and Korsakoff patients (N=20). Analysis revealed that the IMIS had a high degree of internal consistency and that interrater reliability is also high. (LLL)

Validity and test-retest reliability in assessing current body size with figure drawings in Chinese adolescents.

PubMed

Lo, Wing-Sze; Ho, Sai-Yin; Wong, Bonny Yee-Man; Mak, Kwok-Kei; Lam, Tai-Hing

2011-06-01

The reliability and validity of Stunkard's Figure Rating Scale (FRS) as a measure of current body size (CBS) was established in Western adolescent girls but not in non-Western population. We examined the validity and test-retest reliability of Stunkard's FRS in assessing CBS among Chinese adolescents. Methods. In a school-based survey in Hong Kong, 5666 adolescents (boys: 45.1%; mean age 14.7 years) provided data on self-reported height and weight, CBS, perceived weight status, and health-related quality of life using the Medical Outcomes Study Short-Form version 2 (SF-12v2). Height and weight were also objectively measured. Spearman's correlation was used to assess construct validity, concurrent validity and test-retest reliability. Convergent and discriminant validity were good: CBS correlated strongly with weight and self-reported/measured BMI, but only weakly with SF-12v2. CBS correlated strongly with perceived weight status, showing concurrent validity. Spearman's correlation (r) for CBS was 0.78 for girls and 0.72 for boys indicating good test-retest reliability. Validity and reliability results did not differ significantly between senior and junior grade adolescents. Our findings support the use of Stunkard's FRS to measure body size among Chinese adolescents.

The Reliability and Validity of the Coopersmith Self-Esteem Inventory-Form B.

ERIC Educational Resources Information Center

Chiu, Lian-Hwang

1985-01-01

The purpose of this study was to determine the test-retest reliability and concurrent validity of the short form (Form B) of the Coopersmith Self-Esteem Inventory. Criterion measures for validity included: (1) sociometric measures; (2) teacher's popularity ranking; and, (3) self-esteem rating. (Author/LMO)

Reliability and Concurrent Validity of Dynamic Rotator Stability Test-A Cross Sectional study.

PubMed

Binoy Mathew, K V; Eapen, Charu; Kumar, P Senthil

2012-01-01

To find intra rater and inter rater reliability of Dynamic Rotator Stability Test (DRST) and to find concurrent validity of Dynamic Rotator Stability Test (DRST) with University of Pennsylvania Shoulder Score (PENN) Scale. 40 subjects of either gender between the age group of 18-70 with painful shoulder conditions of musculoskeletal origin was selected through convenient sampling. Tester 1 and tester 2 administered DRST and PENN scale randomly. In a subgroup of 20 subjects DRST was administered by both the testers to find the inter rater reliability. 180° Standard Universal Goniometer was used to take measurements. For intra-rater reliability, all the test variables were showing highly significant correlation (p=.94 - 1). For inter -rater, with tester 2, test variables like position, ROM, force, direction of abnormal translation, pain during the test, compensatory movement during test were found to be significant (p=.71-1).only some variables of DRST showed significant correlation with PENN scale (P=.320-.450). Dynamic Rotator Stability Test has good intra rater and moderate inter rater reliability. Concurrent validity of Dynamic Rotator Stability Test was found to be poor when compared to PENN Shoulder Score.

Reliability and Validity of Objective Measures of Physical Activity in Youth With Cerebral Palsy Who Are Ambulatory.

PubMed

O'Neil, Margaret E; Fragala-Pinkham, Maria; Lennon, Nancy; George, Ameeka; Forman, Jeffrey; Trost, Stewart G

2016-01-01

Physical therapy for youth with cerebral palsy (CP) who are ambulatory includes interventions to increase functional mobility and participation in physical activity (PA). Thus, reliable and valid measures are needed to document PA in youth with CP. The purpose of this study was to evaluate the inter-instrument reliability and concurrent validity of 3 accelerometer-based motion sensors with indirect calorimetry as the criterion for measuring PA intensity in youth with CP. Fifty-seven youth with CP (mean age=12.5 years, SD=3.3; 51% female; 49.1% with spastic hemiplegia) participated. Inclusion criteria were: aged 6 to 20 years, ambulatory, Gross Motor Function Classification System (GMFCS) levels I through III, able to follow directions, and able to complete the full PA protocol. Protocol activities included standardized activity trials with increasing PA intensity (resting, writing, household chores, active video games, and walking at 3 self-selected speeds), as measured by weight-relative oxygen uptake (in mL/kg/min). During each trial, participants wore bilateral accelerometers on the upper arms, waist/hip, and ankle and a portable indirect calorimeter. Intraclass coefficient correlations (ICCs) were calculated to evaluate inter-instrument reliability (left-to-right accelerometer placement). Spearman correlations were used to examine concurrent validity between accelerometer output (activity and step counts) and indirect calorimetry. Friedman analyses of variance with post hoc pair-wise analyses were conducted to examine the validity of accelerometers to discriminate PA intensity across activity trials. All accelerometers exhibited excellent inter-instrument reliability (ICC=.94-.99) and good concurrent validity (rho=.70-.85). All accelerometers discriminated PA intensity across most activity trials. This PA protocol consisted of controlled activity trials. Accelerometers provide valid and reliable measures of PA intensity among youth with CP. © 2016 American Physical Therapy Association.

Reliability and concurrent validity of the Dutch hip and knee replacement expectations surveys

PubMed Central

2010-01-01

Background Preoperative expectations of outcome of total hip and knee arthroplasty are important determinants of patients' satisfaction and functional outcome. Aims of the study were (1) to translate the Hospital for Special Surgery Hip Replacement Expectations Survey and Knee Replacement Expectations Survey into Dutch and (2) to study test-retest reliability and concurrent validity. Methods Patients scheduled for total hip (N = 112) or knee replacement (N = 101) were sent the Dutch Expectations Surveys twice with a 2 week interval to determine test-retest reliability. To determine concurrent validity, the Expectation WOMAC was sent. Results The results for the Dutch Hip Replacement Expectations Survey revealed good test-retest reliability (ICC 0.87), no bias and good internal consistency (alpha 0.86) (N = 72). The correlation between the Hip Expectations Score and the Expectation WOMAC score was 0.59 (N = 86). The results for the Dutch Knee Replacement Expectations Survey revealed good test-retest reliability (ICC 0.79), no bias and good internal consistency (alpha 0.91) (N = 46). The correlation with the Expectation WOMAC score was 0.52 (N = 57). Conclusions Both Dutch Expectations Surveys are reliable instruments to determine patients' expectations before total hip or knee arthroplasty. As for concurrent validity, the correlation between both surveys and the Expectation WOMAC was moderate confirming that the same construct was determined. However, patients scored systematically lower on the Expectation WOMAC compared to the Dutch Expectation Surveys. Research on patients' expectations before total hip and knee replacement has only been performed in a limited amount of countries. With the Dutch Expectations Surveys it is now possible to determine patients' expectations in another culture and healthcare setting. PMID:20958990

Reliability and concurrent validity of the Dutch hip and knee replacement expectations surveys.

PubMed

van den Akker-Scheek, Inge; van Raay, Jos J A M; Reininga, Inge H F; Bulstra, Sjoerd K; Zijlstra, Wiebren; Stevens, Martin

2010-10-19

Preoperative expectations of outcome of total hip and knee arthroplasty are important determinants of patients' satisfaction and functional outcome. Aims of the study were (1) to translate the Hospital for Special Surgery Hip Replacement Expectations Survey and Knee Replacement Expectations Survey into Dutch and (2) to study test-retest reliability and concurrent validity. Patients scheduled for total hip (N = 112) or knee replacement (N = 101) were sent the Dutch Expectations Surveys twice with a 2 week interval to determine test-retest reliability. To determine concurrent validity, the Expectation WOMAC was sent. The results for the Dutch Hip Replacement Expectations Survey revealed good test-retest reliability (ICC 0.87), no bias and good internal consistency (alpha 0.86) (N = 72). The correlation between the Hip Expectations Score and the Expectation WOMAC score was 0.59 (N = 86). The results for the Dutch Knee Replacement Expectations Survey revealed good test-retest reliability (ICC 0.79), no bias and good internal consistency (alpha 0.91) (N = 46). The correlation with the Expectation WOMAC score was 0.52 (N = 57). Both Dutch Expectations Surveys are reliable instruments to determine patients' expectations before total hip or knee arthroplasty. As for concurrent validity, the correlation between both surveys and the Expectation WOMAC was moderate confirming that the same construct was determined. However, patients scored systematically lower on the Expectation WOMAC compared to the Dutch Expectation Surveys. Research on patients' expectations before total hip and knee replacement has only been performed in a limited amount of countries. With the Dutch Expectations Surveys it is now possible to determine patients' expectations in another culture and healthcare setting.

THE RELIABILITY AND CONCURRENT VALIDITY OF MEASUREMENTS USED TO QUANTIFY LUMBAR SPINE MOBILITY: AN ANALYSIS OF AN IPHONE® APPLICATION AND GRAVITY BASED INCLINOMETRY

PubMed Central

Pizzini, Matias; Robinson, Ashley; Yanez, Dania; Hanney, William J.

2013-01-01

Purpose/Aim: This purpose of this study was to investigate the reliability, minimal detectable change (MDC), and concurrent validity of active spinal mobility measurements using a gravity‐based bubble inclinometer and iPhone® application. Materials/Methods: Two investigators each used a bubble inclinometer and an iPhone® with inclinometer application to measure total thoracolumbo‐pelvic flexion, isolated lumbar flexion, total thoracolumbo‐pelvic extension, and thoracolumbar lateral flexion in 30 asymptomatic participants using a blinded repeated measures design. Results: The procedures used in this investigation for measuring spinal mobility yielded good intrarater and interrater reliability with Intraclass Correlation Coefficients (ICC) for bubble inclinometry ≥ 0.81 and the iPhone® ≥ 0.80. The MDC90 for the interrater analysis ranged from 4° to 9°. The concurrent validity between bubble inclinometry and the iPhone® application was good with ICC values of ≥ 0.86. The 95% level of agreement indicates that although these measuring instruments are equivalent individual differences of up to 18° may exist when using these devices interchangeably. Conclusions: The bubble inclinometer and iPhone® possess good intrarater and interrater reliability as well as concurrent validity when strict measurement procedures are adhered to. This study provides preliminary evidence to suggest that smart phone applications may offer clinical utility comparable to inclinometry for quantifying spinal mobility. Clinicians should be aware of the potential disagreement when using these devices interchangeably. Level of Evidence: 2b (Observational study of reliability) PMID:23593551

The reliability and concurrent validity of measurements used to quantify lumbar spine mobility: an analysis of an iphone® application and gravity based inclinometry.

PubMed

Kolber, Morey J; Pizzini, Matias; Robinson, Ashley; Yanez, Dania; Hanney, William J

2013-04-01

PURPOSEAIM: This purpose of this study was to investigate the reliability, minimal detectable change (MDC), and concurrent validity of active spinal mobility measurements using a gravity-based bubble inclinometer and iPhone® application. MATERIALSMETHODS: Two investigators each used a bubble inclinometer and an iPhone® with inclinometer application to measure total thoracolumbo-pelvic flexion, isolated lumbar flexion, total thoracolumbo-pelvic extension, and thoracolumbar lateral flexion in 30 asymptomatic participants using a blinded repeated measures design. The procedures used in this investigation for measuring spinal mobility yielded good intrarater and interrater reliability with Intraclass Correlation Coefficients (ICC) for bubble inclinometry ≥ 0.81 and the iPhone® ≥ 0.80. The MDC90 for the interrater analysis ranged from 4° to 9°. The concurrent validity between bubble inclinometry and the iPhone® application was good with ICC values of ≥ 0.86. The 95% level of agreement indicates that although these measuring instruments are equivalent individual differences of up to 18° may exist when using these devices interchangeably. The bubble inclinometer and iPhone® possess good intrarater and interrater reliability as well as concurrent validity when strict measurement procedures are adhered to. This study provides preliminary evidence to suggest that smart phone applications may offer clinical utility comparable to inclinometry for quantifying spinal mobility. Clinicians should be aware of the potential disagreement when using these devices interchangeably. 2b (Observational study of reliability).

The reliability, minimal detectable change and concurrent validity of a gravity-based bubble inclinometer and iphone application for measuring standing lumbar lordosis.

PubMed

Salamh, Paul A; Kolber, Morey

2014-01-01

To investigate the reliability, minimal detectable change (MDC90) and concurrent validity of a gravity-based bubble inclinometer (inclinometer) and iPhone® application for measuring standing lumbar lordosis. Two investigators used both an inclinometer and an iPhone® with an inclinometer application to measure lumbar lordosis of 30 asymptomatic participants. ICC models 3,k and 2,k were used for the intrarater and interrater analysis, respectively. Good interrater and intrarater reliability was present for the inclinometer with Intraclass Correlation Coefficients (ICC) of 0.90 and 0.85, respectively and the iPhone® application with ICC values of 0.96 and 0.81. The minimal detectable change (MDC90) indicates that a change greater than or equal to 7° and 6° is needed to exceed the threshold of error using the iPhone® and inclinometer, respectively. The concurrent validity between the two instruments was good with a Pearson product-moment coefficient of correlation (r) of 0.86 for both raters. Ninety-five percent limits of agreement identified differences ranging from 9° greater in regards to the iPhone® to 8° less regarding the inclinometer. Both the inclinometer and iPhone® application possess good interrater reliability, intrarater reliability and concurrent validity for measuring standing lumbar lordosis. This investigation provides preliminary evidence to suggest that smart phone applications may offer clinical utility comparable to inclinometry for quantifying standing lumbar lordosis. Clinicians should recognize potential individual differences when using these devices interchangeably.

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS).

PubMed

Poon, Vickie Wan-kei; Lam, Linda Chiu-wa; Wong, Samuel Yeung-shan

2008-09-01

With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha=0.89 and alpha=0.94 respectively). High value of Cronbach's alpha (alpha=0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r=0.58 to r=0.78, p<0.01). The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation.

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Test-retest reliability, smallest real difference and concurrent validity of six different balance tests on young people with mild to moderate intellectual disability.

PubMed

Blomqvist, Sven; Wester, Anita; Sundelin, Gunnevi; Rehn, Börje

2012-12-01

Some studies have reported that people with intellectual disability may have reduced balance ability compared with the population in general. However, none of these studies involved adolescents, and the reliability and validity of balance tests in this population are not known. The purpose of this study was to examine the reliability of six different balance tests and to investigate their concurrent validity. Test-retest reliability assessment. All subjects were recruited from a special school for people with intellectual disability in Bollnäs, Sweden. Eighty-nine adolescents (35 females and 54 males) with mild to moderate intellectual disability with a mean age of 18 years (range 16 to 20 years). All subjects followed the same test protocol on two occasions within an 11-day period. Balance test performances. Intraclass correlation coefficients greater than 0.80 were achieved for four of the balance tests: Extended Timed Up and Go Test, Modified Functional Reach Test, One-leg Stance Test and Force Platform Test. The smallest real differences ranged from 12% to 40%; less than 20% is considered to be low. Concurrent validity among these balance tests varied between no and low correlation. The results indicate that these tests could be used to evaluate changes in balance ability over time in people with mild to moderate intellectual disability. The low concurrent validity illustrates the importance of knowing more about the influence of various sensory subsystems that are significant for balance among adolescents with intellectual disability. Copyright © 2011 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

A validation study on the traditional Chinese version of Spinal Appearance Questionnaire for adolescent idiopathic scoliosis.

PubMed

Guo, Jing; Lau, Ajax Hong Yin; Chau, Jack; Ng, Bobby Kin Wah; Lee, Kwong Man; Qiu, Yong; Cheng, Jack Chun Yiu; Lam, Tsz Ping

2016-10-01

"Simplified Chinese" version of Spinal Appearance Questionnaire (SC-SAQ) for patients with adolescent idiopathic scoliosis (AIS) was available but did not fit for communities using "Traditional Chinese" as their primary language. We developed a traditional Chinese version of SAQ (TC-SAQ) and evaluated its reliability and validity. TC-SAQ was administered to 112 AIS patients, of which 101 bilingual (English and Chinese) patients completed E-SAQ and the traditional Chinese version of Scoliosis Research Society-22 questionnaire (TC-SRS-22). Internal consistency and test-retest reliability were evaluated. Concurrent validity was evaluated by comparing TC-SAQ score with E-SAQ score, and convergent validity by comparing TC-SAQ score with TC-SRS-22 self-image domain score, and discriminant validity by analyzing the relationship between TC-SAQ score and patients' characteristics. Internal consistency of individual TC-SAQ domain was high (Cronbach's α = 0.785 to 0.940), except for general (Cronbach's α = 0.665) and shoulders (Cronbach's α = 0.421) domain. Test-retest reliability of TC-SAQ was good (ICCs of each domain from 0.798 to 0.865). Concurrent validity demonstrated an excellent correlation between TC-SAQ and E-SAQ scores (r = 0.820 to 0.954, P < 0.0001 for all domains). Correlation between TC-SAQ domains and TC-SRS-22 self-image domain was weak to moderate. TC-SAQ total score and individual domain scores (except waist and chest domains) were positively correlated to major curve magnitude. TC-SAQ had good internal consistency and test-retest reliability. Concurrent validity evaluated against the original English version was excellent. TC-SAQ was both reliable and valid for clinical use for AIS patients using traditional Chinese as their primary language.

Validating the Alcohol Use Disorders Identification Test with Persons Who Have a Serious Mental Illness

ERIC Educational Resources Information Center

O'Hare, Thomas; Sherrer, Margaret V.; LaButti, Annamaria; Emrick, Kelly

2004-01-01

Objective/Method: The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual assessments and program evaluation for integrated mental health-substance abuse services for persons with serious mental illness. This investigation examines the internal consistency reliability, concurrent validity,…

The cross-cultural adaptation, reliability, and validity of the Copenhagen Neck Functional Disability Scale in patients with chronic neck pain: Turkish version study.

PubMed

Yapali, Gökmen; Günel, Mintaze Kerem; Karahan, Sevilay

2012-05-15

The study design was cross-cultural adaptation and investigation of reliability and validity of the Copenhagen Neck Functional Disability Scale (CNFDS). The aim of this study was to translate the CNFDS into Turkish language and assess its reliability and validity among patients with neck pain in Turkish population. The CNFDS is a reliable and valid evaluation instrument for disability, but there is no published the Turkish version of the CNFDS. One hundred one subjects who had chronic neck pain were included in this study. The CNFDS, Neck Pain and Disability Scale, and visual analogue scale were administered to all subjects. For investigating test-retest reliability, correlation between CNFDS scores, applied at 1-week interval, intraclass correlation coefficient score for test-retest reliability was 0.86 (95% confidence interval = 0.679-0.935). There was no difference between test-retest scores (P < 0.001). For investigating concurrent validity, correlation between total score of the CNFDS and the mean visual analogue scale was r = 0.73 (P < 0.001). Concurrent validity of the CNFDS was very good. For investigating construct validity, correlation between total score of the CNFDS and the Neck Pain and Disability Scale was r = 0.78 (P < 0.001). Construct validity of the CNFDS was also very good. Our results suggest that the Turkish version of the CNFDS is a reliable and valid instrument for Turkish people.

Validity and reliability of Optojump photoelectric cells for estimating vertical jump height.

PubMed

Glatthorn, Julia F; Gouge, Sylvain; Nussbaumer, Silvio; Stauffacher, Simone; Impellizzeri, Franco M; Maffiuletti, Nicola A

2011-02-01

Vertical jump is one of the most prevalent acts performed in several sport activities. It is therefore important to ensure that the measurements of vertical jump height made as a part of research or athlete support work have adequate validity and reliability. The aim of this study was to evaluate concurrent validity and reliability of the Optojump photocell system (Microgate, Bolzano, Italy) with force plate measurements for estimating vertical jump height. Twenty subjects were asked to perform maximal squat jumps and countermovement jumps, and flight time-derived jump heights obtained by the force plate were compared with those provided by Optojump, to examine its concurrent (criterion-related) validity (study 1). Twenty other subjects completed the same jump series on 2 different occasions (separated by 1 week), and jump heights of session 1 were compared with session 2, to investigate test-retest reliability of the Optojump system (study 2). Intraclass correlation coefficients (ICCs) for validity were very high (0.997-0.998), even if a systematic difference was consistently observed between force plate and Optojump (-1.06 cm; p < 0.001). Test-retest reliability of the Optojump system was excellent, with ICCs ranging from 0.982 to 0.989, low coefficients of variation (2.7%), and low random errors (±2.81 cm). The Optojump photocell system demonstrated strong concurrent validity and excellent test-retest reliability for the estimation of vertical jump height. We propose the following equation that allows force plate and Optojump results to be used interchangeably: force plate jump height (cm) = 1.02 × Optojump jump height + 0.29. In conclusion, the use of Optojump photoelectric cells is legitimate for field-based assessments of vertical jump height.

The validity and reliability of the Finnish Family Empowerment Scale (FES): a survey of parents with small children.

PubMed

Vuorenmaa, M; Halme, N; Åstedt-Kurki, P; Kaunonen, M; Perälä, M-L

2014-07-01

The Family Empowerment Scale (FES) is a widely used instrument which measures the parents' own sense of their empowerment at the level of the family, service system and community. It was originally developed for parents of children with emotional disabilities. The aims of this study were to evaluate the validity and reliability of the Finnish FES and to examine its responsiveness in measuring the empowerment of parents with small children. The English FES was translated into Finnish using back translation and modified so as to be generic and convenient for all families. The construct, convergent, discriminant and concurrent validities, reliability and responsiveness of the Finnish FES were examined. Participants (n = 955) were the parents of children aged 0-9 years who had been selected using stratified random sampling. Confirmatory factor analysis proved that the Finnish FES had three subscales based on the original FES. Convergent and discriminant validities confirmed and supported the same construct. The relationship between parents' participation and empowerment was tested for concurrent validity. As in previous FES studies, the participating parents were more empowered, which supported the concurrent validity. The reliability of the Finnish FES proved acceptable for both parents. The Finnish FES could also discriminate the responses of the parents. Participation in the activities organized by the family service system influenced parents' perceptions of empowerment more than did their background characteristics. The Finnish FES is a valid and reliable instrument and it is suitable for measuring the empowerment of parents. However, it is necessary to consider how the FES would identify in the best way the parents who perhaps need some help. © 2013 John Wiley & Sons Ltd.

Quantitative measurement of hypertrophic scar: interrater reliability and concurrent validity.

PubMed

Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo

2008-01-01

Research into the pathophysiology and treatment of hypertrophic scar (HSc) remains limited by the heterogeneity of scar and the imprecision with which its severity is measured. The objective of this study was to test the interrater reliability and concurrent validity of the Cutometer measurement of elasticity, the Mexameter measurement of erythema and pigmentation, and total thickness measure of the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar, and HSc. Three independent investigators evaluated 128 sites (severe HSc, moderate or mild HSc, donor site, and normal skin) on 32 burn survivors using all of the above measurement tools. The intraclass correlation coefficient, which was used to measure interrater reliability, reflects the inherent amount of error in the measure and is considered acceptable when it is >0.75. Interrater reliability of the totals of the height, pliability, and vascularity subscales of the mVSS fell below the acceptable limit ( congruent with0.50). The individual subscales of the mVSS fell well below the acceptable level (< or =0.3). The Cutometer reading of elasticity provided acceptable reliability (>0.89) for each study site with the exception of severe scar. Mexameter and DermaScan C reliability measurements were acceptable for all sites (>0.82). Concurrent validity correlations with the mVSS were significant except for the comparison of the mVSS pliability subscale and the Cutometer maximum deformation measure comparison in severe scar. In conclusion, the Mexameter and DermaScan C measurements of scar color and thickness of all sites, as well as the Cutometer measurement of elasticity in all but the most severe scars shows high interrater reliability. Their significant concurrent validity with the mVSS confirms that these tools are measuring the same traits as the mVSS, and in a more objective way.

Development and assessment of a digital X-ray software tool to determine vertebral rotation in adolescent idiopathic scoliosis.

PubMed

Eijgenraam, Susanne M; Boselie, Toon F M; Sieben, Judith M; Bastiaenen, Caroline H G; Willems, Paul C; Arts, Jacobus J; Lataster, Arno

2017-02-01

The amount of vertebral rotation in the axial plane is of key importance in the prognosis and treatment of adolescent idiopathic scoliosis (AIS). Current methods to determine vertebral rotation are either designed for use in analogue plain radiographs and not useful in digital images, or lack measurement precision and are therefore less suitable for the follow-up of rotation in AIS patients. This study aimed to develop a digital X-ray software tool with high measurement precision to determine vertebral rotation in AIS, and to assess its (concurrent) validity and reliability. In this study a combination of basic science and reliability methodology applied in both laboratory and clinical settings was used. Software was developed using the algorithm of the Perdriolle torsion meter for analogue AP plain radiographs of the spine. Software was then assessed for (1) concurrent validity and (2) intra- and interobserver reliability. Plain radiographs of both human cadaver vertebrae and outpatient AIS patients were used. Concurrent validity was measured by two independent observers, both experienced in the assessment of plain radiographs. Reliability-measurements were performed by three independent spine surgeons. Pearson correlation of the software compared with the analogue Perdriolle torsion meter for mid-thoracic vertebrae was 0.98, for low-thoracic vertebrae 0.97 and for lumbar vertebrae 0.97. Measurement exactness of the software was within 5° in 62% of cases and within 10° in 97% of cases. Intraclass correlation coefficient (ICC) for inter-observer reliability was 0.92 (0.91-0.95), ICC for intra-observer reliability was 0.96 (0.94-0.97). We developed a digital X-ray software tool to determine vertebral rotation in AIS with a substantial concurrent validity and reliability, which may be useful for the follow-up of vertebral rotation in AIS patients. Copyright © 2015 Elsevier Inc. All rights reserved.

Reliability and validity of the neurorehabilitation experience questionnaire for inpatients.

PubMed

Kneebone, Ian I; Hull, Samantha L; McGurk, Rhona; Cropley, Mark

2012-09-01

Patient-centered measures of the inpatient neurorehabilitation experience are needed to assess services. The objective of this study was to develop a valid and reliable Neurorehabilitation Experience Questionnaire (NREQ) to assess whether neurorehabilitation inpatients experience service elements important to them. Based on the themes established in prior qualitative research, adopting questions from established inventories and using a literature review, a draft version of the NREQ was generated. Focus groups and interviews were conducted with 9 patients and 26 staff from neurological rehabilitation units to establish face validity. Then, 70 patients were recruited to complete the NREQ to ascertain reliability (internal and test-retest) and concurrent validity. On the basis of the face validity testing, several modifications were made to the draft version of the NREQ. Subsequently, internal reliability (time 1 α = .76, time 2 α = .80), test retest reliability (r = 0.70), and concurrent validity (r = 0.32 and r = 0.56) were established for the revised version. Whereas responses were associated with positive mood (r = 0.30), they appeared not to be influenced by negative mood, age, education, length of stay, sex, functional independence, or whether a participant had been a patient on a unit previously. Preliminary validation of the NREQ suggests promise for use with its target population.

Three-dimensional assessment of squats and drop jumps using the Microsoft Xbox One Kinect: Reliability and validity.

PubMed

Mentiplay, Benjamin F; Hasanki, Ksaniel; Perraton, Luke G; Pua, Yong-Hao; Charlton, Paula C; Clark, Ross A

2018-03-01

The Microsoft Xbox One Kinect™ (Kinect V2) contains a depth camera that can be used to manually identify anatomical landmark positions in three-dimensions independent of the standard skeletal tracking, and therefore has potential for low-cost, time-efficient three-dimensional movement analysis (3DMA). This study examined inter-session reliability and concurrent validity of the Kinect V2 for the assessment of coronal and sagittal plane kinematics for the trunk, hip and knee during single leg squats (SLS) and drop vertical jumps (DVJ). Thirty young, healthy participants (age = 23 ± 5yrs, male/female = 15/15) performed a SLS and DVJ protocol that was recorded concurrently by the Kinect V2 and 3DMA during two sessions, one week apart. The Kinect V2 demonstrated good to excellent reliability for all SLS and DVJ variables (ICC ≥ 0.73). Concurrent validity ranged from poor to excellent (ICC = 0.02 to 0.98) during the SLS task, although trunk, hip and knee flexion and two-dimensional measures of knee abduction and frontal plane projection angle all demonstrated good to excellent validity (ICC ≥ 0.80). Concurrent validity for the DVJ task was typically worse, with only two variables exceeding ICC = 0.75 (trunk and hip flexion). These findings indicate that the Kinect V2 may have potential for large-scale screening for ACL injury risk, however future prospective research is required.

The Eating and Drinking Ability Classification System: concurrent validity and reliability in children with cerebral palsy.

PubMed

Tschirren, Lea; Bauer, Susanne; Hanser, Chiara; Marsico, Petra; Sellers, Diane; van Hedel, Hubertus J A

2018-06-01

As there is little evidence for concurrent validity of the Eating and Drinking Ability Classification System (EDACS), this study aimed to determine its concurrent validity and reliability in children and adolescents with cerebral palsy (CP). After an extensive translation procedure, we applied the German language version to 52 participants with CP (30 males, 22 females, mean age 9y 7mo [SD 4y 2mo]). We correlated (Kendall's tau or K τ ) the EDACS levels with the Bogenhausener Dysphagiescore (BODS), and the EDACS level of assistance with the Manual Ability Classification System (MACS) and the item 'eating' of the Functional Independence Measure for Children (WeeFIM). We further quantified the interrater reliability between speech and language therapists (SaLTs) and between SaLTs and parents with Kappa (κ). The EDACS levels correlated highly with the BODS (K τ =0.79), and the EDACS level of assistance correlated highly with the MACS (K τ =0.73) and WeeFIM eating item (K τ =-0.80). Interrater reliability proved almost perfect between SaLTs (EDACS: κ=0.94; EDACS level of assistance: κ=0.89) and SaLTs and parents (EDACS: κ=0.82; EDACS level of assistance: κ=0.89). The EDACS levels and level of assistance seem valid and showed almost perfect interrater reliability when classifying eating and drinking problems in children and adolescents with CP. The Eating and Drinking Ability Classification System (EDACS) correlates well with a dysphagia score. The EDACS level of assistance proves valid. The German version of EDACS is highly reliable. EDACS correlates moderately to highly with other classification systems. © 2018 Mac Keith Press.

Reliability of the Balance Evaluation Systems Test (BESTest) and BESTest sections for adults with hemiparesis

PubMed Central

Rodrigues, Letícia C.; Marques, Aline P.; Barros, Paula B.; Michaelsen, Stella M.

2014-01-01

BACKGROUND: The Balance Evaluation Systems Test (BESTest) was recently created to allow the development of treatments according to the specific balance system affected in each patient. The Brazilian version of the BESTest has not been specifically tested after stroke. OBJECTIVE: To evaluate the intra- and inter-rater reliability and concurrent and convergent validity of the total score of the BESTest and BESTest sections for adults with hemiparesis after stroke. METHOD: The study included 16 subjects (61.1±7.5 years) with chronic hemiparesis (54.5±43.5 months after stroke). The BESTest was administered by two raters in the same week and one of the raters repeated the test after a one-week interval. Intraclass correlation coefficient (ICC) was calculated to assess intra- and interrater reliability. Concurrent validity with the Berg Balance Scale (BBS) and convergent validity with the Activities-specific Balance Confidence scale (ABC-Brazil) were assessed using Pearson's correlation coefficient. RESULTS: Both the BESTest total score (ICC=0.98) and the BESTest sections (ICC between 0.85 and 0.96) have excellent intrarater reliability. Interrater reliability for the total score was excellent (ICC=0.93) and, for the sections, it ranged between 0.71 and 0.94. The correlation coefficient between the BESTest and the BBS and ABC-Brazil were 0.78 and 0.59, respectively. CONCLUSIONS: The Brazilian version of the BESTest demonstrated adequate reliability when measured by sections and could identify what balance system was affected in patients after stroke. Concurrent validity was excellent with the BBS total score and good to excellent with the sections. The total scores but not the sections present adequate convergent validity with the ABC-Brazil. However, other psychometric properties should be further investigated. PMID:25003281

THE 6-MINUTE WALK TEST AND OTHER CLINICAL ENDPOINTS IN DUCHENNE MUSCULAR DYSTROPHY: RELIABILITY, CONCURRENT VALIDITY, AND MINIMAL CLINICALLY IMPORTANT DIFFERENCES FROM A MULTICENTER STUDY

PubMed Central

McDonald, Craig M; Henricson, Erik K; Abresch, R Ted; Florence, Julaine; Eagle, Michelle; Gappmaier, Eduard; Glanzman, Allan M; Spiegel, Robert; Barth, Jay; Elfring, Gary; Reha, Allen; Peltz, Stuart W

2013-01-01

Introduction: An international clinical trial enrolled 174 ambulatory males ≥5 years old with nonsense mutation Duchenne muscular dystrophy (nmDMD). Pretreatment data provide insight into reliability, concurrent validity, and minimal clinically important differences (MCIDs) of the 6-minute walk test (6MWT) and other endpoints. Methods: Screening and baseline evaluations included the 6-minute walk distance (6MWD), timed function tests (TFTs), quantitative strength by myometry, the PedsQL, heart rate–determined energy expenditure index, and other exploratory endpoints. Results: The 6MWT proved feasible and reliable in a multicenter context. Concurrent validity with other endpoints was excellent. The MCID for 6MWD was 28.5 and 31.7 meters based on 2 statistical distribution methods. Conclusions: The ratio of MCID to baseline mean is lower for 6MWD than for other endpoints. The 6MWD is an optimal primary endpoint for Duchenne muscular dystrophy (DMD) clinical trials that are focused therapeutically on preservation of ambulation and slowing of disease progression. Muscle Nerve 48: 357–368, 2013 PMID:23674289

Concurrent validity and reliability of the Simple Goniometer iPhone app compared with the Universal Goniometer.

PubMed

Jones, Anne; Sealey, Rebecca; Crowe, Michael; Gordon, Susan

2014-10-01

The aim of this study was to assess the concurrent validity and reliability of the Simple Goniometer (SG) iPhone® app compared to the Universal Goniometer (UG). Within subject comparison design comparing the UG with the SG app. James Cook University, Townsville, Queensland, Australia. Thirty-six volunteer participants, with a mean age of 60.6 years (SD 6.2). Not applicable. Thirty-six participants performed three standing lunges during which the knee joint angle was measured with the SG app and the UG. There were no significant differences in the measures of individual knee joint angles between the UG and the SG app. Pearson correlations of 0.96-0.98 and intraclass correlation coefficients of 0.97-0.99 (95% confidence interval: 0.95-1.00) were recorded for all measures. Using the Bland-Altman method, the standard error of the mean of the differences and the standard deviation of the mean of the differences were low. The measurements from the SG iPhone® app were reliable and possessed concurrent validity for this sample and protocol when compared to the UG.

Validation of the Intrinsic Spirituality Scale (ISS) with Muslims.

PubMed

Hodge, David R; Zidan, Tarek; Husain, Altaf

2015-12-01

This study validates an existing spirituality measure--the intrinsic spirituality scale (ISS)--for use with Muslims in the United States. A confirmatory factor analysis was conducted with a diverse sample of self-identified Muslims (N = 281). Validity and reliability were assessed along with criterion and concurrent validity. The measurement model fit the data well, normed χ2 = 2.50, CFI = 0.99, RMSEA = 0.07, and SRMR = 0.02. All 6 items that comprise the ISS demonstrated satisfactory levels of validity (λ > .70) and reliability (R2 > .50). The Cronbach's alpha obtained with the present sample was .93. Appropriate correlations with theoretically linked constructs demonstrated criterion and concurrent validity. The results suggest the ISS is a valid measure of spirituality in clinical settings with the rapidly growing Muslim population. The ISS may, for instance, provide an efficient screening tool to identify Muslims that are particularly likely to benefit from spiritually accommodative treatments. (c) 2015 APA, all rights reserved).

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Validation of the one pass measure for motivational interviewing competence.

PubMed

McMaster, Fiona; Resnicow, Ken

2015-04-01

This paper examines the psychometric properties of the OnePass coding system: a new, user-friendly tool for evaluating practitioner competence in motivational interviewing (MI). We provide data on reliability and validity with the current gold-standard: Motivational Interviewing Treatment Integrity tool (MITI). We compared scores from 27 videotaped MI sessions performed by student counselors trained in MI and simulated patients using both OnePass and MITI, with three different raters for each tool. Reliability was estimated using intra-class coefficients (ICCs), and validity was assessed using Pearson's r. OnePass had high levels of inter-rater reliability with 19/23 items found from substantial to almost perfect agreement. Taking the pair of scores with the highest inter-rater reliability on the MITI, the concurrent validity between the two measures ranged from moderate to high. Validity was highest for evocation, autonomy, direction and empathy. OnePass appears to have good inter-rater reliability while capturing similar dimensions of MI as the MITI. Despite the moderate concurrent validity with the MITI, the OnePass shows promise in evaluating both traditional and novel interpretations of MI. OnePass may be a useful tool for developing and improving practitioner competence in MI where access to MITI coders is limited. Copyright © 2015. Published by Elsevier Ireland Ltd.

The Validity and reliability of the Comprehensive Home Environment Survey (CHES).

PubMed

Pinard, Courtney A; Yaroch, Amy L; Hart, Michael H; Serrano, Elena L; McFerren, Mary M; Estabrooks, Paul A

2014-01-01

Few comprehensive measures exist to assess contributors to childhood obesity within the home, specifically among low-income populations. The current study describes the modification and psychometric testing of the Comprehensive Home Environment Survey (CHES), an inclusive measure of the home food, physical activity, and media environment related to childhood obesity. The items were tested for content relevance by an expert panel and piloted in the priority population. The CHES was administered to low-income parents of children 5 to 17 years (N = 150), including a subsample of parents a second time and additional caregivers to establish test-retest and interrater reliabilities. Children older than 9 years (n = 95), as well as parents (N = 150) completed concurrent assessments of diet and physical activity behaviors (predictive validity). Analyses and item trimming resulted in 18 subscales and a total score, which displayed adequate internal consistency (α = .74-.92) and high test-retest reliability (r ≥ .73, ps < .01) and interrater reliability (r ≥ .42, ps < .01). The CHES score and a validated screener for the home environment were correlated (r = .37, p < .01; concurrent validity). CHES subscales were significantly correlated with behavioral measures (r = -.20-.55, p < .05; predictive validity). The CHES shows promise as a valid/reliable assessment of the home environment related to childhood obesity, including healthy diet and physical activity.

Examining the Reliability and Validity of ADEPT and CELDT: Comparing Two Assessments of Oral Language Proficiency for English Language Learners

ERIC Educational Resources Information Center

Chavez, Gina

2013-01-01

Few classroom measures of English language proficiency have been evaluated for reliability and validity. This research examined the concurrent and predictive validity of an oral language test, titled A Developmental English Language Proficiency Test (ADEPT), and the relationship to the California English Language Development Test (CELDT) in the…

Validity and Reliability of the Turkish Version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form.

PubMed

Yalin Sapmaz, Şermin; Ergin, Dilek; Özek Erkuran, Handan; Şen Celasin, Nesrin; Öztürk, Masum; Karaarslan, Duygu; Köroğlu, Ertuğrul; Aydemir, Ömer

2017-09-01

This study assessed the validity and reliability of the Turkish version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form for use among the Turkish population. The study group consisted of 30 patients that had been treated in a child psychiatry unit and diagnosed with posttraumatic stress disorder and 83 healthy volunteers that were attending middle or high school during the study period. For reliability analyses, the internal consistency coefficient and the test-retest correlation coefficient were measured. For validity analyses, the exploratory factor analysis and correlation analysis with the Child Posttraumatic Stress Reaction Index for concurrent validity were measured. The Cronbach's alpha (the internal consistency coefficient) of the scale was 0.909, and the test-retest correlation coefficient was 0.663. One factor that could explain 58.5% of the variance was obtained and was congruent with the original construct of the scale. As for concurrent validity, the scale showed high correlation with the Child Posttraumatic Stress Reaction Index. It was concluded that the Turkish version of the DSM-5 Posttraumatic Stress Symptom Severity Scale-Child Form can be used as a valid and reliable tool.

Measuring disability: a systematic review of the validity and reliability of the Global Activity Limitations Indicator (GALI).

PubMed

Van Oyen, Herman; Bogaert, Petronille; Yokota, Renata T C; Berger, Nicolas

2018-01-01

GALI or Global Activity Limitation Indicator is a global survey instrument measuring participation restriction. GALI is the measure underlying the European indicator Healthy Life Years (HLY). Gali has a substantial policy use within the EU and its Member States. The objective of current paper is to bring together what is known from published manuscripts on the validity and the reliability of GALI. Following the PRISMA guidelines, two search strategies (PUBMED, Google Scholar) were combined to identify manuscripts published in English with publication date 2000 or beyond. Articles were classified as reliability studies, concurrent or predictive validity studies, in national or international populations. Four cross-sectional studies (of which 2 international) studied how GALI relates to other health measures (concurrent validity). A dose-response effect by GALI severity level on the association with the other health status measures was observed in the national studies. The 2 international studies (SHARE, EHIS) concluded that the odds of reporting participation restriction was higher in subjects with self-reported or observed functional limitations. In SHARE, the size of the Odds Ratio's (ORs) in the different countries was homogeneous, while in EHIS the size of the ORs varied more strongly. For the predictive validity, subjects were followed over time (4 studies of which one international). GALI proved, both in national and international data, to be a consistent predictor of future health outcomes both in terms of mortality and health care expenditure. As predictors of mortality, the two distinct health concepts, self-rated health and GALI, acted independently and complementary of each other. The one reliability study identified reported a sufficient reliability of GALI. GALI as inclusive one question instrument fits all conceptual characteristics specified for a global measure on participation restriction. In none of the studies, included in the review, there was evidence of a failing validity. The review shows that GALI has a good and sufficient concurrent and predictive validity, and reliability.

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

PubMed

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

Reliability and Validity of the Flemish Physical Activity Computerized Questionnaire in Adults

ERIC Educational Resources Information Center

Matton, Lynn; Wijndaele, Katrien; Duvigneaud, Nathalie; Duquet, William; Philippaerts, Renaat; Thomis, Martine; Lefevre, Johan

2007-01-01

The purpose of this study was to investigate the test-retest reliability and concurrent validity of the Flemish Physical Activity Computerized Questionnaire (FPACQ) in employed/unemployed and retired people. The FPACQ was developed to assess detailed information on several dimensions of physical activity and sedentary behavior over a usual week. A…

Technical Adequacy of the easyCBM Grade 2 Reading Measures. Technical Report #1004

ERIC Educational Resources Information Center

Jamgochian, Elisa; Park, Bitnara Jasmine; Nese, Joseph F. T.; Lai, Cheng-Fei; Saez, Leilani; Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

Reliability and concurrent validity of a Smartphone, bubble inclinometer and motion analysis system for measurement of hip joint range of motion.

PubMed

Charlton, Paula C; Mentiplay, Benjamin F; Pua, Yong-Hao; Clark, Ross A

2015-05-01

Traditional methods of assessing joint range of motion (ROM) involve specialized tools that may not be widely available to clinicians. This study assesses the reliability and validity of a custom Smartphone application for assessing hip joint range of motion. Intra-tester reliability with concurrent validity. Passive hip joint range of motion was recorded for seven different movements in 20 males on two separate occasions. Data from a Smartphone, bubble inclinometer and a three dimensional motion analysis (3DMA) system were collected simultaneously. Intraclass correlation coefficients (ICCs), coefficients of variation (CV) and standard error of measurement (SEM) were used to assess reliability. To assess validity of the Smartphone application and the bubble inclinometer against the three dimensional motion analysis system, intraclass correlation coefficients and fixed and proportional biases were used. The Smartphone demonstrated good to excellent reliability (ICCs>0.75) for four out of the seven movements, and moderate to good reliability for the remaining three movements (ICC=0.63-0.68). Additionally, the Smartphone application displayed comparable reliability to the bubble inclinometer. The Smartphone application displayed excellent validity when compared to the three dimensional motion analysis system for all movements (ICCs>0.88) except one, which displayed moderate to good validity (ICC=0.71). Smartphones are portable and widely available tools that are mostly reliable and valid for assessing passive hip range of motion, with potential for large-scale use when a bubble inclinometer is not available. However, caution must be taken in its implementation as some movement axes demonstrated only moderate reliability. Copyright © 2014 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Validity and intra-rater reliability of an android phone application to measure cervical range-of-motion.

PubMed

Quek, June; Brauer, Sandra G; Treleaven, Julia; Pua, Yong-Hao; Mentiplay, Benjamin; Clark, Ross Allan

2014-04-17

Concurrent validity and intra-rater reliability using a customized Android phone application to measure cervical-spine range-of-motion (ROM) has not been previously validated against a gold-standard three-dimensional motion analysis (3DMA) system. Twenty-one healthy individuals (age:31 ± 9.1 years, male:11) participated, with 16 re-examined for intra-rater reliability 1-7 days later. An Android phone was fixed on a helmet, which was then securely fastened on the participant's head. Cervical-spine ROM in flexion, extension, lateral flexion and rotation were performed in sitting with concurrent measurements obtained from both a 3DMA system and the phone.The phone demonstrated moderate to excellent (ICC = 0.53-0.98, Spearman ρ = 0.52-0.98) concurrent validity for ROM measurements in cervical flexion, extension, lateral-flexion and rotation. However, cervical rotation demonstrated both proportional and fixed bias. Excellent intra-rater reliability was demonstrated for cervical flexion, extension and lateral flexion (ICC = 0.82-0.90), but poor for right- and left-rotation (ICC = 0.05-0.33) using the phone. Possible reasons for the outcome are that flexion, extension and lateral-flexion measurements are detected by gravity-dependent accelerometers while rotation measurements are detected by the magnetometer which can be adversely affected by surrounding magnetic fields. The results of this study demonstrate that the tested Android phone application is valid and reliable to measure ROM of the cervical-spine in flexion, extension and lateral-flexion but not in rotation likely due to magnetic interference. The clinical implication of this study is that therapists should be mindful of the plane of measurement when using the Android phone to measure ROM of the cervical-spine.

Validity and intra-rater reliability of an Android phone application to measure cervical range-of-motion

PubMed Central

2014-01-01

Background Concurrent validity and intra-rater reliability using a customized Android phone application to measure cervical-spine range-of-motion (ROM) has not been previously validated against a gold-standard three-dimensional motion analysis (3DMA) system. Findings Twenty-one healthy individuals (age:31 ± 9.1 years, male:11) participated, with 16 re-examined for intra-rater reliability 1–7 days later. An Android phone was fixed on a helmet, which was then securely fastened on the participant’s head. Cervical-spine ROM in flexion, extension, lateral flexion and rotation were performed in sitting with concurrent measurements obtained from both a 3DMA system and the phone. The phone demonstrated moderate to excellent (ICC = 0.53-0.98, Spearman ρ = 0.52-0.98) concurrent validity for ROM measurements in cervical flexion, extension, lateral-flexion and rotation. However, cervical rotation demonstrated both proportional and fixed bias. Excellent intra-rater reliability was demonstrated for cervical flexion, extension and lateral flexion (ICC = 0.82-0.90), but poor for right- and left-rotation (ICC = 0.05-0.33) using the phone. Possible reasons for the outcome are that flexion, extension and lateral-flexion measurements are detected by gravity-dependent accelerometers while rotation measurements are detected by the magnetometer which can be adversely affected by surrounding magnetic fields. Conclusion The results of this study demonstrate that the tested Android phone application is valid and reliable to measure ROM of the cervical-spine in flexion, extension and lateral-flexion but not in rotation likely due to magnetic interference. The clinical implication of this study is that therapists should be mindful of the plane of measurement when using the Android phone to measure ROM of the cervical-spine. PMID:24742001

The MG Composite

PubMed Central

Burns, Ted M.; Conaway, Mark; Sanders, Donald B.

2010-01-01

Objective: To study the concurrent and construct validity and test-retest reliability in the practice setting of an outcome measure for myasthenia gravis (MG). Methods: Eleven centers participated in the validation study of the Myasthenia Gravis Composite (MGC) scale. Patients with MG were evaluated at 2 consecutive visits. Concurrent and construct validities of the MGC were assessed by evaluating MGC scores in the context of other MG-specific outcome measures. We used numerous potential indicators of clinical improvement to assess the sensitivity and specificity of the MGC for detecting clinical improvement. Test-retest reliability was performed on patients at the University of Virginia. Results: A total of 175 patients with MG were enrolled at 11 sites from July 1, 2008, to January 31, 2009. A total of 151 patients were seen in follow-up. Total MGC scores showed excellent concurrent validity with other MG-specific scales. Analyses of sensitivities and specificities of the MGC revealed that a 3-point improvement in total MGC score was optimal for signifying clinical improvement. A 3-point improvement in the MGC also appears to represent a meaningful improvement to most patients, as indicated by improved 15-item myasthenia gravis quality of life scale (MG-QOL15) scores. The psychometric properties were no better for an individualized subscore made up of the 2 functional domains that the patient identified as most important to treat. The test-retest reliability coefficient of the MGC was 98%, with a lower 95% confidence interval of 97%, indicating excellent test-retest reliability. Conclusions: The Myasthenia Gravis Composite is a reliable and valid instrument for measuring clinical status of patients with myasthenia gravis in the practice setting and in clinical trials. PMID:20439845

The validity of upper-limb neurodynamic tests for detecting peripheral neuropathic pain.

PubMed

Nee, Robert J; Jull, Gwendolen A; Vicenzino, Bill; Coppieters, Michel W

2012-05-01

The validity of upper-limb neurodynamic tests (ULNTs) for detecting peripheral neuropathic pain (PNP) was assessed by reviewing the evidence on plausibility, the definition of a positive test, reliability, and concurrent validity. Evidence was identified by a structured search for peer-reviewed articles published in English before May 2011. The quality of concurrent validity studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies tool, where appropriate. Biomechanical and experimental pain data support the plausibility of ULNTs. Evidence suggests that a positive ULNT should at least partially reproduce the patient's symptoms and that structural differentiation should change these symptoms. Data indicate that this definition of a positive ULNT is reliable when used clinically. Limited evidence suggests that the median nerve test, but not the radial nerve test, helps determine whether a patient has cervical radiculopathy. The median nerve test does not help diagnose carpal tunnel syndrome. These findings should be interpreted cautiously, because diagnostic accuracy might have been distorted by the investigators' definitions of a positive ULNT. Furthermore, patients with PNP who presented with increased nerve mechanosensitivity rather than conduction loss might have been incorrectly classified by electrophysiological reference standards as not having PNP. The only evidence for concurrent validity of the ulnar nerve test was a case study on cubital tunnel syndrome. We recommend that researchers develop more comprehensive reference standards for PNP to accurately assess the concurrent validity of ULNTs and continue investigating the predictive validity of ULNTs for prognosis or treatment response.

Clinimetric properties of the Tinetti Mobility Test, Four Square Step Test, Activities-specific Balance Confidence Scale, and spatiotemporal gait measures in individuals with Huntington's disease

PubMed Central

Kloos, Anne D.; Fritz, Nora E.; Kostyk, Sandra K.; Young, Gregory S.; Kegelmeyer, Deb A.

2014-01-01

Background and purpose Individuals with Huntington's disease (HD) experience balance and gait problems that lead to falls. Clinicians currently have very little information about the reliability and validity of outcome measures to determine the efficacy of interventions that aim to reduce balance and gait impairments in HD. This study examined the reliability and concurrent validity of spatiotemporal gait measures, the Tinetti Mobility Test (TMT), Four Square Step Test (FSST), and Activities-specific Balance Confidence (ABC) Scale in individuals with HD. Methods Participants with HD [n = 20; mean age ± SD = 50.9 ± 13.7; 7 male] were tested on spatiotemporal gait measures the TMT, FSST, and ABC Scale before and after a six week period to determine test–retest reliability and minimal detectable change (MDC) values. Linear relationships between gait and clinical measures were estimated using Pearson's correlation coefficients. Results Spatiotemporal gait measures, the TMT total and the FSST showed good to excellent test–retest reliability (ICC > 0.75). MDC values were 0.30 m/s and 0.17 m/s for velocity in forward and backward walking respectively, four points for the TMT, and 3 s for the FSST. The TMT and FSST were highly correlated with most spatiotemporal measures. The ABC Scale demonstrated lower reliability and less concurrent validity than other measures. Conclusions The high test–retest reliability over a six week period and concurrent validity between the TMT, FSST, and spatiotemporal gait measures suggest that the TMT and FSST may be useful outcome measures for future intervention studies in ambulatory individuals with HD. PMID:25128156

Clinimetric properties of the Tinetti Mobility Test, Four Square Step Test, Activities-specific Balance Confidence Scale, and spatiotemporal gait measures in individuals with Huntington's disease.

PubMed

Kloos, Anne D; Fritz, Nora E; Kostyk, Sandra K; Young, Gregory S; Kegelmeyer, Deb A

2014-09-01

Individuals with Huntington's disease (HD) experience balance and gait problems that lead to falls. Clinicians currently have very little information about the reliability and validity of outcome measures to determine the efficacy of interventions that aim to reduce balance and gait impairments in HD. This study examined the reliability and concurrent validity of spatiotemporal gait measures, the Tinetti Mobility Test (TMT), Four Square Step Test (FSST), and Activities-specific Balance Confidence (ABC) Scale in individuals with HD. Participants with HD [n = 20; mean age ± SD=50.9 ± 13.7; 7 male] were tested on spatiotemporal gait measures and the TMT, FSST, and ABC Scale before and after a six week period to determine test-retest reliability and minimal detectable change (MDC) values. Linear relationships between gait and clinical measures were estimated using Pearson's correlation coefficients. Spatiotemporal gait measures, the TMT total and the FSST showed good to excellent test-retest reliability (ICC > 0.75). MDC values were 0.30 m/s and 0.17 m/s for velocity in forward and backward walking respectively, four points for the TMT, and 3s for the FSST. The TMT and FSST were highly correlated with most spatiotemporal measures. The ABC Scale demonstrated lower reliability and less concurrent validity than other measures. The high test-retest reliability over a six week period and concurrent validity between the TMT, FSST, and spatiotemporal gait measures suggest that the TMT and FSST may be useful outcome measures for future intervention studies in ambulatory individuals with HD. Copyright © 2014 Elsevier B.V. All rights reserved.

The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia.

PubMed

Chung, Wen Wei; Chua, Siew Siang; Lai, Pauline Siew Mei; Morisky, Donald E

2015-01-01

Medication non-adherence is a prevalent problem worldwide but up to today, no gold standard is available to assess such behavior. This study was to evaluate the psychometric properties, particularly the concurrent validity of the English version of the Malaysian Medication Adherence Scale (MALMAS) among people with type 2 diabetes in Malaysia. Individuals with type 2 diabetes, aged 21 years and above, using at least one anti-diabetes agent and could communicate in English were recruited. The MALMAS was compared with the 8-item Morisky Medication Adherence Scale (MMAS-8) to assess its convergent validity while concurrent validity was evaluated based on the levels of glycated hemoglobin (HbA1C). Participants answered the MALMAS twice: at baseline and 4 weeks later. The study involved 136 participants. The MALMAS achieved acceptable internal consistency (Cronbach's alpha=0.565) and stable reliability as the test-retest scores showed fair correlation (Spearman's rho=0.412). The MALMAS has good correlation with the MMAS-8 (Spearman's rho=0.715). Participants who were adherent to their anti-diabetes medications had significantly lower median HbA1C values than those who were non-adherence (7.90 versus 8.55%, p=0.032). The odds of participants who were adherent to their medications achieving good glycemic control was 3.36 times (95% confidence interval: 1.09-10.37) of those who were non-adherence. This confirms the concurrent validity of the MALMAS. The sensitivity of the MALMAS was 88.9% while its specificity was 29.6%. The findings of this study further substantiates the reliability and validity of the MALMAS, in particular its concurrent validity and sensitivity for assessing medication adherence of people with type 2 diabetes in Malaysia.

The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia

PubMed Central

Lai, Pauline Siew Mei; Morisky, Donald E.

2015-01-01

Medication non-adherence is a prevalent problem worldwide but up to today, no gold standard is available to assess such behavior. This study was to evaluate the psychometric properties, particularly the concurrent validity of the English version of the Malaysian Medication Adherence Scale (MALMAS) among people with type 2 diabetes in Malaysia. Individuals with type 2 diabetes, aged 21 years and above, using at least one anti-diabetes agent and could communicate in English were recruited. The MALMAS was compared with the 8-item Morisky Medication Adherence Scale (MMAS-8) to assess its convergent validity while concurrent validity was evaluated based on the levels of glycated hemoglobin (HbA1C). Participants answered the MALMAS twice: at baseline and 4 weeks later. The study involved 136 participants. The MALMAS achieved acceptable internal consistency (Cronbach’s alpha=0.565) and stable reliability as the test-retest scores showed fair correlation (Spearman’s rho=0.412). The MALMAS has good correlation with the MMAS-8 (Spearman’s rho=0.715). Participants who were adherent to their anti-diabetes medications had significantly lower median HbA1C values than those who were non-adherence (7.90 versus 8.55%, p=0.032). The odds of participants who were adherent to their medications achieving good glycemic control was 3.36 times (95% confidence interval: 1.09-10.37) of those who were non-adherence. This confirms the concurrent validity of the MALMAS. The sensitivity of the MALMAS was 88.9% while its specificity was 29.6%. The findings of this study further substantiates the reliability and validity of the MALMAS, in particular its concurrent validity and sensitivity for assessing medication adherence of people with type 2 diabetes in Malaysia. PMID:25909363

Reliability and validity of a measure of role functioning among people with psychiatric disabilities.

PubMed

Harris, Meredith; Gladman, Beverley; Hennessy, Nicole; Lloyd, Chris; Mowry, Bryan; Waghorn, Geoffrey

2011-06-01

The aim was to investigate the reliability and validity of the Socially Valued Role Classification Scale (SRCS), a domain-specific measure of role functioning designed for use with community residents with psychiatric disabilities. Test-retest reliability, concurrent validity, face validity, consumer and clinician acceptability and utility were examined. Sixty community residents with schizophrenia or schizoaffective disorder participated in this study where the SRCS was administered by telephone. Test-retest reliability showed good or very good agreement for subscale scores (intraclass correlations (ICCs): 0.78-0.89) and for items capturing amount of participation in domain-specific activities (ICC: 0.67-1.00). Greater variation was observed for items capturing assistance required with activities (κ: 0.40-0.75), and standard of activities performed (κ: 0.43-1.00). Concurrent validity was supported by moderate to very good associations in the directions expected. Face validity, user acceptability and utility in telephone interviews were adequate. These findings add to previous psychometric evidence and support the continued development of the SRCS for use in community mental health settings. The SRCS has promising utility for occupational therapists involved in psychiatric rehabilitation outcome measurement. © 2011 Queensland Health - QCMHR. Australian Occupational Therapy Journal © 2011 Australian Association of Occupational Therapists.

Assessing Empathy across Childhood and Adolescence: Validation of the Empathy Questionnaire for Children and Adolescents (EmQue-CA)

PubMed Central

Overgaauw, Sandy; Rieffe, Carolien; Broekhof, Evelien; Crone, Eveline A.; Güroğlu, Berna

2017-01-01

Empathy plays a crucial role in healthy social functioning and in maintaining positive social relationships. In this study, 1250 children and adolescents (10–15 year olds) completed the newly developed Empathy Questionnaire for Children and Adolescents (EmQue-CA) that was tested on reliability, construct validity, convergent validity, and concurrent validity. The EmQue-CA aims to assess empathy using the following scales: affective empathy, cognitive empathy, and intention to comfort. A Principal Components Analysis, which was directly tested with a Confirmatory Factor Analysis, confirmed the proposed three-factor model resulting in 14 final items. Reliability analyses demonstrated high internal consistency of the scales. Furthermore, the scales showed high convergent validity, as they were positively correlated with related scales of the Interpersonal Reactivity Index (Davis, 1983). With regard to concurrent validity, higher empathy was related to more attention to others’ emotions, higher friendship quality, less focus on own affective state, and lower levels of bullying behavior. Taken together, we show that the EmQue-CA is a reliable and valid instrument to measure empathy in typically developing children and adolescents aged 10 and older. PMID:28611713

A digital photographic measurement method for quantifying foot posture: validity, reliability, and descriptive data.

PubMed

Cobb, Stephen C; James, C Roger; Hjertstedt, Matthew; Kruk, James

2011-01-01

Although abnormal foot posture long has been associated with lower extremity injury risk, the evidence is equivocal. Poor intertester reliability of traditional foot measures might contribute to the inconsistency. To investigate the validity and reliability of a digital photographic measurement method (DPMM) technology, the reliability of DPMM-quantified foot measures, and the concurrent validity of the DPMM with clinical-measurement methods (CMMs) and to report descriptive data for DPMM measures with moderate to high intratester and intertester reliability. Descriptive laboratory study. Biomechanics research laboratory. A total of 159 people participated in 3 groups. Twenty-eight people (11 men, 17 women; age  =  25 ± 5 years, height  =  1.71 ± 0.10 m, mass  =  77.6 ± 17.3 kg) were recruited for investigation of intratester and intertester reliability of the DPMM technology; 20 (10 men, 10 women; age  =  24 ± 2 years, height  =  1.71 ± 0.09 m, mass  =  76 ± 16 kg) for investigation of DPMM and CMM reliability and concurrent validity; and 111 (42 men, 69 women; age  =  22.8 ± 4.7 years, height  =  168.5 ± 10.4 cm, mass  =  69.8 ± 13.3 kg) for development of a descriptive data set of the DPMM foot measurements with moderate to high intratester and intertester reliabilities. The dimensions of 10 model rectangles and the 28 participants' feet were measured, and DPMM foot posture was measured in the 111 participants. Two clinicians assessed the DPMM and CMM foot measures of the 20 participants. Validity and reliability were evaluated using mean absolute and percentage errors and intraclass correlation coefficients. Descriptive data were computed from the DPMM foot posture measures. The DPMM technology intratester and intertester reliability intraclass correlation coefficients were 1.0 for each tester and variable. Mean absolute errors were equal to or less than 0.2 mm for the bottom and right-side variables and 0.1° for the calculated angle variable. Mean percentage errors between the DPMM and criterion reference values were equal to or less than 0.4%. Intratester and intertester reliabilities of DPMM-computed structural measures of arch and navicular indices were moderate to high (>0.78), and concurrent validity was moderate to strong. The DPMM is a valid and reliable clinical and research tool for quantifying foot structure. The DPMM and the descriptive data might be used to define groups in future studies in which the relationship between foot posture and function or injury risk is investigated.

Validity and reliability of a novel measure of activity performance and participation.

PubMed

Murgatroyd, Phil; Karimi, Leila

2016-01-01

To develop and evaluate an innovative clinician-rated measure, which produces global numerical ratings of activity performance and participation. Repeated measures study with 48 community-dwelling participants investigating clinical sensibility, comprehensiveness, practicality, inter-rater reliability, responsiveness, sensitivity and concurrent validity with Barthel Index. Important clinimetric characteristics including comprehensiveness and ease of use were rated >8/10 by clinicians. Inter-rater reliability was excellent on the summary scores (intraclass correlation of 0.95-0.98). There was good evidence that the new outcome measure distinguished between known high and low functional scoring groups, including both responsiveness to change and sensitivity at the same time point in numerous tests. Concurrent validity with the Barthel Index was fair to high (Spearman Rank Order Correlation 0.32-0.85, p > 0.05). The new measure's summary scores were nearly twice as responsive to change compared with the Barthel Index. Other more detailed data could also be generated by the new measure. The Activity Performance Measure is an innovative outcome instrument that showed good clinimetric qualities in this initial study. Some of the results were strong, given the sample size, and further trial and evaluation is appropriate. Implications for Rehabilitation The Activity Performance Measure is an innovative outcome measure covering activity performance and participation. In an initial evaluation, it showed good clinimetric qualities including responsiveness to change, sensitivity, practicality, clinical sensibility, item coverage, inter-rater reliability and concurrent validity with the Barthel Index. Further trial and evaluation is appropriate.

Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables.

PubMed

Mentiplay, Benjamin F; Perraton, Luke G; Bower, Kelly J; Pua, Yong-Hao; McGaw, Rebekah; Heywood, Sophie; Clark, Ross A

2015-07-16

The revised Xbox One Kinect, also known as the Microsoft Kinect V2 for Windows, includes enhanced hardware which may improve its utility as a gait assessment tool. This study examined the concurrent validity and inter-day reliability of spatiotemporal and kinematic gait parameters estimated using the Kinect V2 automated body tracking system and a criterion reference three-dimensional motion analysis (3DMA) marker-based camera system. Thirty healthy adults performed two testing sessions consisting of comfortable and fast paced walking trials. Spatiotemporal outcome measures related to gait speed, speed variability, step length, width and time, foot swing velocity and medial-lateral and vertical pelvis displacement were examined. Kinematic outcome measures including ankle flexion, knee flexion and adduction and hip flexion were examined. To assess the agreement between Kinect and 3DMA systems, Bland-Altman plots, relative agreement (Pearson's correlation) and overall agreement (concordance correlation coefficients) were determined. Reliability was assessed using intraclass correlation coefficients, Cronbach's alpha and standard error of measurement. The spatiotemporal measurements had consistently excellent (r≥0.75) concurrent validity, with the exception of modest validity for medial-lateral pelvis sway (r=0.45-0.46) and fast paced gait speed variability (r=0.73). In contrast kinematic validity was consistently poor to modest, with all associations between the systems weak (r<0.50). In those measures with acceptable validity, the inter-day reliability was similar between systems. In conclusion, while the Kinect V2 body tracking may not accurately obtain lower body kinematic data, it shows great potential as a tool for measuring spatiotemporal aspects of gait. Copyright © 2015 Elsevier Ltd. All rights reserved.

Factor Structure and Psychometric Properties of the Work-Family Balance Scale in an Urban Chinese Sample.

PubMed

Zhang, Huiping; Yip, Paul S F; Chi, Peilian; Chan, Kinsun; Cheung, Yee Tak; Zhang, Xiulan

2012-02-01

The purpose of this study was to explore the factor structure of the Work-Family Balance Scale (WFBS) and examine its reliability and validity in use in the urban Chinese population. The scale was validated using a sample of 605 urban Chinese residents from 7 cities. Exploratory factor analysis identified two factors: work-family conflict and work-family enrichment. The WFBS showed adequate reliability and concurrent validity. The WFBS is a reliable and valid instrument to measure work-family balance for Chinese working parents. However, further examination of the scale is needed.

The Mayo Dysphagia Questionnaire-30: documentation of reliability and validity of a tool for interventional trials in adults with esophageal disease.

PubMed

McElhiney, Judith; Lohse, Matthew R; Arora, Amindra S; Peloquin, Joanna M; Geno, Debra M; Kuntz, Melissa M; Enders, Felicity B; Fredericksen, Mary; Abdalla, Adil A; Khan, Yulia; Talley, Nicholas J; Diehl, Nancy N; Beebe, Timothy J; Harris, Ann M; Farrugia, Gianrico; Graner, Darlene E; Murray, Joseph A; Locke, G Richard; Grothe, Rayna M; Crowell, Michael D; Francis, Dawn L; Grudell, April M B; Dabade, Tushar; Ramirez, Angelica; Alkhatib, MhdMaan; Alexander, Jeffrey A; Kimber, Jessica; Prasad, Ganapathy; Zinsmeister, Alan R; Romero, Yvonne

2010-09-01

The aim of this study was to develop the Mayo Dysphagia Questionnaire-30 Day (MDQ-30), a tool to measure esophageal dysphagia, by adapting items from validated instruments for use in clinical trials, and assess its feasibility, reproducibility, and concurrent validity. Outpatients referred to endoscopy for dysphagia or seen in a specialty clinic were recruited. Feasibility testing was done to identify problematic items. Reproducibility was measured by test-retest format. Concurrent validity reflects agreement between information gathered in a structured interview versus the patients' written responses. The MDQ-30, a 28-item instrument, took 10 min (range = 5-30 min) to complete. Four hundred thirty-one outpatients [210 (49%) men; mean age = 61 years] participated. Overall, most concurrent validity kappa values for dysphagia were very good to excellent with a median of 0.78 (min 0.28, max 0.95). The majority of reproducibility kappa values for dysphagia were moderate to excellent with a median kappa value of 0.66 (min 0.07, max 1.0). Overall, concurrent validity and reproducibility kappa values for gastroesophageal reflux disease (GERD) symptoms were 0.81 (95% CI = 0.72, 0.91) and 0.66 (95% CI = 0.55, 0.77), respectively. Individual item percent agreement was generally very good to excellent. Internal consistency was excellent. We conclude that the MDQ-30 is an easy-to-complete tool to evaluate reliably dysphagia symptoms over the last 30 days.

Validation of the Inventory of Depressive Symptomatology (IDS) in Cocaine Dependent Inmates.

ERIC Educational Resources Information Center

Suris, Alina; Kashner, T. Michael; Gillaspy, James A., Jr.; Biggs, Melanie; Rush, A. John

2001-01-01

While the reliability and validity of Inventory of Depressive Symptomatology (IDS) scores have been established with outpatient adults being treated in community psychiatric clinics, it has not been used in special or dually diagnosed populations. Establishes internal consistency, concurrent validity, and construct validity for both the clinical…

Assessing physiotherapists' communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool.

PubMed

Murray, Aileen; Hall, Amanda; Williams, Geoffrey C; McDonough, Suzanne M; Ntoumanis, Nikos; Taylor, Ian; Jackson, Ben; Copsey, Bethan; Hurley, Deirdre A; Matthews, James

2018-02-27

To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings. This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase. The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.

[Psychometric properties and diagnostic value of 'lexical screening for aphasias'].

PubMed

Pena-Chavez, R; Martinez-Jimenez, L; Lopez-Espinoza, M

2014-09-16

INTRODUCTION. Language assessment in persons with brain injury makes it possible to know whether they require language rehabilitation or not. Given the importance of a precise evaluation, assessment instruments must be valid and reliable, so as to avoid mistaken and subjective diagnoses. AIM. To validate 'lexical screening for aphasias' in a sample of 58 Chilean individuals. SUBJECTS AND METHODS. A screening-type language test, lasting 20 minutes and based on the lexical processing model devised by Patterson and Shewell (1987), was constructed. The sample was made up of two groups containing 29 aphasic subjects and 29 control subjects from different health centres in the regions of Biobio and Maule, Chile. Their ages ranged between 24 and 79 years and had between 0 and 17 years' schooling. Tests were carried out to determine discriminating validity, concurrent validity with the aphasia disorder assessment battery, reliability, sensitivity and specificity. RESULTS. The statistical analysis showed a high discriminating validity (p < 0.001), an acceptable mean concurrent validity with aphasia disorder assessment battery (rs = 0.65), high mean reliability (alpha = 0.87), moderate mean sensitivity (69%) and high mean specificity (86%). CONCLUSION. 'Lexical screening for aphasias' is valid and reliable for assessing language in persons with aphasias; it is sensitive for detecting aphasic subjects and is specific for precluding language disorders in persons with normal language abilities.

Development and validation of the Stirling Eating Disorder Scales.

PubMed

Williams, G J; Power, K G; Miller, H R; Freeman, C P; Yellowlees, A; Dowds, T; Walker, M; Parry-Jones, W L

1994-07-01

The development and reliability/validity check of an 80-item, 8-scale measure for use with eating disorder patients is presented. The Stirling Eating Disorder Scales (SEDS) assess anorexic dietary behavior, anorexic dietary cognitions, bulimic dietary behavior, bulimic dietary cognitions, high perceived external control, low assertiveness, low self-esteem, and self-directed hostility. The SEDS were administered to 82 eating disorder patients and 85 controls. Results indicate that the SEDS are acceptable in terms of internal consistency, reliability, group validity, and concurrent validity.

Greek cultural adaption and validation of the Kujala anterior knee pain scale in patients with patellofemoral pain syndrome.

PubMed

Papadopoulos, Costas; Constantinou, Antonis; Cheimonidou, Areti-Zoi; Stasinopoulos, Dimitrios

2017-04-01

To cross-culturally adapt and validate the Greek version of the Kujala anterior knee pain scale (KAKPS). The Greek KAKPS was translated from the original English version following standard forward and backward translation procedures. The survey was then conducted in clinical settings by a questionnaire comprising the Greek KAKPS and patellofemoral pain syndrome (PFPS) severity scale. A total of 130 (62 women and 68 men) Greek-reading patients between 18 and 45 years old with anterior knee pain (AKP) for at least four weeks were recruited from physical therapy clinics. To establish test-retest reliability, the patients were asked to complete the KAKPS at initial visit and 2-3 days after the initial visit. The Greek version of the PFPS severity scale was also administered once at initial visit. Internal consistency of the translated instrument was measured using Cronbach's α. An intraclass correlation coefficient was used to assess the test-retest reliability of the KAKPS. Concurrent validity was measured by correlating the KAKPS with the PFPS severity scale using Pearson's correlation coefficient. The results showed that the Greek KAKPS has good internal consistency (Cronbach's α = 0.942), test-retest reliability (ICC = 0.921) and concurrent validity (r > 0.7). This study has shown that the Greek KAKPS has good internal consistency, test-retest reliability and concurrent validity when correlated with the PFPS severity scale in adult patients with AKP for at least four weeks. Implications for rehabilitation The Greek version of the KAKPS has been found to be reliable and valid when used in adult patients with AKP for at least four weeks. The results of the psychometric characteristics were compatible with those of the original English version. The KAKPS could be applied in a Greek-speaking population to assess functional limitations and symptoms in patients aged 18-45 years old with AKP for at least four weeks.

The Reliability and Validity of the Concepts About Print and Record of Oral Language.

ERIC Educational Resources Information Center

Day, H. D.; Day, Kaaren C.

The Concepts about Print (Sand) and Record of Oral Language (ROL) tests were administered three times to 29 male and 27 female kindergarten children as part of a study to determine the reliability and concurrent validity of the tests. The Sand and Metropolitan Readiness Test (MRT) were administered to the returning participants (27 males and 24…

Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity

PubMed Central

Nicholas, Kevin; Sparkes, Valerie; Sheeran, Liba; Davies, Jennifer L

2018-01-01

The aim of this study was to investigate the reliability and concurrent validity of a commercially available Xsens MVN BIOMECH inertial-sensor-based motion capture system during clinically relevant functional activities. A clinician with no prior experience of motion capture technologies and an experienced clinical movement scientist each assessed 26 healthy participants within each of two sessions using a camera-based motion capture system and the MVN BIOMECH system. Participants performed overground walking, squatting, and jumping. Sessions were separated by 4 ± 3 days. Reliability was evaluated using intraclass correlation coefficient and standard error of measurement, and validity was evaluated using the coefficient of multiple correlation and the linear fit method. Day-to-day reliability was generally fair-to-excellent in all three planes for hip, knee, and ankle joint angles in all three tasks. Within-day (between-rater) reliability was fair-to-excellent in all three planes during walking and squatting, and poor-to-high during jumping. Validity was excellent in the sagittal plane for hip, knee, and ankle joint angles in all three tasks and acceptable in frontal and transverse planes in squat and jump activity across joints. Our results suggest that the MVN BIOMECH system can be used by a clinician to quantify lower-limb joint angles in clinically relevant movements. PMID:29495600

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)".

PubMed

Resnik, Linda; Borgia, Matthew; Ni, Pensheng; Pirraglia, Paul A; Jette, Alan

2012-09-17

The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT.The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration.

Validity and Reliability of Farsi Version of Youth Sport Environment Questionnaire

PubMed Central

Eshghi, Mohammad Ali; Kordi, Ramin; Memari, Amir Hossein; Ghaziasgar, Ahmad; Mansournia, Mohammad-Ali; Zamani Sani, Seyed Hojjat

2015-01-01

The Youth Sport Environment Questionnaire (YSEQ) had been developed from Group Environment Questionnaire, a well-known measure of team cohesion. The aim of this study was to adapt and examine the reliability and validity of the Farsi version of the YSEQ. This version was completed by 455 athletes aged 13–17 years. Results of confirmatory factor analysis indicated that two-factor solution showed a good fit to the data. The results also revealed that the Farsi YSEQ showed high internal consistency, test-retest reliability, and good concurrent validity. This study indicated that the Farsi version of the YSEQ is a valid and reliable measure to assess team cohesion in sport setting. PMID:26464900

Psychometric Properties of the Chinese Version of the Occupational Fatigue Exhaustion/Recovery Scale: A Test in a Nursing Population.

PubMed

Fang, Jin-Bo; Zhou, Chun-Fen; Huang, Jing; Qiu, Chang-Jian

2018-06-01

The Occupational Fatigue Exhaustion/Recovery Scale (OFER) was designed to assess occupational fatigue in nurses. Although the original English version of this instrument has shown high degrees of reliability and validity, a Chinese version of this scale has yet to be verified. The aim of this study was to evaluate the psychometric properties of the OFER in a population of Chinese nurses. The scale was translated using translation and back-translation. The validities and reliabilities were evaluated on 923 qualified participants using content validity index, concurrent validity, factorial validity, internal consistency reliability, and test-retest reliability. The content validity index for the OFER was .92. The correlation coefficients between the scores of the OFER subscales and the criteria in this study (varying from -.498 to .705) verified that the OFER has acceptable concurrent validity. Principal component analysis and confirmatory factor analysis revealed that three factors correspond to the structure of the original instrument and that recovery mediates the relationship between acute and chronic fatigue. The Cronbach's alpha for the chronic fatigue, acute fatigue, and intershift recovery subscales were .83, .85, and .86, respectively. Test-retest reliabilities with correlation coefficients from .61 to .78 were found in the three subscales. OFER is a reliable and valid instrument for assessing work-related fatigue in Chinese nurses. However, further improvement of the acute fatigue subscale is recommended. The OFER has the potential to elicit information that is useful for assessing fatigue in nurses in China. Furthermore, as it differentiates between acute and chronic fatigue, OFER may be an effective tool for guiding the development and implementation of various, related intervention measures.

The Prosocial and Antisocial Behaviour in Sport Scale: further evidence for construct validity and reliability.

PubMed

Kavussanu, Maria; Stanger, Nicholas; Boardley, Ian D

2013-01-01

The purpose of this research was to provide further evidence for the construct validity (i.e., convergent, concurrent, and discriminant validity) of the Prosocial and Antisocial Behaviour in Sport Scale (PABSS), an instrument that has four subscales measuring prosocial and antisocial behaviour toward teammates and opponents. We also investigated test-retest reliability and stability of the PABSS. We conducted three studies using athletes from a variety of team sports. In Study 1, participants (N = 129) completed the PABSS and measures of physical and verbal aggression, hostility, anger, moral identity, and empathy; a sub-sample (n = 111) also completed the PABSS one week later. In Study 2, in addition to the PABSS, participants (N = 89) completed measures of competitive aggressiveness and anger, moral attitudes, moral disengagement, goal orientation, and anxiety. In Study 3, participants (N = 307) completed the PABSS and a measure of social goals. Across the three studies, the four subscales evidenced the hypothesised relationships with a number of variables. Correlations were large between the two antisocial behaviours and small between the two prosocial behaviours. Overall, the findings supported the convergent, concurrent, and discriminant validity of the scale, provided evidence for its test-retest reliability and stability, and suggest that the instrument is a valid and reliable measure of prosocial and antisocial behaviour in sport.

Development and validation of a work stressor scale for Australian farming families.

PubMed

McShane, Connar J; Quirk, Frances; Swinbourne, Anne

2016-08-01

The aim of this research was to gain insight into the key stressors for Australian farming families. It is well established that the farming work environment consists of a number of unique stressors which arise from dependency on factors beyond an individual's control (e.g. climate conditions) as well as the overlap between work and family environments. Despite this, limited research has included family factors in the assessment of stress felt by farmers and their families. This research sought to develop a scale of stressors for farming families in an Australian sample. A survey design was used for validity and reliability studies. The validity study involved assessment of factor structure, concurrent validity and discriminant validity. The reliability study used a test-retest reliability design. Participants were recruited from across Australia (38% Queensland; 30% New South Wales) and multiple industries (43% beef; 27% broadacre cropping; 26% horticulture). The validity study involved 278 participants and the reliability study involved 53 participants. Development of a Farming Family Stressor scale. The generated Farming Family Stressor scale presented satisfactory levels of concurrent validity (e.g. r = .73 against the Farm Stress Survey total score), discriminant validity (e.g. r = -.42 to r = .53 against the Satisfaction with Life and Kessler-10 total scores, respectively), internal consistency (Cronbach's alpha >.90) and test-retest reliability (rho > .66). This research lends insight into the complexity of stressors for farming families and has implications for occupational health and mental health programs that seek to reduce stress and improve health outcomes for that group. © 2015 National Rural Health Alliance Inc.

Psychometric properties of the Spanish version of the Cocaine Selective Severity Assessment to evaluate cocaine withdrawal in treatment-seeking individuals.

PubMed

Pérez de los Cobos, José; Trujols, Joan; Siñol, Núria; Vasconcelos e Rego, Lisiane; Iraurgi, Ioseba; Batlle, Francesca

2014-09-01

Reliable and valid assessment of cocaine withdrawal is relevant for treating cocaine-dependent patients. This study examined the psychometric properties of the Spanish version of the Cocaine Selective Severity Assessment (CSSA), an instrument that measures cocaine withdrawal. Participants were 170 cocaine-dependent inpatients receiving detoxification treatment. Principal component analysis revealed a 4-factor structure for CSSA that included the following components: 'Cocaine Craving and Psychological Distress', 'Lethargy', 'Carbohydrate Craving and Irritability', and 'Somatic Depressive Symptoms'. These 4 components accounted for 56.0% of total variance. Internal reliability for these components ranged from unacceptable to good (Chronbach's alpha: 0.87, 0.65, 0.55, and 0.22, respectively). All components except Somatic Depressive Symptoms presented concurrent validity with cocaine use. In summary, while some properties of the Spanish version of the CSSA are satisfactory, such as interpretability of factor structure and test-retest reliability, other properties, such as internal reliability and concurrent validity of some factors, are inadequate. Copyright © 2014 Elsevier Inc. All rights reserved.

The modified gait abnormality rating scale in patients with a conversion disorder: a reliability and responsiveness study.

PubMed

Vandenberg, Justin M; George, Deanna R; O'Leary, Andrea J; Olson, Lindsay C; Strassburg, Kaitlyn R; Hollman, John H

2015-01-01

Individuals with conversion disorder have neurologic symptoms that are not identified by an underlying organic cause. Often the symptoms manifest as gait disturbances. The modified gait abnormality rating scale (GARS-M) may be useful for quantifying gait abnormalities in these individuals. The purpose of this study was to examine the reliability, responsiveness and concurrent validity of GARS-M scores in individuals with conversion disorder. Data from 27 individuals who completed a rehabilitation program were included in this study. Pre- and post-intervention videos were obtained and walking speed was measured. Five examiners independently evaluated gait performance according to the GARS-M criteria. Inter- and intrarater reliability of GARS-M scores were estimated with intraclass correlation coefficients (ICCs). Responsiveness was estimated with the minimum detectable change (MDC). Pre- to post-treatment changes in GARS-M scores were analyzed with a dependent t-test. The correlation between GARS-M scores and walking speed was analyzed to assess concurrent validity. GARS-M scores were quantified with good-to-excellent inter- (ICC = 0.878) and intrarater reliability (ICC = 0.989). The MDC was 2 points. Mean GARS-M scores decreased from 7 ± 5 at baseline to 1 ± 2 at discharge (t26 = 7.411, p < 0.001) and 85% of patients improved beyond the MDC. Furthermore, GARS-M scores and walking speed measurements were moderately correlated (r = -0.582, p = 0.004), indicating that the GARS-M has acceptable concurrent validity. Our findings provide evidence that the GARS-M scores are reliable, valid and responsive for quantifying gait abnormalities in patients with conversion disorder. GARS-M scores provide objective measures upon which treatment effects can be assessed. Copyright © 2014 Elsevier B.V. All rights reserved.

Development and validation of a novel patient-reported treatment satisfaction measure for hyperfunctional facial lines: facial line satisfaction questionnaire.

PubMed

Pompilus, Farrah; Burgess, Somali; Hudgens, Stacie; Banderas, Benjamin; Daniels, Selena

2015-12-01

Facial lines or wrinkles are among the most visible signs of aging, and minimally invasive cosmetic procedures are becoming increasingly popular. The aim of this study was to develop and validate the Facial Line Satisfaction Questionnaire (FLSQ) for use in adults with upper facial lines (UFL). A literature review, concept elicitation interviews (n = 33), and cognitive debriefing interviews (n = 23) of adults with UFL were conducted to develop the FLSQ. The FLSQ comprises Baseline and Follow-up versions and was field-tested with 150 subjects in a US observational study designed to assess its psychometric performance. Analyses included acceptability (item and scale distribution [i.e. missingness, floor, and ceiling effects]), reliability, and validity (including concurrent validity). In total, 69 concepts were elicited during patient interviews. Following cognitive debriefing interviews, the FLSQ-Baseline version included 11 items and the Follow-up version included 13 items. Response rates for the FLSQ were 100% and 73% at baseline and follow-up, respectively; no items had excessive missing data. Questionnaire scale scores were normally distributed. Most domain scores demonstrated good internal consistency reliability (Cronbach's α ≥ 0.70). Most items within their respective domains exhibited good convergent (item-scale correlations > 0.40) and discriminant (items had higher correlation with their hypothesized scales than other scales) validity. Concurrent validity correlation coefficients of the FLSQ domain scores with the associated concurrent measures were acceptable (range: r = 0.40-0.70). Six FLSQ items demonstrated reliability and validity as stand-alone items outside their domains. The FLSQ is a valid questionnaire for assessing treatment expectations, satisfaction, impact, and preference in adults with UFL. © 2015 The Authors. Journal of Cosmetic Dermatology Published by Wiley Periodicals, Inc.

Validity and Reliability of the Italian Version of the Functioning Assessment Short Test (FAST) in Bipolar Disorder

PubMed Central

Moro, Maria Francesca; Colom, Francesc; Floris, Francesca; Pintus, Elisa; Pintus, Mirra; Contini, Francesca; Carta, Mauro Giovanni

2012-01-01

Background: Functioning Assessment Short Test (FAST) is a brief instrument designed to assess the main functioning problems experienced by psychiatric patients, specifically bipolar patients. It includes 24 items assessing impairment or disability in six domains of functioning: autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time. The aim of this study is to measure the validity and reliability of the Italian version of this instrument. Methods: Twenty-four patients with DSM-IV TR bipolar disorder and 20 healthy controls were recruited and evaluated in three private clinics in Cagliari (Sardinia, Italy). The psychometric properties of FAST (feasibility, internal consistency, concurrent validity, discriminant validity (patients vs controls and eutimic patients vs manic and depressed), and test-retest reliability were analyzed. Results: The internal consistency obtained was very high with a Cronbach's alpha of 0.955. A highly significant negative correlation with GAF was obtained (r = -0.9; p < 0.001) pointing to a reasonable degree of concurrent validity. FAST show a good test-retest reliability between two independent evaluation differing of one week (mean K =0.73). The total FAST scores were lower in controls as compared with Bipolar Patients and in Euthimic patients compared with Depressed or Manic. Conclusion: The Italian version of the FAST showed similar psychometrics properties as far as regard internal consistency and discriminant validity of the original version and show a good test retest reliability measure by means of K statistics. PMID:22905035

Validation of the Korean Version of the Mini-Sleep Questionnaire-Insomnia in Korean College Students.

PubMed

Kim, Hee-Ju

2017-03-01

This study aimed to evaluate the reliability and validity of the Korean version of the Mini-Sleep Questionnaire-Insomnia in Korean college students. A total of 470 students from six nursing colleges in South Korea participated in the study. The translation and linguistic validation of the Mini-Sleep Questionnaire-Insomnia was performed based on guidelines. The Pittsburgh Sleep Quality Index and the Perceived Stress Scale were used to validate the measure. Cronbach α, item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability were evaluated. Exploratory factor analysis for construct validity, Pearson's correlation with the Pittsburgh Sleep Quality Index and the Perceived Stress Scale for concurrent validity, and the receiver operating character curve for predictive validity were assessed. The 4-item Mini-Sleep Questionnaire-Insomnia had a Cronbach α of .69 and the item-total correlations were higher than .30. Cronbach α increased to .73 if the item assessing the use of sleeping pills and tranquilizers was deleted. This item had marked skewness and kurtosis issues. Factor analysis indicated unidimensionality, explaining 53.0% of the total variance. The measure showed high test-retest reliability (i.e., intraclass correlation coefficient = .84), acceptable concurrent validity (r with the Pittsburg Sleep Quality Index = .69; r with the Perceived Stress Scale = .31) and predictive validity [area under curve = .85; 95% confidence interval (0.81, 0.90)]. The Mini-Sleep Questionnaire-Insomnia showed acceptable reliability and validity. Yet, the limited distribution in sleep medications warrants further evaluations in the clinical population. Copyright © 2017. Published by Elsevier B.V.

The Short International Physical Activity Questionnaire: cross-cultural adaptation, validation and reliability of the Hausa language version in Nigeria.

PubMed

Oyeyemi, Adewale L; Oyeyemi, Adetoyeje Y; Adegoke, Babatunde O; Oyetoke, Fatima O; Aliyu, Habeeb N; Aliyu, Salamatu U; Rufai, Adamu A

2011-11-22

Accurate assessment of physical activity is important in determining the risk for chronic diseases such as cardiovascular disease, stroke, type 2 diabetes, cancer and obesity. The absence of culturally relevant measures in indigenous languages could pose challenges to epidemiological studies on physical activity in developing countries. The purpose of this study was to translate and cross-culturally adapt the Short International Physical Activity Questionnaire (IPAQ-SF) to the Hausa language, and to evaluate the validity and reliability of the Hausa version of IPAQ-SF in Nigeria. The English IPAQ-SF was translated into the Hausa language, synthesized, back translated, and subsequently subjected to expert committee review and pre-testing. The final product (Hausa IPAQ-SF) was tested in a cross-sectional study for concurrent (correlation with the English version) and construct validity, and test-retest reliability in a sample of 102 apparently healthy adults. The Hausa IPAQ-SF has good concurrent validity with Spearman correlation coefficients (ρ) ranging from 0.78 for vigorous activity (Min Week-1) to 0.92 for total physical activity (Metabolic Equivalent of Task [MET]-Min Week-1), but poor construct validity, with cardiorespiratory fitness (ρ = 0.21, p = 0.01) and body mass index (ρ = 0.22, p = 0.04) significantly correlated with only moderate activity and sitting time (Min Week-1), respectively. Reliability was good for vigorous (ICC = 0.73, 95% C.I = 0.55-0.84) and total physical activity (ICC = 0.61, 95% C.I = 0.47-0.72), but fair for moderate activity (ICC = 0.33, 95% C.I = 0.12-0.51), and few meaningful differences were found in the gender and socioeconomic status specific analyses. The Hausa IPAQ-SF has acceptable concurrent validity and test-retest reliability for vigorous-intensity activity, walking, sitting and total physical activity, but demonstrated only fair construct validity for moderate and sitting activities. The Hausa IPAQ-SF can be used for physical activity measurements in Nigeria, but further construct validity testing with objective measures such as an accelerometer is needed.

Structural Validation of the Holistic Wellness Assessment

ERIC Educational Resources Information Center

Brown, Charlene; Applegate, E. Brooks; Yildiz, Mustafa

2015-01-01

The Holistic Wellness Assessment (HWA) is a relatively new assessment instrument based on an emergent transdisciplinary model of wellness. This study validated the factor structure identified via exploratory factor analysis (EFA), assessed test-retest reliability, and investigated concurrent validity of the HWA in three separate samples. The…

Reliability and validity of the Wolfram Unified Rating Scale (WURS)

PubMed Central

2012-01-01

Background Wolfram syndrome (WFS) is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS) to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS). Methods A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease). WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age). Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated. Results The WURS had high inter-rater reliability (ICCs>.93), moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91) and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, p<.03), between the WURS Behavioral Scale and reports of mood and behavior (rs>.76, p<.04) and between WURS Total scores and quality of life (rs=-.86, p=.001). The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83). Conclusions These preliminary findings demonstrate that the WURS has acceptable reliability and validity and captures individual differences in disease severity in children and young adults with WFS. PMID:23148655

A Note on Some Characteristics and Correlates of the Meier Art Test of Aesthetic Perception.

ERIC Educational Resources Information Center

Stallings, William M.; Anderson, Frances E.

The reliability and the predictive and concurrent validity of the MATAP were investigated with the implicit goal of improving the prediction of course grades in the College of Fine and Applied Arts. It was found that reliability and validity coefficients were low, and it was suggested that the scoring system was a source of error variance. (MS)

The Six-Minute Walk Test for Adults with Intellectual Disability: A Study of Validity and Reliability

ERIC Educational Resources Information Center

Nasuti, Gabriella; Stuart-Hill, Lynneth; Temple, Viviene A.

2013-01-01

Background: The Six-Minute Walk Test (6MWT) has been used with clinical and healthy populations to assess functional capacity and cardiovascular fitness. The aim of this study was to determine the test-retest reliability of a modified-6MWT as well as concurrent validity of walk distance with peak oxygen uptake (VO[subscript 2] peak). Method:…

A Digital Photographic Measurement Method for Quantifying Foot Posture: Validity, Reliability, and Descriptive Data

PubMed Central

Cobb, Stephen C.; James, C. Roger; Hjertstedt, Matthew; Kruk, James

2011-01-01

Abstract Context: Although abnormal foot posture long has been associated with lower extremity injury risk, the evidence is equivocal. Poor intertester reliability of traditional foot measures might contribute to the inconsistency. Objectives: To investigate the validity and reliability of a digital photographic measurement method (DPMM) technology, the reliability of DPMM-quantified foot measures, and the concurrent validity of the DPMM with clinical-measurement methods (CMMs) and to report descriptive data for DPMM measures with moderate to high intratester and intertester reliability. Design: Descriptive laboratory study. Setting: Biomechanics research laboratory. Patients or Other Participants: A total of 159 people participated in 3 groups. Twenty-eight people (11 men, 17 women; age  =  25 ± 5 years, height  =  1.71 ± 0.10 m, mass  =  77.6 ± 17.3 kg) were recruited for investigation of intratester and intertester reliability of the DPMM technology; 20 (10 men, 10 women; age  =  24 ± 2 years, height  =  1.71 ± 0.09 m, mass  =  76 ± 16 kg) for investigation of DPMM and CMM reliability and concurrent validity; and 111 (42 men, 69 women; age  =  22.8 ± 4.7 years, height  =  168.5 ± 10.4 cm, mass  =  69.8 ± 13.3 kg) for development of a descriptive data set of the DPMM foot measurements with moderate to high intratester and intertester reliabilities. Intervention(s): The dimensions of 10 model rectangles and the 28 participants' feet were measured, and DPMM foot posture was measured in the 111 participants. Two clinicians assessed the DPMM and CMM foot measures of the 20 participants. Main Outcome Measure(s): Validity and reliability were evaluated using mean absolute and percentage errors and intraclass correlation coefficients. Descriptive data were computed from the DPMM foot posture measures. Results: The DPMM technology intratester and intertester reliability intraclass correlation coefficients were 1.0 for each tester and variable. Mean absolute errors were equal to or less than 0.2 mm for the bottom and right-side variables and 0.1° for the calculated angle variable. Mean percentage errors between the DPMM and criterion reference values were equal to or less than 0.4%. Intratester and intertester reliabilities of DPMM-computed structural measures of arch and navicular indices were moderate to high (>0.78), and concurrent validity was moderate to strong. Conclusions: The DPMM is a valid and reliable clinical and research tool for quantifying foot structure. The DPMM and the descriptive data might be used to define groups in future studies in which the relationship between foot posture and function or injury risk is investigated. PMID:21214347

Anger Assessment in Clinical and Nonclinical Populations: Further Validation of the State-Trait Anger Expression Inventory-2.

PubMed

Lievaart, Marien; Franken, Ingmar H A; Hovens, Johannes E

2016-03-01

The most commonly used instrument for measuring anger is the State-Trait Anger Expression Inventory-2 (STAXI-2; Spielberger, 1999). This study further examines the validity of the STAXI-2 and compares anger scores between several clinical and nonclinical samples. Reliability, concurrent, and construct validity were investigated in Dutch undergraduate students (N = 764), a general population sample (N = 1211), and psychiatric outpatients (N = 226). The results support the reliability and validity of the STAXI-2. Concurrent validity was strong, with meaningful correlations between the STAXI-2 scales and anger-related constructs in both clinical and nonclinical samples. Importantly, patients showed higher experience and expression of anger than the general population sample. Additionally, forensic outpatients with addiction problems reported higher Anger Expression-Out than general psychiatric outpatients. Our conclusion is that the STAXI-2 is a suitable instrument to measure both the experience and the expression of anger in both general and clinical populations. © 2016 Wiley Periodicals, Inc.

Standards Performance Continuum: Development and Validation of a Measure of Effective Pedagogy.

ERIC Educational Resources Information Center

Doherty, R. William; Hilberg, R. Soleste; Epaloose, Georgia; Tharp, Roland G.

2002-01-01

Describes the development and validation of the Standards Performance Continuum (SPC) for assessing teacher performance of the Standards for Effective Pedagogy. Three studies involving Florida, California, and New Mexico public school teachers provided evidence of inter-rater reliability, concurrent validity, and criterion-related validity…

An Italian multicentre validation study of the coma recovery scale-revised.

PubMed

Estraneo, A; Moretta, P; De Tanti, A; Gatta, G; Giacino, J T; Trojano, L

2015-10-01

Rate of misdiagnosis of disorders of consciousness (DoC) can be reduced by employing validated clinical diagnostic tools, such as the Coma Recovery Scale-Revised (CRS-R). An Italian version of the CRS-R has been recently developed, but its applicability across different clinical settings, and its concurrent validity and diagnostic sensitivity have not been estimated yet. To perform a multicentre validation study of the Italian version of the Coma Recovery Scale-Revised (CRS-R). Analysis of inter-rater reliability, concurrent validity and diagnostic sensitivity of the scale. One Intensive Care Unit, 8 Post-acute rehabilitation centres and 2 Long-term facilities Twenty-seven professionals (physicians, N.=11; psychologists, N.=5; physiotherapists, N.=3; speech therapists, N.=6; nurses, N.=2) from 11 Italian Centres. CRS-R and Disability Rating Scale (DRS) applied to 122 patients with clinical diagnosis of Vegetative State (VS) or Minimally Conscious State (MCS). CRS-R has good-to-excellent inter-rater reliability for all subscales, particularly for the communication subscale. The Italian version of the CRS-R showed a high sensitivity and specificity in detecting MCS with reference to clinical consensus diagnosis. The CRS-R showed good concurrent validity with the Disability Rating Scale, which had very low specificity with reference to clinical consensus diagnosis. The Italian version of the CRS-R is a valid scale for use from the sub-acute to chronic stages of DoC. It can be administered reliably by all members of the rehabilitation team with different specialties, levels of experience and settings. The present study promote use of the Italian version of the CRS-R to improve diagnosis of DoC patients, and plan tailored rehabilitation treatment.

[Spanish version of Adonis Complex Questionnaire. A questionnaire to test the muscle dimorphism and vigorexy].

PubMed

Latorre-Román, Pedro Ángel; Garrido-Ruiz, Antonio; García-Pinillos, Felipe

2014-11-08

To validate the Spanish version of Adonis Complex Questionnaire in bodybuilders. Participants included 99 bodybuilders who train regularly (age: 25.45±5.19 y; BMI=24.53±1.89). In order to test the discriminant and concurrent validity the Exercise Dependence Scale-Revised (EDS-R) and the Eating Attitudes Test (EAT-26) were used. The scale's psychometric properties were obtained through a concurrent validity process, factorial analysis of principal components, internal consistency, and test-retest reliability. The internal consistency of this questionnaire was high (Cronbach's Alpha= 0.880) in total scale. The intraclass correlation coefficient (ICC) to test the temporal consistency of the questionnaire was 0.707 (95% IC=0.336- 0.871). The questionnaire obtained concurrent validity with the EDS-R (r=0.613, p<0.001), and EAT-26 (r=0.422, p<0.001). The results have shown a three-factor structure Factor 1: psychosocial effect of physical appearance, Factor 2: control of physical appearance, Factor 3: concern about physical appearance which explain 65.29% of variance. The Adonis Complex Questionnaire shows a proper psychometric properties and it is a valid and reliable measure of vigorexy and muscle dimorphism in bodybuilders. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

The Cardiff Acne Disability Index (CADI): linguistic and cultural validation in Serbian.

PubMed

Jankovic, Slavenka; Vukicevic, Jelica; Djordjevic, Sanja; Jankovic, Janko; Marinkovic, Jelena; Basra, Mohammad K A

2013-02-01

The aims of this study were to translate the Cardiff Acne Disability Index (CADI) into Serbian and to assess its validity and reliability in Serbian acne patients. The CADI was translated and linguistically validated into Serbian according to published guidelines. This version of CADI, along with the Serbian version of Children's Dermatology Life Quality Index (CDLQI) and a short demographic questionnaire, was administrated to a cohort of secondary school pupils. The Global Acne Grading Score was used to measure the clinical severity of acne. The internal consistency reliability of the Serbian version of CADI was assessed by Cronbach's alpha coefficient while its concurrent validity was assessed by Spearman's correlation coefficient. Construct validity was examined by factor analysis. A total of 465 pupils completed questionnaires. Self-reported acne was present in 76% of pupils (353/465). The Serbian version of CADI showed high internal consistency reliability (Cronbach's alpha coefficient = 0.79). The mean item-total correlation coefficient was 0.74 with a range of 0.53-0.81. The concurrent validity of the scale was supported by a moderate but highly significant correlation with the CDLQI (Spearman's rho = 0.66; P < 0.001). Factor analysis revealed the presence of two dimensions underlying the factor structure of the scale. The Serbian version of the CADI is a reliable, valid, and valuable tool for assessing the impact of acne on the quality of life of Serbian-speaking patients.

Isometric hand grip strength measured by the Nintendo Wii Balance Board - a reliable new method.

PubMed

Blomkvist, A W; Andersen, S; de Bruin, E D; Jorgensen, M G

2016-02-03

Low hand grip strength is a strong predictor for both long-term and short-term disability and mortality. The Nintendo Wii Balance Board (WBB) is an inexpensive, portable, wide-spread instrument with the potential for multiple purposes in assessing clinically relevant measures including muscle strength. The purpose of the study was to explore intrarater reliability and concurrent validity of the WBB by comparing it to the Jamar hand dynamometer. Intra-rater test-retest cohort design with randomized validity testing on the first session. Using custom WBB software, thirty old adults (69.0 ± 4.2 years of age) were studied for reproducibility and concurrent validity compared to the Jamar hand dynamometer. Reproducibility was tested for dominant and non-dominant hands during the same time-of-day, one week apart. Intraclass correlation coefficient (ICC) and standard error of measurement (SEM) and limits of agreement (LOA) were calculated to describe relative and absolute reproducibility respectively. To describe concurrent validity, Pearson's product-moment correlation and ICC was calculated. Reproducibility was high with ICC values of >0.948 across all measures. Both SEM and LOA were low (0.2-0.5 kg and 2.7-4.2 kg, respectively) in both the dominant and non-dominant hand. For validity, Pearson correlations were high (0.80-0.88) and ICC values were fair to good (0.763-0.803). Reproducibility for WBB was high for relative measures and acceptable for absolute measures. In addition, concurrent validity between the Jamar hand dynamometer and the WBB was acceptable. Thus, the WBB may be a valid instrument to assess hand grip strength in older adults.

Reliability and validity of the Tilburg Frailty Indicator (TFI) among Chinese community-dwelling older people.

PubMed

Dong, Lijuan; Liu, Na; Tian, Xiaoyu; Qiao, Xiaoxia; Gobbens, Robbert J J; Kane, Robert L; Wang, Cuili

2017-11-01

To translate the Tilburg Frailty Indicator (TFI) into Chinese and assess its reliability and validity. A sample of 917 community-dwelling older people, aged ≥60 years, in a Chinese city was included between August 2015 and March 2016. Construct validity was assessed using alternative measures corresponding to the TFI items, including self-rated health status (SRH), unintentional weight loss, walking speed, timed-up-and-go tests (TUGT), making telephone calls, grip strength, exhaustion, Short Portable Mental Status Questionnaire (SPMSQ), Geriatric Depression scale (GDS-15), emotional role, Adaptability Partnership Growth Affection and Resolve scale (APGAR) and Social Support Rating Scale (SSRS). Fried's phenotype and frailty index were measured to evaluate criterion validity. Adverse health outcomes (ADL and IADL disability, healthcare utilization, GDS-15, SSRS) were used to assess predictive (concurrent) validity. The internal consistency reliability was good (Cronbach's α=0.71). The test-retest reliability was strong (r=0.88). Kappa coefficients showed agreements between the TFI items and corresponding alternative measures. Alternative measures correlated as expected with the three domains of TFI, with an exclusion that alternative psychological measures had similar correlations with psychological and physical domains of the TFI. The Chinese TFI had excellent criterion validity with the AUCs regarding physical phenotype and frailty index of 0.87 and 0.86, respectively. The predictive (concurrent) validities of the adverse health outcomes and healthcare utilization were acceptable (AUCs: 0.65-0.83). The Chinese TFI has good validity and reliability as an integral instrument to measure frailty of older people living in the community in China. Copyright © 2017 Elsevier B.V. All rights reserved.

The psychometric properties of Observer OPTION(5), an observer measure of shared decision making.

PubMed

Barr, Paul J; O'Malley, Alistair James; Tsulukidze, Maka; Gionfriddo, Michael R; Montori, Victor; Elwyn, Glyn

2015-08-01

Observer OPTION(5) was designed as a more efficient version of OPTION(12), the most commonly used measure of shared decision making (SDM). The current paper assesses the psychometric properties of OPTION(5). Two raters used OPTION(5) to rate recordings of clinical encounters from two previous patient decision aid (PDA) trials (n=201; n=110). A subsample was re-rated two weeks later. We assessed discriminative validity, inter-rater reliability, intra-rater reliability, and concurrent validity. OPTION(5) demonstrated discriminative validity, with increases in SDM between usual care and PDA arms. OPTION(5) also demonstrated concurrent validity with OPTION(12), r=0.61 (95%CI 0.54, 0.68) and intra-rater reliability, r=0.93 (0.83, 0.97). The mean difference in rater score was 8.89 (95% Credibility Interval, 7.5, 10.3), with intraclass correlation (ICC) of 0.67 (95% Credibility Interval, 0.51, 0.91) for the accuracy of rater scores and 0.70 (95% Credibility Interval, 0.56, 0.94) for the consistency of rater scores across encounters, indicating good inter-rater reliability. Raters reported lower cognitive burden when using OPTION(5) compared to OPTION(12). OPTION(5) is a brief, theoretically grounded observer measure of SDM with promising psychometric properties in this sample and low burden on raters. OPTION(5) has potential to provide reliable, valid assessment of SDM in clinical encounters. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Validation of the Mandarin Chinese version of the Leicester Cough Questionnaire in bronchiectasis.

PubMed

Gao, Y-H; Guan, W-J; Xu, G; Gao, Y; Lin, Z-Y; Tang, Y; Lin, Z-M; Li, H-M; Luo, Q; Zhong, N-S; Birring, S S; Chen, R-C

2014-12-01

The Leicester Cough Questionnaire (LCQ) has been validated for assessing cough-specific health status in bronchiectasis. We translated the LCQ into Mandarin Chinese and investigated its validity, reliability and responsiveness. The LCQ was translated into Mandarin Chinese using the forward-backward translation procedure. A total of 144 out-patients completed the Mandarin Chinese version of the LCQ (LCQ-MC), the Hospital Anxiety and Depression Scale (HADS) and the St George's Respiratory Questionnaire. Reassessments were performed during exacerbations and at 6 months. Concurrent validation, internal consistency, repeatability and responsiveness were determined. Minor cultural adaptations were made to the wording of LCQ-MC. No other difficulties were found during the translation process, with all items easily adapted to acceptable Mandarin Chinese. The questionnaire was not changed in terms of content layout and the order of the questions. In cognitive debriefing interviews, participants reported that the questionnaire was acceptable, relevant, comprehensive and easy to complete. The LCQ-MC showed good concurrent validity, internal consistency and test-retest reliability. Responsiveness was shown by significant changes in LCQ-MC scores between steady state, the first exacerbation and following 2-week antibiotic treatment (both interval changes, P < 0.01) CONCLUSION: The LCQ-MC is a valid, reliable and responsive instrument for determining cough-specific health status in Chinese bronchiectasis patients.

The Computerized Perceptual Motor Skills Assessment: A new visual perceptual motor skills evaluation tool for children in early elementary grades.

PubMed

Howe, Tsu-Hsin; Chen, Hao-Ling; Lee, Candy Chieh; Chen, Ying-Dar; Wang, Tien-Ni

2017-10-01

Visual perceptual motor skills have been proposed as underlying courses of handwriting difficulties. However, there is no evaluation tool currently available to assess these skills comprehensively and to serve as a sensitive measure. The purpose of this study was to validate the Computerized Perceptual Motor Skills Assessment (CPMSA), a newly developed evaluation tool for children in early elementary grades. Its test-retest reliability, concurrent validity, discriminant validity, and responsiveness were examined in 43 typically developing children and 26 children with handwriting difficulty. The CPMSA demonstrated excellent reliability across all subtests with intra-class correlation coefficients (ICCs)≥0.80. Significant moderate correlations between the domains of the CPMSA and corresponding gold standards including Beery VMI, the TVPS-3, and the eye-hand coordination subtest of the DTVP-2 demonstrated good concurrent validity. In addition, the CPMSA showed evidence of discriminant validity in samples of children with and without handwriting difficulty. This article provides evidence in support of the CPMSA. The CPMSA is a reliable, valid, and promising measure of visual perceptual motor skills for children in early elementary grades. Directions for future study and improvements to the assessment are discussed. Copyright © 2017. Published by Elsevier Ltd.

Assessment of Lower Limb Muscle Strength and Power Using Hand-Held and Fixed Dynamometry: A Reliability and Validity Study

PubMed Central

Perraton, Luke G.; Bower, Kelly J.; Adair, Brooke; Pua, Yong-Hao; Williams, Gavin P.; McGaw, Rebekah

2015-01-01

Introduction Hand-held dynamometry (HHD) has never previously been used to examine isometric muscle power. Rate of force development (RFD) is often used for muscle power assessment, however no consensus currently exists on the most appropriate method of calculation. The aim of this study was to examine the reliability of different algorithms for RFD calculation and to examine the intra-rater, inter-rater, and inter-device reliability of HHD as well as the concurrent validity of HHD for the assessment of isometric lower limb muscle strength and power. Methods 30 healthy young adults (age: 23±5yrs, male: 15) were assessed on two sessions. Isometric muscle strength and power were measured using peak force and RFD respectively using two HHDs (Lafayette Model-01165 and Hoggan microFET2) and a criterion-reference KinCom dynamometer. Statistical analysis of reliability and validity comprised intraclass correlation coefficients (ICC), Pearson correlations, concordance correlations, standard error of measurement, and minimal detectable change. Results Comparison of RFD methods revealed that a peak 200ms moving window algorithm provided optimal reliability results. Intra-rater, inter-rater, and inter-device reliability analysis of peak force and RFD revealed mostly good to excellent reliability (coefficients ≥ 0.70) for all muscle groups. Concurrent validity analysis showed moderate to excellent relationships between HHD and fixed dynamometry for the hip and knee (ICCs ≥ 0.70) for both peak force and RFD, with mostly poor to good results shown for the ankle muscles (ICCs = 0.31–0.79). Conclusions Hand-held dynamometry has good to excellent reliability and validity for most measures of isometric lower limb strength and power in a healthy population, particularly for proximal muscle groups. To aid implementation we have created freely available software to extract these variables from data stored on the Lafayette device. Future research should examine the reliability and validity of these variables in clinical populations. PMID:26509265

The reliability and validity study of the Kinesthetic and Visual Imagery Questionnaire in individuals with Multiple Sclerosis

PubMed Central

Tabrizi, Yousef Moghadas; Zangiabadi, Nasser; Mazhari, Shahrzad; Zolala, Farzaneh

2013-01-01

Objective Motor imagery (MI) has been recently considered as an adjunct to physical rehabilitation in patients with multiple sclerosis (MS). It is necessary to assess MI abilities and benefits in patients with MS by using a reliable tool. The Kinesthetic and Visual Imagery Questionnaire (KVIQ) was recently developed to assess MI ability in patients with stroke and other disabilities. Considering the different underlying pathologies, the present study aimed to examine the validity and reliability of the KVIQ in MS patients. Method Fifteen MS patients were assessed using the KVIQ in 2 sessions (5-14days apart) by the same examiner. In the second session, the participants also completed a revised MI questionnaire (MIQ-R) as the gold standard. Intra-class correlation coefficients (ICCs) were measured to determine test-retest reliability. Spearman's correlation analysis was performed to assess concurrent validity with the MIQ-R. Furthermore, the internal consistency (Cronbach's alpha) and factorial structure of the KVIQ were studied. Results The test-retest reliability for the KVIQ was good (ICCs: total KVIQ=0.89, visual KVIQ=0.85, and kinesthetic KVIQ=0.93), and the concurrent validity between the KVIQ and MIQ-R was good (r=0.79). The KVIQ had good internal consistency, with high Cronbach's alpha (alpha=0.84). Factorial analysis showed the bi-factorial structure of the KVIQ, which was explained by visual=57.6% and kinesthetic=32.4%. Conclusions The results of the present study revealed that the KVIQ is a valid and reliable tool for assessing MI in MS patients. PMID:24271091

The reliability and validity study of the Kinesthetic and Visual Imagery Questionnaire in individuals with multiple sclerosis.

PubMed

Tabrizi, Yousef Moghadas; Zangiabadi, Nasser; Mazhari, Shahrzad; Zolala, Farzaneh

2013-01-01

Motor imagery (MI) has been recently considered as an adjunct to physical rehabilitation in patients with multiple sclerosis (MS). It is necessary to assess MI abilities and benefits in patients with MS by using a reliable tool. The Kinesthetic and Visual Imagery Questionnaire (KVIQ) was recently developed to assess MI ability in patients with stroke and other disabilities. Considering the different underlying pathologies, the present study aimed to examine the validity and reliability of the KVIQ in MS patients. Fifteen MS patients were assessed using the KVIQ in 2 sessions (5-14 days apart) by the same examiner. In the second session, the participants also completed a revised MI questionnaire (MIQ-R) as the gold standard. Intra-class correlation coefficients (ICCs) were measured to determine test-retest reliability. Spearman's correlation analysis was performed to assess concurrent validity with the MIQ-R. Furthermore, the internal consistency (Cronbach's alpha) and factorial structure of the KVIQ were studied. The test-retest reliability for the KVIQ was good (ICCs: total KVIQ=0.89, visual KVIQ=0.85, and kinesthetic KVIQ=0.93), and the concurrent validity between the KVIQ and MIQ-R was good (r=0.79). The KVIQ had good internal consistency, with high Cronbach's alpha (alpha=0.84). Factorial analysis showed the bi-factorial structure of the KVIQ, which was explained by visual=57.6% and kinesthetic=32.4%. The results of the present study revealed that the KVIQ is a valid and reliable tool for assessing MI in MS patients.

Stroke Impact Scale 3.0: Reliability and Validity Evaluation of the Korean Version

PubMed Central

2017-01-01

Objective To establish the reliability and validity the Korean version of the Stroke Impact Scale (K-SIS) 3.0. Methods A total of 70 post-stroke patients were enrolled. All subjects were evaluated for general characteristics, Mini-Mental State Examination (MMSE), the National Institutes of Health Stroke Scale (NIHSS), Modified Barthel Index, Hospital Anxiety and Depression Scale (HADS). The SF-36 and K-SIS 3.0 assessed their health-related quality of life. Statistical analysis after evaluation, determined the reliability and validity of the K-SIS 3.0. Results A total of 70 patients (mean age, 54.97 years) participated in this study. Internal consistency of the SIS 3.0 (Cronbach's alpha) was obtained, and all domains had good co-efficiency, with threshold above 0.70. Test-retest reliability of SIS 3.0 required correlation (Spearman's rho) of the same domain scores obtained on the first and second assessments. Results were above 0.5, with the exception of social participation and mobility. Concurrent validity of K-SIS 3.0 was assessed using the SF-36, and other scales with the same or similar domains. Each domain of K-SIS 3.0 had a positive correlation with corresponding similar domain of SF-36 and other scales (HADS, MMSE, and NIHSS). Conclusion The newly developed K-SIS 3.0 showed high inter-intra reliability and test-retest reliabilities, together with high concurrent validity with the original and various other scales, for patients with stroke. K-SIS 3.0 can therefore be used for stroke patients, to assess their health-related quality of life and treatment efficacy. PMID:28758075

Stroke Impact Scale 3.0: Reliability and Validity Evaluation of the Korean Version.

PubMed

Choi, Seong Uk; Lee, Hye Sun; Shin, Joon Ho; Ho, Seung Hee; Koo, Mi Jung; Park, Kyoung Hae; Yoon, Jeong Ah; Kim, Dong Min; Oh, Jung Eun; Yu, Se Hwa; Kim, Dong A

2017-06-01

To establish the reliability and validity the Korean version of the Stroke Impact Scale (K-SIS) 3.0. A total of 70 post-stroke patients were enrolled. All subjects were evaluated for general characteristics, Mini-Mental State Examination (MMSE), the National Institutes of Health Stroke Scale (NIHSS), Modified Barthel Index, Hospital Anxiety and Depression Scale (HADS). The SF-36 and K-SIS 3.0 assessed their health-related quality of life. Statistical analysis after evaluation, determined the reliability and validity of the K-SIS 3.0. A total of 70 patients (mean age, 54.97 years) participated in this study. Internal consistency of the SIS 3.0 (Cronbach's alpha) was obtained, and all domains had good co-efficiency, with threshold above 0.70. Test-retest reliability of SIS 3.0 required correlation (Spearman's rho) of the same domain scores obtained on the first and second assessments. Results were above 0.5, with the exception of social participation and mobility. Concurrent validity of K-SIS 3.0 was assessed using the SF-36, and other scales with the same or similar domains. Each domain of K-SIS 3.0 had a positive correlation with corresponding similar domain of SF-36 and other scales (HADS, MMSE, and NIHSS). The newly developed K-SIS 3.0 showed high inter-intra reliability and test-retest reliabilities, together with high concurrent validity with the original and various other scales, for patients with stroke. K-SIS 3.0 can therefore be used for stroke patients, to assess their health-related quality of life and treatment efficacy.

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study

PubMed Central

Hashmi, Ali M.; Naz, Shahana; Asif, Aftab; Khawaja, Imran S.

2016-01-01

Objective: To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. Methods: After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. Results: The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. Conclusion: The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research. PMID:28083049

Urdu translation of the Hamilton Rating Scale for Depression: Results of a validation study.

PubMed

Hashmi, Ali M; Naz, Shahana; Asif, Aftab; Khawaja, Imran S

2016-01-01

To develop a standardized validated version of the Hamilton Rating Scale for Depression (HAM-D) in Urdu. After translation of the HAM-D into the Urdu language following standard guidelines, the final Urdu version (HAM-D-U) was administered to 160 depressed outpatients. Inter-item correlation was assessed by calculating Cronbach alpha. Correlation between HAM-D-U scores at baseline and after a 2-week interval was evaluated for test-retest reliability. Moreover, scores of two clinicians on HAM-D-U were compared for inter-rater reliability. For establishing concurrent validity, scores of HAM-D-U and BDI-U were compared by using Spearman correlation coefficient. The study was conducted at Mayo Hospital, Lahore, from May to December 2014. The Cronbach alpha for HAM-D-U was 0.71. Composite scores for HAM-D-U at baseline and after a 2-week interval were also highly correlated with each other (Spearman correlation coefficient 0.83, p-value < 0.01) indicating good test-retest reliability. Composite scores for HAM-D-U and BDI-U were positively correlated with each other (Spearman correlation coefficient 0.85, p < 0.01) indicating good concurrent validity. Scores of two clinicians for HAM-D-U were also positively correlated (Spearman correlation coefficient 0.82, p-value < 0.01) indicated good inter-rater reliability. The HAM-D-U is a valid and reliable instrument for the assessment of Depression. It shows good inter-rater and test-retest reliability. The HAM-D-U can be a tool either for clinical management or research.

The patient dignity inventory: a novel way of measuring dignity-related distress in palliative care.

PubMed

Chochinov, Harvey Max; Hassard, Thomas; McClement, Susan; Hack, Thomas; Kristjanson, Linda J; Harlos, Mike; Sinclair, Shane; Murray, Alison

2008-12-01

Quality palliative care depends on a deep understanding of distress facing patients nearing death. Yet, many aspects of psychosocial, existential and spiritual distress are often overlooked. The aim of this study was to test a novel psychometric--the Patient Dignity Inventory (PDI)--designed to measure various sources of dignity-related distress among patients nearing the end of life. Using standard instrument development techniques, this study examined the face validity, internal consistency, test-retest reliability, factor structure and concurrent validity of the PDI. The 25-items of the PDI derive from a model of dignity in the terminally ill. To establish its basic psychometric properties, the PDI was administered to 253 patients receiving palliative care, along with other measures addressing issues identified within the Dignity Model in the Terminally Ill. Cronbach's coefficient alpha for the PDI was 0.93; the test-retest reliability was r = 0.85. Factor analysis resulted in a five-factor solution; factor labels include Symptom Distress, Existential Distress, Dependency, Peace of Mind, and Social Support, accounting for 58% of the overall variance. Evidence for concurrent validity was reported by way of significant associations between PDI factors and concurrent measures of distress. The PDI is a valid and reliable new instrument, which could assist clinicians to routinely detect end-of-life dignity-related distress. Identifying these sources of distress is a critical step toward understanding human suffering and should help clinicians deliver quality, dignity-conserving end-of-life care.

Validity and Reliability of 2 Goniometric Mobile Apps: Device, Application, and Examiner Factors.

PubMed

Wellmon, Robert H; Gulick, Dawn T; Paterson, Mark L; Gulick, Colleen N

2016-12-01

Smartphones are being used in a variety of practice settings to measure joint range of motion (ROM). A number of factors can affect the validity of the measurements generated. However, there are no studies examining smartphone-based goniometer applications focusing on measurement variability and error arising from the electromechanical properties of the device being used. To examine the concurrent validity and interrater reliability of 2 goniometric mobile applications (Goniometer Records, Goniometer Pro), an inclinometer, and a universal goniometer (UG). Nonexperimental, descriptive validation study. University laboratory. 3 physical therapists having an average of 25 y of experience. Three standardized angles (acute, right, obtuse) were constructed to replicate the movement of a hinge joint in the human body. Angular changes were measured and compared across 3 raters who used 3 different devices (UG, inclinometer, and 2 goniometric apps installed on 3 different smartphones: Apple iPhone 5, LG Android, and Samsung SIII Android). Intraclass correlation coefficients (ICCs) and Bland-Altman plots were used to examine interrater reliability and concurrent validity. Interrater reliability for each of the smartphone apps, inclinometer and UG were excellent (ICC = .995-1.000). Concurrent validity was also good (ICC = .998-.999). Based on the Bland-Altman plots, the means of the differences between the devices were low (range = -0.4° to 1.2°). This study identifies the error inherent in measurement that is independent of patient factors and due to the smartphone, the installed apps, and examiner skill. Less than 2° of measurement variability was attributable to those factors alone. The data suggest that 3 smartphones with the 2 installed apps are a viable substitute for using a UG or an inclinometer when measuring angular changes that typically occur when examining ROM and demonstrate the capacity of multiple examiners to accurately use smartphone-based goniometers.

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)”

PubMed Central

2012-01-01

Background The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. Methods This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom / Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Results Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. Conclusion The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration. PMID:22984850

Valid and Reliable Science Content Assessments for Science Teachers

NASA Astrophysics Data System (ADS)

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-03-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

Cultural Adaptation of the Cardiff Acne Disability Index to a Hindi Speaking Population: A Pilot Study.

PubMed

Gupta, Aayush; Sharma, Yugal K; Dash, K; Verma, Sampurna

2015-01-01

Acne vulgaris is known to impair many aspects of the quality of life (QoL) of its patients. To translate the Cardiff Acne Disability Index (CADI) from English into Hindi and to assess its validity and reliability in Hindi speaking patients with acne from India. Hindi version of CADI, translated and linguistically validated as per published international guidelines, along with a previously translated Hindi version of dermatology life quality index (DLQI) and a demographic questionnaire were administered to acne patients. The internal consistency reliability of the Hindi version of CADI and its concurrent validity were assessed by Cronbach's alpha co-efficient and Spearman's correlation co-efficient respectively. Construct validity was examined by factor analysis. Statistical analysis was carried out using the Statistical Package for the Social Sciences (SPSS) version 20 (SPSS Inc., Chicago, IL, USA) for Windows. One hundred Hindi speaking patients with various grades of acne participated in the study. Hindi version of CADI showed high internal consistency reliability (Cronbach's alpha co-efficient = 0.722). Mean item-to-total correlation co-efficient ranged from 0.502 to 0.760. Concurrent validity of the scale was supported by a significant correlation with the Hindi DLQI. Factor analysis revealed the presence of two dimensions underlying the factor structure of the scale. Hindi CADI is equivalent to the original English version and constitutes a reliable and valid tool for clinical assessment of the impact of acne on QoL.

Concurrent validity and reliability of wireless instrumented insoles measuring postural balance and temporal gait parameters.

PubMed

Oerbekke, Michiel S; Stukstette, Mirelle J; Schütte, Kurt; de Bie, Rob A; Pisters, Martijn F; Vanwanseele, Benedicte

2017-01-01

The OpenGo seems promising to take gait analysis out of laboratory settings due to its capability of long-term measurements and mobility. However, the OpenGo's concurrent validity and reliability need to be assessed to determine if the instrument is suitable for validation in patient samples. Twenty healthy volunteers participated. Center of pressure data were collected under eyes open and closed conditions with participants performing unilateral stance trials on the gold standard (AMTI OR6-7 force plate) while wearing the OpenGo. Temporal gait data (stance time, gait cycle time, and cadence) were collected at a self-selected comfortable walking speed with participants performing test-retest trials on an instrumented treadmill while wearing the OpenGo. Validity was assessed using Bland-Altman plots. Reliability was assessed with Intraclass Correlation Coefficient (2,1) and smallest detectable changes were calculated. Negative means of differences were found in all measured parameters, illustrating lower scores for the OpenGo on average. The OpenGo showed negative upper limits of agreement in center of pressure parameters on the mediolateral axis. Temporal reliability ICCs ranged from 0.90-0.93. Smallest detectable changes for both stance times were 0.04 (left) and 0.05 (right) seconds, for gait cycle time 0.08s, and for cadence 4.5 steps per minute. The OpenGo is valid and reliable for the measurement of temporal gait parameters during walking. Measurements of center of pressure parameters during unilateral stance are not considered valid. The OpenGo seems a promising instrument for clinically screening and monitoring temporal gait parameters in patients, however validation in patient populations is needed. Copyright © 2016 Elsevier B.V. All rights reserved.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population.

PubMed

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population

PubMed Central

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe. PMID:27228050

The Reliability and Validity of the Computerized Double Inclinometer in Measuring Lumbar Mobility

PubMed Central

MacDermid, Joy Christine; Arumugam, Vanitha; Vincent, Joshua Israel; Carroll, Krista L

2014-01-01

Study Design : Repeated measures reliability/validity study. Objectives : To determine the concurrent validity, test-retest, inter-rater and intra-rater reliability of lumbar flexion and extension measurements using the Tracker M.E. computerized dual inclinometer (CDI) in comparison to the modified-modified Schober (MMS) Summary of Background : Numerous studies have evaluated the reliability and validity of the various methods of measuring spinal motion, but the results are inconsistent. Differences in equipment and techniques make it difficult to correlate results. Methods : Twenty subjects with back pain and twenty without back pain were selected through convenience sampling. Two examiners measured sagittal plane lumbar range of motion for each subject. Two separate tests with the CDI and one test with the MMS were conducted. Each test consisted of three trials. Instrument and examiner order was randomly assigned. Intra-class correlations (ICCs 2, 2 and 2, 2) and Pearson correlation coefficients (r) were used to calculate reliability and concurrent validity respectively. Results : Intra-trial reliability was high to very high for both the CDI (ICCs 0.85 - 0.96) and MMS (ICCs 0.84 - 0.98). However, the reliability was poor to moderate, when the CDI unit had to be repositioned either by the same rate (ICCs 0.16 - 0.59) or a different rater (ICCs 0.45 - 0.52). Inter-rater reliability for the MMS was moderate to high (ICCs 0.75 - 0.82) which bettered the moderate correlation obtained for the CDI (ICCs 0.45 - 0.52). Correlations between the CDI and MMS were poor for flexion (0.32; p<0.05) and poor to moderate (-0.42 - -0.51; p<0.05) for extension measurements. Conclusion : When using the CDI, an average of subsequent tests is required to obtain moderate reliability. The MMS was highly reliable than the CDI. The MMS and the CDI measure lumbar movement on a different metric that are not highly related to each other. PMID:25352928

Absolute Reliability and Concurrent Validity of Hand Held Dynamometry and Isokinetic Dynamometry in the Hip, Knee and Ankle Joint: Systematic Review and Meta-analysis

PubMed Central

Chamorro, Claudio; Armijo-Olivo, Susan; De la Fuente, Carlos; Fuentes, Javiera; Javier Chirosa, Luis

2017-01-01

Abstract The purpose of the study is to establish absolute reliability and concurrent validity between hand-held dynamometers (HHDs) and isokinetic dynamometers (IDs) in lower extremity peak torque assessment. Medline, Embase, CINAHL databases were searched for studies related to psychometric properties in muscle dynamometry. Studies considering standard error of measurement SEM (%) or limit of agreement LOA (%) expressed as percentage of the mean, were considered to establish absolute reliability while studies using intra-class correlation coefficient (ICC) were considered to establish concurrent validity between dynamometers. In total, 17 studies were included in the meta-analysis. The COSMIN checklist classified them between fair and poor. Using HHDs, knee extension LOA (%) was 33.59%, 95% confidence interval (CI) 23.91 to 43.26 and ankle plantar flexion LOA (%) was 48.87%, CI 35.19 to 62.56. Using IDs, hip adduction and extension; knee flexion and extension; and ankle dorsiflexion showed LOA (%) under 15%. Lower hip, knee, and ankle LOA (%) were obtained using an ID compared to HHD. ICC between devices ranged between 0.62, CI (0.37 to 0.87) for ankle dorsiflexion to 0.94, IC (0.91to 0.98) for hip adduction. Very high correlation were found for hip adductors and hip flexors and moderate correlations for knee flexors/extensors and ankle plantar/dorsiflexors. PMID:29071305

Assessing Peer Entry and Play in Preschoolers at Risk for Maladjustment

ERIC Educational Resources Information Center

Brotman, Laurie Miller; Gouley, Kathleen Kiely; Chesir-Teran, Daniel

2005-01-01

This study evaluated the psychometric properties of an observational rating system for assessing preschoolers' peer entry and play skills: Observed Peer Play in Unfamiliar Settings (OPPUS). Participants were 84 preschoolers at risk for psychopathology. Reliability and concurrent validity are reported. The 30-min paradigm yielded reliable indexes…

Validation of an instrument to measure quality of life in British children with inflammatory bowel disease.

PubMed

Ogden, C A; Akobeng, A K; Abbott, J; Aggett, P; Sood, M R; Thomas, A G

2011-09-01

To validate IMPACT-III (UK), a health-related quality of life (HRQoL) instrument, in British children with inflammatory bowel disease (IBD). One hundred six children and parents were invited to participate. IMPACT-III (UK) was validated by inspection by health professionals and children to assess face and content validity, factor analysis to determine optimum domain structure, use of Cronbach alpha coefficients to test internal reliability, ANOVA to assess discriminant validity, correlation with the Child Health Questionnaire to assess concurrent validity, and use of intraclass correlation coefficients to assess test-retest reliability. The independent samples t test was used to measure differences between sexes and age groups, and between paper and computerised versions of IMPACT-III (UK). IMPACT-III (UK) had good face and content validity. The most robust factor solution was a 5-domain structure: body image, embarrassment, energy, IBD symptoms, and worries/concerns about IBD, all of which demonstrated good internal reliability (α = 0.74-0.88). Discriminant validity was demonstrated by significant (P  < 0.05, P < 0.01) differences in HRQoL scores between the severe, moderate, and inactive/mild symptom severity groups for the embarrassment scale (63.7 vs 81.0 vs 81.2), IBD symptom scale (45.0 vs 64.2 vs 80.6), and the energy scale (46.4 vs 62.1 vs 77.7). Concurrent validity of IMPACT-III (UK) with comparable domains of the Child Health Questionnaire was confirmed. Test-retest reliability was confirmed with good intraclass correlation coefficients of 0.66 to 0.84. Paper and computer versions of IMPACT-III (UK) collected comparable scores, and there were no differences between the sexes and age groups. IMPACT-III (UK) appears to be a useful tool to measure HRQoL in British children with IBD.

Self-rating inventory for posttraumatic stress disorder: review of the psychometric properties of a new brief Dutch screening instrument.

PubMed

Hovens, J E; Bramsen, I; van der Ploeg, H M

2002-06-01

The Self-rating Inventory for Posttraumatic Stress Disorder of 22 items was developed for use with populations without identified traumatic experiences. The inventory has been used extensively in survey research in The Netherlands. This paper examines the psychometric properties. In four different groups (trauma and psychiatric patients, elderly Dutch subjects, former peacekeepers, and medical students) internal consistency, test-retest reliability, concurrent and discriminant validity, and sensitivity and specificity are analyzed. The inventory showed good internal consistency, test-retest reliability, concurrent and discriminant validity, and high sensitivity and specificity. It appears to be valuable for survey research on posttraumatic stress in nonselected populations. As a screening device, high sensitivity for PTSD symptoms is evident even when the traumatic event has not been defined.

Comparing Two Processing Pipelines to Measure Subcortical and Cortical Volumes in Patients with and without Mild Traumatic Brain Injury.

PubMed

Reid, Matthew W; Hannemann, Nathan P; York, Gerald E; Ritter, John L; Kini, Jonathan A; Lewis, Jeffrey D; Sherman, Paul M; Velez, Carmen S; Drennon, Ann Marie; Bolzenius, Jacob D; Tate, David F

2017-07-01

To compare volumetric results from NeuroQuant® and FreeSurfer in a service member setting. Since the advent of medical imaging, quantification of brain anatomy has been a major research and clinical effort. Rapid advancement of methods to automate quantification and to deploy this information into clinical practice has surfaced in recent years. NeuroQuant® is one such tool that has recently been used in clinical settings. Accurate volumetric data are useful in many clinical indications; therefore, it is important to assess the intermethod reliability and concurrent validity of similar volume quantifying tools. Volumetric data from 148 U.S. service members across three different experimental groups participating in a study of mild traumatic brain injury (mTBI) were examined. Groups included mTBI (n = 71), posttraumatic stress disorder (n = 22), or a noncranial orthopedic injury (n = 55). Correlation coefficients and nonparametric group mean comparisons were used to assess reliability and concurrent validity, respectively. Comparison of these methods across our entire sample demonstrates generally fair to excellent reliability as evidenced by large intraclass correlation coefficients (ICC = .4 to .99), but little concurrent validity as evidenced by significantly different Mann-Whitney U comparisons for 26 of 30 brain structures measured. While reliability between the two segmenting tools is fair to excellent, volumetric outcomes are statistically different between the two methods. As suggested by both developers, structure segmentation should be visually verified prior to clinical use and rigor should be used when interpreting results generated by either method. Copyright © 2017 by the American Society of Neuroimaging.

Initial validation of two opiate craving questionnaires the obsessive compulsive drug use scale and the desires for drug questionnaire.

PubMed

Franken, Ingmar H A; Hendriksa, Vincent M; van den Brink, Wim

2002-01-01

In the present study, the factor structure, internal consistency, and the concurrent validity of two heroin craving questionnaires are examined. The Desires for Drug Questionnaire (DDQ) measures three factors: desire and intention, negative reinforcement, and control. The Obsessive Compulsive Drug Use Scale (OCDUS) also measures three factors: thoughts about heroin and interference, desire and control, and resistance to thoughts and intention. Subjects were 102 Dutch patients who were currently in treatment for drug dependency. All proposed scales have good reliability and concurrent validity. Implementation of these instruments in both clinical and research field is advocated.

Validating Quantitative Measurement Using Qualitative Data: Combining Rasch Scaling and Latent Semantic Analysis in Psychiatry

NASA Astrophysics Data System (ADS)

Lange, Rense

2015-02-01

An extension of concurrent validity is proposed that uses qualitative data for the purpose of validating quantitative measures. The approach relies on Latent Semantic Analysis (LSA) which places verbal (written) statements in a high dimensional semantic space. Using data from a medical / psychiatric domain as a case study - Near Death Experiences, or NDE - we established concurrent validity by connecting NDErs qualitative (written) experiential accounts with their locations on a Rasch scalable measure of NDE intensity. Concurrent validity received strong empirical support since the variance in the Rasch measures could be predicted reliably from the coordinates of their accounts in the LSA derived semantic space (R2 = 0.33). These coordinates also predicted NDErs age with considerable precision (R2 = 0.25). Both estimates are probably artificially low due to the small available data samples (n = 588). It appears that Rasch scalability of NDE intensity is a prerequisite for these findings, as each intensity level is associated (at least probabilistically) with a well- defined pattern of item endorsements.

Reliability and concurrent validity of a new iPhone® goniometric application for measuring active wrist range of motion: a cross-sectional study in asymptomatic subjects.

PubMed

Pourahmadi, Mohammad Reza; Ebrahimi Takamjani, Ismail; Sarrafzadeh, Javad; Bahramian, Mehrdad; Mohseni-Bandpei, Mohammad Ali; Rajabzadeh, Fatemeh; Taghipour, Morteza

2017-03-01

Measurement of wrist range of motion (ROM) is often considered to be an essential component of wrist physical examination. The measurement can be carried out through various instruments such as goniometers and inclinometers. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for goniometric functions. This study, for the first time, aimed to evaluate the reliability and concurrent validity of a new smartphone goniometric app (Goniometer Pro©) for measuring active wrist ROM. In all, 120 wrists of 70 asymptomatic adults (38 men and 32 women; aged 18-40 years) were assessed in a physiotherapy clinic located at the School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. Following the recruitment process, active wrist ROM was measured using a universal goniometer and iPhone ® 5 app. Two blinded examiners each utilized the universal goniometer and iPhone ® to measure active wrist ROM using a volar/dorsal alignment technique in the following sequences: flexion, extension, radial deviation, and ulnar deviation. The second (2 h later) and third (48 h later) sessions were carried out in the same manner as the first session. All the measurements were conducted three times and the mean value of three repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone ® app. Good to excellent intra-rater and inter-rater reliability was demonstrated for the goniometer with ICC values of ≥ 0.82 and ≥ 0.73 and the iPhone ® app with ICC values of ≥ 0.83 and ≥ 0.79, respectively. Minimum detectable change at the 95% confidence level (MDC 95 ) was computed as 1.96 × standard error of measurement × √2. The MDC 95 ranged from 1.66° to 5.35° for the intra-rater analysis and from 1.97° to 6.15° for the inter-rater analysis. The concurrent validity between the two instruments was high, with r values of ≥ 0.80. From the results of this cross-sectional study, it can be concluded that the iPhone ® app possesses good to excellent intra-rater and inter-rater reliability and concurrent validity. It seems that this app can be used for the measurement of wrist ROM. However, further research is needed to evaluate symptomatic subjects using this app. © 2016 Anatomical Society.

Measurement of acute nonspecific low back pain perception in primary care physical therapy: reliability and validity of the brief illness perception questionnaire.

PubMed

Hallegraeff, Joannes M; van der Schans, Cees P; Krijnen, Wim P; de Greef, Mathieu H G

2013-02-01

The eight-item Brief Illness Perception Questionnaire is used as a screening instrument in physical therapy to assess mental defeat in patients with acute low back pain, besides patient perception might determine the course and risk for chronic low back pain. However, the psychometric properties of the Brief Illness Perception Questionnaire in common musculoskeletal disorders like acute low back pain have not been adequately studied. Patients' perceptions vary across different populations and affect coping styles. Thus, our aim was to determine the internal consistency, test-retest reliability and validity of the Dutch language version of the Brief Illness Perception Questionnaire in acute non-specific low back pain patients in primary care physical therapy. A non-experimental cross-sectional study with two measurements was performed. Eighty-four acute low back pain patients, in multidisciplinary health care center in Dutch primary care with a sample mean (SD) age of 42 (12) years, participated in the study. Internal consistency (Cronbach's α) and test-retest procedures (Intraclass Correlation Coefficients and limits of agreement) were evaluated at a one-week interval. The concurrent validity of the Brief Illness Perception Questionnaire was examined by using the Mental Health Component of the Short Form 36 Health Survey. The Cronbach's α for internal consistency was 0.73 (95% CI, 0.67 - 0.83); and the Intraclass Correlation Coefficient test-retest reliability was acceptable: 0.72 (95% CI, 0.53 - 0.82), however, the limits of agreement were large. The Intraclass Correlation Coefficient measuring concurrent validity 0.65 (95% CI, 0.46 - 0.80). The Dutch version of the Brief Illness Perception Questionnaire is an appropriate instrument for measuring patients' perceptions in acute low back pain patients, showing acceptable internal consistency and reliability. Concurrent validity is adequate, however, the instrument may be unsuitable for detecting changes in low back pain perception over time.

Reliability and validity of the Wii Balance Board for assessment of standing balance: A systematic review.

PubMed

Clark, Ross A; Mentiplay, Benjamin F; Pua, Yong-Hao; Bower, Kelly J

2018-03-01

The use of force platform technologies to assess standing balance is common across a range of clinical areas. Numerous researchers have evaluated the low-cost Wii Balance Board (WBB) for its utility in assessing balance, with variable findings. This review aimed to systematically evaluate the reliability and concurrent validity of the WBB for assessment of static standing balance. Articles were retrieved from six databases (Medline, SCOPUS, EMBASE, CINAHL, Web of Science, Inspec) from 2007 to 2017. After independent screening by two reviewers, 25 articles were included. Two reviewers performed the data extraction and quality assessment. Test-retest reliability was investigated in 12 studies, with intraclass correlation coefficients or Pearson's correlation values showing a range from poor to excellent reliability (range: 0.27 to 0.99). Concurrent validity (i.e. comparison with another force platform) was examined in 21 studies, and was generally found to be excellent in studies examining the association between the same outcome measures collected on both devices. For studies reporting predominantly poor to moderate validity, potentially influential factors included the choice of 1) criterion reference (e.g. not a common force platform), 2) test duration (e.g. <30 s for double leg), 3) outcome measure (e.g. comparing a centre of pressure variable from the WBB with a summary score from the force platform), 4) data acquisition platform (studies using Apple iOS reported predominantly moderate validity), and 5) low sample size. In conclusion, evidence suggests that the WBB can be used as a reliable and valid tool for assessing standing balance. Protocol registration number: PROSPERO 2017: CRD42017058122. Copyright © 2018 Elsevier B.V. All rights reserved.

An evidence-based decision assistance model for predicting training outcome in juvenile guide dogs.

PubMed

Harvey, Naomi D; Craigon, Peter J; Blythe, Simon A; England, Gary C W; Asher, Lucy

2017-01-01

Working dog organisations, such as Guide Dogs, need to regularly assess the behaviour of the dogs they train. In this study we developed a questionnaire-style behaviour assessment completed by training supervisors of juvenile guide dogs aged 5, 8 and 12 months old (n = 1,401), and evaluated aspects of its reliability and validity. Specifically, internal reliability, temporal consistency, construct validity, predictive criterion validity (comparing against later training outcome) and concurrent criterion validity (comparing against a standardised behaviour test) were evaluated. Thirty-nine questions were sourced either from previously published literature or created to meet requirements identified via Guide Dogs staff surveys and staff feedback. Internal reliability analyses revealed seven reliable and interpretable trait scales named according to the questions within them as: Adaptability; Body Sensitivity; Distractibility; Excitability; General Anxiety; Trainability and Stair Anxiety. Intra-individual temporal consistency of the scale scores between 5-8, 8-12 and 5-12 months was high. All scales excepting Body Sensitivity showed some degree of concurrent criterion validity. Predictive criterion validity was supported for all seven scales, since associations were found with training outcome, at at-least one age. Thresholds of z-scores on the scales were identified that were able to distinguish later training outcome by identifying 8.4% of all dogs withdrawn for behaviour and 8.5% of all qualified dogs, with 84% and 85% specificity. The questionnaire assessment was reliable and could detect traits that are consistent within individuals over time, despite juvenile dogs undergoing development during the study period. By applying thresholds to scores produced from the questionnaire this assessment could prove to be a highly valuable decision-making tool for Guide Dogs. This is the first questionnaire-style assessment of juvenile dogs that has shown value in predicting the training outcome of individual working dogs.

Interrater and test-retest reliability and validity of the Norwegian version of the BESTest and mini-BESTest in people with increased risk of falling.

PubMed

Hamre, Charlotta; Botolfsen, Pernille; Tangen, Gro Gujord; Helbostad, Jorunn L

2017-04-20

The Balance Evaluation Systems Test (BESTest) was developed to assess underlying systems for balance control in order to be able to individually tailor rehabilitation interventions to people with balance disorders. A short form, the Mini-BESTest, was developed as a screening test. The study aimed to assess interrater and test-retest reliability of the Norwegian version of the BESTest and the Mini-BESTest in community-dwelling people with increased risk of falling and to assess concurrent validity with the Fall Efficacy Scale-International (FES-I), and it was an observational study with a cross-sectional design. Forty-two persons with increased risk of falling (elderly over 65 years of age, persons with a history of stroke or Multiple Sclerosis) were assessed twice by two raters. Relative reliability was analysed with Intraclass Correlation Coefficient (ICC), and absolute reliability with standard error of measurement (SEM) and smallest detectable change (SDC). Concurrent validity was assessed against the FES-I using Spearman's rho. The BESTest showed very good interrater reliability (ICC = 0.98, SEM = 1.79, SDC 95  = 5.0) and test-retest reliability (rater A/rater B = ICC = 0.89/0.89, SEM = 3.9/4.3, SDC 95  = 10.8/11.8). The Mini-BESTest also showed very good interrater reliability (ICC = 0.95, SEM = 1.19, SDC 95  = 3.3) and test-retest reliability (rater A/rater B = ICC = 0.85/0.84, SEM = 1.8/1.9, SDC 95  = 4.9/5.2). The correlations were moderate between the FES-I and both the BESTest and the Mini-BESTest (Spearman's rho -0.51 and-0.50, p < 0.01). The BESTest and its short form, the Mini-BESTest, showed very good interrater and test-retest reliability when assessed in a heterogeneous sample of people with increased risk of falling. The concurrent validity measured against the FES-I showed moderate correlation. The results are comparable with earlier studies and indicate that the Norwegian versions can be used in daily clinic and in research.

What is the best method for assessing lower limb force-velocity relationship?

PubMed

Giroux, C; Rabita, G; Chollet, D; Guilhem, G

2015-02-01

This study determined the concurrent validity and reliability of force, velocity and power measurements provided by accelerometry, linear position transducer and Samozino's methods, during loaded squat jumps. 17 subjects performed squat jumps on 2 separate occasions in 7 loading conditions (0-60% of the maximal concentric load). Force, velocity and power patterns were averaged over the push-off phase using accelerometry, linear position transducer and a method based on key positions measurements during squat jump, and compared to force plate measurements. Concurrent validity analyses indicated very good agreement with the reference method (CV=6.4-14.5%). Force, velocity and power patterns comparison confirmed the agreement with slight differences for high-velocity movements. The validity of measurements was equivalent for all tested methods (r=0.87-0.98). Bland-Altman plots showed a lower agreement for velocity and power compared to force. Mean force, velocity and power were reliable for all methods (ICC=0.84-0.99), especially for Samozino's method (CV=2.7-8.6%). Our findings showed that present methods are valid and reliable in different loading conditions and permit between-session comparisons and characterization of training-induced effects. While linear position transducer and accelerometer allow for examining the whole time-course of kinetic patterns, Samozino's method benefits from a better reliability and ease of processing. © Georg Thieme Verlag KG Stuttgart · New York.

A Test of the Inventory of Attitudes towards Seeking Mental Health Services

ERIC Educational Resources Information Center

Hyland, Philip; Boduszek, Daniel; Dhingra, Katie; Shevlin, Mark; Maguire, Rebecca; Morley, Kevin

2015-01-01

This study investigates the construct validity, composite reliability and concurrent validity of the "Inventory of attitudes towards seeking mental health services" (IASMHS). A large sample of Irish police officers (N = 331) participated in the study. Confirmatory factor analysis supported the three-factor structure of the scale, while…

Spanish version of the screening Örebro musculoskeletal pain questionnaire: a cross-cultural adaptation and validation.

PubMed

Cuesta-Vargas, Antonio Ignacio; González-Sánchez, Manuel

2014-10-29

Spanish is one of the five most spoken languages in the world. There is currently no published Spanish version of the Örebro Musculoskeletal Pain Questionnaire (OMPQ). The aim of the present study is to describe the process of translating the OMPQ into Spanish and to perform an analysis of reliability, internal structure, internal consistency and concurrent criterion-related validity. Translation and psychometric testing. Two independent translators translated the OMPQ into Spanish. From both translations a consensus version was achieved. A backward translation was made to verify and resolve any semantic or conceptual problems. A total of 104 patients (67 men/37 women) with a mean age of 53.48 (±11.63), suffering from chronic musculoskeletal disorders, twice completed a Spanish version of the OMPQ. Statistical analysis was performed to evaluate the reliability, the internal structure, internal consistency and concurrent criterion-related validity with reference to the gold standard questionnaire SF-12v2. All variables except "Coping" showed a rate above 0.85 on reliability. The internal structure calculation through exploratory factor analysis indicated that 75.2% of the variance can be explained with six components with an eigenvalue higher than 1 and 52.1% with only three components higher than 10% of variance explained. In the concurrent criterion-related validity, several significant correlations were seen close to 0.6, exceeding that value in the correlation between general health and total value of the OMPQ. The Spanish version of the screening questionnaire OMPQ can be used to identify Spanish patients with musculoskeletal pain at risk of developing a chronic disability.

Validity of a novel computerized screening test system for mild cognitive impairment.

PubMed

Park, Jin-Hyuck; Jung, Minye; Kim, Jongbae; Park, Hae Yean; Kim, Jung-Ran; Park, Ji-Hyuk

2018-06-20

ABSTRACTBackground:The mobile screening test system for screening mild cognitive impairment (mSTS-MCI) was developed for clinical use. However, the clinical usefulness of mSTS-MCI to detect elderly with MCI from those who are cognitively healthy has yet to be validated. Moreover, the comparability between this system and traditional screening tests for MCI has not been evaluated. The purpose of this study was to examine the validity and reliability of the mSTS-MCI and confirm the cut-off scores to detect MCI. The data were collected from 107 healthy elderly people and 74 elderly people with MCI. Concurrent validity was examined using the Korean version of Montreal Cognitive Assessment (MoCA-K) as a gold standard test, and test-retest reliability was investigated using 30 of the study participants at four-week intervals. The sensitivity, specificity, positive predictive value, and negative predictive value (NPV) were confirmed through Receiver Operating Characteristic (ROC) analysis, and the cut-off scores for elderly people with MCI were identified. Concurrent validity showed statistically significant correlations between the mSTS-MCI and MoCA-K and test-rests reliability indicated high correlation. As a result of screening predictability, the mSTS-MCI had a higher NPV than the MoCA-K. The mSTS-MCI was identified as a system with a high degree of validity and reliability. In addition, the mSTS-MCI showed high screening predictability, indicating it can be used in the clinical field as a screening test system for mild cognitive impairment.

Axis IV--psychosocial and environmental problems--in the DSM-IV.

PubMed

Ramirez, A; Ekselius, L; Ramklint, M

2013-11-01

The aim of this study was to further explore the properties of axis IV in the Diagnostic and statistical manual of mental disorders, 4th edition (DSM-IV). In a naturalistic cross-sectional design, a group (n = 163) of young (18-25 years old) Swedish psychiatric outpatients was assessed according to DSM-IV. Psychosocial and environmental problems/axis IV were evaluated through structured interviewing by a social worker and by self-assessment on a questionnaire. Reliability between professional assessment and self-assessment of axis IV was examined. Concurrent validity of axis IV was also examined. Reliability between professional and self-assessed axis IV was fair to almost perfect, 0.31-0.83, according to prevalence and bias-adjusted kappa. Categories of psychosocial stress and environmental problems were related to the presence of axis I disorders, co-morbidity, personality disorders and decreasing Global Assessment of Functioning (GAF) values. The revised axis IV according to DSM-IV seems to have concurrent validity, but is still hampered by limited reliability. © 2013 John Wiley & Sons Ltd.

Development of a Tablet-based symbol digit modalities test for reliably assessing information processing speed in patients with stroke.

PubMed

Tung, Li-Chen; Yu, Wan-Hui; Lin, Gong-Hong; Yu, Tzu-Ying; Wu, Chien-Te; Tsai, Chia-Yin; Chou, Willy; Chen, Mei-Hsiang; Hsieh, Ching-Lin

2016-09-01

To develop a Tablet-based Symbol Digit Modalities Test (T-SDMT) and to examine the test-retest reliability and concurrent validity of the T-SDMT in patients with stroke. The study had two phases. In the first phase, six experts, nine college students and five outpatients participated in the development and testing of the T-SDMT. In the second phase, 52 outpatients were evaluated twice (2 weeks apart) with the T-SDMT and SDMT to examine the test-retest reliability and concurrent validity of the T-SDMT. The T-SDMT was developed via expert input and college student/patient feedback. Regarding test-retest reliability, the practise effects of the T-SDMT and SDMT were both trivial (d=0.12) but significant (p≦0.015). The improvement in the T-SDMT (4.7%) was smaller than that in the SDMT (5.6%). The minimal detectable changes (MDC%) of the T-SDMT and SDMT were 6.7 (22.8%) and 10.3 (32.8%), respectively. The T-SDMT and SDMT were highly correlated with each other at the two time points (Pearson's r=0.90-0.91). The T-SDMT demonstrated good concurrent validity with the SDMT. Because the T-SDMT had a smaller practise effect and less random measurement error (superior test-retest reliability), it is recommended over the SDMT for assessing information processing speed in patients with stroke. Implications for Rehabilitation The Symbol Digit Modalities Test (SDMT), a common measure of information processing speed, showed a substantial practise effect and considerable random measurement error in patients with stroke. The Tablet-based SDMT (T-SDMT) has been developed to reduce the practise effect and random measurement error of the SDMT in patients with stroke. The T-SDMT had smaller practise effect and random measurement error than the SDMT, which can provide more reliable assessments of information processing speed.

Development of a new body image assessment scale in urban Cameroon: an anthropological approach.

PubMed

Cohen, Emmanuel; Pasquet, Patrick

2011-01-01

Develop and validate body image scales (BIS) presenting real human bodies adapted to the macroscopic phenotype of urban Cameroonian populations. Quantitative and qualitative analysis. Yaoundé, capital city of Cameroon. Four samples with balanced sex-ratio: the first (n=16) aged 18 to 65 years (qualitative study), the second (n=30) aged 25 to 40 years (photo database), the third (n=47) and fourth (n=181), > or =18 years (validation study). Construct validity, test retest reliability, concurrent and convergent validity of BIS. Body image scales present six Cameroonians of each sex arranged according to main body mass index (BMI) categories: underweight (<18.5 kg/m2), normal (18.5-24.9 kg/m2), overweight (25-29.9 kg/m2), obesity class I (30-34.9 kg/m2), obesity class II (35-39.9 kg/m2), and obesity class III (> or =40 kg/m2). Test-retest reliability correlations for current body size (CBS), desired body size and current desirable discrepancy (body self-satisfaction index) on BIS were never below .90. Plus, for the concurrent validity, we observed a significant correlation (r=0.67, P<.01) between measured BMI and CBS. Finally, the convergent validity between BIS and a female African American silhouettes scale, for different dimensions of body size perceptions, is acceptable. Body image scales are adapted to the phenotypic characteristics of urban Cameroonian populations. They are reliable and valid to assess body size perceptions and culturally adapted to the Cameroonian context.

Development of a job stressor scale for nurses caring for patients with intractable neurological diseases.

PubMed

Ando, Yukako; Kataoka, Tsuyoshi; Okamura, Hitoshi; Tanaka, Katsutoshi; Kobayashi, Toshio

2013-12-01

The purpose of this research is to verify the reliability and validity of a job stressor scale for nurses caring for patients with intractable neurological diseases. A mail survey was conducted using a self-report questionnaire. The subjects were 263 nurses and assistant nurses working in wards specializing in intractable neurological diseases. The response rate was 71.9% (valid response rate, 66.2%). With regard to reliability, internal consistency and stability were assessed. Internal consistency was examined via Cronbach's alpha. For stability, the test-retest method was performed and stability was examined via intraclass correlation coefficients. With regard to validity, factor validity, criterion-related validity, and content validity were assessed. Exploratory factor analysis was used for factor validity. For criterion-related validity, an existing scale was used as an external criterion; concurrent validity was examined via Spearman's rank correlation coefficients. As a result of analysis, there were 26 items in the scale created with an eight factor structure. Cronbach's a for the 26 items was 0.90; with the exception of two factors, alpha for all of the individual sub-factors was high at 0.7 or higher. The intraclass correlation coefficient for the 26 items was 0.89 (p < 0.001). With regard to criterion-related validity, concurrent validity was confirmed and the correlation coefficient with an external criterion was 0.73 (p < 0.001). For content validity, subjects who responded that "The questionnaire represents a stressor well or to a degree" accounted for 81% of the total responses. Reliability and validity were confirmed, so the scale created in the current research is a usable scale.

Validation of the Japanese version of the Pediatric Quality of Life Inventory (PedsQL) Cancer Module.

PubMed

Tsuji, Naoko; Kakee, Naoko; Ishida, Yasushi; Asami, Keiko; Tabuchi, Ken; Nakadate, Hisaya; Iwai, Tsuyako; Maeda, Miho; Okamura, Jun; Kazama, Takuro; Terao, Yoko; Ohyama, Wataru; Yuza, Yuki; Kaneko, Takashi; Manabe, Atsushi; Kobayashi, Kyoko; Kamibeppu, Kiyoko; Matsushima, Eisuke

2011-04-10

The PedsQL 3.0 Cancer Module is a widely used instrument to measure pediatric cancer specific health-related quality of life (HRQOL) for children aged 2 to 18 years. We developed the Japanese version of the PedsQL Cancer Module and investigated its reliability and validity among Japanese children and their parents. Participants were 212 children with cancer and 253 of their parents. Reliability was determined by internal consistency using Cronbach's coefficient alpha and test-retest reliability using intra-class correlation coefficient (ICC). Validity was assessed through factor validity, convergent and discriminant validity, concurrent validity, and clinical validity. Factor validity was examined by exploratory factor analysis. Convergent and discriminant validity were examined by multitrait scaling analysis. Concurrent validity was assessed using Spearman's correlation coefficients between the Cancer Module and Generic Core Scales, and the comparison of the scores of child self-reports with those of other self-rating depression scales for children. Clinical validity was assessed by comparing the on- and off- treatment scores using Kruskal-Wallis and Mann-Whitney U tests. Cronbach's coefficient alpha was over 0.70 for the total scale and over 0.60 for each subscale by age except for the 'pain and hurt' subscale for children aged 5 to 7 years. For test-retest reliability, the ICC exceeded 0.70 for the total scale for each age. Exploratory factor analysis demonstrated sufficient factorial validity. Multitrait scaling analysis showed high success rates. Strong correlations were found between the reports by children and their parents, and the scores of the Cancer Module and the Generic Core Scales except for 'treatment anxiety' subscales for child reports. The Depression Self-Rating Scale for Children (DSRS-C) scores were significantly correlated with emotional domains and the total score of the cancer module. Children who had been off treatment over 12 months demonstrated significantly higher scores than those on treatment. The results demonstrate the reliability and validity of the Japanese version of the PedsQL Cancer Module among Japanese children.

Development and validation of a toddler silhouette scale.

PubMed

Hager, Erin R; McGill, Adrienne E; Black, Maureen M

2010-02-01

The purpose of this study is to develop and validate a toddler silhouette scale. A seven-point scale was developed by an artist based on photographs of 15 toddlers (6 males, 9 females) varying in race/ethnicity and body size, and a list of phenotypic descriptions of toddlers of varying body sizes. Content validity, age-appropriateness, and gender and race/ethnicity neutrality were assessed among 180 pediatric health professionals and 129 parents of toddlers. Inter- and intrarater reliability and concurrent validity were assessed by having 138 pediatric health professionals match the silhouettes with photographs of toddlers. Assessments of content validity revealed that most health professionals (74.6%) and parents of toddlers (63.6%) ordered all seven silhouettes correctly, and interobserver agreement for weight status classification was high (kappa = 0.710, r = 0.827, P < 0.001). Most respondents reported that the scale represented toddlers aged 12-36 months (89%) and was gender (68.5%) and race/ethnicity (77.3%) neutral. The inter-rater reliability, based on matching silhouettes with photographs, was 0.787 (Cronbach's alpha) and the intrarater reliability was 0.855 (P < 0.001). The concurrent validity, based on the correlation between silhouette choice and the weight-for-length percentile of each toddler's photograph, was 0.633 (P < 0.001). In conclusion, a valid and reliable toddler silhouette scale that may be used for male or female toddlers, aged 12-36 months, of varying race/ethnicity was developed and evaluated. This scale may be used clinically or in research settings to assess parents' perception of and satisfaction with their toddler's body size. Interventions can be targeted toward parents who have inaccurate perceptions of or are dissatisfied with their toddler's body size.

Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire.

PubMed

Grandes, Gonzalo; Bully, Paola; Martinez, Catalina; Gagnon, Marie-Pierre

2017-11-10

Organizational readiness to change healthcare practice is a major determinant of successful implementation of evidence-based interventions. However, we lack of comprehensive, valid, and reliable instruments to measure it. We assessed the validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire in the context of the implementation of the Prescribe Vida Saludable III project, which seeks to strengthen health promotion and chronic disease prevention in primary healthcare organizations of the Osakidetza (Basque Health Service, Spain). A cross-sectional study was conducted including 127 professionals from 20 primary care centers within Osakidetza. They filled in the OR4KT questionnaire twice in a 15- to 30-day period to test repeatability. In addition, we used the Survey of Organizational Attributes for Primary Care (SOAPC) and we documented the number of healthcare professionals who formally engaged in the Prescribe Vida Saludable III project within each participating center to assess concurrent validity. Cronbach's alpha for the overall OR4KT was .95, and the overall repeatability coefficient was 6.95%, both excellent results. Confirmatory factor analysis supported the underlying theoretical structure of 6 dimensions and 23 sub-dimensions. There were positive moderate-to-high internal correlations between these six dimensions, and there was evidence of good concurrent validity (correlation coefficient of .76 with SOAPC, and .80 with the proportion of professionals engaged by center). A score higher than 64 (out of 100) would be indicative of an organization with high level of readiness to implement the intervention (sensitivity = .75, specificity = 1). The Spanish version of the OR4KT exhibits very strong reliability and good validity, although it needs to be validated in a larger sample and in different implementation contexts.

Concurrent validity of the Microsoft Kinect for Windows v2 for measuring spatiotemporal gait parameters.

PubMed

Dolatabadi, Elham; Taati, Babak; Mihailidis, Alex

2016-09-01

This paper presents a study to evaluate the concurrent validity of the Microsoft Kinect for Windows v2 for measuring the spatiotemporal parameters of gait. Twenty healthy adults performed several sequences of walks across a GAITRite mat under three different conditions: usual pace, fast pace, and dual task. Each walking sequence was simultaneously captured with two Kinect for Windows v2 and the GAITRite system. An automated algorithm was employed to extract various spatiotemporal features including stance time, step length, step time and gait velocity from the recorded Kinect v2 sequences. Accuracy in terms of reliability, concurrent validity and limits of agreement was examined for each gait feature under different walking conditions. The 95% Bland-Altman limits of agreement were narrow enough for the Kinect v2 to be a valid tool for measuring all reported spatiotemporal parameters of gait in all three conditions. An excellent intraclass correlation coefficient (ICC2, 1) ranging from 0.9 to 0.98 was observed for all gait measures across different walking conditions. The inter trial reliability of all gait parameters were shown to be strong for all walking types (ICC3, 1 > 0.73). The results of this study suggest that the Kinect for Windows v2 has the capacity to measure selected spatiotemporal gait parameters for healthy adults. Copyright © 2016 IPEM. Published by Elsevier Ltd. All rights reserved.

Connectedness among Taiwanese Middle School Students: A Validation Study of the Hemingway Measure of Adolescent Connectedness.

ERIC Educational Resources Information Center

Karcher, Michael J.; Lee, Yun

2002-01-01

Examines the psychometric properties of the Hemingway Measure of Adolescent Connectedness among 320 Taiwanese junior high school students. Finds that connectedness measure subscales and composite scales demonstrated acceptable reliability and concurrent validity. Also finds, among other things, that girls report more connectedness to school than…

Applying an Analytic Writing Rubric to Children's Hpermedia "Narratives".

ERIC Educational Resources Information Center

Mott, Michael Seth; Etsler, Cynthia; Drumgold, Deondra

In an effort designed to guide and improve the assessment of a newly developed writing environment, the reliability and developmental and concurrent validity of a previously validated rubric developed for pen-and-paper-created narratives, Writing What You Read (WWYR), was determined when applied to hypermedia-authored narratives of children in…

Assessment of Romantic Perfectionism: Psychometric Properties of the Romantic Relationship Perfectionism Scale

ERIC Educational Resources Information Center

Matte, Melody; Lafontaine, Marie-France

2012-01-01

The objective of the present study was to provide validity evidence for the scores from the Romantic Relationship Perfectionism Scale. Results indicate a two-factor structure, adequate reliability, and overall good convergent, concurrent, discriminant, and incremental validity evidence. The strengths and limitations of this measure are discussed.…

Cross-cultural evaluation of the French version of the LEIPAD, a health-related quality of life instrument for use in the elderly living at home.

PubMed

Jalenques, I; Auclair, C; Roblin, J; Morand, D; Tourtauchaux, R; May, R; Vaille-Perret, E; Watts, J; Gerbaud, L; De Leo, D

2013-04-01

To cross-culturally adapt a French version of the LEIPAD, a self-administered questionnaire assessing the health-related quality of life (HRQoL) in adults aged 65 years and over living at home, and to evaluate its psychometric properties. After having translated LEIPAD in accordance with guidelines, we studied psychometric properties: reliability and construct validity-factor analysis, relationships between items and scales, internal consistency, concurrent validity with the Medical Outcome Study Short-Form 36 and known-groups validity. The results obtained in a sample of 195 elderly from the general population showed very good acceptability, with response rates superior to 93 %. Exploratory factor analysis extracted eight factors providing a multidimensionality structure with five misclassifications of items in the seven theoretical scales. Good internal consistency (Cronbach's alpha ranging from 0.73 and 0.86) and strong test-retest reliability (ICCs higher than 0.80 for six scales and 0.70 for one) were demonstrated. Concurrent validity with the SF-36 showed small to strong expected correlations. This first evaluation of the French version of LEIPAD's psychometric properties provides evidence in construct validity and reliability. It would allow HRQoL assessment in clinical and common practice, and investigators would be able to take part in national and international research projects.

Expressed emotion in children: associations with sibling relationships.

PubMed

Yelland, I; Daley, D

2009-07-01

To investigate the reliability and validity of the expressed emotion (EE) measure, the Pre-school Five Minute Speech Sample (PFMSS), in child-to-child sibling relationships. A total of 106 boys aged 7-11 were recruited from 12 mainstream primary schools in North Wales. The children completed the PFMSS regarding their sibling and two self-report measures of sibling relationship: the Sibling Relationship Questionnaire (SRQ) and a Child Visual Analogue Scale (CVAS). The parents of 60 participants completed the Strengths and Difficulties Questionnaire regarding the behavioural problems of the participating child and his younger sibling. The PFMSS demonstrated good inter-rater and code-recode reliability. The significant associations between EE dimensions such as relationship, positive comments and critical comments with various components of the SRQ and CVAS provided support for the concurrent validity of the PFMSS. Significantly higher levels of Conflict and Rivalry and significantly lower levels of Warmth/Closeness on the SRQ were reported by children with high EE, demonstrating good discriminant validity for the PFMSS. There was no significant association between the child's EE profile and the behavioural difficulties of both siblings as reported by parents. The study found that the PFMSS is a valid and reliable measure of child EE. Future research is needed to clarify the concurrent validity of the warmth and initial statement components of the measure as well as the association between EE dimensions and behaviour.

The preliminary analysis of the reliability and validity of the Chinese Edition of the CSBS DP.

PubMed

Lin, Chu-Sui; Chang, Shu-Hui; Cheng, Shu-Fen; Chao, Pen-Chiang; Chiu, Chun-Hao

2015-03-01

This study marked a preliminary attempt to standardize the Chinese Edition of the Communication and Symbolic Behavior Scales Developmental Profile (Wetherby & Prizant, 2002; CSBS DP) to assist in the early identification of young children with special needs in Taiwan. The study was conducted among 171 infants and toddlers aged 1-2. It also included a follow-up study one year after the initial test. Three domestically developed standardized child development inventories were used to measure the concurrent validity and predictive validity. The Chinese Edition of the CSBS DP demonstrated overall good test-retest and inter-rater reliability. It also showed good concurrent and predictive validity. The current study yields preliminary evidence that the Chinese Edition of the CSBS DP could be a valuable assessment tool worthy of wider distribution. Future research should employ random sampling to establish a true national norm. Additionally, the follow-up study needs to include atypical groups and to expand to children aged 6-12 months to strengthen the applicability of the instrument in Taiwan. Copyright © 2014 Elsevier Ltd. All rights reserved.

Validation of the Persian Version of the Problematic Internet Use Questionnaire (PIUQ).

PubMed

Ranjbar, Hadi; Thatcher, Andrew; Greyling, Michael; Arab, Mansour; Nasri, Nahid

2014-10-01

The most commonly used instrument for the research and treatment of excessive internet use is Young's Internet Addiction Test (IAT). While the IAT has been translated to several languages (including Persian) and has demonstrated good psychometric properties across several independent studies, there is still a room for alternative assessment instruments. This study reports a validation of the Persian version of the Problematic Internet Use Questionnaire (PIUQ). A sample (n = 296) from Kerman, Iran was administered the translated Persian version of the PIUQ as well as the Persian version of the University of California, Los Angeles (UCLA) Loneliness scale, Satisfaction With Life scale, and questions related to use of technology and the internet. Analyses using confirmatory and exploratory factor analyses demonstrated that the Persian version of the PIUQ had good internal reliability and concurrent validity (with loneliness and satisfaction with life), but they also had an alternative factor structure that did not support the original factor structure. The Persian version of the PIUQ produced adequate psychometric properties (internal reliability and concurrent validity), but care should be taken in the interpretation of the factor structure.

Comparison of Parent versus Child-Report of Child Impulsivity Traits and Prediction of Outcome Variables

PubMed Central

Zapolski, Tamika C. B.; Smith, Gregory T.

2013-01-01

Five personality traits that dispose individuals to rash or ill-advised action (i.e., sensation seeking, negative urgency, positive urgency, lack of planning, and lack of perseverance), can be reliably and validly assessed in children. This paper reports on the first test of parental reports of these traits. In a sample of 94 children (ages 7–13, mean age 10.6), the authors found the following. First, parental reports of the five traits in their children appeared to be reliable. Second, there was moderate convergent validity: parent and child reports of the same traits had a median correlation of r = .30. Third, there was adequate discriminant validity: within-parent reports on different traits had a median correlation of r = .11. Fourth, concurrent prediction of child behavior from parental reports generally was inconsistent with prior findings. Fifth, discrepancies between the two reporters did predict dysfunctional child behavior. There are advantages to securing both child self-report and parental report of personality dispositions to rash action, although there is limited evidence for the concurrent validity of parental reports. PMID:24039341

The Spanish version of the Alberta Infant Motor Scale: Validity and reliability analysis.

PubMed

Morales-Monforte, Erica; Bagur-Calafat, Caridad; Suc-Lerin, Neus; Fornaguera-Martí, Montserrat; Cazorla-Sánchez, Engracia; Girabent-Farrés, Montserrat

2017-02-01

Validity and reliability of the cross-cultural adaptive translation of the Alberta Infant Motor Scale (AIMS), to monitor gross motor development in infants from 0 to 18 months of age, were evaluated. A cross-cultural translation was used to generate a Spanish version of the AIMS. Fifty infants at risk or with diagnosis of motor delay, 0-18 months of age, participated in this study. Two independent physical therapists scored infants on the AIMS. Concurrent validity was tested using the AIMS and the Bayley Scales of Infant and Toddler Development - III (Bayley - III). Reliability and the internal consistency were high (ICCs ranged from 0.94 to 1.00 and KR-20 ranged from 0.90 to 0.98, respectively). AIMS and Bayley - III scores correlated strongly (r = 0.97). The Spanish version of the AIMS presented excellent validity and reliability. Further studies are suggested in order to assess the AIMS in preterm babies.

Translation and validation of Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazil-Portuguese language.

PubMed

Garcia, Leila F Dos S; Manna, Thais Della; Passone, Caroline de Gouveia Buff; Oliveira, Lygia Spassapan de

2017-11-14

The aim of the present study was to create a translated version of the Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazilian Portuguese that was conceptually equivalent to the original American English version and to linguistically validate it in a Brazilian pediatric population with type 1 diabetes mellitus and their parents or caregivers. The instrument was translated, back-translated, and then administered to 83 children/adolescents (5-18 years) with type 1 diabetes mellitus and their family members and to 25 parents/caregivers of patients aged between 2 and 4 years. The final translated version was tested for reliability by analyzing internal consistency, intraobserver (test-retest) reliability, and concurrent validity. Cronbach's alpha coefficient for the total score of the questionnaires of children/adolescents (α=0.85) and their parents (α=0.82) was above the recommended minimum of 0.70 for group comparisons. Intraobserver reliability and concurrent validity exhibited a significant positive correlation (p<0.001), indicating the reliability of the translated instrument. A moderate but significant positive correlation (r=0.40; p<0.001) was demonstrated between the total scores of patient self-report and parent proxy-report scales. There was no significant correlation between glycated hemoglobin (HbA1c) levels and the respective scores in the questionnaires answered by patients and their parents/caregivers. The analysis of the translated version of the PedsQL™ 3.0 Diabetes Module revealed adequate psychometric characteristics with respect to reliability and validity following administration to a sample of Brazilian children/adolescents with type 1 diabetes mellitus and their caregivers. Copyright © 2017. Published by Elsevier Editora Ltda.

Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study

PubMed Central

Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

2013-01-01

Background Current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sport, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record monthly participation in all major sports relevant to our patient-group. Objective To assess the reliability, content validity, and concurrent validity of the survey, and evaluate if it provided more complete data on sports participation than a routine activity questionnaire. Methods One hundred and forty-five consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed two days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients were included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the twelfth postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. Results The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was substantial agreement between the two methods on return to preinjury main sport (κ = 0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. Conclusion The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire. PMID:23645830

Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study.

PubMed

Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

2014-05-01

The current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sports, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record the monthly participation in all major sports relevant to our patient-group. To assess the reliability, content validity and concurrent validity of the survey and to evaluate if it provided more complete data on sports participation than a routine activity questionnaire. 145 consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed 2 days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients was included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the 12th postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was a substantial agreement between the two methods on return to preinjury main sport (κ=0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire.

Concurrent Validity of Walking Speed Values Calculated via the GAITRite Electronic Walkway and 3 Meter Walk Test in the Chronic Stroke Population

PubMed Central

Peters, Denise M.; Middleton, Addie; Donley, Jonathan W.; Blanck, Erika L.; Fritz, Stacy L.

2014-01-01

The purpose of this study was to provide novel information regarding the concurrent validity (primary aim) and reliability (secondary aim) of walking speed (WS) calculated via the GAITRite1 electronic walkway system and 3 meter walk test (3MWT) in the chronic stroke population. The 3MWT is a feasible option for clinicians working in environments where space is limited. Psychometric properties of the test have not been established. Participants with chronic stroke were stratified into three groups: household ambulators (HA) (self-selected WS <0.4 m/s, 12 participants, 31 observations), limited community ambulators (LCA) (self-selected WS 0.4–0.8 m/s, 24 participants, 60 observations), and community ambulators (CA) (self-selected WS >0.8 m/s, 26 participants, 71 observations). Three consecutive trials of GAITRite1 and 3MWT were performed at participant’s self-selected WS. Average WS measurements differed significantly (p <0.05) between GAITRite1 and 3MWT for all three groups. HA group: GAITRite1 0.25 (0.11) m/s, 3MWT 0.27 (0.11) m/s; LCA group: GAITRite1 0.56 (0.11) m/s, 3MWT 0.52 (0.10) m/s; CA group: GAITRite1 1.03 (0.16) m/s, 3MWT 0.89 (0.15) m/s. Both WS measures had excellent within-session reliability (ICC’s ranging from 0.85 to 0.97, SEM95 from 0.04 to 0.12 m/s, and MDC95 from 0.05 to 0.16 m/s). Reliability was highest for HA on both measures. Although both the 3MWT and the GAITRite1 are reliable measures of WS for individuals with chronic stroke, the two measures do not demonstrate concurrent validity. PMID:24164441

Concurrent validity and reliability of using ground reaction force and center of pressure parameters in the determination of leg movement initiation during single leg lift.

PubMed

Aldabe, Daniela; de Castro, Marcelo Peduzzi; Milosavljevic, Stephan; Bussey, Melanie Dawn

2016-09-01

Postural adjustment evaluations during single leg lift requires the initiation of heel lift (T1) identification. T1 measured by means of motion analyses system is the most reliable approach. However, this method involves considerable workspace, expensive cameras, and time processing data and setting up laboratory. The use of ground reaction forces (GRF) and centre of pressure (COP) data is an alternative method as its data processing and setting up is less time consuming. Further, kinetic data is normally collected using frequency samples higher than 1000Hz whereas kinematic data are commonly captured using 50-200Hz. This study describes the concurrent-validity and reliability of GRF and COP measurements in determining T1, using a motion analysis system as reference standard. Kinematic and kinetic data during single leg lift were collected from ten participants. GRF and COP data were collected using one and two force plates. Displacement of a single heel marker was captured by means of ten Vicon(©) cameras. Kinetic and kinematic data were collected using a sample frequency of 1000Hz. Data were analysed in two stages: identification of key events in the kinetic data, and assessing concurrent validity of T1 based on the chosen key events with T1 provided by the kinematic data. The key event presenting the least systematic bias, along with a narrow 95% CI and limits of agreement against the reference standard T1, was the Baseline COPy event. Baseline COPy event was obtained using one force plate and presented excellent between-tester reliability. Copyright © 2016 Elsevier B.V. All rights reserved.

Validity of eyeball estimation for range of motion during the cervical flexion rotation test compared to an ultrasound-based movement analysis system.

PubMed

Schäfer, Axel; Lüdtke, Kerstin; Breuel, Franziska; Gerloff, Nikolas; Knust, Maren; Kollitsch, Christian; Laukart, Alex; Matej, Laura; Müller, Antje; Schöttker-Königer, Thomas; Hall, Toby

2018-08-01

Headache is a common and costly health problem. Although pathogenesis of headache is heterogeneous, one reported contributing factor is dysfunction of the upper cervical spine. The flexion rotation test (FRT) is a commonly used diagnostic test to detect upper cervical movement impairment. The aim of this cross-sectional study was to investigate concurrent validity of detecting high cervical ROM impairment during the FRT by comparing measurements established by an ultrasound-based system (gold standard) with eyeball estimation. Secondary aim was to investigate intra-rater reliability of FRT ROM eyeball estimation. The examiner (6 years experience) was blinded to the data from the ultrasound-based device and to the symptoms of the patients. FRT test result (positive or negative) was based on visual estimation of range of rotation less than 34° to either side. Concurrently, range of rotation was evaluated using the ultrasound-based device. A total of 43 subjects with headache (79% female), mean age of 35.05 years (SD 13.26) were included. According to the International Headache Society Classification 23 subjects had migraine, 4 tension type headache, and 16 multiple headache forms. Sensitivity and specificity were 0.96 and 0.89 for combined rotation, indicating good concurrent reliability. The area under the ROC curve was 0.95 (95% CI 0.91-0.98) for rotation to both sides. Intra-rater reliability for eyeball estimation was excellent with Fleiss Kappa 0.79 for right rotation and left rotation. The results of this study indicate that the FRT is a valid and reliable test to detect impairment of upper cervical ROM in patients with headache.

Reliability, Validity, and Minimal Detectable Change of Balance Evaluation Systems Test and Its Short Versions in Older Cancer Survivors: A Pilot Study.

PubMed

Huang, Min H; Miller, Kara; Smith, Kristin; Fredrickson, Kayle; Shilling, Tracy

2016-01-01

Cancer is primarily a disease of older adults. About 77% of all cancers are diagnosed in persons aged 55 years and older. Cancer and its treatment can cause diverse sequelae impacting body systems underlying balance control. No study has examined the psychometric properties of balance assessment tools in older cancer survivors, presenting a significant challenge in the selection of outcome measures for clinicians treating this fast-growing population. This study aimed to determine the reliability, validity, and minimal detectable change (MDC) of the Balance Evaluation System Test (BESTest), Mini-Balance Evaluation Systems Test (Mini-BESTest), and Brief-Balance Evaluation Systems Test (Brief-BESTest) in community-dwelling older cancer survivors. This study was a cross-sectional design. Twenty breast and 8 prostate cancer survivors participated [age (SD) = 68.4 (8.13) years]. The BESTest and Activity-specific Balance Confidence (ABC) Scale were administered during the first session. Scores of Mini-BESTest and Brief-BESTest were extracted on the basis of the scores of BESTest. The BESTest was repeated within 1 to 2 weeks by the same rater to determine the test-retest reliability. For the analysis of the inter-rater reliability, 21 participants were randomly selected to be evaluated by 2 raters. A primary rater administered the test. The 2 raters independently and concurrently scored the performance of the participants. Each rater recorded the ratings separately on the scoring sheet. No discussion among the raters was allowed throughout the testing. Intraclass correlation coefficients (ICCs), standard error of measurement, minimal detectable change (MDC), and Bland-Altman plots were calculated. Concurrent validity of these balance tests with the ABC Scale was examined using the Spearman correlation. The BESTest, Mini-BESTest, and Brief-BESTest had high test-retest (ICC = 0.90-0.94) and interrater reliability (ICC = 0.86-0.96), small standard error of measurement (0.86-2.47 points), and MDC (2.39-6.86 points). The Bland-Altman plot revealed no systematic errors. The scores of BESTest, Mini-BEST, and Brief-BEST were correlated significantly with those of ABC Scale (P < .01), supporting their concurrent validity. The BESTest, Mini-BESTest, and Brief-BESTest showed high interrater and test-retest reliability, and excellent concurrent validity with the ABC Scale for community-dwelling cancer survivors aged 55 years and older who had completed cancer treatments for at least 3 months. Future studies are necessary to determine the predictive values for determining fall risks using balance assessment tools in older cancer survivors. Clinicians can utilize the BESTest and its short versions to evaluate balance problems in community-dwelling older cancer survivors and apply the established MDC to assess the intervention outcomes.

Standardization of the Gordon Primary Measures of Music Audiation in Greece

ERIC Educational Resources Information Center

Stamou, Lelouda; Schmidt, Charles P.; Humphreys, Jere T.

2010-01-01

The purpose of this study was to standardize the Primary Measures of Music Audiation in Greece ( N = 1,188). Split-halves reliability was acceptable across grade levels (K through 3) for the Tonal and Rhythm subtests, but test-retest reliability was generally unacceptable, especially for the Rhythm subtest. Concurrent validity was mixed, with…

Reliability and validity of the French-Canadian version of the scoliosis research society 22 questionnaire in France.

PubMed

Lonjon, Guillaume; Ilharreborde, Brice; Odent, Thierry; Moreau, Sébastien; Glorion, Christophe; Mazda, Keyvan

2014-01-01

Outcome study to determine the internal consistency, reproducibility, and concurrent validity of the French-Canadian version of the Scoliosis Research Society 22 (SRS-22 fcv) patient questionnaire in France. To determine whether the SRS-22 fcv can be used in a population from France. The SRS-22 has been translated and validated in multiple countries, notably in the French-Canadian language in Quebec, Canada. Use of SRS-22 fcv seems appropriate for evaluating adolescent idiopathic scoliosis in France. However, French-Canadian French is noticeably different from the French spoken in France, and no study has investigated the use of a French-Canadian version of a health-quality questionnaire in another French population. The methods used for validating the SRS-22 fcv in Quebec were adopted for use with a group of 200 adolescents with idiopathic scoliosis and 60 healthy adolescents in France. Reliability and reproducibility were measured by the Cronbach α and intraclass correlation coefficient (ICC), construct validity by factorial analysis, concurrent validity by the Short-Form of the survey, and discriminant validity by analysis of variance and multivariate linear regression. In France, the SRS-22 fcv showed good global internal consistency (Cronbach α = 0.87, intraclass correlation coefficient = 0.92), a coherent factorial structure, and high correlation coefficients between the SRS-22 fcv and Short-Form of the survey (P < 0.001). However, reliability and validity were slightly less than that for the instrument's original validation and the validation of the SRS-22 fcv in Quebec. These differences could be explained by language and cultural differences. The SRS-22 fcv is relevant for use in France, but further development and validation of a specific French questionnaire remain necessary to improve the assessment of functional outcomes of adolescents with scoliosis in France. N/A.

Translation and validation of the Cardiac Depression Scale to Arabic.

PubMed

Papasavvas, T; Al-Amin, H; Ghabrash, H F; Micklewright, D

2016-08-01

The Cardiac Depression Scale (CDS) has been designed to measure depressive symptoms in patients with heart disease. There is no Arabic version of the CDS. We translated and validated the CDS in an Arabic sample of patients with heart disease. Forward and back translation of the CDS was followed by assessment of cultural relevance and content validity. The Arabic version of the CDS (A-CDS) and the Arabic version of the Hospital Anxiety and Depression Scale (A-HADS) were then administered to 260 Arab in-patients with heart disease from 18 Arabic countries. Construct validity was assessed using exploratory factor analysis with polychoric correlations. Internal consistency was assessed using ordinal reliability alpha and item-to-factor polychoric correlations. Concurrent validity was assessed using Pearson's correlation coefficient between the A-CDS and the depression subscale of the A-HADS (A-HADS-D). Cultural relevance and content validity of the A-CDS were satisfactory. Exploratory factor analysis revealed three robust factors, without cross-loadings, that formed a single dimension. Internal consistency was high (ordinal reliability alpha for the total scale and the three factors were .94, .91, .86, and .87, respectively; item-to-factor correlations ranged from .77 to .91). Concurrent validity was high (r=.72). The A-CDS demonstrated a closer to normal distribution of scores than the A-HADS-D. Sensitivity and specificity of the A-CDS were not objectively assessed. The A-CDS appears to be a valid and reliable instrument to measure depressive symptoms in a representative sample of Arab in-patients with heart disease. Copyright © 2016 Elsevier B.V. All rights reserved.

Development and validation of the Pediatric Anesthesia Behavior score--an objective measure of behavior during induction of anesthesia.

PubMed

Beringer, Richard M; Greenwood, Rosemary; Kilpatrick, Nicky

2014-02-01

Measuring perioperative behavior changes requires validated objective rating scales. We developed a simple score for children's behavior during induction of anesthesia (Pediatric Anesthesia Behavior score) and assessed its reliability, concurrent validity, and predictive validity. Data were collected as part of a wider observational study of perioperative behavior changes in children undergoing general anesthesia for elective dental extractions. One-hundred and two healthy children aged 2-12 were recruited. Previously validated behavioral scales were used as follows: the modified Yale Preoperative Anxiety Scale (m-YPAS); the induction compliance checklist (ICC); the Pediatric Anesthesia Emergence Delirium scale (PAED); and the Post-Hospitalization Behavior Questionnaire (PHBQ). Pediatric Anesthesia Behavior (PAB) score was independently measured by two investigators, to allow assessment of interobserver reliability. Concurrent validity was assessed by examining the correlation between the PAB score, the m-YPAS, and the ICC. Predictive validity was assessed by examining the association between the PAB score, the PAED scale, and the PHBQ. The PAB score correlated strongly with both the m-YPAS (P < 0.001) and the ICC (P < 0.001). PAB score was significantly associated with the PAED score (P = 0.031) and with the PHBQ (P = 0.034). Two independent investigators recorded identical PAB scores for 94% of children and overall, there was close agreement between scores (Kappa coefficient of 0.886 [P < 0.001]). The PAB score is simple to use and may predict which children are at increased risk of developing postoperative behavioral disturbance. This study provides evidence for its reliability and validity. © 2013 John Wiley & Sons Ltd.

Psychometrics of the PHQ-9 as a measure of depressive symptoms in patients with heart failure.

PubMed

Hammash, Muna H; Hall, Lynne A; Lennie, Terry A; Heo, Seongkum; Chung, Misook L; Lee, Kyoung Suk; Moser, Debra K

2013-10-01

Depression in patients with heart failure commonly goes undiagnosed and untreated. The Patient Health Questionnaire-9 (PHQ-9) is a simple, valid measure of depressive symptoms that may facilitate clinical assessment. It has not been validated in patients with heart failure. To test the reliability, and concurrent and construct validity of the PHQ-9 in patients with heart failure. A total of 322 heart failure patients (32% female, 61 ± 12 years, 56% New York Heart Association class III/IV) completed the PHQ-9, the Beck Depression Inventory-II (BDI-II), and the Control Attitudes Scale (CAS). Cronbach's alpha of .83 supported the internal consistency reliability of the PHQ-9 in this sample. Inter-item correlations (range .22-.66) and item-total correlation (except item 9) supported homogeneity of the PHQ-9. Spearman's rho of .80, (p < .001) between the PHQ-9 and the BDI-II supported the concurrent validity as did the agreement between the PHQ-9 and the BDI-II (Kappa = 0.64, p < .001). At cut-off score of 10, the PHQ-9 was 70% sensitive and 92% specific in identifying depressive symptoms, using the BDI-II scores as the criterion for comparison. Differences in PHQ-9 scores by level of perceived control measured by CAS (t(318) = -5.05, p < .001) supported construct validity. The PHQ-9 is a reliable, valid measure of depressive symptoms in patients with heart failure.

How reliable and valid is the teacher version of the Strengths and Difficulties Questionnaire in primary school children?

PubMed

van den Heuvel, Meta; Jansen, Danielle E M C; Stewart, Roy E; Smits-Engelsman, Bouwien C M; Reijneveld, Sijmen A; Flapper, Boudien C T

2017-01-01

The Strengths and Difficulties Questionnaire (SDQ) is validated for parents, but not yet for teachers in a broad age range of children. We conducted a cross-sectional study with 4-10 years old school children to investigate if the SDQ-T can be used instead of the validated but lengthy Teacher's Report Form (TRF) to acquire information about emotional and behavioral problems in the school community. Teachers of 453 children from primary schools were approached. Teachers of 394 children (response rate 86.9%) with a mean age of 7.1 years filled in the SDQ-T (n = 387), the TRF (n = 349) or both (n = 342). We assessed reliability by calculating internal consistency and concurrent validity (using correlation coefficients, sensitivity, specificity) of the SDQ-T compared with the TRF. Internal consistency of the SDQ-T Total Difficulties Score (SDQ-T TDS; Cronbach α = 0.80), hyperactivity/ inattention- (α = 0.86) and prosocial behavior (α = 0.81) was very good. Concurrent validity demonstrated a strong correlation of all subscales of the SDQ-T with the corresponding scale on the TRF (range 0.54-0.73), except for peer problems (0.46). Using a SDQ-T TDS cut-off score > 14, the SDQ-T had a good sensitivity (90%) and specificity (94%). The good reliability, validity and brevity of the SDQ-T make it an easily applicable questionnaire for obtaining information about emotional and behavioral problems from teachers in primary school children.

Measuring patients' satisfaction with their anti-TNF treatment in severe Crohn's disease: scoring and psychometric validation of the Satisfaction for PAtients in Crohn's diseasE Questionnaire (SPACE-Q(©)).

PubMed

Gilet, Hélène; Arnould, Benoit; Fofana, Fatoumata; Clerson, Pierre; Colombel, Jean-Frédéric; D'Hondt, Olivier; Faure, Patrick; Hagège, Hervé; Nachury, Maria; Nahon, Stéphane; Tucat, Gilbert; Vandromme, Luc; Cazala-Telinge, Ines; Thibout, Emmanuel

2014-01-01

Severe Crohn's disease management includes anti-tumor necrosis factor (anti-TNF) drugs that differ from early-stage treatments regarding efficacy, safety, and convenience. This study aimed to finalize and psychometrically validate the Satisfaction for PAtients in Crohn's diseasE Questionnaire (SPACE-Q(©)), developed to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease. A total of 279 patients with severe Crohn's disease receiving anti-TNF therapy completed the SPACE-Q 62-item pilot version at inclusion and 12 and 13 weeks after first anti-TNF injection. The final SPACE-Q scoring was defined using multitrait and regression analyses and clinical relevance considerations. Psychometric validation included clinical validity against Harvey-Bradshaw score, concurrent validity against Treatment Satisfaction Questionnaire for Medication (TSQM), internal consistency reliability, test-retest reliability, and responsiveness against the patient global impression of change (PGIC). Quality of completion was good (55%-67% of patients completed all items). Four items were removed from the questionnaire. Eleven scores were defined within the final 58-item SPACE-Q: disease control; symptoms, anal symptoms, and quality of life transition scales; tolerability; convenience; expectation confirmation toward efficacy, side effects, and convenience; satisfaction with treatment; and motivation. Scores met standards for concurrent validity (correlation between SPACE-Q satisfaction with treatment and TSQM satisfaction scores =0.59), internal consistency reliability (Cronbach's α=0.67-0.93), test-retest reliability (intraclass correlations =0.62-0.91), and responsiveness (improvement in treatment experience assessed by the SPACE-Q for patients reporting improvement on the PGIC). Significantly different mean scores were observed between groups of patients with different Harvey-Bradshaw disease severity scores. The SPACE-Q is a valid, reliable, and responsive instrument to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease and for use in future studies.

Reliability and validity of a self-administered tool for online neuropsychological testing: The Amsterdam Cognition Scan.

PubMed

Feenstra, Heleen E M; Murre, Jaap M J; Vermeulen, Ivar E; Kieffer, Jacobien M; Schagen, Sanne B

2018-04-01

To facilitate large-scale assessment of a variety of cognitive abilities in clinical studies, we developed a self-administered online neuropsychological test battery: the Amsterdam Cognition Scan (ACS). The current studies evaluate in a group of adult cancer patients: test-retest reliability of the ACS and the influence of test setting (home or hospital), and the relationship between our online and a traditional test battery (concurrent validity). Test-retest reliability was studied in 96 cancer patients (57 female; M age  = 51.8 years) who completed the ACS twice. Intraclass correlation coefficients (ICCs) were used to assess consistency over time. The test setting was counterbalanced between home and hospital; influence on test performance was assessed by repeated measures analyses of variance. Concurrent validity was studied in 201 cancer patients (112 female; M age  = 53.5 years) who completed both the online and an equivalent traditional neuropsychological test battery. Spearman or Pearson correlations were used to assess consistency between online and traditional tests. ICCs of the online tests ranged from .29 to .76, with an ICC of .78 for the ACS total score. These correlations are generally comparable with the test-retest correlations of the traditional tests as reported in the literature. Correlating online and traditional test scores, we observed medium to large concurrent validity (r/ρ = .42 to .70; total score r = .78), except for a visuospatial memory test (ρ = .36). Correlations were affected-as expected-by design differences between online tests and their offline counterparts. Although development and optimization of the ACS is an ongoing process, and reliability can be optimized for several tests, our results indicate that it is a highly usable tool to obtain (online) measures of various cognitive abilities. The ACS is expected to facilitate efficient gathering of data on cognitive functioning in the near future.

Reliability and validity of the new Tanaka B Intelligence Scale scores: a group intelligence test.

PubMed

Uno, Yota; Mizukami, Hitomi; Ando, Masahiko; Yukihiro, Ryoji; Iwasaki, Yoko; Ozaki, Norio

2014-01-01

The present study evaluated the reliability and concurrent validity of the new Tanaka B Intelligence Scale, which is an intelligence test that can be administered on groups within a short period of time. The new Tanaka B Intelligence Scale and Wechsler Intelligence Scale for Children-Third Edition were administered to 81 subjects (mean age ± SD 15.2 ± 0.7 years) residing in a juvenile detention home; reliability was assessed using Cronbach's alpha coefficient, and concurrent validity was assessed using the one-way analysis of variance intraclass correlation coefficient. Moreover, receiver operating characteristic analysis for screening for individuals who have a deficit in intellectual function (an FIQ<70) was performed. In addition, stratum-specific likelihood ratios for detection of intellectual disability were calculated. The Cronbach's alpha for the new Tanaka B Intelligence Scale IQ (BIQ) was 0.86, and the intraclass correlation coefficient with FIQ was 0.83. Receiver operating characteristic analysis demonstrated an area under the curve of 0.89 (95% CI: 0.85-0.96). In addition, the stratum-specific likelihood ratio for the BIQ≤65 stratum was 13.8 (95% CI: 3.9-48.9), and the stratum-specific likelihood ratio for the BIQ≥76 stratum was 0.1 (95% CI: 0.03-0.4). Thus, intellectual disability could be ruled out or determined. The present results demonstrated that the new Tanaka B Intelligence Scale score had high reliability and concurrent validity with the Wechsler Intelligence Scale for Children-Third Edition score. Moreover, the post-test probability for the BIQ could be calculated when screening for individuals who have a deficit in intellectual function. The new Tanaka B Intelligence Test is convenient and can be administered within a variety of settings. This enables evaluation of intellectual development even in settings where performing intelligence tests have previously been difficult.

Reliability and Validity of the New Tanaka B Intelligence Scale Scores: A Group Intelligence Test

PubMed Central

Uno, Yota; Mizukami, Hitomi; Ando, Masahiko; Yukihiro, Ryoji; Iwasaki, Yoko; Ozaki, Norio

2014-01-01

Objective The present study evaluated the reliability and concurrent validity of the new Tanaka B Intelligence Scale, which is an intelligence test that can be administered on groups within a short period of time. Methods The new Tanaka B Intelligence Scale and Wechsler Intelligence Scale for Children-Third Edition were administered to 81 subjects (mean age ± SD 15.2±0.7 years) residing in a juvenile detention home; reliability was assessed using Cronbach’s alpha coefficient, and concurrent validity was assessed using the one-way analysis of variance intraclass correlation coefficient. Moreover, receiver operating characteristic analysis for screening for individuals who have a deficit in intellectual function (an FIQ<70) was performed. In addition, stratum-specific likelihood ratios for detection of intellectual disability were calculated. Results The Cronbach’s alpha for the new Tanaka B Intelligence Scale IQ (BIQ) was 0.86, and the intraclass correlation coefficient with FIQ was 0.83. Receiver operating characteristic analysis demonstrated an area under the curve of 0.89 (95% CI: 0.85–0.96). In addition, the stratum-specific likelihood ratio for the BIQ≤65 stratum was 13.8 (95% CI: 3.9–48.9), and the stratum-specific likelihood ratio for the BIQ≥76 stratum was 0.1 (95% CI: 0.03–0.4). Thus, intellectual disability could be ruled out or determined. Conclusion The present results demonstrated that the new Tanaka B Intelligence Scale score had high reliability and concurrent validity with the Wechsler Intelligence Scale for Children-Third Edition score. Moreover, the post-test probability for the BIQ could be calculated when screening for individuals who have a deficit in intellectual function. The new Tanaka B Intelligence Test is convenient and can be administered within a variety of settings. This enables evaluation of intellectual development even in settings where performing intelligence tests have previously been difficult. PMID:24940880

Reliability and Validity of the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A).

PubMed

Bervoets, Liene; Van Noten, Caroline; Van Roosbroeck, Sofie; Hansen, Dominique; Van Hoorenbeeck, Kim; Verheyen, Els; Van Hal, Guido; Vankerckhoven, Vanessa

2014-01-01

This study was designed to validate the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A). After adjustment of the original Canadian PAQ-C and PAQ-A (i.e. translation/back-translation and evaluation by expert committee), content validity of both PAQs was assessed and calculated using item-level (I-CVI) and scale-level (S-CVI) content validity indexes. Inter-item and inter-rater reliability of 196 PAQ-C and 95 PAQ-A filled in by both children or adolescents and their parent, were evaluated. Inter-item reliability was calculated by Cronbach's alpha (α) and inter-rater reliability was examined by percent observed agreement and weighted kappa (κ). Concurrent validity of PAQ-A was examined in a subsample of 28 obese and 16 normal-weight children by comparing it with concurrently measured physical activity using a maximal cardiopulmonary exercise test for the assessment of peak oxygen uptake (VO2 peak). For both PAQs, I-CVI ranged 0.67-1.00. S-CVI was 0.89 for PAQ-C and 0.90 for PAQ-A. A total of 192 PAQ-C and 94 PAQ-A were fully completed by both child and parent. Cronbach's α was 0.777 for PAQ-C and 0.758 for PAQ-A. Percent agreement ranged 59.9-74.0% for PAQ-C and 51.1-77.7% for PAQ-A, and weighted κ ranged 0.48-0.69 for PAQ-C and 0.51-0.68 for PAQ-A. The correlation between total PAQ-A score and VO2 peak - corrected for age, gender, height and weight - was 0.516 (p = 0.001). Both PAQs have an excellent content validity, an acceptable inter-item reliability and a moderate to good strength of inter-rater agreement. In addition, total PAQ-A score showed a moderate positive correlation with VO2 peak. Both PAQs have an acceptable to good reliability and validity, however, further validity testing is recommended to provide a more complete assessment of both PAQs.

Reliability and validity of simplified Chinese version of Swiss Spinal Stenosis Questionnaire for patients with degenerative lumbar spinal stenosis.

PubMed

Yi, Honglei; Wei, Xianzhao; Zhang, Wei; Chen, Ziqiang; Wang, Xinhui; Ji, Xinran; Zhu, Xiaodong; Wang, Fei; Xu, Ximing; Li, Zhikun; Fan, Jianping; Wang, Chuanfeng; Chen, Kai; Zhang, Guoyou; Zhao, Yinchuan; Li, Ming

2014-05-01

This was a prospective clinical validation study. To evaluate the reliability and validity of the adapted simplified Chinese version of Swiss Spinal Stenosis (SC-SSS) Questionnaire. The SSS Questionnaire is a reliable and valid instrument to assess the perception of function and pain for patients with degenerative lumbar spinal stenosis. However, there is no culturally adapted SSS Questionnaire for use in mainland China. This was a prospective clinical validation study. The adaption was conducted according to International Quality of Life Assessment Project guidelines. To examine the psychometric properties of the adapted SC-SSS Questionnaire, a sample of 105 patients with lumbar spinal stenosis were included. Thirty-two patients were randomly selected to evaluate the test-retest reliability. Reliability assessment of the SC-SSS Questionnaire was determined by calculating Cronbach α and intraclass coefficient values. Concurrent validity was assessed by correlating SC-SSS Questionnaire scores with relevant domains of the 36-Item Short Form Health Survey. Cronbach α of the symptom severity scale, physical function scale, patients, and satisfaction scale of SC-SSS Questionnaire are 0.89, 0.86, 0.91, respectively, which revealed very good internal consistency. The test-retest reproducibility was found to be excellent with the intraclass correlation coefficient of 0.93, 0.91, and 0.95. In terms of concurrent validity, SC-SSS Questionnaire had good correlation with physical functioning and bodily pain of 36-Item Short Form Health Survey (r = 0.663, 0.653) and low correlation with mental health (r = 0.289). The physical function scale had good correlation with physical functioning of 36-Item Short Form Health Survey (r = 0.637), whereas the rest had moderate correlation. The satisfaction scale score was highly correlated with the change in the symptom severity (r = 0.71) and physical function (r = 0.68) scale score. The SC-SSS Questionnaire showed satisfactory reliability and validity in the evaluation of functionality in patients with lumbar spinal stenosis who are experiencing neurogenic claudication. It is simple and easy to use and can be recommended in clinical and research practice in mainland China. 3.

Assessing the validity and reliability of the Pool Activity Level (PAL) Checklist for use with older people with dementia.

PubMed

Wenborn, Jennifer; Challis, David; Pool, Jackie; Burgess, Jane; Elliott, Nicola; Orrell, Martin

2008-03-01

Activity is key to maintaining physical and mental health and well-being. However, as dementia affects the ability to engage in activity, care-givers can find it difficult to provide appropriate activities. The Pool Activity Level (PAL) Checklist guides the selection of appropriate, personally meaningful activities. The aim of this study was to assess the reliability and validity of the PAL Checklist when used with older people with dementia. A postal questionnaire sent to activity providers assessed content validity. Validity and reliability were measured in a sample of 60 older people with dementia. The questionnaire response rate was 83% (102/122). Most respondents felt no important items were missing. Seven of the nine activities were ranked as 'very important' or 'essential' by at least 77% of the sample, indicating very good content validity. Correlation with measures of cognition, severity of dementia and activity performance demonstrated strong concurrent validity. Inter-item correlation indicated strong construct validity. Cronbach's alpha coefficient measured internal consistency as excellent (0.95). All items achieved acceptable test-retest reliability, and the majority demonstrated acceptable inter-rater reliability. We conclude that the PAL Checklist demonstrates adequate validity and reliability when used with older people with dementia and appears a useful tool for a variety of care settings.

Development and Validation of a Measure of Attitudes toward Fluffy Women

PubMed Central

Barned, C; Lipps, GE

2014-01-01

ABSTRACT Background: There is an absence of research on the newly evolved term “fluffy” which describes body image and personality features among women. Research on “fluffiness” among Caribbean peoples has been limited by the lack of valid and reliable measures of the concept. Objective: This project addresses this problem by exploring the internal consistency reliability and the concurrent and discriminant validity of the Attitudes toward Fluffy Women Scale (ATFW) using a mixture of past and present students from The University of the West Indies (UWI), Mona, and the University of Technology (UTech), Kingston. Method: Past or present students from The UWI, Mona, and UTech, Kingston, were recruited for the study through the use of convenience sampling. A total of 80 students (38 males, 47.5%; 42 females, 52.5%) participated in the study. Results: Overall, the ATFW was found to have an acceptable degree of internal consistency reliability (α = 0.90). The scale also had reasonably good concurrent validity as evidenced by moderate correlations with scores on the Attitudes Toward Obese Persons Scale (r = −0.42) and acceptable discriminant validity as demonstrated through low correlations with a Bogardus Social Distance Scale designed to assess prejudice toward people living with the human immunodeficiency virus [HIV] (r = 0.29). This pattern of scores suggests that the majority of the stable variance underlying the ATFW assesses the “fluffy” concept (17.6%) while a smaller degree of the variability (8%) measures a conceptually similar but distinct concept. Conclusion: The Attitudes toward Fluffy Women scale was found to be a reliable and valid scale for assessing the attitudes of young adults toward fluffy women. PMID:25803379

Is self-reporting workplace activity worthwhile? Validity and reliability of occupational sitting and physical activity questionnaire in desk-based workers.

PubMed

Pedersen, Scott J; Kitic, Cecilia M; Bird, Marie-Louise; Mainsbridge, Casey P; Cooley, P Dean

2016-08-19

With the advent of workplace health and wellbeing programs designed to address prolonged occupational sitting, tools to measure behaviour change within this environment should derive from empirical evidence. In this study we measured aspects of validity and reliability for the Occupational Sitting and Physical Activity Questionnaire that asks employees to recount the percentage of work time they spend in the seated, standing, and walking postures during a typical workday. Three separate cohort samples (N = 236) were drawn from a population of government desk-based employees across several departmental agencies. These volunteers were part of a larger state-wide intervention study. Workplace sitting and physical activity behaviour was measured both subjectively against the International Physical Activity Questionnaire, and objectively against ActivPal accelerometers before the intervention began. Criterion validity and concurrent validity for each of the three posture categories were assessed using Spearman's rank correlation coefficients, and a bias comparison with 95 % limits of agreement. Test-retest reliability of the survey was reported with intraclass correlation coefficients. Criterion validity for this survey was strong for sitting and standing estimates, but weak for walking. Participants significantly overestimated the amount of walking they did at work. Concurrent validity was moderate for sitting and standing, but low for walking. Test-retest reliability of this survey proved to be questionable for our sample. Based on our findings we must caution occupational health and safety professionals about the use of employee self-report data to estimate workplace physical activity. While the survey produced accurate measurements for time spent sitting at work it was more difficult for employees to estimate their workplace physical activity.

The specification-based validation of reliable multicast protocol: Problem Report. M.S. Thesis

NASA Technical Reports Server (NTRS)

Wu, Yunqing

1995-01-01

Reliable Multicast Protocol (RMP) is a communication protocol that provides an atomic, totally ordered, reliable multicast service on top of unreliable IP multicasting. In this report, we develop formal models for RMP using existing automated verification systems, and perform validation on the formal RMP specifications. The validation analysis help identifies some minor specification and design problems. We also use the formal models of RMP to generate a test suite for conformance testing of the implementation. Throughout the process of RMP development, we follow an iterative, interactive approach that emphasizes concurrent and parallel progress of implementation and verification processes. Through this approach, we incorporate formal techniques into our development process, promote a common understanding for the protocol, increase the reliability of our software, and maintain high fidelity between the specifications of RMP and its implementation.

Reliability and validity of an adapted Arabic version of the Scoliosis Research Society-22r Questionnaire.

PubMed

Haidar, Rachid K; Kassak, Kassem; Masrouha, Karim; Ibrahim, Kamal; Mhaidli, Hani

2015-09-01

Cross-sectional validation and reliability assessment study of Arabic version of Scoliosis Research Society-22 (SRS-22r) Questionnaire. To develop and validate the Arabic version of the SRS-22r questionnaire. The diagnosis and treatment of adolescent idiopathic scoliosis may influence patient quality of life. SRS-22r is an internationally validated questionnaire used to assess function/activity, pain, self-image, and mental health of patients with scoliosis. It has been translated into several languages but not into Arabic language. Therefore, a valid health-related quality-of-life outcome questionnaire for patients with spinal deformity is still lacking in Arabic language. The English version of SRS-22r questionnaire was translated, back-translated, and culturally adapted to Arabic language. Then, 81 patients with idiopathic adolescent scoliosis were allocated randomly into either the reliability testing group (group 1) or the validity testing group (group 2). Group 1 patients completed Arabic version of SRS-22r questionnaire twice with 1-week interval in-between. Cronbach α and intraclass correlation coefficient were measured to determine internal consistency and temporal reliability. Group 2 patients completed the Arabic version of SRS-22r questionnaire and the previously validated Arabic version of 36-Item Short Form Health Survey (Short Form-36) questionnaire concurrently, and Pearson correlation coefficient was obtained to assess validity. Content analysis, internal consistency reliability, test/retest reproducibility (intraclass correlation coefficient range: 0.82-0.90), and test of concurrent validity showed satisfactory results. Function/activity and satisfaction with management domains had a lower Cronbach α (0.58 and 0.44, respectively, vs. 0.71-0.85 range for others). Self-image/appearance and satisfaction with management had a lower correlation with domains of the 36-Item Short Form Health Survey. An Arabic version of the SRS-22r questionnaire has been developed and validated. This questionnaire will aid health care workers and researchers in evaluation of patient perception of the deformity, satisfaction with treatment, and quality of life in Arabic-speaking populations. 3.

[Development of Autogenic Training Clinical Effectiveness Scale (ATCES)].

PubMed

Ikezuki, Makoto; Miyauchi, Yuko; Yamaguchi, Hajime; Koshikawa, Fusako

2002-02-01

The purpose of the present study was to develop a scale measuring clinical effectiveness of autogenic training. In Study 1, 167 undergraduates completed a survey of items concerning physical and mental states, which were thought to vary in the course of autogenic training. With item and factor analyses, 20 items were selected, and the resulting scale (ATCES) had high discrimination and clear factor structure. In Study 2, reliability and concurrent and clinical validity of the scale were examined with three groups of respondents: 85 mentally healthy, 31 control, 13 clinical persons. The scale showed a high test-retest correlation (r = .83) and alpha coefficient (alpha = .86). ATCES had a Pearson correlation coefficient of r = .56 with General Health Questionnaire (GHQ-12), and r = .73 with trait anxiety (STAI-T). And ATCES successfully discriminated the mentally healthy and clinical groups in terms of clinical effectiveness. These results demonstrated high reliability and sufficient concurrent and clinical validity of the new scale.

Student-Centered Reliability, Concurrent Validity and Instructional Sensitivity in Scoring of Students' Concept Maps in a University Science Laboratory

ERIC Educational Resources Information Center

Kaya, Osman Nafiz; Kilic, Ziya

2004-01-01

Student-centered approach of scoring the concept maps consisted of three elements namely symbol system, individual portfolio and scoring scheme. We scored student-constructed concept maps based on 5 concept map criteria: validity of concepts, adequacy of propositions, significance of cross-links, relevancy of examples, and interconnectedness. With…

Measuring the suffering of end-stage dementia: reliability and validity of the Mini-Suffering State Examination.

PubMed

Aminoff, Bechor Z; Purits, Elena; Noy, Shlomo; Adunsky, Abraham

2004-01-01

Assessment of suffering is extremely important in dying end-stage dementia patients (ESDP). We have developed and examined the reliability and validity of the Mini-Suffering State Examination (MSSE), in 103 consecutive bedridden ESDP. Main outcome measures included inter-observer reliability and concurrent validity. Reliability of the MSSE questionnaire was satisfactory, with Cronbach alpha values of 0.735 and 0.718 for the two physicians (Ph-1, Ph-2), respectively. The kappa agreement coefficient was 0.791. There was a high agreement for seven items (kappa 0.882-0.972) and a substantial agreement for the other three items (kappa 0.621-0.682) of the MSSE. MSSE was validated versus the comfort assessment in dying with dementia (CAD-EOLD) scale and resulted in a significant Pearson correlation (r=-0.796, P<0.001). We conclude that the MSSE scale is a reliable and valid clinical tool, recommended for evaluating the severity of the patient's condition and the level of suffering of ESDP. Use of MSSE may improve medical management and facilitate communication between patients and caregivers.

Alberta infant motor scale: reliability and validity when used on preterm infants in Taiwan.

PubMed

Jeng, S F; Yau, K I; Chen, L C; Hsiao, S F

2000-02-01

The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97-.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and.90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.

Health-related quality of life in young adults in education, employment, or training: development of the Japanese version of Pediatric Quality of Life Inventory (PedsQL) Generic Core Scales Young Adult Version.

PubMed

Kaneko, Mei; Sato, Iori; Soejima, Takafumi; Kamibeppu, Kiyoko

2014-09-01

The purpose of the study is to develop a Japanese version of the Pediatric Quality of Life Inventory (PedsQL) Generic Core Scales Young Adult Version (PedsQL-YA-J) and determine the feasibility, reliability, and validity of the scales. Translation equivalence and content validity were verified using back-translation and cognitive debriefing tests. A total of 428 young adults recruited from one university, two vocational schools, or five companies completed questionnaires. We determined questionnaire feasibility, internal consistency, and test-retest reliability; checked concurrent validity against the Center for Epidemiologic Studies Depression Scale (CES-D); determined convergent and discriminant validity with the Medical Outcome Study 36-item Short Form Health Survey (SF-36); described known-groups validity with regard to subjective symptoms, illness or injury requiring regular medical visits, and depression; and verified factorial validity. All scales were internally consistent (Cronbach's coefficient alpha = 0.77-0.86); test-retest reliability was acceptable (intraclass correlation coefficient = 0.57-0.69); and all scales were concurrently valid with depression (Pearson's correlation coefficient = 0.43-0.57). The scales convergent and discriminant validity with the SF-36 and CES-D were acceptable. Evaluation of known-groups validity confirmed that the Physical Functioning scale was sensitive for subjective symptoms, the Emotional Functioning scale for depression, and the Work/School Functioning scale for illness or injury requiring regular medical visits. Exploratory factor analysis found a six-factor structure consistent with the assumed structure (cumulative proportion = 57.0%). The PedsQL-YA-J is suitable for assessing health-related quality of life in young adults in education, employment, or training, and for clinical trials and epidemiological research.

Reliability and validity of the Japanese version of the Resilience Scale and its short version.

PubMed

Nishi, Daisuke; Uehara, Ritei; Kondo, Maki; Matsuoka, Yutaka

2010-11-17

The clinical relevance of resilience has received considerable attention in recent years. The aim of this study is to demonstrate the reliability and validity of the Japanese version of the Resilience Scale (RS) and short version of the RS (RS-14). The original English version of RS was translated to Japanese and the Japanese version was confirmed by back-translation. Participants were 430 nursing and university psychology students. The RS, Center for Epidemiologic Studies Depression Scale (CES-D), Rosenberg Self-Esteem Scale (RSES), Social Support Questionnaire (SSQ), Perceived Stress Scale (PSS), and Sheehan Disability Scale (SDS) were administered. Internal consistency, convergent validity and factor loadings were assessed at initial assessment. Test-retest reliability was assessed using data collected from 107 students at 3 months after baseline. Mean score on the RS was 111.19. Cronbach's alpha coefficients for the RS and RS-14 were 0.90 and 0.88, respectively. The test-retest correlation coefficients for the RS and RS-14 were 0.83 and 0.84, respectively. Both the RS and RS-14 were negatively correlated with the CES-D and SDS, and positively correlated with the RSES, SSQ and PSS (all p < 0.05), although the correlation between the RS and CES-D was somewhat lower than that in previous studies. Factor analyses indicated a one-factor solution for RS-14, but as for RS, the result was not consistent with previous studies. This study demonstrates that the Japanese version of RS has psychometric properties with high degrees of internal consistency, high test-retest reliability, and relatively low concurrent validity. RS-14 was equivalent to the RS in internal consistency, test-retest reliability, and concurrent validity. Low scores on the RS, a positive correlation between the RS and perceived stress, and a relatively low correlation between the RS and depressive symptoms in this study suggest that validity of the Japanese version of the RS might be relatively low compared with the original English version.

An evidence-based decision assistance model for predicting training outcome in juvenile guide dogs

PubMed Central

Craigon, Peter J.; Blythe, Simon A.; England, Gary C. W.; Asher, Lucy

2017-01-01

Working dog organisations, such as Guide Dogs, need to regularly assess the behaviour of the dogs they train. In this study we developed a questionnaire-style behaviour assessment completed by training supervisors of juvenile guide dogs aged 5, 8 and 12 months old (n = 1,401), and evaluated aspects of its reliability and validity. Specifically, internal reliability, temporal consistency, construct validity, predictive criterion validity (comparing against later training outcome) and concurrent criterion validity (comparing against a standardised behaviour test) were evaluated. Thirty-nine questions were sourced either from previously published literature or created to meet requirements identified via Guide Dogs staff surveys and staff feedback. Internal reliability analyses revealed seven reliable and interpretable trait scales named according to the questions within them as: Adaptability; Body Sensitivity; Distractibility; Excitability; General Anxiety; Trainability and Stair Anxiety. Intra-individual temporal consistency of the scale scores between 5–8, 8–12 and 5–12 months was high. All scales excepting Body Sensitivity showed some degree of concurrent criterion validity. Predictive criterion validity was supported for all seven scales, since associations were found with training outcome, at at-least one age. Thresholds of z-scores on the scales were identified that were able to distinguish later training outcome by identifying 8.4% of all dogs withdrawn for behaviour and 8.5% of all qualified dogs, with 84% and 85% specificity. The questionnaire assessment was reliable and could detect traits that are consistent within individuals over time, despite juvenile dogs undergoing development during the study period. By applying thresholds to scores produced from the questionnaire this assessment could prove to be a highly valuable decision-making tool for Guide Dogs. This is the first questionnaire-style assessment of juvenile dogs that has shown value in predicting the training outcome of individual working dogs. PMID:28614347

An initial investigation into the validity of a computer-based auditory processing assessment (Feather Squadron).

PubMed

Barker, Matthew D; Purdy, Suzanne C

2016-01-01

This research investigates a novel method for identifying and measuring school-aged children with poor auditory processing through a tablet computer. Feasibility and test-retest reliability are investigated by examining the percentage of Group 1 participants able to complete the tasks and developmental effects on performance. Concurrent validity was investigated against traditional tests of auditory processing using Group 2. There were 847 students aged 5 to 13 years in group 1, and 46 aged 5 to 14 years in group 2. Some tasks could not be completed by the youngest participants. Significant correlations were found between results of most auditory processing areas assessed by the Feather Squadron test and traditional auditory processing tests. Test-retest comparisons indicated good reliability for most of the Feather Squadron assessments and some of the traditional tests. The results indicate the Feather Squadron assessment is a time-efficient, feasible, concurrently valid, and reliable approach for measuring auditory processing in school-aged children. Clinically, this may be a useful option for audiologists when performing auditory processing assessments as it is a relatively fast, engaging, and easy way to assess auditory processing abilities. Research is needed to investigate further the construct validity of this new assessment by examining the association between performance on Feather Squadron and objective evoked potential, lesion studies, and/or functional imaging measures of auditory function.

Reliability and concurrent validity of the computer workstation checklist.

PubMed

Baker, Nancy A; Livengood, Heather; Jacobs, Karen

2013-01-01

Self-report checklists are used to assess computer workstation set up, typically by workers not trained in ergonomic assessment or checklist interpretation.Though many checklists exist, few have been evaluated for reliability and validity. This study examined reliability and validity of the Computer Workstation Checklist (CWC) to identify mismatches between workers' self-reported workstation problems. The CWC was completed at baseline and at 1 month to establish reliability. Validity was determined with CWC baseline data compared to an onsite workstation evaluation conducted by an expert in computer workstation assessment. Reliability ranged from fair to near perfect (prevalence-adjusted bias-adjusted kappa, 0.38-0.93); items with the strongest agreement were related to the input device, monitor, computer table, and document holder. The CWC had greater specificity (11 of 16 items) than sensitivity (3 of 16 items). The positive predictive value was greater than the negative predictive value for all questions. The CWC has strong reliability. Sensitivity and specificity suggested workers often indicated no problems with workstation setup when problems existed. The evidence suggests that while the CWC may not be valid when used alone, it may be a suitable adjunct to an ergonomic assessment completed by professionals.

Physician Enabling Skills Questionnaire

PubMed Central

Hudon, Catherine; Lambert, Mireille; Almirall, José

2015-01-01

Abstract Objective To evaluate the reliability and validity of the newly developed Physician Enabling Skills Questionnaire (PESQ) by assessing its internal consistency, test-retest reliability, concurrent validity with patient-centred care, and predictive validity with patient activation and patient enablement. Design Validation study. Setting Saguenay, Que. Participants One hundred patients with at least 1 chronic disease who presented in a waiting room of a regional health centre family medicine unit. Main outcome measures Family physicians’ enabling skills, measured with the PESQ at 2 points in time (ie, while in the waiting room at the family medicine unit and 2 weeks later through a mail survey); patient-centred care, assessed with the Patient Perception of Patient-Centredness instrument; patient activation, assessed with the Patient Activation Measure; and patient enablement, assessed with the Patient Enablement Instrument. Results The internal consistency of the 6 subscales of the PESQ was adequate (Cronbach α = .69 to .92). The test-retest reliability was very good (r = 0.90; 95% CI 0.84 to 0.93). Concurrent validity with the Patient Perception of Patient-Centredness instrument was good (r = −0.67; 95% CI −0.78 to −0.53; P < .001). The PESQ accounts for 11% of the total variance with the Patient Activation Measure (r2 = 0.11; P = .002) and 19% of the variance with the Patient Enablement Instrument (r2 = 0.19; P < .001). Conclusion The newly developed PESQ presents good psychometric properties, allowing for its use in practice and research. PMID:26889507

The reliability and validity of the English version of the Evaluation of Daily Activity Questionnaire for people with rheumatoid arthritis

PubMed Central

Tennant, Alan; Tyson, Sarah F.; Nordenskiöld, Ulla; Hawkins, Ruth; Prior, Yeliz

2015-01-01

Objectives. The Evaluation of Daily Activity Questionnaire (EDAQ) includes 138 items in 14 domains identified as important by people with RA. The aim of this study was to test the validity and reliability of the English EDAQ. Methods. A total of 502 participants completed two questionnaires 3 weeks apart. The first consisted of the EDAQ, HAQ, RA Quality of Life (RAQoL) and the Medical Outcomes Scale (MOS) 36-item Short-Form Health Survey (SF-36v2), and the second consisted of the EDAQ only. The 14 EDAQ domains were tested for: unidimensionality—using confirmatory factor analysis; fit, response dependency, invariance across groups (differential item functioning)—using Rasch analysis; internal consistency [Person Separation Index (PSI)]; concurrent validity—by correlations with the HAQ, SF-36v2 and RAQoL; and test–retest reliability (Spearman’s correlations). Results. Confirmatory factor analysis of the 14 EDAQ domains indicated unidimensionality, after adjustment for local dependency in each domain. All domains achieved a root mean square error of approximation <0.10 and satisfied Rasch model expectations for local dependency. DIF by age, gender and employment status was largely absent. The PSI was consistent with individual use (PSI = 0.94 for all 14 domains). For all domains, except Caring, concurrent validity was good: HAQ (rs = 0.72–0.91), RAQoL (rs = 0.67–0.82) and SF36v2 Physical Function scale (rs = −0.60 to −0.84) and test–retest reliability was good (rs = 0.70–0.89). Conclusion. Analysis supported a 14-domain, two-component structure (Self care and Mobility) of the EDAQ, where each domain, and both components, satisfied Rasch model requirements, and have robust reliability and validity. PMID:25863045

Exploratory Factor Analysis of NRG Oncology's University of Washington Quality of Life Questionnaire – RTOG Modification

PubMed Central

Pugh, Stephanie L.; Wyatt, Gwen; Wong, Raimond K. W.; Sagar, Stephen M.; Yueh, Bevan; Singh, Anurag K.; Yao, Min; Nguyen-Tan, Phuc Felix; Yom, Sue S.; Cardinale, Francis S.; Sultanem, Khalil; Hodson, D. Ian; Krempl, Greg A.; Chavez, Ariel; Yeh, Alexander M.; Bruner, Deborah W.

2016-01-01

Context The 15-item University of Washington Quality of Life questionnaire – Radiation Therapy Oncology Group (RTOG) modification (UW-QOL-RTOG modification) has been used in several trials of head and neck cancer conducted by NRG Oncology such as RTOG 9709, RTOG 9901, RTOG 0244, and RTOG 0537. Objectives This study is an exploratory factor analysis (EFA) to establish validity and reliability of the instrument subscales. Methods EFA on the UW-QOL - RTOG modification was conducted using baseline data from NRG Oncology's RTOG 0537, a trial of acupuncture-like transcutaneous electrical nerve stimulation in treating radiation-induced xerostomia. Cronbach's α coefficient was calculated to measure reliability; correlation with the University of Michigan Xerostomia Related Quality of Life Scale (XeQOLS) was used to evaluate concurrent validity; and correlations between consecutive time points were used to assess test-retest reliability. Results The 15-item EFA of the modified tool resulted in 11 items split into 4 factors: mucus, eating, pain, and activities. Cronbach's α ranged from 0.71 to 0.93 for the factors and total score, consisting of all 11 items. There were strong correlations (ρ≥0.60) between consecutive time points and between total score and the XeQOLS total score (ρ>0.65). Conclusion The UW-QOL-RTOG modification is a valid tool that can be used to assess symptom burden of head and neck cancer patients receiving radiation therapy or those who have recently completed radiation. The modified tool has acceptable reliability, concurrent validity, and test-retest reliability in this patient population, as well as the advantage of having being shortened from 15 to 11 items. PMID:27899312

Validity and intra-rater reliability of MyJump app on iPhone 6s in jump performance.

PubMed

Stanton, Robert; Wintour, Sally-Anne; Kean, Crystal O

2017-05-01

Smartphone applications are increasingly used by researchers, coaches, athletes and clinicians. The aim of this study was to examine the concurrent validity and intra-rater reliability of the smartphone-based application, MyJump, against laboratory-based force plate measurements. Cross sectional study. Participants completed counter-movement jumps (CMJ) (n=29) and 30cm drop jumps (DJ) (n=27) on a force plate which were simultaneously recorded using MyJump. To assess concurrent validity, jump height, derived from flight time acquired from each device, was compared for each jump type. Intra-rater reliability was determined by replicating data analysis of MyJump recordings on two occasions separated by seven days. CMJ and DJ heights derived from MyJump showed excellent agreement with the force plate (ICC values range from 0.991 for CMJ to 0.993) However mean DJ height from the force plate was significantly higher than MyJump (mean difference: 0.87cm, 95% CI: 0.69-1.04cm). Intra-rater reliability of MyJump for both CMJ and DJ was almost perfect (ICC values range from 0.997 for CMJ to 0.998 for DJ); however, mean CMJ and DJ jump height for Day 1 was significantly higher than Day 2 (CMJ: 0.43cm, 95% CI: 0.23-0.62cm); (DJ: 0.38cm, 95% CI: 0.23-0.53cm). The present study finds MyJump to be a valid and highly reliable tool for researchers, coaches, athletes and clinicians; however, systematic bias should be considered when comparing MyJump outputs to other testing devices. Copyright © 2016 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Psychometric validation of the PROQOL-HIV questionnaire, a new health-related quality of life instrument-specific to HIV disease.

PubMed

Duracinsky, Martin; Lalanne, Christophe; Le Coeur, Sophie; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew Richard; Lau, Joseph Tak Fai; Fournier, Isabelle; Chassany, Olivier

2012-04-15

This study reports the psychometric validation of a new HIV/AIDS-specific health-related quality of life (HRQL) questionnaire, the Patient Reported Outcomes Quality of Life-HIV. The instrument was developed simultaneously across Europe, North and South America, Africa, Asia, and Australia to assess multidimensional quality of life impairments in the era of highly active antiretroviral therapy. A cross-sectional study was performed in 8 countries. The pilot 70-item questionnaire was co-administered with the HIV symptoms index, the EQ-5D and Medical Outcomes Study-HIV questionnaires. Demographic and biomedical data were collected. After item analysis and reduction, convergent discriminant concurrent validity and known-group validity were examined. Internal consistency and reliability scores were assessed using Cronbach alpha and intraclass correlation. The final sample of 791 patients was composed of 64% males (median age: 41 years, HIV diagnosis = 5 years), 13.8% were treatment naive. Item reduction yielded a 43-item form surveying 8 dimensions and 1 global health item that showed good convergent and discriminant validity and reliability (98% scaling success; Cronbach alphas 0.77-0.89). Correlations with EQ-5D and Medical Outcomes Study-HIV complied with concurrent validity expectations; likewise, correlations against the number of self-reported symptoms and depression showed good support for criterion validity. A test-retest study on French patients (n = 34) showed temporal stability (intraclass correlation coefficient = 0.86). Significant and meaningful differences of HRQL scores between countries were found. The Patient Reported Outcomes Quality of Life-HIV questionnaire is a valid and reliable instrument for assessing HRQL specific to HIV disease in different cultures and healthcare systems.

Reliability and validity of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in evaluations of chronic low back pain patients.

PubMed

Tarescavage, Anthony M; Scheman, Judith; Ben-Porath, Yossef S

2015-06-01

The purpose of the current study was to investigate the reliability and concurrent validity of Minnesota Multiphasic Personality Inventory (MMPI)-2-Restructured Form (2-RF) (Ben-Porath & Tellegen, 2008/2011) scores in a sample of 811 chronic low back pain patients (346 males, 529 females) beginning treatment in a short-term interdisciplinary pain rehabilitation program. We calculated internal consistency coefficients, mean-item correlations, and SEM for all substantive scales, as well as zero-order correlations with collateral medical record information and self-report testing. Results indicated reliability and validity for most of the MMPI-2-RF substantive scales. Implications of these findings and limitations of this study are discussed. (c) 2015 APA, all rights reserved).

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale

PubMed Central

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-01-01

Introduction Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. Objective To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. Method The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. Results The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Conclusion Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results. PMID:29736104

Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale.

PubMed

Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe

2018-04-01

Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results.

Validity and reliability of Nintendo Wii Fit balance scores.

PubMed

Wikstrom, Erik A

2012-01-01

Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Descriptive laboratory study. Sports medicine research laboratory. Forty-five recreationally active participants (age = 27.0 ± 9.8 years, height = 170.9 ± 9.2 cm, mass = 72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Participants completed a single-limb-stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC] = 0.80) to poor (ICC = 0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated poor intersession reliability, with scores ranging from fair (ICC = 0.74) to poor (ICC = 0.29). Wii Fit balance activity scores had poor concurrent validity relative to COP outcomes and SEBT reach distances. In addition, the included Wii Fit balance activity scores generally had poor intrasession and intersession reliability.

Technical Adequacy of the easyCBM Primary-Level Mathematics Measures (Grades K-2), 2009-2010 Version. Technical Report #1006

ERIC Educational Resources Information Center

Anderson, Daniel; Lai, Cheng-Fei; Nese, Joseph F. T.; Park, Bitnara Jasmine; Saez, Leilani; Jamgochian, Elisa; Alonzo, Julie; Tindal, Gerald

2010-01-01

In the following technical report, we present evidence of the technical adequacy of the easyCBM[R] math measures in grades K-2. In addition to reliability information, we present criterion-related validity evidence, both concurrent and predictive, and construct validity evidence. The results represent data gathered throughout the 2009/2010 school…

Measuring Risk Perception in Later Life: The Perceived Risk Scale.

PubMed

Lifshitz, Rinat; Nimrod, Galit; Bachner, Yaacov G

2016-11-01

Risk perception is a subjective assessment of the actual or potential threat to one's life or, more broadly, to one's psychological well-being. Given the various risks associated with later life, a valid and reliable integrative screening tool for assessing risk perception among the elderly is warranted. The study examined the psychometric properties and factor structure of a new integrative risk perception instrument, the Perceived Risk Scale. This eight-item measure refers to various risks simultaneously, including terror, health issues, traffic accidents, violence, and financial loss, and was developed specifically for older adults. An online survey was conducted with 306 participants aged 50 years and older. The scale was examined using exploratory factor analysis and concurrent validity testing. Factor analysis revealed a two-factor structure: later-life risks and terror risks A high percentage of explained variance, as well as internal consistency, was found for the entire scale and for both factors. Concurrent validity was supported by significant positive associations with participants' depression and negative correlations with their life satisfaction. These findings suggest that the Perceived Risk Scale is internally reliable, valid, and appropriate for evaluating risk perception in later life. The scale's potential applications are discussed. © The Author(s) 2016.

Development of the Japanese Version of the Psychosocial Assessment of Candidates for Transplantation in Allogeneic Hematopoietic Stem Cell Transplantation.

PubMed

Harashima, Saki; Yoneda, Ryo; Horie, Takeshi; Kayano, Mami; Fujioka, Yosei; Nakamura, Fumihiko; Kurokawa, Mineo; Yoshiuchi, Kazuhiro

The Psychosocial Assessment of Candidates for Transplantation (PACT) is a validated instrument for evaluating psychosocial risk factors in transplant candidates. This study examined reliability and validity of the Japanese version of the PACT (J-PACT). PACT is a clinician-rated scale consisting of an initial rating, 8 subscales, and a final rating. J-PACT was developed through a translation and back-translation procedure. Seventy adult patients who underwent allogeneic hematopoietic stem cell transplant between April 2009 and December 2013 received retrospective J-PACT ratings based on medical records. Interrater reliability and concurrent validity with Hospital Anxiety and Depression Scale (HADS) and Profile of Mood Status (POMS) scores were assessed. Interrater reliability for each J-PACT item was generally high, ranging from 0.53 (drug and alcohol use)-0.93 (support stability). The concurrent validity analyses revealed the following significant relationships (p < 0.05). Higher support stability was associated with lower HADS depression (p = 0.02), POMS anger (p = 0.001), POMS fatigue (p = 0.03), and POMS confusion (p = 0.01) scores. Higher support availability was associated with lower POMS anger scores (p = 0.01). More suitable personality was associated with lower HADS anxiety (p = 0.04) and HADS depression (p = 0.048) scores. Better scores on lifestyle factors and alcohol use were both associated with lower POMS confusion scores (p = 0.01, 0.04, respectively). Better final rating was associated with lower HADS anxiety (p = 0.03) and HADS depression (p = 0.02) scores. J-PACT was reliable and valid, although further study is needed to confirm these findings. Copyright © 2017 The Academy of Psychosomatic Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric properties of the defense style questionnaire (DSQ-40) in adolescents.

PubMed

Ruuttu, Titta; Pelkonen, Mirjami; Holi, Matti; Karlsson, Linnea; Kiviruusu, Olli; Heilä, Hannele; Tuisku, Virpi; Tuulio-Henriksson, Annamari; Marttunen, Mauri

2006-02-01

This study examined the psychometric properties of the Defense Style Questionnaire (DSQ-40) in adolescents. Internal consistency, factor structure, and discriminant and concurrent validity of the DSQ-40 were studied in 211 adolescent psychiatric outpatients aged 13 to 19 years and 199 age-matched and sex-matched controls. Principal components analysis yielded four internally consistent components: mature, neurotic, image-distorting, and immature defense styles. The outpatients reported more immature, image-distorting, and neurotic styles and less mature style than did the controls, suggesting adequate discriminant validity. As a demonstration of convergent and concurrent validity, the severity of psychiatric symptoms assessed by the General Health Questionnaire and psychosocial adjustment assessed by the Global Assessment of Functioning Scale correlated theoretically meaningfully with the different defense styles. The DSQ-40 appears to be a reliable and valid instrument for adolescents.

How reliable and valid is the teacher version of the Strengths and Difficulties Questionnaire in primary school children?

PubMed Central

van den Heuvel, Meta; Jansen, Danielle E. M. C.; Stewart, Roy E.; Smits-Engelsman, Bouwien C. M.; Reijneveld, Sijmen A.; Flapper, Boudien C. T.

2017-01-01

Introduction The Strengths and Difficulties Questionnaire (SDQ) is validated for parents, but not yet for teachers in a broad age range of children. We conducted a cross-sectional study with 4–10 years old school children to investigate if the SDQ-T can be used instead of the validated but lengthy Teacher’s Report Form (TRF) to acquire information about emotional and behavioral problems in the school community. Methods Teachers of 453 children from primary schools were approached. Teachers of 394 children (response rate 86.9%) with a mean age of 7.1 years filled in the SDQ-T (n = 387), the TRF (n = 349) or both (n = 342). We assessed reliability by calculating internal consistency and concurrent validity (using correlation coefficients, sensitivity, specificity) of the SDQ-T compared with the TRF. Results Internal consistency of the SDQ-T Total Difficulties Score (SDQ-T TDS; Cronbach α = 0.80), hyperactivity/ inattention- (α = 0.86) and prosocial behavior (α = 0.81) was very good. Concurrent validity demonstrated a strong correlation of all subscales of the SDQ-T with the corresponding scale on the TRF (range 0.54–0.73), except for peer problems (0.46). Using a SDQ-T TDS cut-off score > 14, the SDQ-T had a good sensitivity (90%) and specificity (94%). Discussion The good reliability, validity and brevity of the SDQ-T make it an easily applicable questionnaire for obtaining information about emotional and behavioral problems from teachers in primary school children. PMID:28453573

Brief report: Assessing dispositional optimism in adolescence--factor structure and concurrent validity of the Life Orientation Test--Revised.

PubMed

Monzani, Dario; Steca, Patrizia; Greco, Andrea

2014-02-01

Dispositional optimism is an individual difference promoting psychosocial adjustment and well-being during adolescence. Dispositional optimism was originally defined as a one-dimensional construct; however, empirical evidence suggests two correlated factors in the Life Orientation Test - Revised (LOT-R). The main aim of the study was to evaluate the dimensionality of the LOT-R. This study is the first attempt to identify the best factor structure, comparing congeneric, two correlated-factor, and two orthogonal-factor models in a sample of adolescents. Concurrent validity was also assessed. The results demonstrated the superior fit of the two orthogonal-factor model thus reconciling the one-dimensional definition of dispositional optimism with the bi-dimensionality of the LOT-R. Moreover, the results of correlational analyses proved the concurrent validity of this self-report measure: optimism is moderately related to indices of psychosocial adjustment and well-being. Thus, the LOT-R is a useful, valid, and reliable self-report measure to properly assess optimism in adolescence. Copyright © 2013 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

[Validity of the Spanish version of the Hypersensitive Narcissism Scale (HSNS) in subjects attended at an Addiction Treatment Unit].

PubMed

Ripoll, Carmen; Salazar, José; Bobes, Julio

2010-01-01

Narcissistic personality is an important component of personality disorders which are prevalent in those presenting drug abuse or dependence. Assessment instruments usually consider self-esteem, narcissism and covert narcissism, but although Spanish versions of instruments for self-esteem and narcissism are available, there is no available test for covert narcissism. OBJECTIVE. To test the validity of the Spanish version of the Hypersensitive Narcissism Scale (HSNS) in individuals presenting drug abuse or dependence. In a sample of 79 outpatients, we assessed reliability by means of Cronbach's alpha and the intraclass correlation coefficient (ICC), construct validity through factor analysis, and concurrent validity by means of the correlation between the HSNS and measures of severity, disability, self-esteem, grandiose narcissism and personality disorders. Reliability of the HSNS total scale score was satisfactory (Cronbach's alpha = 0,73, ICC = 0,67), though some items would require further consideration. Factor analysis showed good construct validity with three factors compatible with the theory of covert narcissism. With regard to concurrent validity, covert narcissism (HSNS) correlated positively with open narcissism, severity and disability due to drug use, and negatively with self-esteem. Highest scores on the HSNS corresponded to borderline, narcissistic and passive-aggressive personality disorders. The Spanish version of the HSNS could be a valid instrument for the assessment of covert narcissism in those treated for drug abuse or dependence.

Psychometric Validation of the Korean Version of the Camberwell Assessment of Need for the Elderly (CANE-K) in Dementia.

PubMed

Park, Myonghwa; Kyung Kim, Sun; Jeong, Miri; Lee, Song Ja; Kim, Seon Hwa; Kim, Jinha; Lee, Dong Young

2018-04-10

The prevalence of dementia has increased rapidly with an aging Korean population. Compared to those without dementia, individuals with dementia have more and complex needs. In this study, the Korean version of the Camberwell Assessment of Need for the Elderly (CANE-K) was evaluated to determine its suitability for individuals with dementia in Korea. The CANE-K was developed following linguistic validation. The reliability of the measurement was examined with Cronbach's alpha coefficient. The factor structure and construct validity were evaluated by performing exploratory factor analysis (EFA) and confirmatory factor analyses (CFA). Pearson's correlation coefficients with related measures were used to ensure concurrent validity. Four factors extracted with EFA and CFA validated the model structure (X 2 = 367.25, p = .000, goodness of fit index = .84, adjusted goodness of fit index = .80, root mean square error of approximation = .07, and comparative fit index = .83). Items on the CANE-K loaded on the four factors in a range between .40 and .80. The output of Pearson's correlation coefficient with cognitive impairment, behavioral problems, activities of daily living and caregiver burden showed acceptable concurrent validity. The CANE-K showed a reasonable degree of reliability and validity. Therefore, it has good potential to appropriately measure the needs and unmet needs of those with dementia. Copyright © 2018. Published by Elsevier B.V.

Assessing the writing of deaf college students: reevaluating a direct assessment of writing.

PubMed

Schley, Sara; Albertini, John

2005-01-01

The NTID Writing Test was developed to assess the writing ability of postsecondary deaf students entering the National Technical Institute for the Deaf and to determine their appropriate placement into developmental writing courses. While previous research (Albertini et al., 1986; Albertini et al., 1996; Bochner, Albertini, Samar, & Metz, 1992) has shown the test to be reliable between multiple test raters and as a valid measure of writing ability for placement into these courses, changes in curriculum and the rater pool necessitated a new look at interrater reliability and concurrent validity. We evaluated the rating scores for 236 samples from students who entered the college during the fall 2001. Using a multiprong approach, we confirmed the interrater reliability and the validity of this direct measure of assessment. The implications of continued use of this and similar tests in light of definitions of validity, local control, and the nature of writing are discussed.

Developing and testing the CHORDS: Characteristics of Responsible Drinking Survey.

PubMed

Barry, Adam E; Goodson, Patricia

2011-01-01

Report on the development and psychometric testing of a theoretically and evidence-grounded instrument, the Characteristics of Responsible Drinking Survey (CHORDS). Instrument subjected to four phases of pretesting (cognitive validity, cognitive and motivational qualities, pilot test, and item evaluation) and a final posttest implementation. Large public university in Texas. Randomly selected convenience sample (n  =  729) of currently enrolled students. This 78-item questionnaire measures individuals' responsible drinking beliefs, motivations, intentions, and behaviors. Cronbach α, split-half reliability, principal components analysis and Spearman ρ were conducted to investigate reliability, stability, and validity. Measures in the CHORDS exhibited high internal consistency reliability and strong correlations of split-half reliability. Factor analyses indicated five distinct scales were present, as proposed in the theoretical model. Subscale composite scores also exhibited a correlation to alcohol consumption behaviors, indicating concurrent validity. The CHORDS represents the first instrument specifically designed to assess responsible drinking beliefs and behaviors. It was found to elicit valid and reliable data among a college student sample. This instrument holds much promise for practitioners who desire to empirically investigate dimensions of responsible drinking.

The validity and reliability of diagnoses of work-related mental ill-health.

PubMed

O'Neill, E; McNamee, R; Agius, R; Gittins, M; Hussey, L; Turner, S

2008-11-01

To establish the reliability and validity of work-related mental ill-health diagnoses. A UK-based surveillance scheme for work-related ill-health involving occupational physicians (OPs) reporting suggests that mental ill-health incidence is increasing by around 13% per year, with anxiety, depression and "other work-related stress" being the most common diagnoses. There have been no studies of the validity and reliability of such diagnoses. Given the existence of a large network of psychiatrists (PSYs) also involved in surveillance of work-related ill-health, an opportunity arose to measure the concurrent validity and reliability of work-related mental ill-health diagnoses. 100 anonymised summaries of cases previously reported by OPs or PSYs were collected; each was sent to 5 PSYs and 5 OPs, who assigned a diagnosis and judged whether the case was work-related. Concurrent validity of the ill-health aspect of the diagnoses, and of the opinion as to work-relatedness, was assessed by comparing the overall classifications of cases by OPs and PSYs. Reliability of the diagnostic classification was measured by kappa matrices. Diagnostic proportions for PSYs and OPs demonstrated good agreement for anxiety, depression, anxiety plus depression and "stress" (11%, 34%, 27%, 14%) and (14%, 30%, 27%, 17%), respectively. In both groups, kappa coefficients were high for a psychotic diagnosis (0.78, 95% CI: 0.74 to 0.83), but not as high for anxiety (0.27, 95% CI: 0.23 to 0.32), depression (0.34, 95% CI: 0.29 to 0.38) and "stress" (0.15, 95% CI: 0.10 to 0.19). The odds ratio of classifying a case as work-related among PSYs compared to OPs was 2.39 (95% CI: 1.68 to 3.38), p<0.001. The overall agreement between OPs and PSYs on mental ill-health diagnoses suggests that OP diagnoses are valid for epidemiological purposes. However, the within-group reliability of the diagnosis "stress" is low. Given differences in judgements about work-relatedness, further research is needed to investigate this aspect of a diagnosis.

Quantifying Calcium Intake in School Age Children: Development and Validation of the Calcium Counts!© Food Frequency Questionnaire

PubMed Central

ZEMEL, BABETTE S.; CAREY, LISA B.; PAULHAMUS, DONNA R.; STALLINGS, VIRGINIA A.; ITTENBACH, RICHARD F.

2014-01-01

Quantifying dietary behavior is difficult and can be intrusive. Calcium, an essential mineral for skeletal development during childhood, is difficult to assess. Few studies have examined the use of food frequency questionnaires (FFQs) for assessing calcium intake in school-age children. This study evaluated the validity and reliability of the Calcium Counts!© FFQ (CCFFQ) for estimating calcium intake in school children in the US. Healthy children, aged 7–10 years (n = 139) completed the CCFFQ and 7-day weighed food records. A subset of subjects completed a second CCFFQ within 3.6 months. Concurrent validity was determined using Pearson correlations between the CCFFQ and food record estimates of calcium intake, and the relationship between quintiles for the two measures. Predictive validity was determined using generalized linear regression models to explore the effects of age, race, and gender. Inter- and intra-individual variability in calcium intake was high (>300 mg/day). Calcium intake was ~300 mg/day higher by CCFFQ compared to food records. Concurrent validity was moderate (r = 0.61) for the entire cohort and higher for selected subgroups. Predictive validity estimates yielded significant relationships between CCFFQ and food record estimates of calcium intake alone and in the presence of such potential effect modifiers as age group, race, and gender. Test–retest reliability was high (r = 0.74). Although calcium intake estimated by the CCFFQ was greater than that measured by food records, the CCFFQ provides valid and reliable estimates of calcium intake in children. The CCFFQ is especially well-suited as a tool to identify children with low calcium intakes. PMID:19621431

The IMPACT-III (HR) questionnaire: a valid measure of health-related quality of life in Croatian children with inflammatory bowel disease.

PubMed

Abdovic, Slaven; Mocic Pavic, Ana; Milosevic, Milan; Persic, Mladen; Senecic-Cala, Irena; Kolacek, Sanja

2013-12-01

To assess the reliability and validity of IMPACT-III (HR), a disease-specific, health-related quality of life instrument in Croatian children with inflammatory bowel disease. In a multicenter study, 104 children participated in a validation study of IMPACT-III (HR) cross-culturally adapted for Croatia. Factor analysis was used to determine optimal domain structure for this cohort, analysis of Cronbach's alpha coefficients to test internal reliability, ANOVA to assess discriminant validity, and correlation with Pediatric Quality of Life Inventory, Version 4.0 (PedsQL) using Pearson correlation coefficients to assess concurrent validity. Cronbach's alpha for the IMPACT-III (HR) total score was 0.92. The most robust factor solution was a 5-domain structure: Symptoms, Concerns, Socializing, Body Image, and Worry about Stool, all of which demonstrated good internal reliability (α=0.60-0.89), but two items were dropped to achieve this. Discriminant validity was demonstrated by significant differences (P<0.001) in mean IMPACT-III (HR) scores between quiescent and mild or moderate-severe disease activity groups for total (148 vs. 139 or 125) and following factor scores: Symptoms (84 vs. 71 or 61), Socializing (91 vs. 83 or 76), and Worry about Stool (significant only between quiescent and moderate-severe groups, 90 vs. 62, respectively). Concurrent validity of IMPACT-III (HR) with PedsQL showed significant correlation, which was strongest when similar domains were compared. IMPACT-III (HR) appears to be useful tool to measure health-related quality of life in Croatian children with Crohn's disease and ulcerative colitis. Copyright © 2012 European Crohn's and Colitis Organisation. Published by Elsevier B.V. All rights reserved.

Adaptation and Validation of the Spanish Version of OSA-18, a Quality of Life Questionnaire for Evaluation of Children with Sleep Apnea-Hypopnea Syndrome.

PubMed

Chiner, Eusebi; Landete, Pedro; Sancho-Chust, José Norberto; Martínez-García, Miguel Ángel; Pérez-Ferrer, Patricia; Pastor, Esther; Senent, Cristina; Arlandis, Mar; Navarro, Cristina; Selma, María José

2016-11-01

To analyze the reliability and validity of the Spanish version of the OSA-18 quality of life questionnaire in children with apnea-hypopnea syndrome (SAHS). Children with suspected SAHS were studied with polysomnography (PSG) before and after adenotonsillectomy (AA). Age, gender, clinical data, PSG, anthropometric data, and Mallampati and Brodsky scales were analyzed. OSA-18 was administered at baseline and 3-6months post AA. After translation and backtranslation by bilingual professionals, the internal consistency, reliability, construct validity, concurrent validity, predictive validity and sensitivity to change of the questionnaire was assessed. In total, 45 boys and 15 girls were evaluated, showing BMI 18±4, neck 28±5, Brodsky (0: 7%; <25%: 12%; 25-50%: 27%; >50 to <75%: 45%; >75%: 6%), AHI 12±7 pre AA. Global Cronbach alpha was 0.91. Correlations between domains were significant except for emotional aspects, although the total scores correlated with all domains (0.50 to 0.90). The factorial analysis was virtually identical to the original structure. The total scores showed good correlation for concurrent validity (0.2-0.45). With regard to predictive validity, the questionnaire adequately differentiated levels of severity according to Mallampati (ANOVA P=.002) and apnea-hypopnea index (ANOVA P=.006). Test-retest reliability was excellent, as was sensitivity to change, both in the total scores (P<.001) and in each domain (P<.001). The Spanish adaptation of the OSA-18 and its psychometric characteristics suggest that the Spanish version is equivalent to the original and can be used in Spanish-speaking countries. Copyright © 2016 SEPAR. Publicado por Elsevier España, S.L.U. All rights reserved.

A Chinese Mandarin translation and validation of the Myocardial Infarction Dimensional Assessment Scale (MIDAS).

PubMed

Wang, W; Lopez, V; Thompson, D R

2006-09-01

To evaluate the validity, reliability, and cultural relevance of the Chinese Mandarin version of Myocardial Infarction Dimensional Assessment Scale (MIDAS) as a disease-specific quality of life measure. The cultural relevance and content validity of the Chinese Mandarin version of the MIDAS (CM-MIDAS) was evaluated by an expert panel. Measurement performance was tested on 180 randomly selected Chinese MI patents. Thirty participants from the primary group completed the CM-MIDAS for test-retest reliability after 2 weeks. Reliability, validity and discriminatory power of the CM-MIDAS were calculated. Two items were modified as suggested by the expert panel. The overall CM-MIDAS had acceptable internal consistency with Cronbach's alpha coefficient 0.93 for the scale and 0.71-0.94 for the seven domains. Test-retest reliability by intraclass correlations was 0.85 for the overall scale and 0.74-0.94 for the seven domains. There was acceptable concurrent validity with significant (p < 0.05) correlations between the CM-MDAS and the Chinese Version of the Short Form 36. The principal components analysis extracted seven factors that explained 67.18% of the variance with high factor loading indicating good construct validity. Empirical data support CM-MIDAS as a valid and reliable disease-specific quality of life measure for Chinese Mandarin speaking patients with myocardial infarction.

The reliability and concurrent validity of the Scoliosis Research Society-22r patient questionnaire compared with the Child Health Questionnaire-CF87 patient questionnaire for adolescent spinal deformity.

PubMed

Glattes, R Christopher; Burton, Douglas C; Lai, Sue Min; Frasier, Elizabeth; Asher, Marc A

2007-07-15

This is a clinic-based cross-sectional study involving 2 health-related quality-of-life (HRQL) questionnaires. To compare the score distribution and reliability of the spinal deformity specific Scoliosis Research Society-22r (SRS-22r) questionnaire and the established generic Child Health Questionnaire-CF87 (CHQ-CF87), and to assess the concurrent validity of the SRS-22r using the CHQ-CF87 in an adolescent spine deformity population. Different questionnaires are commonly thought to be necessary to assess the HRQL of adolescent and adult populations. But since spinal deformities usually begin in the second decade of life, longitudinal follow-up with the same HRQL is desirable. The SRS-22r HRQL has recently been validated for score distribution and internal consistency in a spinal deformity population ranging in age from 7 to 78 years. The SRS-22r and CHQ-CF87 HRQLs were completed by 70 orthopedic spinal deformity outpatients 8 to 18 years of age, of whom 54 returned mailed retest questionnaires at an average of 24 days later. The ceiling effect averaged 27% for the SRS-22r and 36% for the CHQ-CF87. Respective values for internal consistency (Cronbach alpha) were 0.81 and 0.82, and for test-retest reproducibility the intraclass correlations (ICC) were 0.73 and 0.61. Concurrent validity was r > or = 0.68 or more for relevant function, pain, and mental health domains. The SRS Self-Image and particularly the Satisfaction/Dissatisfaction with Management domains did not correlate well with any CHQ-CF87 domains (r = 0.50 and 0.30, respectively). In a spinal deformity population 8 to 18 years of age, the score distribution and reliability, internal consistency, and reproducibility of the SRS-22r were at least as good as the CHQ-CF87. The SRS-22r function, pain, and mental health domains were concurrently valid in comparison to relevant CHQ-CF87 domains, but the SRS-22r self-image and satisfaction/dissatisfaction domains were not, thereby providing health-related quality-of-life information not provided for by the CHQ-CF87.

Validity and reliability of an online visual-spatial working memory task for self-reliant administration in school-aged children.

PubMed

Van de Weijer-Bergsma, Eva; Kroesbergen, Evelyn H; Prast, Emilie J; Van Luit, Johannes E H

2015-09-01

Working memory is an important predictor of academic performance, and of math performance in particular. Most working memory tasks depend on one-to-one administration by a testing assistant, which makes the use of such tasks in large-scale studies time-consuming and costly. Therefore, an online, self-reliant visual-spatial working memory task (the Lion game) was developed for primary school children (6-12 years of age). In two studies, the validity and reliability of the Lion game were investigated. The results from Study 1 (n = 442) indicated satisfactory six-week test-retest reliability, excellent internal consistency, and good concurrent and predictive validity. The results from Study 2 (n = 5,059) confirmed the results on the internal consistency and predictive validity of the Lion game. In addition, multilevel analysis revealed that classroom membership influenced Lion game scores. We concluded that the Lion game is a valid and reliable instrument for the online computerized and self-reliant measurement of visual-spatial working memory (i.e., updating).

The Irvine, Beatties, and Bresnahan (IBB) Forelimb Recovery Scale: An Assessment of Reliability and Validity

PubMed Central

Irvine, Karen-Amanda; Ferguson, Adam R.; Mitchell, Kathleen D.; Beattie, Stephanie B.; Lin, Amity; Stuck, Ellen D.; Huie, J. Russell; Nielson, Jessica L.; Talbott, Jason F.; Inoue, Tomoo; Beattie, Michael S.; Bresnahan, Jacqueline C.

2014-01-01

The IBB scale is a recently developed forelimb scale for the assessment of fine control of the forelimb and digits after cervical spinal cord injury [SCI; (1)]. The present paper describes the assessment of inter-rater reliability and face, concurrent and construct validity of this scale following SCI. It demonstrates that the IBB is a reliable and valid scale that is sensitive to severity of SCI and to recovery over time. In addition, the IBB correlates with other outcome measures and is highly predictive of biological measures of tissue pathology. Multivariate analysis using principal component analysis (PCA) demonstrates that the IBB is highly predictive of the syndromic outcome after SCI (2), and is among the best predictors of bio-behavioral function, based on strong construct validity. Altogether, the data suggest that the IBB, especially in concert with other measures, is a reliable and valid tool for assessing neurological deficits in fine motor control of the distal forelimb, and represents a powerful addition to multivariate outcome batteries aimed at documenting recovery of function after cervical SCI in rats. PMID:25071704

Assessing Students' Spiritual and Religious Qualities

ERIC Educational Resources Information Center

Astin, Alexander W.; Astin, Helen S.; Lindholm, Jennifer A.

2011-01-01

This paper describes a comprehensive set of 12 new measures for studying undergraduate students' spiritual and religious development. The three measures of spirituality, four measures of "spiritually related" qualities, and five measures of religiousness demonstrate satisfactory reliability, robustness, and both concurrent and predictive validity.…

German validation of the BIDQ-S questionnaire on body image disturbance in idiopathic scoliosis.

PubMed

Wetterkamp, Mark; Thielsch, Meinald T; Gosheger, Georg; Boertz, Patrick; Terheyden, Jan Henrik; Schulte, Tobias L

2017-02-01

The Body Image Disturbance Questionnaire-Scoliosis (BIDQ-S) is a seven-item questionnaire inquiring into patients' worries about back shape and associated problems at school, at work, with friends or family, and whether the patients are avoiding certain activities. The aim of this study was to translate the BIDQ-S into German (G-BIDQ-S), test its reliability, and establish its convergent, divergent, concurrent, and discriminant validity. In a prospective cohort study, 259 patients with idiopathic scoliosis (mean age 30.2; 221 female; mean Cobb angle 43.8°) completed the G-BIDQ-S; Scoliosis Research Society 22-r (SRS 22-r); Patient Health Questionnaire (PHQ-9); Positive and Negative Affect Schedule (PANAS); Questionnaire on Body Dysmorphic Symptoms (FKS); and WHO-5 Well-Being Index. Healthy control individuals matched by age, sex and BMI (n = 149; mean age 36.1; 133 female; BMI = 23.0) answered the same questions to establish discriminant validity. Discriminant statistics, and Pearson and Spearman correlations were calculated. The G-BIDQ-S proved to be one-factorial, internally consistent (Cronbach alpha = 0.87), and stable over time (total score 2.22 vs. 2.21 during retest; retest reliability r = 0.79, P < 0.001). It correlated significantly with the mean SRS 22-r (r = -0.72, P < 0.001) and with Cobb angles (r = 0.30, P < 0.001)-convergent validity; much less with body mass index (r = 0.19, P < 0.001)-divergent validity; and with the PANAS (r = 0.55, P < 0.001), PHQ-9 (r = 0.53, P < 0.001), FKS (r = 0.67, P < 0.001), and WHO-5 (r = -0.54, P < 0.001)-concurrent validity. The G-BIDQ-S also showed discriminant validity, with a strong difference between the scoliosis group (total score 2.19) and the control group (total score 1.13; P < 0.001). The G-BIDQ-S showed good internal consistency, reliability, and convergent, divergent, concurrent, and discriminant validity. This questionnaire is the first one inquiring into patients' body image disturbances that has been validated and is available in German.

Reliability and Validity of the Korean Version of the Internet Addiction Test among College Students

PubMed Central

Lee, Kounseok; Lee, Hye-Kyung; Gyeong, Hyunsu; Yu, Byeongkwan; Song, Yul-Mai

2013-01-01

We developed a Korean translation of the Internet Addiction Test (KIAT), widely used self-report for internet addiction and tested its reliability and validity in a sample of college students. Two hundred seventy-nine college students at a national university completed the KIAT. Internal consistency and two week test-retest reliability were calculated from the data, and principal component factor analysis was conducted. Participants also completed the Internet Addiction Diagnostic Questionnaire (IADQ), the Korea Internet addiction scale (K-scale), and the Patient Health Questionnaire-9 for the criterion validity. Cronbach's alpha of the whole scale was 0.91, and test-retest reliability was also good (r = 0.73). The IADQ, the K-scale, and depressive symptoms were significantly correlated with the KIAT scores, demonstrating concurrent and convergent validity. The factor analysis extracted four factors (Excessive use, Dependence, Withdrawal, and Avoidance of reality) that accounted for 59% of total variance. The KIAT has outstanding internal consistency and high test-retest reliability. Also, the factor structure and validity data show that the KIAT is comparable to the original version. Thus, the KIAT is a psychometrically sound tool for assessing internet addiction in the Korean-speaking population. PMID:23678270

Development and initial validation of the internalization of Asian American stereotypes scale.

PubMed

Shen, Frances C; Wang, Yu-Wei; Swanson, Jane L

2011-07-01

This research consists of four studies on the initial reliability and validity of the Internalization of Asian American Stereotypes Scale (IAASS), a self-report instrument that measures the degree Asian Americans have internalized racial stereotypes about their own group. The results from the exploratory and confirmatory factor analyses support a stable four-factor structure of the IAASS: Difficulties with English Language Communication, Pursuit of Prestigious Careers, Emotional Reservation, and Expected Academic Success. Evidence for concurrent and discriminant validity is presented. High internal-consistency and test-retest reliability estimates are reported. A discussion of how this scale can contribute to research and practice regarding internalized stereotyping among Asian Americans is provided.

Test – Retest Reliability and Concurrent Validity of in vivo Myelin Content Indices: Myelin Water Fraction and Calibrated T1w/T2w Image Ratio

PubMed Central

Arshad, Muzamil; Stanley, Jeffrey A.; Raz, Naftali

2016-01-01

In an age-heterogeneous sample of healthy adults, we examined test-retest reliability (with and without participant re-positioning) of two popular MRI methods of estimating myelin content: modeling the short spin-spin (T2) relaxation component of multi-echo imaging data and computing the ratio of T1-weighted and T2-weighted images (T1w/T2w). Taking the myelin water fraction (MWF) index of myelin content derived from the multi-component T2 relaxation data as a standard, we evaluate the concurrent and differential validity of T1w/T2w ratio images. The results revealed high reliability of MWF and T1w/T2w ratio. However, we found significant correlations of low to moderate magnitude between MWF and the T1w/T2w ratio in only two of six examined regions of the cerebral white matter. Notably, significant correlations of the same or greater magnitude were observed for T1w/T2w ratio and the intermediate T2 relaxation time constant, which is believed to reflect differences in the mobility of water between the intracellular and extracellular compartments. We conclude that although both methods are highly reliable and thus well-suited for longitudinal studies, T1w/T2w ratio has low criterion validity and may be not an optimal index of subcortical myelin content. PMID:28009069

Psychometric Validation of the World Health Organization Disability Assessment Schedule 2.0-Twelve-Item Version in Persons with Spinal Cord Injuries

ERIC Educational Resources Information Center

Smedema, Susan Miller; Ruiz, Derek; Mohr, Michael J.

2017-01-01

Purpose: To evaluate the factorial and concurrent validity and internal consistency reliability of the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) 12-item version in persons with spinal cord injuries. Method: Two hundred forty-seven adults with spinal cord injuries completed an online survey consisting of the WHODAS…

Psychometric properties of three measures assessing advanced theory of mind: Evidence from people with schizophrenia.

PubMed

Chen, Kuan-Wei; Lee, Shih-Chieh; Chiang, Hsin-Yu; Syu, Ya-Cing; Yu, Xiao-Xuan; Hsieh, Ching-Lin

2017-11-01

Patients with schizophrenia tend to have deficits in advanced Theory of Mind (ToM). The "Reading the mind in the eyes" test (RMET), the Faux Pas Task, and the Strange Stories are commonly used for assessing advanced ToM. However, most of the psychometric properties of these 3 measures in patients with schizophrenia are unknown. The aims of this study were to validate the psychometric properties of the 3 advanced ToM measures in patients with schizophrenia, including: (1) test-retest reliability; (2) random measurement error; (3) practice effect; (4) concurrent validity; and (5) ecological validity. We recruited 53 patients with schizophrenia, who completed the 3 measures twice, 4 weeks apart. The Revised Social Functioning Scale-Taiwan short version (R-SFST) was completed within 3 days of first session of assessments. We found that the intraclass correlation coefficients of the RMET, Strange Stories, and Faux Pas Task were 0.24, 0.5, and 0.76. All 3 advanced ToM measures had large random measurement error, trivial to small practice effects, poor concurrent validity, and low ecological validity. We recommend that the scores of the 3 advanced ToM measures be interpreted with caution because these measures may not provide reliable and valid results on patients' advanced ToM abilities. Copyright © 2017 Elsevier B.V. All rights reserved.

Concurrent validity of walking speed values calculated via the GAITRite electronic walkway and 3 meter walk test in the chronic stroke population.

PubMed

Peters, Denise M; Middleton, Addie; Donley, Jonathan W; Blanck, Erika L; Fritz, Stacy L

2014-04-01

The purpose of this study was to provide novel information regarding the concurrent validity (primary aim) and reliability (secondary aim) of walking speed (WS) calculated via the GAITRite electronic walkway system and 3 meter walk test (3MWT) in the chronic stroke population. The 3MWT is a feasible option for clinicians working in environments where space is limited. Psychometric properties of the test have not been established. Participants with chronic stroke were stratified into three groups: (1) household ambulators (HA) (self-selected WS < 0.4 m/s, 12 participants, 31 observations); (2) limited community ambulators (LCA) (self-selected WS 0.4-0.8 m/s, 24 participants, 60 observations); and (3) community ambulators (CA) (self-selected WS > 0.8 m/s, 26 participants, 71 observations). Three consecutive trials of GAITRite and 3MWT were performed at participant's self-selected WS. Average WS measurements differed significantly (p < 0.05) between GAITRite and 3MWT for all three groups. HA group: GAITRite 0.25 (0.11) m/s, 3MWT 0.27 (0.11) m/s; LCA group: GAITRite 0.56 (0.11) m/s, 3MWT 0.52 (0.10) m/s; CA group: GAITRite 1.03 (0.16) m/s, 3MWT 0.89 (0.15) m/s. Both WS measures had excellent within-session reliability (ICC's ranging from 0.85 to 0.97, SEM95 from 0.04 to 0.12 m/s and MDC95 from 0.05 to 0.16 m/s). Reliability was highest for HA on both measures. Although both the 3MWT and the GAITRite are reliable measures of WS for individuals with chronic stroke, the two measures do not demonstrate concurrent validity.

Cross-cultural adaptation and psychometric evaluation of oral health impact profile among school teacher community

PubMed Central

Vyas, Shaleen; Nagarajappa, Sandesh; Dasar, Pralhad L.; Mishra, Prashant

2018-01-01

AIM: To translate OHIP-14 into Hindi and test its psychometric properties among school teacher community. METHODS: The OHIP-14 was translated to OHIP-14-H using WHO recommended translation protocol. During pre-testing, an expert panel assessed content validity of the questionnaire. Face validity was assessed on a sample of 10 individuals. The OHIP-14-H was administered on a random sample of 170 primary school teachers. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and Intra-class correlation coefficient (ICC) respectively, with 2 weeks interval. Predictive validity was tested by comparing OHIP-14-H scores with clinical parameters. The concurrent validity was assessed using self-reported oral health and discriminant validity was ascertained through negative association with sociodemographic variables. RESULTS: The mean OHIP-14-H score was 9.57 (S.D = 4.58). ICC and Cronbach's alpha for OHIP-14-H was 0.96 and 0.92 respectively. Concurrent validity using binomial regression model indicated that good (OR = 0.56, 95% CI = 0.55 – 4.47) and moderate (OR = 0.25, 95% CI = 0.17 – 1.87) OHIP-14-H scores were negative but significant risk indicators of poor self reported oral health (P < 0.009). Significant predictive validity was observed between OHIP-14-H scores and clinical parameters (P < 0.000). CONCLUSION: Translated and culturally adapted OHIP-14-H indicates good reliability and validity among primary school teachers. PMID:29417064

Validation of the Weight Concerns Scale Applied to Brazilian University Students.

PubMed

Dias, Juliana Chioda Ribeiro; da Silva, Wanderson Roberto; Maroco, João; Campos, Juliana Alvares Duarte Bonini

2015-06-01

The aim of this study was to evaluate the validity and reliability of the Portuguese version of the Weight Concerns Scale (WCS) when applied to Brazilian university students. The scale was completed by 1084 university students from Brazilian public education institutions. A confirmatory factor analysis was conducted. The stability of the model in independent samples was assessed through multigroup analysis, and the invariance was estimated. Convergent, concurrent, divergent, and criterion validities as well as internal consistency were estimated. Results indicated that the one-factor model presented an adequate fit to the sample and values of convergent validity. The concurrent validity with the Body Shape Questionnaire and divergent validity with the Maslach Burnout Inventory for Students were adequate. Internal consistency was adequate, and the factorial structure was invariant in independent subsamples. The results present a simple and short instrument capable of precisely and accurately assessing concerns with weight among Brazilian university students. Copyright © 2015 Elsevier Ltd. All rights reserved.

Reliability and validity of the upper-body dressing scale in Japanese patients with vascular dementia with hemiparesis.

PubMed

Endo, Arisa; Suzuki, Makoto; Akagi, Atsumi; Chiba, Naoyuki; Ishizaka, Ikuyo; Matsunaga, Atsuhiko; Fukuda, Michinari

2015-03-01

The purpose of this study was to examine the reliability and validity of the Upper-body Dressing Scale (UBDS) for buttoned shirt dressing, which evaluates the learning process of new component actions of upper-body dressing in patients diagnosed with dementia and hemiparesis. This was a preliminary correlational study of concurrent validity and reliability in which 10 vascular dementia patients with hemiparesis were enrolled and assessed repeatedly by six occupational therapists by means of the UBDS and the dressing item of the Functional Independence Measure (FIM). Intraclass correlation coefficient was 0.97 for intra-rater reliability and 0.99 for inter-rater reliability. The level of correlation between UBDS score and FIM dressing item scores was -0.93. UBDS scores for paralytic hand passed into the sleeve and sleeve pulled up beyond the shoulder joint were worse than the scores for the other components of the task. The UBDS has good reliability and validity for vascular dementia patients with hemiparesis. Further research is needed to investigate the relation between UBDS score and the effect of intervention and to clarify sensitivity or responsiveness of the scale to clinical change. Copyright © 2014 John Wiley & Sons, Ltd.

Relapse Risk Assessment for Schizophrenia Patients (RASP): A New Self-Report Screening Tool.

PubMed

Velligan, Dawn; Carpenter, William; Waters, Heidi C; Gerlanc, Nicole M; Legacy, Susan N; Ruetsch, Charles

2018-01-01

The Relapse Assessment for Schizophrenia Patients (RASP) was developed as a six-question self-report screener that measures indicators of Increased Anxiety and Social Isolation to assess patient stability and predict imminent relapse. This paper describes the development and psychometric characteristics of the RASP. The RASP and Positive and Negative Syndrome Scale (PANSS) were administered to patients with schizophrenia (n=166) three separate times. Chart data were collected on a subsample of patients (n=81). Psychometric analyses of RASP included tests of reliability, construct validity, and concurrent validity of items. Factors from RASP were correlated with subscales from PANSS (sensitivity to change and criterion validity [agreement between RASP and evidence of relapse]). Test-retest reliability returned modest to strong agreement at the item level and strong agreement at the questionnaire level. RASP showed good item response curves and internal consistency for the total instrument and within each of the two subscales (Increased Anxiety and Social Isolation). RASP Total Score and subscales showed good concurrent validity when correlated with PANSS Total Score, Positive, Excitement, and Anxiety subscales. RASP correctly predicted relapse in 67% of cases, with good specificity and negative predictive power and acceptable positive predictive power and sensitivity. The reliability and validity data presented support the use of RASP in settings where addition of a brief self-report assessment of relapse risk among patients with schizophrenia may be of benefit. Ease of use and scoring, and the ability to administer without clinical supervision allows for routine administration and assessment of relapse risk.

The Japanese version of the overall assessment of the speaker's experience of stuttering for adults (OASES-A-J): Translation and psychometric evaluation.

PubMed

Sakai, Naomi; Chu, Shin Ying; Mori, Koichi; Yaruss, J Scott

2017-03-01

This study evaluates the psychometric performance of the Japanese version of the Overall Assessment of the Speaker's Experience of Stuttering for Adults (OASES-A), a comprehensive assessment tool of individuals who stutter. The OASES-A-J was administered to 200 adults who stutter in Japan. All respondents also evaluated their own speech (SA scale), satisfaction of their own speech (SS scale) and the Japanese translation version of the Modified Erickson Communication Attitude scale (S-24). The test-retest reliability and internal consistency of the OASES-A-J were assessed. To examine the concurrent validity of the questionnaire, Pearson correlation was conducted between the OASES-A-J Impact score and the S-24 scale, SA scale and SS scale. In addition, Pearson correlation among the impact scores of each section and total were calculated to examine the construct validity. The OASES-A-J showed a good test-retest reliability (r=0.81-0.95) and high internal consistency (α>0.80). Concurrent validity was moderate to high (0.55-0.75). Construct validity was confirmed by the relation between internal consistency in each section and correlation among sections' impact scores. Japanese adults showed higher negative impact for 'General Information', 'Reactions to Stuttering' and 'Quality of Life' sections. These results suggest that the OASES-A-J is a reliable and valid instrument to measure the impact of stuttering on Japanese adults who stutter. The OASES-A-J could be used as a clinical tool in Japanese stuttering field. Copyright © 2016 Elsevier Inc. All rights reserved.

Validity and reliability of an Arabic version of the state-trait anxiety inventory in a Saudi dental setting

PubMed Central

Bahammam, Maha A.

2016-01-01

Objectives: To test the psychometric properties of an adapted Arabic version of the state trait anxiety-form Y (STAI-Y) in Saudi adult dental patients. Methods: In this cross-sectional study, the published Arabic version of the STAI-Y was evaluated by 2 experienced bilingual professionals for its compatibility with Saudi culture and revised prior to testing. Three hundred and eighty-seven patients attending dental clinics for treatment at the Faculty of Dentistry Hospital, King Abdullah University, Jeddah, Kingdom of Saudi Arabia, participated in the study. The Arabic version of the modified dental anxiety scale (MDAS) and visual analogue scale (VAS) ratings of anxiety were used to assess the concurrent criterion validity. Results: The Arabic version of the STAI-Y had high internal consistency reliability (Cronbach’s alpha: 0.989) for state and trait subscales. Factor analysis indicated unidimensionality of the scale. Correlations between STAI-Y scores and both MDAS and VAS scores indicated strong concurrent criterion validity. Discriminant validity was supported by the findings that higher anxiety levels were present among females as opposed to males, younger individuals as compared to older individuals, and patients who do not visit the dentist unless they have a need as opposed to more frequent visitors to the dental office. Conclusion: The Arabic version of the STAI-Y has an adequate internal consistency reliability, generally similar to that reported in the international literature, suggesting it is appropriate for assessing dental anxiety in Arabic speaking populations. PMID:27279514

Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

ERIC Educational Resources Information Center

Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

2016-01-01

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Validity and Reliability of the Persian Version of Baecke Habitual Physical Activity Questionnaire in Healthy Subjects.

PubMed

Sadeghisani, Meissam; Dehghan Manshadi, Farideh; Azimi, Hadi; Montazeri, Ali

2016-09-01

Baecke Habitual Physical Activity Questionnaire (BHPAQ) has widely been employed in clinical and laboratorial studies as a tool for measuring subjects' physical activities. But, the reliability and validity of this questionnaire have not been investigated among Persian speakers. Therefore, the aim of the current study was examining the reliability and validity of the Persian version of the BHPAQ in healthy Persian adults. After following the process of forward-backward translation, 32 subjects were invited to fill out the Persian version of the questionnaire in two independent sessions (3 - 7 days after the first session) in order to determine the reliability index. Also, the validity of the questionnaire was assessed through concurrent validity by 126 subjects (66 males and 60 females) answering both the Baecke and the International Physical Activity Questionnaire (IPAQ). An acceptable level of intraclass correlation coefficient (ICC of work score = 0.95, sport score = 0.93, and leisure score = 0.77) was achieved for the Persian Baecke questionnaire. Correlations between Persian Baecke and IPAQ with and without the score for sitting position were found to be 0.19 and 0.36, respectively. The Persian version of the BHPAQ is a reliable and valid instrument that can be used to measure the level of habitual functional activities in Persian-speaking subjects.

Predicting functional outcomes among college drinkers: reliability and predictive validity of the Young Adult Alcohol Consequences Questionnaire.

PubMed

Read, Jennifer P; Merrill, Jennifer E; Kahler, Christopher W; Strong, David R

2007-11-01

Heavy drinking and associated consequences are widespread among U.S. college students. Recently, Read et al. (Read, J. P., Kahler, C. W., Strong, D., & Colder, C. R. (2006). Development and preliminary validation of the Young Adult Alcohol Consequences Questionnaire. Journal of Studies on Alcohol, 67, 169-178) developed the Young Adult Alcohol Consequences Questionnaire (YAACQ) to assess the broad range of consequences that may result from heavy drinking in the college milieu. In the present study, we sought to add to the psychometric validation of this measure by employing a prospective design to examine the test-retest reliability, concurrent validity, and predictive validity of the YAACQ. We also sought to examine the utility of the YAACQ administered early in the semester in the prediction of functional outcomes later in the semester, including the persistence of heavy drinking, and academic functioning. Ninety-two college students (48 females) completed a self-report assessment battery during the first weeks of the Fall semester, and approximately one week later. Additionally, 64 subjects (37 females) participated at an optional third time point at the end of the semester. Overall, the YAACQ demonstrated strong internal consistency, test-retest reliability, and concurrent and predictive validity. YAACQ scores also were predictive of both drinking frequency, and "binge" drinking frequency. YAACQ total scores at baseline were an early indicator of academic performance later in the semester, with greater number of total consequences experienced being negatively associated with end-of-semester grade point average. Specific YAACQ subscale scores (Impaired Control, Dependence Symptoms, Blackout Drinking) showed unique prediction of persistent drinking and academic outcomes.

Development of a validated questionnaire to measure the self-perceived competence of primary health professionals in providing nutrition care to patients with chronic disease.

PubMed

Ball, Lauren E; Leveritt, Michael D

2015-12-01

Nutrition is an important aspect of chronic disease prevention and management by primary health professionals, including GPs, dietitians, practice nurses, diabetes educators and exercise professionals. In order to better understand how to improve the delivery of nutrition care, it is important to have valid and reliable tools to measure self-perceived competence. This study aimed to develop a valid, structured, questionnaire that measures the self-perceived competence of primary health professionals to provide nutrition care to patients with chronic disease. The development of the questionnaire was carried out in four stages (1): preparation of scope and structure, through a literature review and consultation with an expert reference group (2); development of questionnaire items, which were refined through feedback from the reference group and 18 primary health professionals (3); investigation of internal consistency and concurrent validity through a pilot study on 118 primary health professionals (4) and investigation of test-retest reliability through a pilot study on 33 primary health professionals who completed the questionnaire twice, 2-3 weeks apart. Stages 1 and 2 resulted in four constructs and 35 questions in the questionnaire. Stage 3 confirmed internal consistency, with Cronbach's α ranging from 0.88 to 0.98 for each construct and 0.98 for all items combined. Dietitians scored significantly higher than speech pathologists (P < 0.05) in each construct, confirming concurrent validity. Stage 4 confirmed test-retest reliability, with correlation coefficients ranging from 0.89 to 0.94 for each construct and 0.95 for all items combined. The NUTrition COMPetence (NUTCOMP) questionnaire is a valid, reliable and suitable tool that can be used to directly inform professional development and identify opportunities to support safe and effective practice. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Reliability and Validity of the KIPPPI: An Early Detection Tool for Psychosocial Problems in Toddlers

PubMed Central

Kruizinga, Ingrid; Jansen, Wilma; de Haan, Carolien L.; Raat, Hein

2012-01-01

Background The KIPPPI (Brief Instrument Psychological and Pedagogical Problem Inventory) is a Dutch questionnaire that measures psychosocial and pedagogical problems in 2-year olds and consists of a KIPPPI Total score, Wellbeing scale, Competence scale, and Autonomy scale. This study examined the reliability, validity, screening accuracy and clinical application of the KIPPPI. Methods Parents of 5959 2-year-old children in the Rotterdam area, the Netherlands, were invited to participate in the study. Parents of 3164 children (53.1% of all invited parents) completed the questionnaire. The internal consistency was evaluated and in subsamples the test-retest reliability and concurrent validity with regard to the Child Behavioral Checklist (CBCL). Discriminative validity was evaluated by comparing scores of parents who worried about their child’s upbringing and parent’s that did not. Screening accuracy of the KIPPPI was evaluated against the CBCL by calculating the Receiver Operating Characteristic (ROC) curves. The clinical application was evaluated by the relation between KIPPPI scores and the clinical decision made by the child health professionals. Results Psychometric properties of the KIPPPI Total score, Wellbeing scale, Competence scale and Autonomy scale were respectively: Cronbach’s alphas: 0.88, 0.86, 0.83, 0.58. Test-retest correlations: 0.80, 0.76, 0.73, 0.60. Concurrent validity was as hypothesised. The KIPPPI was able to discriminate between parents that worried about their child and parents that did not. Screening accuracy was high (>0.90) for the KIPPPI Total score and for the Wellbeing scale. The KIPPPI scale scores and clinical decision of the child health professional were related (p<0.05), indicating a good clinical application. Conclusion The results in this large-scale study of a diverse general population sample support the reliability, validity and clinical application of the KIPPPI Total score, Wellbeing scale and Competence scale. Also, the screening accuracy of the KIPPPI Total score and Wellbeing scale were supported. The Autonomy scale needs further study. PMID:23185388

Psychometric Evaluation of the PROMIS Fatigue-Short Form Across Diverse Populations

PubMed Central

Ameringer, Suzanne; Elswick, R. K.; Menzies, Victoria; Robins, Jo Lynne; Starkweather, Angela; Walter, Jeanne; Gentry, Amanda Elswick; Jallo, Nancy

2016-01-01

Background The need for reliable, valid tools to measure patient-reported outcomes (PROs) is critical for both research and for evaluating treatment effects in practice. The Patient Reported Outcome Measurement Information System (PROMIS) Fatigue-Short Form v1.0 –Fatigue 7a (PROMIS F-SF) has had limited psychometric evaluation in various populations. Objectives The aim of the study is to examine psychometric properties of PROMIS F-SF item responses across various populations. Methods Data from five studies with common data elements were used in this secondary analysis. Samples from patients with fibromyalgia, sickle cell disease, cardiometabolic risk, pregnancy, and healthy controls were used. Reliability was estimated using Cronbach’s alpha. Dimensionality was evaluated with confirmatory factor analysis. Concurrent validity was evaluated by examining Pearson’s correlations between scores from the PROMIS F-SF, the Multidimensional Fatigue Symptom Inventory-Short Form (MFSI-SF), and the Brief Fatigue Inventory (BFI). Discriminant validity was evaluated by examining Pearson’s correlations between scores on the PROMIS F-SF and measures of stress and depressive symptoms. Known groups validity was assessed by comparing PROMIS F-SH scores in the clinical samples to healthy controls. Results Reliability of PROMIS F-SF scores was adequate across samples, ranging from .72 in the pregnancy sample to .88 in healthy controls. Unidimensionality was supported in each sample. Concurrent validity was strong; across the groups, correlations with scores on the MFSI-SF and BFI ranged from .60–.85. Correlations of the PROMIS-SF with measures of stress and depressive mood were moderate to strong, ranging from .37–.64. PROMIS F-SF scores were significantly higher in clinical samples, compared to healthy controls. Discussion Reliability and validity of the PROMIS F-SF were acceptable. The PROMIS F-SF is a suitable measure of fatigue across the four diverse clinical populations included in the analysis. PMID:27362514

Reliability and Validity of the Italian Version of the Protocol of Orofacial Myofunctional Evaluation with Scores (I-OMES).

PubMed

Scarponi, Letizia; de Felicio, Claudia Maria; Sforza, Chiarella; Pimenta Ferreira, Claudia Lucia; Ginocchio, Daniela; Pizzorni, Nicole; Barozzi, Stefania; Mozzanica, Francesco; Schindler, Antonio

2018-05-30

To evaluate the reliability, validity, and responsiveness of the Italian OMES (I-OMES). The study consisted of 3 phases: (1) internal consistency and reliability, (2) validity, and (3) responsiveness analysis. The recruited population included 27 patients with orofacial myofunctional disorders (OMD) and 174 healthy volunteers. Forty-seven subjects, 18 healthy and all recruited patients with OMD were assessed for inter-rater and test-retest reliability analysis. I-OMES and Nordic Orofacial Test - Screening (NOT-S) scores of the patients were correlated for concurrent validity analysis. I-OMES scores from 27 patients with OMD and 27 age- and gender-matched healthy subjects were compared to investigate construct validity. I-OMES scores before and after successful swallowing rehabilitation in patients were compared for responsiveness analysis. Adequate internal consistency (Cronbach α = 0.71) and strong inter-rater and test-retest reliability (intraclass coefficient correlation = 0.97 and 0.98, respectively) were found. I-OMES and NOT-S scores significantly and inversely correlated (r = -0.38). A statistical significance (p < 0.001) was found between the pathological group and the control group for the total I-OMES score. The mean I-OMES score improved from 90 (78-102) to 99 (89-103) after myofunctional rehabilitation (p < 0.001). The I-OMES is a reliable and valid tool to evaluate OMD. © 2018 S. Karger AG, Basel.

Reliability and Validity of the Work and Well-Being Inventory (WBI) for Employees.

PubMed

Vendrig, A A; Schaafsma, F G

2018-06-01

Purpose The purpose of this study is to measure the psychometric properties of the Work and Wellbeing Inventory (WBI) (in Dutch: VAR-2), a screening tool that is used within occupational health care and rehabilitation. Our research question focused on the reliability and validity of this inventory. Methods Over the years seven different samples of workers, patients and sick listed workers varying in size between 89 and 912 participants (total: 2514), were used to measure the test-retest reliability, the internal consistency, the construct and concurrent validity, and the criterion and predictive validity. Results The 13 scales displayed good internal consistency and test-retest reliability. The constructive validity of the WBI could clearly be demonstrated in both patients and healthy workers. Confirmative factor analyses revealed a CFI >.90 for all scales. The depression scale predicted future work absenteeism (>6 weeks) because of a common mental disorder in healthy workers. The job strain scale and the illness behavior scale predicted long term absenteeism (>3 months) in workers with short-term absenteeism. The illness behavior scale moderately predicted return to work in rehab patients attending an intensive multidisciplinary program. Conclusions The WBI is a valid and reliable tool for occupational health practitioners to screen for risk factors for prolonged or future sickness absence. With this tool they will have reliable indications for further advice and interventions to restore the work ability.

Potential reliability and validity of a modified version of the Unified Parkinson’s Disease Rating Scale that could be administered remotely

PubMed Central

Abdolahi, Amir; Scoglio, Nicholas; Killoran, Annie; Dorsey, Ray; Biglan, Kevin M.

2013-01-01

Background By permitting remote assessments of patients and research participants, telemedicine has the potential to reshape clinical care and clinical trials for Parkinson disease. While the majority of the motor Unified Parkinson’s Disease Rating Scale (UPDRS) items can be conducted visually, rigidity and retropulsion pull testing require hands-on assessment by the rater and are less feasible to perform remotely in patients' homes. Methods In a secondary data analysis of the Comparison of the Agonist pramipexole vs. Levodopa on Motor complications in Parkinson’s Disease (CALM-PD) study, a randomized clinical trial, we assessed the cross-sectional (baseline and 2 years) and longitudinal (change from baseline to 2 years) reliability of a modified motor UPDRS (removing rigidity and retropulsion items) compared to the standard motor UPDRS (all items) using intraclass correlation coefficients (ICC), stratified by treatment group. Internal consistency of the modified UPDRS (mUPDRS) was measured using Cronbach’s alpha, and concurrent validity was assessed using Pearson’s correlation coefficient (r) between the standard motor UPDRS and mUPDRS. Results The mUPDRS versus standard motor UPDRS is cross-sectionally (ICC ≥ 0.92) and longitudinally (ICC ≥ 0.92) reliable for both treatment groups. High internal consistencies were also observed (α ≥ 0.96). The mUPDRS had high concurrent validity with the standard UPDRS at both time points and longitudinally (r ≥ 0.93, p < 0.0001). Conclusions A modified version of the motor UPDRS without rigidity and retropulsion pull testing is reliable and valid and may lay the foundation for its use in remote assessments of patients and research participants. PMID:23102808

Potential reliability and validity of a modified version of the Unified Parkinson's Disease Rating Scale that could be administered remotely.

PubMed

Abdolahi, Amir; Scoglio, Nicholas; Killoran, Annie; Dorsey, E Ray; Biglan, Kevin M

2013-02-01

By permitting remote assessments of patients and research participants, telemedicine has the potential to reshape clinical care and clinical trials for Parkinson disease. While the majority of the motor Unified Parkinson's Disease Rating Scale (UPDRS) items can be conducted visually, rigidity and retropulsion pull testing require hands-on assessment by the rater and are less feasible to perform remotely in patients' homes. In a secondary data analysis of the Comparison of the Agonist pramipexole vs. Levodopa on Motor complications in Parkinson's Disease (CALM-PD) study, a randomized clinical trial, we assessed the cross-sectional (baseline and 2 years) and longitudinal (change from baseline to 2 years) reliability of a modified motor UPDRS (removing rigidity and retropulsion items) compared to the standard motor UPDRS (all items) using intraclass correlation coefficients (ICC), stratified by treatment group. Internal consistency of the modified UPDRS (mUPDRS) was measured using Cronbach's alpha, and concurrent validity was assessed using Pearson's correlation coefficient (r) between the standard motor UPDRS and mUPDRS. The mUPDRS versus standard motor UPDRS is cross-sectionally (ICC ≥ 0.92) and longitudinally (ICC ≥ 0.92) reliable for both treatment groups. High internal consistencies were also observed (α ≥ 0.96). The mUPDRS had high concurrent validity with the standard UPDRS at both time points and longitudinally (r ≥ 0.93, p < 0.0001). A modified version of the motor UPDRS without rigidity and retropulsion pull testing is reliable and valid and may lay the foundation for its use in remote assessments of patients and research participants. Copyright © 2012 Elsevier Ltd. All rights reserved.

Assessment of Caregiver Inventory for Rett Syndrome

PubMed Central

Lane, Jane B.; Salter, Amber R.; Jones, Nancy E.; Cutter, Gary; Horrigan, Joseph; Skinner, Steve A.; Kaufmann, Walter E.; Glaze, Daniel G.; Neul, Jeffrey L.; Percy, Alan K.

2017-01-01

Rett syndrome (RTT) requires total caregiver attention and leads to potential difficulties throughout life. The Caregiver Burden Inventory, designed for Alzheimer disease, was modified to a RTT Caregiver Inventory Assessment (RTT CIA). Reliability and face, construct, and concurrent validity were assessed in caregivers of individuals with RTT. Chi-square or Fisher’s exact test for categorical variables and t-tests or Wilcoxon two-sample tests for continuous variables were utilized. Survey completed by 198 caregivers; 70 caregivers completed follow-up assessment. Exploratory factor analysis revealed good agreement for Physical Burden, Emotional Burden, and Social Burden. Internal reliability was high (Cronbach’s alpha: 0.898). RTT CIA represents a reliable and valid measure, providing a needed metric of caregiver burden in this disorder. PMID:28132121

Inter-Rater Reliability and Validity of the Australian Football League’s Kicking and Handball Tests

PubMed Central

Cripps, Ashley J.; Hopper, Luke S.; Joyce, Christopher

2015-01-01

Talent identification tests used at the Australian Football League’s National Draft Combine assess the capacities of athletes to compete at a professional level. Tests created for the National Draft Combine are also commonly used for talent identification and athlete development in development pathways. The skills tests created by the Australian Football League required players to either handball (striking the ball with the hand) or kick to a series of 6 randomly generated targets. Assessors subjectively rate each skill execution giving a 0-5 score for each disposal. This study aimed to investigate the inter-rater reliability and validity of the skills tests at an adolescent sub-elite level. Male Australian footballers were recruited from sub-elite adolescent teams (n = 121, age = 15.7 ± 0.3 years, height = 1.77 ± 0.07 m, mass = 69.17 ± 8.08 kg). The coaches (n = 7) of each team were also recruited. Inter-rater reliability was assessed using Inter-class correlations (ICC) and Limits of Agreement statistics. Both the kicking (ICC = 0.96, p < .01) and handball tests (ICC = 0.89, p < .01) demonstrated strong reliability and acceptable levels of absolute agreement. Content validity was determined by examining the test scores sensitivity to laterality and distance. Concurrent validity was assessed by comparing coaches’ perceptions of skill to actual test outcomes. Multivariate analysis of variance (MANOVA) examined the main effect of laterality, with scores on the dominant hand (p = .04) and foot (p < .01) significantly higher compared to the non-dominant side. Follow-up univariate analysis reported significant differences at every distance in the kicking test. A poor correlation was found between coaches’ perceptions of skill and testing outcomes. The results of this study demonstrate both skill tests demonstrate acceptable inter-rater reliable. Partial content validity was confirmed for the kicking test, however further research is required to confirm validity of the handball test. Key points The skill tests created by the AFL demonstrated acceptable levels of relative and absolute inter-rater reliability. Both the AFL’s skills tests are able to differentiate between athletes dominant and non-dominant limbs. However, only the kicking test could consistently differentiated between score outcomes over a range of Australian Football specific disposal distances. Both tests demonstrated poor concurrent validity, with no correlation found between coaches’ perceptions of technical skills and actual skill outcomes measured. PMID:26336356

Development and Validation of the Food Liking Questionnaire in a French-Canadian Population

PubMed Central

Carbonneau, Elise; Bradette-Laplante, Maude; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Corneau, Louise; Lemieux, Simone

2017-01-01

The purpose of this study was to develop and validate a questionnaire assessing food liking in a French-Canadian population. A questionnaire was developed, in which participants were asked to rate their degree of liking of 50 food items. An expert panel evaluated the content validity. For the validation study, 150 men and women completed the questionnaire twice. An Exploratory Factor Analysis (EFA) was performed to assess the number of subscales of the questionnaire. Internal consistency and test-retest reliability of the subscales were evaluated. Concurrent validity was assessed through correlations between liking scores and self-reported frequencies of consumption. Comments from the experts led to changes in the list of foods included in the questionnaire. The EFA revealed a two-factor structure for the questionnaire (i.e., savory and sweet foods) and led to the removal of nine items, resulting in a 32-item questionnaire. The two subscales revealed good internal consistency (Cronbach alphas: 0.85 and 0.89) and test-retest reliability (p = 0.84 and 0.86). The questionnaire demonstrated adequate concurrent validity, with moderate correlations between food liking and self-reported frequency of consumption (r = 0.19–0.39, ps < 0.05). This new Food Liking Questionnaire assessing liking of a variety of savory and sweet foods demonstrated good psychometric properties in every validation step. This questionnaire will be useful to explore the role of food liking and its interactions with other factors in predicting eating behaviors and energy intake. PMID:29292754

Development and Validation of the Food Liking Questionnaire in a French-Canadian Population.

PubMed

Carbonneau, Elise; Bradette-Laplante, Maude; Lamarche, Benoît; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-12-08

The purpose of this study was to develop and validate a questionnaire assessing food liking in a French-Canadian population. A questionnaire was developed, in which participants were asked to rate their degree of liking of 50 food items. An expert panel evaluated the content validity. For the validation study, 150 men and women completed the questionnaire twice. An Exploratory Factor Analysis (EFA) was performed to assess the number of subscales of the questionnaire. Internal consistency and test-retest reliability of the subscales were evaluated. Concurrent validity was assessed through correlations between liking scores and self-reported frequencies of consumption. Comments from the experts led to changes in the list of foods included in the questionnaire. The EFA revealed a two-factor structure for the questionnaire (i.e., savory and sweet foods) and led to the removal of nine items, resulting in a 32-item questionnaire. The two subscales revealed good internal consistency (Cronbach alphas: 0.85 and 0.89) and test-retest reliability ( p = 0.84 and 0.86). The questionnaire demonstrated adequate concurrent validity, with moderate correlations between food liking and self-reported frequency of consumption ( r = 0.19-0.39, p s < 0.05). This new Food Liking Questionnaire assessing liking of a variety of savory and sweet foods demonstrated good psychometric properties in every validation step. This questionnaire will be useful to explore the role of food liking and its interactions with other factors in predicting eating behaviors and energy intake.

Reliability and validity of current physical examination techniques of the foot and ankle.

PubMed

Wrobel, James S; Armstrong, David G

2008-01-01

This literature review was undertaken to evaluate the reliability and validity of the orthopedic, neurologic, and vascular examination of the foot and ankle. We searched PubMed-the US National Library of Medicine's database of biomedical citations-and abstracts for relevant publications from 1966 to 2006. We also searched the bibliographies of the retrieved articles. We identified 35 articles to review. For discussion purposes, we used reliability interpretation guidelines proposed by others. For the kappa statistic that calculates reliability for dichotomous (eg, yes or no) measures, reliability was defined as moderate (0.4-0.6), substantial (0.6-0.8), and outstanding (> 0.8). For the intraclass correlation coefficient that calculates reliability for continuous (eg, degrees of motion) measures, reliability was defined as good (> 0.75), moderate (0.5-0.75), and poor (< 0.5). Intraclass correlations, based on the various examinations performed, varied widely. The range was from 0.08 to 0.98, depending on the examination performed. Concurrent and predictive validity ranged from poor to good. Although hundreds of articles exist describing various methods of lower-extremity assessment, few rigorously assess the measurement properties. This information can be used both by the discerning clinician in the art of clinical examination and by the scientist in the measurement properties of reproducibility and validity.

Psychometric evaluation and wording effects on the Chinese version of the parent-proxy Kid-KINDL.

PubMed

Lee, Chih-Ting; Lin, Chung-Ying; Tsai, Meng-Che; Strong, Carol; Lin, Yi-Ching

2016-09-05

The pediatric quality of life (QoL) questionnaire, the child-rated Kid-KINDL, has wording effects. However, no studies have examined for its parallel questionnaire, the parent-proxy Kid-KINDL. This study aimed to examine the psychometric properties and wording effects of the parent-proxy Kid-KINDL. Parents with 8- to 12-year-old children (n = 247) completed the parent-proxy Kid-KINDL, 83 of them completed it again 7-14 days later, and 241 of their children completed the child-rated Kid-KINDL. Internal consistency was examined using Cronbach's α; test-retest reliability and concurrent validity, using Pearson correlation coefficients (r); construct validity and wording effects, using confirmatory factor analyses (CFAs). The internal consistency of the parent-proxy Kid-KINDL total score was acceptable (α = .86). Test-retest reliability (r = .33-.60) and concurrent validity (r = .27-.42) were acceptable or nearly acceptable for all subscales and the total score. The CFA models simultaneously accounting for QoL traits and wording effects had satisfactory fit indices, and outperformed the model accounting only for QoL traits. However, four subscales had unsatisfactory internal consistency, which might be attributable to wording effects. When children are unable to complete a QoL questionnaire, the parent-proxy Kid-KINDL can substitute with all due cautions to wording effects and inconsistent reliability among different raters.

Measurement of Family Affective Structure.

ERIC Educational Resources Information Center

Lowman, Joseph

1980-01-01

Three studies demonstrate that the Inventory of Family Feelings, a measure of family affective structure, has high reliability and construct and concurrent validity. It is appropriate for affective comparisons by age, sex, and ordinal position of children and for measuring change after family or marital therapy, or after predictable stress…

Assessment of Caregiver Inventory for Rett Syndrome

ERIC Educational Resources Information Center

Lane, Jane B.; Salter, Amber R.; Jones, Nancy E.; Cutter, Gary; Horrigan, Joseph; Skinner, Steve A.; Kaufmann, Walter E.; Glaze, Daniel G.; Neul, Jeffrey L.; Percy, Alan K.

2017-01-01

Rett syndrome (RTT) requires total caregiver attention and leads to potential difficulties throughout life. The Caregiver Burden Inventory, designed for Alzheimer disease, was modified to a RTT Caregiver Inventory Assessment (RTT CIA). Reliability and face, construct, and concurrent validity were assessed in caregivers of individuals with RTT. Chi…

Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus.

PubMed

McElhone, Kathleen; Abbott, Janice; Shelmerdine, Joanna; Bruce, Ian N; Ahmad, Yasmeen; Gordon, Caroline; Peers, Kate; Isenberg, David; Ferenkeh-Koroma, Ada; Griffiths, Bridget; Akil, Mohamed; Maddison, Peter; Teh, Lee-Suan

2007-08-15

To develop and validate a disease-specific health-related quality of life (HRQOL) instrument for adults with systemic lupus erythematosus (SLE). The work consisted of 6 stages. Stage 1 included item generation for questionnaire content from semistructured interviews with SLE patients. In stage 2 item selection for the draft questionnaire was performed by thematic analysis of the patient interview transcripts and expert panel agreement. In stage 3 the content validity of the draft questionnaire was assessed by patients completing the questionnaire and providing critical feedback. In stages 4 and 5 construct validity and internal reliability of the 3 versions of the LupusQoL were evaluated using principal component analysis with varimax rotation and Cronbach's alpha coefficients, respectively. In stage 6 discriminatory validity, concurrent validity, and test-retest reliability were evaluated. Stages 1, 2, and 3 resulted in a preliminary instrument containing 63 items. In stage 4, 8 domains were identified. This factor structure, accounting for 82% of the variance, was confirmed in stage 5. The domains and Cronbach's alpha coefficients were physical health (0.94), emotional health (0.94), body image (0.89), pain (0.92), planning (0.93), fatigue (0.88), intimate relationships (0.96), and burden to others (0.94). Discriminant validity was demonstrated for different levels of disease activity (British Isles Lupus Assessment Group Index) and damage (Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index). High correlations (r = 0.71-0.79) between comparable domains of the Short Form 36 and the LupusQoL assured acceptable concurrent validity. Good test-retest reliability (r = 0.72-0.93) was demonstrated. The LupusQoL is a validated SLE-specific HRQOL instrument with 34 items across 8 domains defined by patients as being important.

The Social Anxiety and Depression Life Interference—24 Inventory: Classical and modern psychometric evaluations

PubMed Central

Berzins, Tiffany L.; Garcia, Antonio F.; Acosta, Melina; Osman, Augustine

2017-01-01

Two instrument validation studies broadened the research literature exploring the factor structure, internal consistency reliability, and concurrent validity of scores on the Social Anxiety and Depression Life Interference—24 Inventory (SADLI-24; Osman, Bagge, Freedenthal, Guiterrez, & Emmerich, 2011). Study 1 (N = 1065) was undertaken to concurrently appraise three competing factor models for the instrument: a unidimensional model, a two-factor oblique model and a bifactor model. The bifactor model provided the best fit to the study sample data. Study 2 (N = 220) extended the results from Study 1 with an investigation of the convergent and discriminant validity for the bifactor model of the SADLI-24 with multiple regression analyses and scale-level exploratory structural equation modeling. This project yields data that augments the initial instrument development investigations for the target measure. PMID:28781401

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Psychometric properties of the Portuguese version of place attachment scale for youth in residential care.

PubMed

Magalhães, Eunice; Calheiros, María M

2015-01-01

Although the significant scientific advances on place attachment literature, no instruments exist specifically developed or adapted to residential care. 410 adolescents (11 - 18 years old) participated in this study. The place attachment scale evaluates five dimensions: Place identity, Place dependence, Institutional bonding, Caregivers bonding and Friend bonding. Data analysis included descriptive statistics, content validity, construct validity (Confirmatory Factor Analysis), concurrent validity with correlations with satisfaction with life and with institution, and reliability evidences. The relationship with individual characteristics and placement length was also verified. Content validity analysis revealed that more than half of the panellists perceive all the items as relevant to assess the construct in residential care. The structure with five dimensions revealed good fit statistics and concurrent validity evidences were found, with significant correlations with satisfaction with life and with the institution. Acceptable values of internal consistence and specific gender differences were found. The preliminary psychometric properties of this scale suggest it potential to be used with youth in care.

Development and validation study of the Smartphone Overuse Screening Questionnaire.

PubMed

Lee, Han-Kyeong; Kim, Ji-Hae; Fava, Maurizio; Mischoulon, David; Park, Jae-Hyun; Shim, Eun-Jung; Lee, Eun-Ho; Lee, Ji Hyeon; Jeon, Hong Jin

2017-11-01

The aim of this study was to develop a screening questionnaire that could distinguish individuals at high risk of smartphone overuse from casual users. The reliability, validity, and diagnostic ability of the Smartphone Overuse Screening Questionnaire (SOS-Q) were evaluated. Preliminary items were assessed by 50 addiction experts on-line, and 28 questions were selected. A total of 158 subjects recruited from six community centers for internet addiction participated in this study. The SOS-Q, Young's internet addiction scale, Korean scale for internet addiction, and Smartphone Scale for Smartphone Addiction (S-Scale) were used to assess the concurrent validity. Construct validity was supported by a six-factor model using an exploratory factor analysis. The internal consistency and the item-total correlations were favorable (α = 0.95, r = 0.35-0.81). The test-retest reliability was moderate (r = 0.70). The SOS-Q showed superior concurrent validity with the highest correlation between the S-Scale (r = 0.76). Receiver operating characteristic curve analysis revealed an area under the curve of 0.877. A cut-off point of 49 effectively categorized addiction high-risk group with a sensitivity of 0.81 and specificity of 0.86. Overall, the current study supports the use of SOS-Q as both a primary and supplementary measurement tool in a variety of settings. Copyright © 2017 Elsevier B.V. All rights reserved.

Initial Psychometric Validation of the Non-Suicidal Self-Injury Scar Cognition Scale.

PubMed

Burke, Taylor A; Olino, Thomas M; Alloy, Lauren B

2017-09-01

Given the growing literature on the detrimental psychological consequences of NSSI, it is surprising that scarce research has focused on the permanent physical consequences of NSSI, scarring to one's tissue (Burke et al. 2015; Lewis 2016). Indeed, with recent research suggesting that upwards of half of those with a history of NSSI bear scarring as a result of the behavior (Burke et al. 2016), the psychological implications of scarring are important to understand. Given preliminary literature suggesting that the vast majority of individuals who bear NSSI scars ascribe a great deal of meaning to their scarring, and that this meaning varies widely, a psychometrically sound scale is needed to comprehensively and systematically assess NSSI scar-related cognitions. The present study examined the psychometric properties of the Non-Suicidal Self-Injury Scar Cognition Scale (NSSI-SCS). A sample of 110 undergraduates with at least one scar from NSSI completed the NSSI-SCS as well as measures of concurrent and divergent validity. Exploratory Factor Analysis was conducted to determine the factor structure of the NSSI-SCS. Results indicated that a five-factor solution offered the best fit for the data. Psychometric analyses support the validity of the NSSI-SCS given evidence of concurrent validity, divergent validity, and reliability. Future research should examine the test-retest reliability of the NSSI-SCS, as well as its sensitivity to change, particularly in the context of treatment research.

Psychometric evaluation of a unified Portuguese-language version of the Body Shape Questionnaire in female university students.

PubMed

Silva, Wanderson Roberto; Costa, David; Pimenta, Filipa; Maroco, João; Campos, Juliana Alvares Duarte Bonini

2016-07-21

The objectives of this study were to develop a unified Portuguese-language version, for use in Brazil and Portugal, of the Body Shape Questionnaire (BSQ) and to estimate its validity, reliability, and internal consistency in Brazilian and Portuguese female university students. Confirmatory factor analysis was performed using both original (34-item) and shortened (8-item) versions. The model's fit was assessed with χ²/df, CFI, NFI, and RMSEA. Concurrent and convergent validity were assessed. Reliability was estimated through internal consistency and composite reliability (α). Transnational invariance of the BSQ was tested using multi-group analysis. The original 32-item model was refined to present a better fit and adequate validity and reliability. The shortened model was stable in both independent samples and in transnational samples (Brazil and Portugal). The use of this unified version is recommended for the assessment of body shape concerns in both Brazilian and Portuguese college students.

Concurrent validity and reliability of the Alberta Infant Motor Scale in infants at dual risk for motor delays.

PubMed

Snyder, Patricia; Eason, Jane M; Philibert, Darbi; Ridgway, Andrea; McCaughey, Tiffany

2008-01-01

Concurrent validity of scores for the Alberta Infant Motor Scale (AIMS) and the Peabody Developmental Gross Motor Scale-2 (PDGMS-2) was examined with a sample of 35 infants at dual risk for motor delays or disabilities. Dual risk was defined as low birthweight ( 9 months of age. Novice examiners' scores on both measures closely approximated those of experienced examiners (ICC range = .98 to .99). The results support concurrent validity of the AIMS and PDGMS-2 for infants at dual risk and have implications for using the AIMS in high-risk follow-up programs, particularly in relation to evaluating functional components of motor performance and ease of administration.

Validation of the French translation-adaptation of the impact of cancer questionnaire version 2 (IOCv2) in a breast cancer survivor population.

PubMed

Blanchin, Myriam; Dauchy, Sarah; Cano, Alejandra; Brédart, Anne; Aaronson, Neil K; Hardouin, Jean-Benoit

2015-07-29

The Impact of Cancer version 2 (IOCv2) was designed to assess the physical and psychosocial health experience of cancer survivors through its positive and negative impacts. Although the IOCv2 is available in English and Dutch, it has not yet been validated for use in French-speaking populations. The current study was undertaken to provide a comprehensive assessment of the reliability and validity of the French language version of the IOCv2 in a sample of breast cancer survivors. An adapted French version of the IOCv2 as well as demographic and medical information were completed by 243 women to validate the factor structure divergent/divergent validities and reliability. Concurrent validity was assessed by correlating the IOCv2 scales with measures from the SF-12, PostTraumatic Growth Inventory and Fear of Cancer Recurrence Inventory. The French version of the IOCv2 supports the structure of the original version, with four positive impact dimensions and four negative impact dimensions. This result was suggested by the good fit of the confirmatory factor analysis and the adequate reliability revealed by Cronbach's alpha coefficients and other psychometric indices. The concurrent validity analysis revealed patterns of association between IOCv2 scale scores and other measures. Unlike the original version, a structure with a Positive Impact domain consisting in the IOCv2 positive dimensions and a Negative Impact domain consisting in the negative ones has not been clearly evidenced in this study. The limited practical use of the conditional dimensions Employment Concerns and Relationship Concerns, whether the patient is partnered or not, did not make possible to provide evidence of validity and reliability of these dimensions as the subsets of sample to work with were not large enough. The scores of these conditional dimensions have to be used with full knowledge of the facts of this limitation of the study. Integrating IOCv2 into studies will contribute to evaluate the psychosocial health experience of the growing population of cancer survivors, enabling better understanding of the multi-dimensional impact of cancer.

Translation, cross-cultural adaptation and psychometric evaluation of yoruba version of the short-form 36 health survey.

PubMed

Mbada, Chidozie Emmanuel; Adeogun, Gafar Atanda; Ogunlana, Michael Opeoluwa; Adedoyin, Rufus Adesoji; Akinsulore, Adesanmi; Awotidebe, Taofeek Oluwole; Idowu, Opeyemi Ayodiipo; Olaoye, Olumide Ayoola

2015-09-14

The Short-Form Health Survey (SF-36) is a valid quality of life tool often employed to determine the impact of medical intervention and the outcome of health care services. However, the SF-36 is culturally sensitive which necessitates its adaptation and translation into different languages. This study was conducted to cross-culturally adapt the SF-36 into Yoruba language and determine its reliability and validity. Based on the International Quality of Life Assessment project guidelines, a sequence of translation, test of item-scale correlation, and validation was implemented for the translation of the Yoruba version of the SF-36. Following pilot testing, the English and the Yoruba versions of the SF-36 were administered to a random sample of 1087 apparently healthy individuals to test validity and 249 respondents completed the Yoruba SF-36 again after two weeks to test reliability. Data was analyzed using Pearson's product moment correlation analysis, independent t-test, one-way analysis of variance, multi trait scaling analysis and Intra-Class Correlation (ICC) at p < 0.05. The concurrent validity scores for scales and domains ranges between 0.749 and 0.902 with the highest and lowest scores in the General Health (0.902) and Bodily Pain (0.749) scale. Scale-level descriptive result showed that all scale and domain scores had negative skewness ranging from -2.08 to -0.98. The mean scores for each scales ranges between 83.2 and 88.8. The domain scores for Physical Health Component and Mental Health Component were 85.6 ± 13.7 and 85.9 ± 15.4 respectively. The convergent validity was satisfactory, ranging from 0.421 to 0.907. Discriminant validity was also satisfactory except for item '1'. The ICC for the test-retest reliability of the Yoruba SF-36 ranges between 0.636 and 0.843 for scales; and 0.783 and 0.851 for domains. The data quality, concurrent and discriminant validity, reliability and internal consistency of the Yoruba version of the SF-36 are adequate and it is recommended for measuring health-related quality of life among Yoruba population.

Validity and Reliability of Accelerometers in Patients With COPD: A SYSTEMATIC REVIEW.

PubMed

Gore, Shweta; Blackwood, Jennifer; Guyette, Mary; Alsalaheen, Bara

2018-05-01

Reduced physical activity is associated with poor prognosis in chronic obstructive pulmonary disease (COPD). Accelerometers have greatly improved quantification of physical activity by providing information on step counts, body positions, energy expenditure, and magnitude of force. The purpose of this systematic review was to compare the validity and reliability of accelerometers used in patients with COPD. An electronic database search of MEDLINE and CINAHL was performed. Study quality was assessed with the Strengthening the Reporting of Observational Studies in Epidemiology checklist while methodological quality was assessed using the modified Quality Appraisal Tool for Reliability Studies. The search yielded 5392 studies; 25 met inclusion criteria. The SenseWear Pro armband reported high criterion validity under controlled conditions (r = 0.75-0.93) and high reliability (ICC = 0.84-0.86) for step counts. The DynaPort MiniMod demonstrated highest concurrent validity for step count using both video and manual methods. Validity of the SenseWear Pro armband varied between studies especially in free-living conditions, slower walking speeds, and with addition of weights during gait. A high degree of variability was found in the outcomes used and statistical analyses performed between studies, indicating a need for further studies to measure reliability and validity of accelerometers in COPD. The SenseWear Pro armband is the most commonly used accelerometer in COPD, but measurement properties are limited by gait speed variability and assistive device use. DynaPort MiniMod and Stepwatch accelerometers demonstrated high validity in patients with COPD but lack reliability data.

Validity and reliability of the Myotest accelerometric system for the assessment of vertical jump height.

PubMed

Casartelli, Nicola; Müller, Roland; Maffiuletti, Nicola A

2010-11-01

The aim of the present study was to verify the validity and reliability of the Myotest accelerometric system (Myotest SA, Sion, Switzerland) for the assessment of vertical jump height. Forty-four male basketball players (age range: 9-25 years) performed series of squat, countermovement and repeated jumps during 2 identical test sessions separated by 2-15 days. Flight height was simultaneously quantified with the Myotest system and validated photoelectric cells (Optojump). Two calculation methods were used to estimate the jump height from Myotest recordings: flight time (Myotest-T) and vertical takeoff velocity (Myotest-V). Concurrent validity was investigated comparing Myotest-T and Myotest-V to the criterion method (Optojump), and test-retest reliability was also examined. As regards validity, Myotest-T overestimated jumping height compared to Optojump (p < 0.001) with a systematic bias of approximately 7 cm, even though random errors were low (2.7 cm) and intraclass correlation coefficients (ICCs) where high (>0.98), that is, excellent validity. Myotest-V overestimated jumping height compared to Optojump (p < 0.001), with high random errors (>12 cm), high limits of agreement ratios (>36%), and low ICCs (<0.75), that is, poor validity. As regards reliability, Myotest-T showed high ICCs (range: 0.92-0.96), whereas Myotest-V showed low ICCs (range: 0.56-0.89), and high random errors (>9 cm). In conclusion, Myotest-T is a valid and reliable method for the assessment of vertical jump height, and its use is legitimate for field-based evaluations, whereas Myotest-V is neither valid nor reliable.

A French validation study of the Coma Recovery Scale-Revised (CRS-R).

PubMed

Schnakers, Caroline; Majerus, Steve; Giacino, Joseph; Vanhaudenhuyse, Audrey; Bruno, Marie-Aurelie; Boly, Melanie; Moonen, Gustave; Damas, Pierre; Lambermont, Bernard; Lamy, Maurice; Damas, Francois; Ventura, Manfredi; Laureys, Steven

2008-09-01

The aim of the present study was to explore the concurrent validity, inter-rater agreement and diagnostic sensitivity of a French adaptation of the Coma Recovery Scale-Revised (CRS-R) as compared to other coma scales such as the Glasgow Coma Scale (GCS), the Full Outline of UnResponsiveness scale (FOUR) and the Wessex Head Injury Matrix (WHIM). Multi-centric prospective study. To test concurrent validity and diagnostic sensitivity, the four behavioural scales were administered in a randomized order in 77 vegetative and minimally conscious patients. Twenty-four clinicians with different professional backgrounds, levels of expertise and CRS-R experience were recruited to assess inter-rater agreement. Good concurrent validity was obtained between the CRS-R and the three other standardized behavioural scales. Inter-rater reliability for the CRS-R total score and sub-scores was good, indicating that the scale yields reproducible findings across examiners and does not appear to be systematically biased by profession, level of expertise or CRS-R experience. Finally, the CRS-R demonstrated a significantly higher sensitivity to detect MCS patients, as compared to the GCS, the FOUR and the WHIM. The results show that the French version of the CRS-R is a valid and sensitive scale which can be used in severely brain damaged patients by all members of the medical staff.

Beliefs about the Consequences of Maternal Employment for Children.

ERIC Educational Resources Information Center

Greenberger, Ellen; And Others

1988-01-01

Developed a 24-item scale to measure Beliefs about the Consequences of Maternal Employment for Children, including beliefs about both benefits and costs. Demonstrated reliability and high convergent, divergent, and concurrent validity. Assessed sex-role traditionalism, women's employment status, work hours, age of child at which employment is…

Errors of Logic and Scholarship Concerning Dissociative Identity Disorder

ERIC Educational Resources Information Center

Ross, Colin A.

2009-01-01

The author reviewed a two-part critique of dissociative identity disorder published in the "Canadian Journal of Psychiatry". The two papers contain errors of logic and scholarship. Contrary to the conclusions in the critique, dissociative identity disorder has established diagnostic reliability and concurrent validity, the trauma histories of…

A Psychometric Evaluation of the Core Bereavement Items

ERIC Educational Resources Information Center

Holland, Jason M.; Nam, Ilsung; Neimeyer, Robert A.

2013-01-01

Despite being a routinely administered assessment of grieving, few studies have empirically examined the psychometric properties of the Core Bereavement Items (CBI). The present study investigated the factor structure, internal reliability, and concurrent validity of the CBI in a large, diverse sample of bereaved young adults (N = 1,366).…

Development and Initial Psychometrics of the Counselor Burnout Inventory

ERIC Educational Resources Information Center

Lee, Sang Min; Baker, Crystal R.; Cho, Seong Ho; Heckathorn, Danette E.; Holland, Michael W.; Newgent, Rebecca A.; Ogle, Nick T.; Powell, Michael L.; Quinn, James J.; Wallace, Sam L.; Yu, Kumlan

2007-01-01

This article describes the development and psychometric properties of the Counselor Burnout Inventory (CBI), which is designed to meet the needs of the counseling profession by assessing burnout in counselors. Factor structure, concurrent validity, internal consistency, and test-retest reliability of the CBI scores are reported. Implications for…

The Hong Kong version of the Oxford Cognitive Screen (HK-OCS): validation study for Cantonese-speaking chronic stroke survivors.

PubMed

Kong, Anthony Pak-Hin; Lam, Pinky Hiu-Ping; Ho, Diana Wai-Lam; Lau, Johnny King; Humphreys, Glyn W; Riddoch, Jane; Weekes, Brendan

2016-09-01

This study reports the validation of the Hong Kong version of Oxford Cognitive Screen (HK-OCS). Seventy Cantonese-speaking healthy individuals participated to establish normative data and 46 chronic stroke survivors were assessed using the HK-OCS, Albert's Test of Visual Neglect, short test of gestural production, and Hong Kong version of the following assessments: Western Aphasia Battery, MMSE, MoCA, Modified Barthel Index, and Lawton Instrumental Activities of Daily Living scale. The validity of the HK-OCS was appraised by the difference between the two participant groups. Neurologically unimpaired individuals performed significantly better than stroke survivors on the HK-OCS. Positive and significant correlations found between cognitive subtests in the HK-OCS and related assessments indicated good concurrent validity. Excellent intra-rater and inter-rater reliabilities, fair test-retest reliability, and acceptable internal consistency suggested that the HK-OCS had good reliability. Specific HK-OCS subtests including semantics, episodic memory, number writing, and orientation were the best predictors of functional outcomes.

Reliability and Concurrent Validity of the Narrow Path Walking Test in Persons With Multiple Sclerosis.

PubMed

Rosenblum, Uri; Melzer, Itshak

2017-01-01

About 90% of people with multiple sclerosis (PwMS) have gait instability and 50% fall. Reliable and clinically feasible methods of gait instability assessment are needed. The study investigated the reliability and validity of the Narrow Path Walking Test (NPWT) under single-task (ST) and dual-task (DT) conditions for PwMS. Thirty PwMS performed the NPWT on 2 different occasions, a week apart. Number of Steps, Trial Time, Trial Velocity, Step Length, Number of Step Errors, Number of Cognitive Task Errors, and Number of Balance Losses were measured. Intraclass correlation coefficients (ICC2,1) were calculated from the average values of NPWT parameters. Absolute reliability was quantified from standard error of measurement (SEM) and smallest real difference (SRD). Concurrent validity of NPWT with Functional Reach Test, Four Square Step Test (FSST), 12-item Multiple Sclerosis Walking Scale (MSWS-12), and 2 Minute Walking Test (2MWT) was determined using partial correlations. Intraclass correlation coefficients (ICCs) for most NPWT parameters during ST and DT ranged from 0.46-0.94 and 0.55-0.95, respectively. The highest relative reliability was found for Number of Step Errors (ICC = 0.94 and 0.93, for ST and DT, respectively) and Trial Velocity (ICC = 0.83 and 0.86, for ST and DT, respectively). Absolute reliability was high for Number of Step Errors in ST (SEM % = 19.53%) and DT (SEM % = 18.14%) and low for Trial Velocity in ST (SEM % = 6.88%) and DT (SEM % = 7.29%). Significant correlations for Number of Step Errors and Trial Velocity were found with FSST, MSWS-12, and 2MWT. In persons with PwMS performing the NPWT, Number of Step Errors and Trial Velocity were highly reliable parameters. Based on correlations with other measures of gait instability, Number of Step Errors was the most valid parameter of dynamic balance under the conditions of our test.Video Abstract available for more insights from the authors (see Supplemental Digital Content 1, available at: http://links.lww.com/JNPT/A159).

A Structured Clinical Interview for Kleptomania (SCI-K): preliminary validity and reliability testing.

PubMed

Grant, Jon E; Kim, Suck Won; McCabe, James S

2006-06-01

Kleptomania presents difficulties in diagnosis for clinicians. This study aimed to develop and test a DSM-IV-based diagnostic instrument for kleptomania. To assess for current kleptomania the Structured Clinical Interview for Kleptomania (SCI-K) was administered to 112 consecutive subjects requesting psychiatric outpatient treatment for a variety of disorders. Reliability and validity were determined. Classification accuracy was examined using the longitudinal course of illness. The SCI-K demonstrated excellent test-retest (Phi coefficient = 0.956 (95% CI = 0.937, 0.970)) and inter-rater reliability (phi coefficient = 0.718 (95% CI = 0.506, 0.848)) in the diagnosis of kleptomania. Concurrent validity was observed with a self-report measure using DSM-IV kleptomania criteria (phi coefficient = 0.769 (95% CI = 0.653, 0.850)). Discriminant validity was observed with a measure of depression (point biserial coefficient = -0.020 (95% CI = -0.205, 0.166)). The SCI-K demonstrated both high sensitivity and specificity based on longitudinal assessment. The SCI-K demonstrated excellent reliability and validity in diagnosing kleptomania in subjects presenting with various psychiatric problems. These findings require replication in larger groups, including non-psychiatric populations, to examine their generalizability. Copyright (c) 2006 John Wiley & Sons, Ltd.

Development of the Teen Oral Health-Related Quality of Life Instrument.

PubMed

Wright, Wanda G; Spiro, Avron; Jones, Judith A; Rich, Sharron E; Garcia, Raul I

2017-03-01

The aim of this study was to develop the Teen Oral Health-Related Quality of Life instrument (TOQOL) and demonstrate its validity and reliability in a diverse sample of 13-18-year-old adolescents. A total of 363 adolescents aged 13-18 years participated in this cross sectional study. Oral screening examinations were conducted to collect oral health status data. Adolescents completed the TOQOL and a generic measure of health-related quality of life, the PedsQL. The psychometric properties of the TOQOL were evaluated in terms of face, content, convergent, concurrent and discriminant validity in addition to internal reliability. The 16-item TOQOL covers five domains: Physical functioning, Role functioning, Social functioning, Oral problems, and Emotional functioning. The total scale and subscales showed satisfactory reliability with Cronbach alpha ranging from 0.75 to 0.92. TOQOL scores showed significant associations with perceived oral health status and the PedsQL (convergent validity) and discriminated well between adolescents with caries and adolescents who were caries free (discriminate validity). The TOQOL is a valid and reliable oral health-related quality of life measurement that can be recommended for self-report in adolescents aged 13-18 years. © 2016 American Association of Public Health Dentistry.

Validity and reliability of the Turkish version of the DSM-5 Generalized Anxiety Disorder Severity Scale for children aged 11–17 years

PubMed

Yalın Sapmaz, Şermin; Özek Erkuran, Handan; Ergin, Dilek; Öztürk, Masum; Şen Celasin, Nesrin; Karaarslan, Duygu; Aydemir, Ömer

2018-02-23

Background/aim: This study aimed to assess the validity and reliability of the Turkish version of the DSM-5 Generalized Anxiety Disorder Severity Scale - Child Form. Materials and methods: The study sample consisted of 32 patients treated in a child psychiatry unit and diagnosed with generalized anxiety disorder and 98 healthy volunteers who were attending middle or high school during the study period. For the assessment, the Screen for Child Anxiety and Related Emotional Disorders (SCARED) was also used along with the DSM-5 Generalized Anxiety Disorder Severity Scale - Child Form. Results: Regarding reliability analyses, the Cronbach alpha internal consistency coefficient was calculated as 0.932. The test-retest correlation coefficient was calculated as r = 0.707. As for construct validity, one factor that could explain 62.6% of the variance was obtained and this was consistent with the original construct of the scale. As for concurrent validity, the scale showed a high correlation with SCARED. Conclusion: It was concluded that Turkish version of the DSM-5 Generalized Anxiety Disorder Severity Scale - Child Form could be utilized as a valid and reliable tool both in clinical practice and for research purposes.

The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function.

PubMed

Wolf, Timothy J; Dahl, Abigail; Auen, Colleen; Doherty, Meghan

2017-07-01

The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889-.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p = -.425), and the Wechsler Test of Adult Reading (p  = -.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = .007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.

Test-retest reliability and concurrent validity of in vivo myelin content indices: Myelin water fraction and calibrated T1 w/T2 w image ratio.

PubMed

Arshad, Muzamil; Stanley, Jeffrey A; Raz, Naftali

2017-04-01

In an age-heterogeneous sample of healthy adults, we examined test-retest reliability (with and without participant repositioning) of two popular MRI methods of estimating myelin content: modeling the short spin-spin (T 2 ) relaxation component of multi-echo imaging data and computing the ratio of T 1 -weighted and T 2 -weighted images (T 1 w/T 2 w). Taking the myelin water fraction (MWF) index of myelin content derived from the multi-component T 2 relaxation data as a standard, we evaluate the concurrent and differential validity of T 1 w/T 2 w ratio images. The results revealed high reliability of MWF and T 1 w/T 2 w ratio. However, we found significant correlations of low to moderate magnitude between MWF and the T 1 w/T 2 w ratio in only two of six examined regions of the cerebral white matter. Notably, significant correlations of the same or greater magnitude were observed for T 1 w/T 2 w ratio and the intermediate T 2 relaxation time constant, which is believed to reflect differences in the mobility of water between the intracellular and extracellular compartments. We conclude that although both methods are highly reliable and thus well-suited for longitudinal studies, T 1 w/T 2 w ratio has low criterion validity and may be not an optimal index of subcortical myelin content. Hum Brain Mapp 38:1780-1790, 2017. © 2017 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Reliability and validity of the visual analogue scale for disability in patients with chronic musculoskeletal pain.

PubMed

Boonstra, Anne M; Schiphorst Preuper, Henrica R; Reneman, Michiel F; Posthumus, Jitze B; Stewart, Roy E

2008-06-01

To determine the reliability and concurrent validity of a visual analogue scale (VAS) for disability as a single-item instrument measuring disability in chronic pain patients was the objective of the study. For the reliability study a test-retest design and for the validity study a cross-sectional design was used. A general rehabilitation centre and a university rehabilitation centre was the setting for the study. The study population consisted of patients over 18 years of age, suffering from chronic musculoskeletal pain; 52 patients in the reliability study, 344 patients in the validity study. Main outcome measures were as follows. Reliability study: Spearman's correlation coefficients (rho values) of the test and retest data of the VAS for disability; validity study: rho values of the VAS disability scores with the scores on four domains of the Short-Form Health Survey (SF-36) and VAS pain scores, and with Roland-Morris Disability Questionnaire scores in chronic low back pain patients. Results were as follows: in the reliability study rho values varied from 0.60 to 0.77; and in the validity study rho values of VAS disability scores with SF-36 domain scores varied from 0.16 to 0.51, with Roland-Morris Disability Questionnaire scores from 0.38 to 0.43 and with VAS pain scores from 0.76 to 0.84. The conclusion of the study was that the reliability of the VAS for disability is moderate to good. Because of a weak correlation with other disability instruments and a strong correlation with the VAS for pain, however, its validity is questionable.

Reliability and validity assessment of gastrointestinal dystemperaments questionnaire: a novel scale in Persian traditional medicine

PubMed Central

Hoseinzadeh, Hamidreza; Taghipour, Ali; Yousefi, Mahdi

2018-01-01

Background Development of a questionnaire based on the resources of Persian traditional medicine seems necessary. One of the problems faced by practitioners of traditional medicine is the different opinions regarding the diagnosis of general temperament or temperament of member. One of the reasons is the lack of validity tools, and it has led to difficulties in training the student of traditional medicine and the treatment of patients. The differences in the detection methods, have given rise to several treatment methods. Objective The present study aimed to develop a questionnaire and standard software for diagnosis of gastrointestinal dystemperaments. Methods The present research is a tool developing study which included 8 stages of developing the items, determining the statements based on items, assessing the face validity, assessing the content validity, assessing the reliability, rating the items, developing a software for calculation of the total score of the questionnaire named GDS v.1.1, and evaluating the concurrent validity using statistical tests including Cronbach’s alpha coefficient, Cohen’s kappa coefficient. Results Based on the results, 112 notes including 62 symptoms were extracted from resources, and 58 items were obtained from in-person interview sessions with a panel of experts. A statement was selected for each item and, after merging a number of statements, a total of 49 statements were finally obtained. By calculating the score of statement impact and determining the content validity, respectively, 6 and 10 other items were removed from the list of statements. Standardized Cronbach’s alpha for this questionnaire was obtained 0.795 and its concurrent validity was equal to 0.8. Conclusion A quantitative tool was developed for diagnosis and examination of gastrointestinal dystemperaments. The developed questionnaire is adequately reliable and valid for this purpose. In addition, the software can be used for clinical diagnosis. PMID:29629060

Characteristics of Residual Symptoms in Korean Patients with Major Depressive Disorder: A Validation Study for the Korean Version of Depression Residual Symptom Scale.

PubMed

Park, Sol A; Jeon, Sang Won; Yoon, Ho-Kyoung; Yoon, Seo Young; Shin, Cheolmin; Ko, Young-Hoon

2018-02-01

Residual symptoms of depression are related to more severe and chronic course of functional impairment with higher risk of relapse. The objective of this study was to validate, and determine psychometric properties of the Korean version of Depression Residual Symptom Scale (KDRSS). A total of 203 outpatients with recent episode of major depression based on DSM-IV criteria were enrolled in this study. They had been treated with antidepressants and assessed by KDRSS, Hamilton Depression Rating Scale-24 (HDRS-24), and Montgomery-Åsberg Depression Rating Scale (MARDS). The validity and reliability of KDRSS were assessed, including internal consistency reliability, concurrent validity, temporal stability, factorial validity, and discriminative validity. Internal consistency (Cronbach's alpha=0.961), concurrent validity (MADRS: r=0.731, p<0.01, HDRS-24: r=0.663, p<0.01), and temporal stability (r=0.726, p<0.01) of KDRSS were all excellent. KDRSS showed good discriminative validity based on MARDS. KDRSS consisted of one-factor structure accounting for 63.8% of total variance. All subjects except two in full remission group had one or more residual symptoms. In 7 subscales of KDRSS consisting of similar items respectively, 'lack of energy' was the most commonly reported, followed by 'increased emotionalism' in this group. KDRSS is a useful and sensitive instrument for measuring residual depressive symptoms. Since some depressive symptoms including 'lack of energy' and 'increased emotionalism' in patients with full remission might be persistent during psychiatric intervention, these symptoms need to be focused on in clinical practice.

Recent status scores for version 6 of the Addiction Severity Index (ASI-6).

PubMed

Cacciola, John S; Alterman, Arthur I; Habing, Brian; McLellan, A Thomas

2011-09-01

To describe the derivation of recent status scores (RSSs) for version 6 of the Addiction Severity Index (ASI-6). 118 ASI-6 recent status items were subjected to nonparametric item response theory (NIRT) analyses followed by confirmatory factor analysis (CFA). Generalizability and concurrent validity of the derived scores were determined. A total of 607 recent admissions to variety of substance abuse treatment programs constituted the derivation sample; a subset (n = 252) comprised the validity sample. The ASI-6 interview and a validity battery of primarily self-report questionnaires that included at least one measure corresponding to each of the seven ASI domains were administered. Nine summary scales describing recent status that achieved or approached both high scalability and reliability were derived; one scale for each of six areas (medical, employment/finances, alcohol, drug, legal, psychiatric) and three scales for the family/social area. Intercorrelations among the RSSs also supported the multi-dimensionality of the ASI-6. Concurrent validity analyses yielded strong evidence supporting the validity of six of the RSSs (medical, alcohol, drug, employment, family/social problems, psychiatric). Evidence was weaker for the legal, family/social support and child problems RSSs. Generalizability analyses of the scales to males versus females and whites versus blacks supported the comparability of the findings, with slight exceptions. The psychometric analyses to derive Addiction Severity Index version 6 recent status scores support the multi-dimensionality of the Addiction Severity Index version 6 (i.e. the relative independence of different life functioning areas), consistent with research on earlier editions of the instrument. In general, the Addiction Severity Index version 6 scales demonstrate acceptable scalability, reliability and concurrent validity. While questions remain about the generalizability of some scales to population subgroups, the overall findings coupled with updated and more extensive content in the Addiction Severity Index version 6 support its use in clinical practice and research. © 2011 The Authors, Addiction © 2011 Society for the Study of Addiction.

Recent Status Scores for Version 6 of the Addiction Severity Index (ASI-6)

PubMed Central

Cacciola, John S.; Alterman, Arthur I; Habing, Brian; McLellan, A. Thomas

2012-01-01

Aims To describe the derivation of Recent Status Scores (RSSs) for Version 6 of the Addiction Severity Index (ASI-6). Design 118 ASI-6 recent status items were subjected to nonparametric item response theory (NIRT) analyses followed by confirmatory factor analysis (CFA). Generalizability and concurrent validity of the derived scores were determined. Setting and Participants 607 recent admissions to variety of substance abuse treatment programs constituted the derivation sample; a subset (N = 254) comprised the validity sample. Measurements The ASI-6 interview and a validity battery of primarily self-report questionnaires that included at least one measure corresponding to each of the seven ASI domains were administered. Findings Nine summary scales describing recent status that achieved or approached both high scalability and reliability were derived; one scale for each of six areas (medical, employment/finances, alcohol, drug, legal, psychiatric), and three scales for the family/social area. Intercorrelations among the RSSs also supported the multidimensionality of the ASI-6. Concurrent validity analyses yielded strong evidence supporting the validity of the six of the RSSs (Medical, Alcohol, Drug, Employment, Family/Social Problems, Psychiatric). Evidence was weaker for the Legal, Family/Social Support and Child Problems RSSs. Generalizability analyses of the scales to males versus females and whites versus blacks supported the comparability of the findings with slight exceptions. Conclusions The psychometric analyses to derive Addiction Severity Index-6 Recent Status Scores (RSSs) support the multidimensionality of the ASI-6 (i.e., the relative independence of different life functioning areas), consistent with research on earlier editions of the instrument. In general, the ASI-6 scales demonstrate acceptable scalability, reliability and concurrent validity. While questions remain about the generalizability of some scales to population subgroups, the overall findings coupled with updated and more extensive content in the ASI-6 support its use in clinical practice and research. PMID:21545666

The validity and clinical utility of purging disorder.

PubMed

Keel, Pamela K; Striegel-Moore, Ruth H

2009-12-01

To review evidence of the validity and clinical utility of Purging Disorder and examine options for the Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-V). Articles were identified by computerized and manual searches and reviewed to address five questions about Purging Disorder: Is there "ample" literature? Is the syndrome clearly defined? Can it be measured and diagnosed reliably? Can it be differentiated from other eating disorders? Is there evidence of syndrome validity? Although empirical classification and concurrent validity studies provide emerging support for the distinctiveness of Purging Disorder, questions remain about definition, diagnostic reliability in clinical settings, and clinical utility (i.e., prognostic validity). We discuss strengths and weaknesses associated with various options for the status of Purging Disorder in the DSM-V ranging from making no changes from DSM-IV to designating Purging Disorder a diagnosis on equal footing with Anorexia Nervosa and Bulimia Nervosa.

Validation of an Empathy Scale in Pharmacy and Nursing Students

PubMed Central

Chen, Aleda M. H.; Yehle, Karen S.; Plake, Kimberly S.

2013-01-01

Objective. To validate an empathy scale to measure empathy in pharmacy and nursing students. Methods. A 15-item instrument comprised of the cognitive and affective empathy domains, was created. Each item was rated using a 7-point Likert scale, ranging from strongly disagree to strongly agree. Concurrent validity was demonstrated with the Jefferson Scale of Empathy – Health Professional Students (JSE-HPS). Results. Reliability analysis of data from 216 students (pharmacy, N=158; nursing, N=58) showed that scores on the empathy scale were positively associated with JSE-HPS scores (p<0.001). Factor analysis confirmed that 14 of the 15 items were significantly associated with their respective domain, but the overall instrument had limited goodness of fit. Conclusions. Results of this study demonstrate the reliability and validity of a new scale for evaluating student empathy. Further testing of the scale at other universities is needed to establish validity. PMID:23788805

Maternal sensitivity and attachment security in Thailand: cross-cultural validation of Western measures.

PubMed

Chaimongkol, Nujjaree N; Flick, Louise H

2006-01-01

The purpose of this study was to examine the psychometric properties of Thai versions of the Maternal Behavior Q-Sort (MBQS), Caldwell's HOME, and the Attachment Q-set (AQS). A sample of 110 Thai mother-infant dyads were studied. The Content Validity Index (CVIs) of the Thai MBQS, HOME and AQS were between 91% and 99%. Internal consistency of the HOME was .71. Interobserver reliability of the MBQS, HOME, and AQS were .95, .87, and .87, respectively. Convergent validity was supported by finding a positive correlation between the MBQS and the HOME (r = .29, p < .001). A positive correlation of .45 (p < .001) between the scores of the MBQS and the AQS indicated concurrent validity of these scales. Study findings indicate the Thai MBQS, HOME, and AQS are reliable and valid in this Thai sample and suggest that the Thai versions reflect concepts similar to those in the original English versions.

Assessing cancer-specific anxiety in Chinese men with prostate cancer: psychometric evaluation of the Chinese version of the Memorial Anxiety Scale for Prostate Cancer (MAX-PC).

PubMed

Huang, Qingmei; Jiang, Ping; Zhang, Zijun; Luo, Jie; Dai, Yun; Zheng, Li; Wang, Wei

2017-12-01

The Memorial Anxiety Scale for Prostate Cancer (MAX-PC) was developed to identify and assess cancer-specific anxiety among men with prostate cancer (PCa); however, there is no Chinese version. The aim of our study was to translate the English version of MAX-PC into Chinese and evaluate the psychometric properties of it. The study cohort comprised 254 participants. Internal consistency including the Cronbach's alpha coefficient and item-total correlations were used to measure the reliability of the scale. Factor structure was analyzed by exploratory factor analysis and concurrent validity by comparing MAX-PC scores with anxiety subscale scores of the Hospital Anxiety and Depression Scale (HADS). Divergent validity was assessed by correlating MAX-PC with HADS depression subscale, while discriminant ability by comparing differences in MAX-PC scores between different patient groups. The Chinese version of MAX-PC demonstrated good reliability; the Cronbach's alpha coefficient for the total and three subscales (prostate cancer anxiety, PSA anxiety, and fear of recurrence) being 0.94, 0.93, 0.82, and 0.85, respectively. Exploratory factor analysis supported the three-factor structure of the scale established in the original version. Despite the somewhat underperformed divergent validity, the scale demonstrated good concurrent validity with a strong correlation with the HADS anxiety subscale (r = 0.71, p < 0.01). Moreover, discriminant ability was demonstrated by ability to differentiate between disease stages. The MAX-PC Chinese version was confirmed to be a valid, reliable instrument and is thus appropriate for identifying and quantifying cancer-specific anxiety in Chinese PCa patients.

Development and psychometric testing of the active aging scale for Thai adults.

PubMed

Thanakwang, Kattika; Isaramalai, Sang-Arun; Hatthakit, Urai

2014-01-01

Active aging is central to enhancing the quality of life for older adults, but its conceptualization is not often made explicit for Asian elderly people. Little is known about active aging in older Thai adults, and there has been no development of scales to measure the expression of active aging attributes. The aim of this study was to develop a culturally relevant composite scale of active aging for Thai adults (AAS-Thai) and to evaluate its reliability and validity. EIGHT STEPS OF SCALE DEVELOPMENT WERE FOLLOWED: 1) using focus groups and in-depth interviews, 2) gathering input from existing studies, 3) developing preliminary quantitative measures, 4) reviewing for content validity by an expert panel, 5) conducting cognitive interviews, 6) pilot testing, 7) performing a nationwide survey, and 8) testing psychometric properties. In a nationwide survey, 500 subjects were randomly recruited using a stratified sampling technique. Statistical analyses included exploratory factor analysis, item analysis, and measures of internal consistency, concurrent validity, and test-retest reliability. Principal component factor analysis with varimax rotation resulted in a final 36-item scale consisting of seven factors of active aging: 1) being self-reliant, 2) being actively engaged with society, 3) developing spiritual wisdom, 4) building up financial security, 5) maintaining a healthy lifestyle, 6) engaging in active learning, and 7) strengthening family ties to ensure care in later life. These factors explained 69% of the total variance. Cronbach's alpha coefficient for the overall AAS-Thai was 0.95 and varied between 0.81 and 0.91 for the seven subscales. Concurrent validity and test-retest reliability were confirmed. The AAS-Thai demonstrated acceptable overall validity and reliability for measuring the multidimensional attributes of active aging in a Thai context. This newly developed instrument is ready for use as a screening tool to assess active aging levels among older Thai adults in both community and clinical practice settings.

Reliability, Validity, and Responsiveness of the QuickDASH in Patients With Upper Limb Amputation.

PubMed

Resnik, Linda; Borgia, Matthew

2015-09-01

To examine the internal consistency, test-retest reliability, validity, and responsiveness of the shortened version of the Disabilities of the Arm, Shoulder and Hand (QuickDASH) questionnaire in persons with upper limb amputation. Cross-sectional and longitudinal. Three sites participating in the U.S. Department of Veterans Affairs Home Study of the DEKA Arm. A convenience sample of upper limb amputees (N=44). Training with a multifunction upper limb prosthesis. Multiple outcome measures including the QuickDASH were administered twice within 1 week, and for a subset of 20 persons, after completion of in-laboratory training with the DEKA Arm. Scale alphas and intraclass correlation coefficient type 3,1 (ICC3,1) were used to examine reliability. Minimum detectable change (MDC) scores were calculated. Analyses of variance, comparing QuickDASH scores by the amount of prosthetic use and amputation level, were used for known-group validity analyses with alpha set at .05. Pairwise correlations between QuickDASH and other measures were used to examine concurrent validity. Responsiveness was measured by effect size (ES) and standardized response mean (SRM). QuickDASH alpha was .83, and ICC was .87 (95% confidence interval, .77-.93). MDC at the 95% confidence level (MDC95%) was 17.4. Full- or part-time prosthesis users had better QuickDASH scores compared with nonprosthesis users (P=.021), as did those with more distal amputations at both baseline (P=.042) and with the DEKA Arm (P=.024). The QuickDASH was correlated with concurrent measures of activity limitation as expected. The ES and SRM after training with the DEKA Arm were 0.6. This study provides evidence of reliability and validity of the QuickDASH in persons with upper limb amputation. Results provide preliminary evidence of responsiveness to prosthetic device type/training. Further research with a larger sample is needed to confirm results. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric properties of the medical outcomes study sleep scale in Spanish postmenopausal women.

PubMed

Zagalaz-Anula, Noelia; Hita-Contreras, Fidel; Martínez-Amat, Antonio; Cruz-Díaz, David; Lomas-Vega, Rafael

2017-07-01

This study aimed to analyze the reliability and validity of the Spanish version of the Medical Outcomes Study Sleep Scale (MOS-SS), and its ability to discriminate between poor and good sleepers among a Spanish population with vestibular disorders. In all, 121 women (50-76 years old) completed the Spanish version of the MOS-SS. Internal consistency, test-retest reliability, and construct validity (exploratory factor analysis) were analyzed. Concurrent validity was evaluated using the Pittsburgh Sleep Quality Index and the 36-item Short Form Health Survey. To analyze the ability of the MOS-SS scores to discriminate between poor and good sleepers, a receiver-operating characteristic curve analysis was performed. The Spanish version of the MOS-SS showed excellent and substantial reliability in Sleep Problems Index I (two sleep disturbance items, one somnolence item, two sleep adequacy items, and awaken short of breath or with headache) and Sleep Problems Index II (four sleep disturbance items, two somnolence items, two sleep adequacy items, and awaken short of breath or with headache), respectively, and good internal consistency with optimal Cronbach's alpha values in all domains and indexes (0.70-0.90). Factor analysis suggested a coherent four-factor structure (explained variance 70%). In concurrent validity analysis, MOS-SS indexes showed significant and strong correlation with the Pittsburgh Sleep Quality Index total score, and moderate with the 36-item Short Form Health Survey component summaries. Several domains and the two indexes were significantly able to discriminate between poor and good sleepers (P < 0.05). Optimal cut-off points were above 20 for "sleep disturbance" domain, with above 22.22 and above 33.33 for Sleep Problems Index I and II. The Spanish version of the MOS-SS is a valid and reliable instrument, suitable to assess sleep quality in Spanish postmenopausal women, with satisfactory general psychometric properties. It discriminates well between good and poor sleepers.

Assessing medical students' perceptions of patient safety: the medical student safety attitudes and professionalism survey.

PubMed

Liao, Joshua M; Etchegaray, Jason M; Williams, S Tyler; Berger, David H; Bell, Sigall K; Thomas, Eric J

2014-02-01

To develop and test the psychometric properties of a survey to measure students' perceptions about patient safety as observed on clinical rotations. In 2012, the authors surveyed 367 graduating fourth-year medical students at three U.S. MD-granting medical schools. They assessed the survey's reliability and construct and concurrent validity. They examined correlations between students' perceptions of organizational cultural factors, organizational patient safety measures, and students' intended safety behaviors. They also calculated percent positive scores for cultural factors. Two hundred twenty-eight students (62%) responded. Analyses identified five cultural factors (teamwork culture, safety culture, error disclosure culture, experiences with professionalism, and comfort expressing professional concerns) that had construct validity, concurrent validity, and good reliability (Cronbach alphas > 0.70). Across schools, percent positive scores for safety culture ranged from 28% (95% confidence interval [CI], 13%-43%) to 64% (30%-98%), while those for teamwork culture ranged from 47% (32%-62%) to 74% (66%-81%). They were low for error disclosure culture (range: 10% [0%-20%] to 27% [20%-35%]), experiences with professionalism (range: 7% [0%-15%] to 23% [16%-30%]), and comfort expressing professional concerns (range: 17% [5%-29%] to 38% [8%-69%]). Each cultural factor correlated positively with perceptions of overall patient safety as observed in clinical rotations (r = 0.37-0.69, P < .05) and at least one safety behavioral intent item. This study provided initial evidence for the survey's reliability and validity and illustrated its applicability for determining whether students' clinical experiences exemplify positive patient safety environments.

Adaptation and psychometric assessment of the Hebrew version of the Recovery Promoting Relationships Scale (RPRS).

PubMed

Moran, Galia S; Zisman-Ilani, Yaara; Garber-Epstein, Paula; Roe, David

2014-03-01

Recovery is supported by relationships that are characterized by human centeredness, empowerment and a hopeful approach. The Recovery Promoting Relationships Scale (RPRS; Russinova, Rogers, & Ellison, 2006) assesses consumer-provider relationships from the consumer perspective. Here we present the adaptation and psychometric assessment of a Hebrew version of the RPRS. The RPRS was translated to Hebrew (RPRS-Heb) using multiple strategies to assure conceptual soundness. Then 216 mental health consumers were administered the RPRS-Heb as part of a larger project initiative implementing illness management and recovery intervention (IMR) in community settings. Psychometric testing included assessment of the factor structure, reliability, and validity using the Hope Scale, the Working Alliance Inventory, and the Recovery Assessment Scale. The RPRS-Heb factor structure replicated the two factor structures found in the original scale with minor exceptions. Reliability estimates were good: Cronbach's alpha for the total scale was 0.94. An estimate of 0.93 for the Recovery-Promoting Strategies factor, and 0.86 for the Core Relationship. Concurrent validity was confirmed using the Working Alliance Scale (rp = .51, p < .001) and the Hope Scale (rp = .43, p < .001). Criterion validity was examined using the Recovery Assessment Scale (rp = .355, p < .05). The study yielded a 23-item RPRS-Heb version with a psychometrically sound factor structure, satisfactory reliability, and concurrent validity tested against the Hope, Alliance, and Recovery Assessment scales. Outcomes are discussed in the context of the original scale properties and a similar Dutch initiative. The RPRS-Heb can serve as a valuable tool for studying recovery promoting relationships with Hebrew speaking population.

Family Self-Efficacy for Diabetes Management: Psychometric Testing.

PubMed

Mcewen, Marylyn M; Pasvogel, Alice; Murdaugh, Carolyn L

2016-01-01

Type 2 diabetes mellitus (T2DM) self-management among Hispanic adults occurs in a family context. Self-efficacy (SE) affects T2DM self-management behaviors; however, no instruments are available to measure family diabetes self-efficacy. The study's purpose was to test the psychometric properties of the Family Self-Efficacy for Diabetes Scale (FSE). Family members (n = 113) of adults with T2DM participated. Psychometric analysis included internal consistency reliability and concurrent and construct validity. Internal consistency reliability was .86. Items loaded on 2 factors, Family SE for Supporting Healthy Behaviors and Family SE for Supporting General Health, accounting for 71% of the variance. FSE correlated significantly with 3 diabetes-related instruments. The FSE is a reliable and valid instrument. Further testing is needed in diverse populations and geographic areas.

The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.

PubMed

Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan

2017-12-25

The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P < 0.05). Discriminative validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P < 0.001). The VCDQ was cross-culturally adapted to Persian and demonstrated to be a valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Development and validation of the occupational identity scale.

PubMed

Melgosa, J

1987-12-01

Ego-identity research utilizing Marcia's (1966) identity statuses has been prolific during the past 15 years. The four types of statuses--achievement, moratorium, foreclosure, diffusion--have become part of the ego-identity development theory. The development of a research tool to study further one of the dimensions of ego-identity development (occupational dimension) was perceived as a need. Therefore, items were created utilizing the criteria established by previous research and content validated by a group of experts. These statements were validated by 417 students from six high schools and colleges. Responses were analyzed and measures of construct and concurrent validity were obtained. Also indexes of internal consistency and item discrimination were estimated. Through factor analysis techniques, four factors were identified for the occupational identity statuses. They accounted for 49 per cent of the total variance. Reliability coefficients ranged between 0.70 and 0.87. Concurrent validity coefficients ranged between 0.38 and 0.79, when correlated with a similar instrument. After deletion of those items that did not contribute significantly to the validity of the instrument, a 28-item Occupational Identity Scale was established.

Which symptom assessments and approaches are uniquely appropriate for paediatric concussion?

PubMed

Gioia, G A; Schneider, J C; Vaughan, C G; Isquith, P K

2009-05-01

To (a) identify post-concussion symptom scales appropriate for children and adolescents in sports; (b) review evidence for reliability and validity; and (c) recommend future directions for scale development. Quantitative and qualitative literature review of symptom rating scales appropriate for children and adolescents aged 5 to 22 years. Literature identified via search of Medline, Ovid-Medline and PsycInfo databases; review of reference lists in identified articles; querying sports concussion specialists. 29 articles met study inclusion criteria. 5 symptom scales examined in 11 studies for ages 5-12 years and in 25 studies for ages 13-22. 10 of 11 studies for 5-12-year-olds presented validity evidence for three scales; 7 studies provided reliability evidence for two scales; 7 studies used serial administrations but no reliable change metrics. Two scales included parent-reports and one included a teacher report. 24 of 25 studies for 13-22 year-olds presented validity evidence for five measures; seven studies provided reliability evidence for four measures with 18 studies including serial administrations and two examining Reliable Change. Psychometric evidence for symptom scales is stronger for adolescents than for younger children. Most scales provide evidence of concurrent validity, discriminating concussed and non-concussed groups. Few report reliability and evidence for validity is narrow. Two measures include parent/teacher reports. Few scales examine reliable change statistics, limiting interpretability of temporal changes. Future studies are needed to fully define symptom scale psychometric properties with the greatest need in younger student-athletes.

The TiltMeter app is a novel and accurate measurement tool for the weight bearing lunge test.

PubMed

Williams, Cylie M; Caserta, Antoni J; Haines, Terry P

2013-09-01

The weight bearing lunge test is increasing being used by health care clinicians who treat lower limb and foot pathology. This measure is commonly established accurately and reliably with the use of expensive equipment. This study aims to compare the digital inclinometer with a free app, TiltMeter on an Apple iPhone. This was an intra-rater and inter-rater reliability study. Two raters (novice and experienced) conducted the measurements in both a bent knee and straight leg position to determine the intra-rater and inter-rater reliability. Concurrent validity was also established. Allied health practitioners were recruited as participants from the workplace. A preconditioning stretch was conducted and the ankle range of motion was established with the weight bearing lunge test position with firstly the leg straight and secondly with the knee bent. The measurement device and each participant were randomised during measurement. The intra-rater reliability and inter-rater reliability for the devices and in both positions were all over ICC 0.8 except for one intra-rater measure (Digital inclinometer, novice, ICC 0.65). The inter-rater reliability between the digital inclinometer and the tilmeter was near perfect, ICC 0.96 (CI: 0.898-0.983); Concurrent validity ICC between the two devices was 0.83 (CI: -0.740 to 0.445). The use of the Tiltmeter app on the iPhone is a reliable and inexpensive tool to measure the available ankle range of motion. Health practitioners should use caution in applying these findings to other smart phone equipment if surface areas are not comparable. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

The development and validation of a carer questionnaire to assess cognitive function in neuropsychiatric patients.

PubMed

Randhawa, Sharan; Walterfang, Mark; Miller, Kathryn; Scholes, Amelia; Mocellin, Ramon; Velakoulis, Dennis

2007-07-01

The carer history is an integral part of the assessment of patients with cognitive impairment. We aimed to develop a comprehensive yet concise carer questionnaire, the CogRisk, which captures actuarial risk variables for cognitive impairment in addition to key symptoms suggestive of cognitive decline in a number of cognitive domains, and to then assess its validity and reliability in a neuropsychiatric population. Carers of patients assessed for cognitive impairment completed the CogRisk, and patients were clinically assessed using the Mini-Mental State Examination (MMSE) and Neuropsychiatry Unit COGnitive assessment tool (NUCOG). Reliability was assessed using test-retest and interrater measures and measures of internal consistency. Construct and concurrent validity was assessed using correlation between total and subscale scores on the CogRisk, total scores on the NUCOG and MMSE, and subscale scores on the NUCOG. Predictive validity was determined using measures of sensitivity and specificity and using receiver operating characteristic (ROC) methods. The CogRisk was completed by all carers in less than 10 min. The total CogRisk score correlated significantly with total MMSE and NUCOG scores (r=-0.511 and -0.563, respectively) and remained highly significant when age and education were controlled for. Internal consistency of CogRisk items was high (alpha=0.943). Intrarater reliability of the CogRisk was high with an intraclass correlation coefficient of .978 (P<.001), and interrater reliability between carers was also high at 0.868 (P<.05). Sensitivity and specificity for the detection of dementia were .70 and .73, respectively, with area under the ROC curve not significantly different from that of the MMSE or NUCOG. The CogRisk is a brief carer-rated tool of a patient's cognitive functioning developed for use within a neuropsychiatric setting. It exhibited good concurrent validity, internal consistency, and interrater and intrarater reliability. The CogRisk also demonstrated good sensitivity and specificity for dementia. The CogRisk provides carer information, which complements the clinical assessment and can be used to focus on direct carer interview.

A new iPhone application for measuring active craniocervical range of motion in patients with non-specific neck pain: a reliability and validity study.

PubMed

Pourahmadi, Mohammad Reza; Bagheri, Rasool; Taghipour, Morteza; Takamjani, Ismail Ebrahimi; Sarrafzadeh, Javad; Mohseni-Bandpei, Mohammad Ali

2018-03-01

Measurement of cervical spine range of motion (ROM) is often considered to be an essential component of cervical spine physiotherapy assessment. This study aimed to investigate the reliability and validity of an iPhone application (app) (Goniometer Pro) for measuring active craniocervical ROM (ACCROM) in patients with non-specific neck pain. A cross-sectional study was conducted at the musculoskeletal biomechanics laboratory located at Iran University of Medical Sciences. Forty non-specific neck pain patients participated in this study. The outcome measure was the ACCROM, including flexion, extension, lateral flexion, and rotation. Following the recruitment process, ACCROM was measured using a universal goniometer (UG) and iPhone 7 app. Two blinded examiners each used the UG and iPhone to measure ACCROM in the following sequences: flexion, extension, lateral flexion, and rotation. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. Intraclass correlation coefficient (ICC) models were used to determine the intra-rater and inter-rater reliability. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone app. Minimum detectable change at the 95% confidence level (MDC 95 ) was also computed. Good intra-rater and inter-rater reliability was demonstrated for the goniometer with ICC values of ≥0.66 and ≥0.70 and the iPhone app with ICC values of ≥0.62 and ≥0.65, respectively. The MDC 95 ranged from 2.21° to 12.50° for the intra-rater analysis and from 3.40° to 12.61° for the inter-rater analysis. The concurrent validity between the two instruments was high, with r valuesof ≥0.63. The magnitude of the differences between the UG and iPhone app values (effect sizes) was small, with Cohen d values of ≤0.17. The iPhone app possesses good reliability and high validity. It seems that this app can be used for measuring ACCROM. Copyright © 2017 Elsevier Inc. All rights reserved.

Rating scales for dystonia in cerebral palsy: reliability and validity.

PubMed

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Reliability and validity of the Symptoms of Depression Questionnaire (SDQ)

PubMed Central

Pedrelli, Paola; Blais, Mark A.; Alpert, Jonathan E.; Shelton, Richard C.; Walker, Rosemary S. W.; Fava, Maurizio

2015-01-01

Current measures for major depressive disorder focus primarily on the assessment of depressive symptoms, while often omitting other common features. However, the presence of comorbid features in the anxiety spectrum influences outcome and may effect treatment. More comprehensive measures of depression are needed that include the assessment of symptoms in the anxiety–depression spectrum. This study examines the reliability and validity of the Symptoms of Depression Questionnaire (SDQ), which assesses irritability, anger attacks, and anxiety symptoms together with the commonly considered symptoms of depression. Analysis of the factor structure of the SDQ identified 5 subscales, including one in the anxiety–depression spectrum, with adequate internal consistency and concurrent validity. The SDQ may be a valuable new tool to better characterize depression and identify and administer more targeted interventions. PMID:25275853

Development and validation of the work-family-school role conflicts and role-related social support scales among registered nurses with multiple roles.

PubMed

Xu, Lijuan; Song, Rhayun

2013-10-01

The purpose of this study was to develop work-family-school role conflicts and role-related social support scales, and to validate the psychometrics of those scales among registered nurses with multiple roles. The concepts, generation of items, and the scale domains of work-family-school role conflicts and role-related social support scales were constructed based on a review of the literature. The validity and reliability of the scales were examined by administering them to 201 registered nurses who were recruited from 8 university hospitals in South Korea. The content validity was examined by nursing experts using a content validity index. Exploratory factor analysis and confirmatory factor analysis were used to establish the construct validity. The correlation with depression was examined to assess concurrent validity. Finally, internal consistency was assessed using Cronbach's alpha coefficients. The work-family-school role conflicts scale comprised ten items with three factors: work-school-to-family conflict (three items), family-school-to-work conflict (three items), and work-family-to-school conflict (four items). The role-related social support scale comprised nine items with three factors: support from family (three items), support from work (three items), and support from school (three items). Cronbach's alphas were 0.83 and 0.76 for the work-family-school role conflicts and role-related social support scales, respectively. Both instruments exhibited acceptable construct and concurrent validity. The validity and reliability of the developed scales indicate their potential usefulness for the assessment of work-family-school role conflict and role-related social support among registered nurses with multiple roles in Korea. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluation of Psychometric Properties of Voice Activity and Participation Profile (VAPP): A Spanish Version.

PubMed

Bermúdez-de-Alvear, Rosa M; Gálvez-Ruiz, Pablo; Martínez-Arquero, A Ginés; Rando-Márquez, Sara; Fernández-Contreras, Elena

2018-06-11

This study aimed to analyze the psychometric properties of the Spanish version of the Voice Activity and Participation Profile (SVAPP) questionnaire. A randomized, cross-sectional sampling strategy with controls was used. Two samples with a total of 169 participants were analyzed, specifically 61 men (mean age 37.02) and 108 women (mean age 37.78). Of these participants, 112 were patients and 57 were controls. The instrument was submitted to reliability (internal consistency and corrected item-total correlations) and reproducibility analyses. Validation assessment was based on the construct validity, convergent validity, discriminant validity, and concurrent validity. The global internal consistency was excellent (Cronbach's α = 0.976), corrected item-total correlations were satisfactory and ranged 0.63-0.89, and factor loadings were above 0.50. The different subscales showed good internal consistency (alpha coefficients ranged 0.830-0.956) and test-retest values were consistently associated. The exploratory factor analysis evidenced a strongly defined five factors internal structure, with factors loadings ranging 0.51-0.86. Convergent validity demonstrated that all subscales and scores were very strongly correlated (Pearson r above 0.735) and significantly associated. The discriminant validity analysis showed that SVAPP had good specificity to distinguish dysphonic from healthy voice subjects. Concurrent validity with Voice Handicap Index Spanish version (SVHI) showed very strong correlations between total scores, and between SVHI total score and SVAPP Daily and Social Communication subscales; correlations between both tests subscales were strong; only between SVAPP Work and SVHI Physical sections correlations were moderate. The findings of the present study demonstrated evidence for the SVAPP questionnaire reliability and validity, and provided insightful implications of voice disorders on Spanish patients' quality of life. However, further investigations are required. Copyright © 2018 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates

ERIC Educational Resources Information Center

Berhenke, Amanda; Miller, Alison L.; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in…

Psychometric Properties of Scores from the Web-based LibQUAL+ Study of Perceptions of Library Service Quality.

ERIC Educational Resources Information Center

Cook, Colleen; Thompson, Bruce

2001-01-01

Investigated the psychometric integrity of scores from the LibQUAL+ evaluation of perceived library service quality conducted by ARL (Association of Research Libraries). Examines score structure, score reliability, score correlation and concurrent validity coefficients, scale means, and scale standardized norms, and considers the potential of the…

Concurrent validity of the Alberta Infant Motor Scale to detect delayed gross motor development in preterm infants: A comparative study with the Bayley III.

PubMed

Albuquerque, Plínio Luna de; Guerra, Miriam Queiroz de Farias; Lima, Marília de Carvalho; Eickmann, Sophie Helena

2017-05-24

To investigate the concurrent validity of AIMS in relation to the gross motor subtest of the Bayley Scale III/GM in preterm infants. A total of 159 gross motor development assessments were performed with the AIMS and Bayley-III/GM. Linear regression was used to assess the correlation between AIMS and Bayley-III/GM scores. The intra-class correlation coefficient (ICC) and the Bland-Altman plot were used to analyze intra- and inter-rater reliability. There was a prevalence of delayed gross motor development of 20.8% according to the Bayley-III/GM, and 11.9% for the 5th percentile and 21.4% for the 10th percentile of AIMS. A good correlation of AIMS with Bayley-III/GM scores and intra- and inter-rater reliability was encountered in this study. AIMS proved very capable of detecting delayed gross motor development in preterm infants when compared with the Bayley-III/GM. The 10th percentile of AIMS provided the best combination of indicators, with greater specificity.

Measuring alcohol-related consequences and motives among students attending Historically Black Colleges and Universities.

PubMed

Messina, Bryan G; Tseng, Andy; Correia, Christopher J

2015-07-01

College student drinkers have the propensity to engage in heavy alcohol consumption. These consumption patterns can be problematic given the well-established relationship between heavy drinking and negative consequences of alcohol consumption. Though the research on college student drinking is abundant, much of the work conducted has been with Caucasian samples and less so with African American samples or at Historically Black Colleges and Universities (HBCUs). The current paper assessed the internal reliability and concurrent validity of two popular measures of alcohol related negative consequences (CAPS-r and YAACQ) and a measure of drinking motives (DMQ-R) within a HBCU sample. Total scores for the CAPS-r and YAACQ and all five subscales of the DMQ-R were internally reliable as determined by Cronbach's alpha. Correlations and regressions established concurrent validity for both measures of negative consequences as well as the subscales for the DMQ-R. Findings support the use of these measures in the assessment of negative consequences and motivations for alcohol consumption within a HBCU population. Copyright © 2015 Elsevier Ltd. All rights reserved.

Concurrent validation and reliability of digital image analysis of granulation tissue color for clinical pressure ulcers.

PubMed

Iizaka, Shinji; Sugama, Junko; Nakagami, Gojiro; Kaitani, Toshiko; Naito, Ayumi; Koyanagi, Hiroe; Matsuo, Junko; Kadono, Takafumi; Konya, Chizuko; Sanada, Hiromi

2011-01-01

Granulation tissue color is one indicator for pressure ulcer (PU) assessment. However, it entails a subjective evaluation only, and quantitative methods have not been established. We developed color indicators from digital image analysis and investigated their concurrent validity and reliability for clinical PUs. A cross-sectional study was conducted on 47 patients with 55 full-thickness PUs. After color calibration, a wound photograph was converted into three images representing red color: erythema index (EI), modified erythema index with additional color calibration (granulation red index [GRI]), and , which represents the artificially created red-green axis of L(*) a(*) b(*) color space. The mean intensity of the granulation tissue region and the percentage of pixels exceeding the optimal cutoff intensity (% intensity) were calculated. Mean GRI (ρ=0.39, p=0.007) and (ρ=0.55, p<0.001), as well as their % intensity indicators, showed positive correlations with a(*) measured by tristimulus colorimeter, but erythema index did not. They were correlated with hydroxyproline concentration in wound fluid, healthy granulation tissue area, and blood hemoglobin level. Intra- and interrater reliability of the indicator calculation using both GRI and had an intraclass correlation coefficient >0.9. GRI and from digital image analysis can quantitatively evaluate granulation tissue color of clinical PUs. © 2011 by the Wound Healing Society.

Monitoring Progress in Vocal Development in Young Cochlear Implant Recipients: Relationships between Speech Samples and Scores from the Conditioned Assessment of Speech Production (CASP)

PubMed Central

Ertmer, David J.; Jung, Jongmin

2012-01-01

Background Evidence of auditory-guided speech development can be heard as the prelinguistic vocalizations of young cochlear implant recipients become increasingly complex, phonetically diverse, and speech-like. In research settings, these changes are most often documented by collecting and analyzing speech samples. Sampling, however, may be too time-consuming and impractical for widespread use in clinical settings. The Conditioned Assessment of Speech Production (CASP; Ertmer & Stoel-Gammon, 2008) is an easily administered and time-efficient alternative to speech sample analysis. The current investigation examined the concurrent validity of the CASP and data obtained from speech samples recorded at the same intervals. Methods Nineteen deaf children who received CIs before their third birthdays participated in the study. Speech samples and CASP scores were gathered at 6, 12, 18, and 24 months post-activation. Correlation analyses were conducted to assess the concurrent validity of CASP scores and data from samples. Results CASP scores showed strong concurrent validity with scores from speech samples gathered across all recording sessions (6 – 24 months). Conclusions The CASP was found to be a valid, reliable, and time-efficient tool for assessing progress in vocal development during young CI recipient’s first 2 years of device experience. PMID:22628109

Reliability and validity analysis of the transfer assessment instrument.

PubMed

McClure, Laura A; Boninger, Michael L; Ozawa, Haishin; Koontz, Alicia

2011-03-01

To describe the development and evaluate the reliability and validity of a newly created outcome measure, the Transfer Assessment Instrument (TAI), to assess the quality of transfers performed by full-time wheelchair users. Repeated measures. 2009 National Veterans Wheelchair Games in Spokane, WA. A convenience sample of full-time wheelchair users (N=40) who perform sitting pivot or standing pivot transfers. Not applicable. Intraclass correlation coefficients (ICCs) for reliability and Spearman correlation coefficients for concurrent validity between the TAI and a global assessment scale (0-100 visual analog scale [VAS]). No adverse events occurred during testing. Intrarater ICCs for 3 raters ranged between .35 and .89, and the interrater ICC was .642. Correlations between the TAI and a global assessment VAS ranged between .19 (P=.285) and .69 (P>.000). Item analyses of the tool found a wide range of results, from weak to good reliability. Evaluators found the TAI to be safe and able to be completed in a short time. The TAI is a safe, quick outcome measure that uses equipment typically found in a clinical setting and does not ask participants to perform new skills. Reliability and validity testing found the TAI to have acceptable interrater and a wide range of intrarater reliability. Future work indicates the need for continued refinement including removal or modification of items found to have low reliability, improved education for clinicians, and further reliability and validity analysis with a more diverse subject population. The TAI has the potential to fill a void in assessment of transfers. Copyright © 2011 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The Adult Attachment Projective Picture System: integrating attachment into clinical assessment.

PubMed

George, Carol; West, Malcolm

2011-01-01

This article summarizes the development and validation of the Adult Attachment Projective System (AAP), a measure we developed from the Bowlby-Ainsworth developmental tradition to assess adult attachment status. The AAP has demonstrated excellent concurrent validity with the Adult Attachment Interview (George, Kaplan, & Main, 1984/1985/1996; Main & Goldwyn, 1985-1994; Main, Goldwyn, & Hesse, 2003), interjudge reliability, and test-retest reliability, with no effects of verbal intelligence or social desirability. The AAP coding and classification system and application in clinical and community samples are summarized. Finally, we introduce the 3 other articles that are part of this Special Section and discuss the use of the AAP in therapeutic assessment and treatment.

A unified approach to validation, reliability, and education study design for surgical technical skills training.

PubMed

Sweet, Robert M; Hananel, David; Lawrenz, Frances

2010-02-01

To present modern educational psychology theory and apply these concepts to validity and reliability of surgical skills training and assessment. In a series of cross-disciplinary meetings, we applied a unified approach of behavioral science principles and theory to medical technical skills education given the recent advances in the theories in the field of behavioral psychology and statistics. While validation of the individual simulation tools is important, it is only one piece of a multimodal curriculum that in and of itself deserves examination and study. We propose concurrent validation throughout the design of simulation-based curriculum rather than once it is complete. We embrace the concept that validity and curriculum development are interdependent, ongoing processes that are never truly complete. Individual predictive, construct, content, and face validity aspects should not be considered separately but as interdependent and complementary toward an end application. Such an approach could help guide our acceptance and appropriate application of these exciting new training and assessment tools for technical skills training in medicine.

The German Version of the Herth Hope Index (HHI-D): Development and Psychometric Properties.

PubMed

Geiser, Franziska; Zajackowski, Katharina; Conrad, Rupert; Imbierowicz, Katrin; Wegener, Ingo; Herth, Kaye A; Urbach, Anne Sarah

2015-01-01

The importance of hope is evident in clinical oncological care. Hope is associated with psychological and also physical functioning. However, there is still a dearth of empirical research on hope as a multidimensional concept. The Herth Hope Index is a reliable and valid instrument for the measurement of hope and is available in many languages. Until now no authorized German translation has been published and validated. After translation, the questionnaire was completed by 192 patients with different tumor entities in radiation therapy. Reliability, concurrent validity, and factor structure of the questionnaire were determined. Correlations were high with depression and anxiety as well as optimism and pessimism. As expected, correlations with coping styles were moderate. Internal consistency and test-retest reliability were satisfactory. We could not replicate the original 3-factor model. Application of the scree plot criterion in an exploratory factor analysis resulted in a single-factor structure. The Herth Hope Index - German Version (HHI-D) is a short, reliable, and valid instrument for the assessment of hope in patient populations. We recommend using only the HHI-D total score until further research gives more insights into possible factorial solutions and subscales. © 2015 S. Karger GmbH, Freiburg.

Development and Validation of a Questionnaire to Assess Multimorbidity in Primary Care: An Indian Experience.

PubMed

Pati, Sanghamitra; Hussain, Mohammad Akhtar; Swain, Subhashisa; Salisbury, Chris; Metsemakers, Job F M; Knottnerus, J André; van den Akker, Marjan

2016-01-01

Multimorbidity remains an underexplored domain in Indian primary care. We undertook a study to assess the prevalence, correlates, and outcomes of multimorbidity in primary care settings in India. This paper describes the process of development and validation of our data collection tool "Multimorbidity Assessment Questionnaire for Primary Care (MAQ-PC)." An iterative process comprising desk review, chart review, and expert consultations was undertaken to generate the questionnaire. The MAQ-PC contained items on chronic conditions, health care utilization, health related quality of life, disease severity, and sociodemographics. It was first tested with twelve adults for comprehensibility followed by test-retest reliability with 103 patients from four primary care practices. For interrater reliability, two interviewers separately administered the questionnaire to sixteen patients. MAQ-PC displayed strong internal consistency (Cronbach's alpha: 0.69), interrater reliability (Cohen's Kappa: 0.78-1), and test-retest reliability (ICC: 0.970-0.741). Substantial concordance between self-report and physician diagnosis (Scott Kappa: 0.59-1.0) was observed for listed chronic conditions indicating strong concurrent validity. Nearly 54% had one chronic condition and 23.3% had multimorbidity. Our findings demonstrate MAQ-PC to be a valid and reliable measure of multimorbidity in primary care practice and suggest its potential utility in multimorbidity research in India.

Assessment of the Tobacco Dependence Screener Among Smokeless Tobacco Users.

PubMed

Mushtaq, Nasir; Beebe, Laura A

2016-05-01

Variants of the Fagerström Tolerance Questionnaire and Fagerström Test for Nicotine Dependence (FTND) are widely used to study dependence among smokeless tobacco (ST) users. However, there is a need for a dependence measure which is based on the clinical definition of dependence and is easy to administer. The Tobacco Dependence Screener (TDS), a self-administered 10-item scale, is based on the Diagnostic and Statistical Manual, fourth edition (DSM-IV) and ICD-10 definitions of dependence. It is commonly used as a tobacco dependence screening tool in cigarette smoking studies but it has not been evaluated for dependence in ST users. The purpose of this study is to evaluate the TDS as a measure of tobacco dependence among ST users. Data collected from a community-based sample of exclusive ST users living in Oklahoma (n = 95) was used for this study. TDS was adapted to be used for ST dependence as the references for smoking were changed to ST use. Concurrent validity and reliability of TDS were evaluated. Salivary cotinine concentration was used as a criterion variable. Overall accuracy of the TDS was assessed by receiver's operating characteristic (ROC) curve and optimal cutoff scores for dependence diagnosis were evaluated. There was no floor or ceiling effect in TDS score (mean = 5.42, SD = 2.61). Concurrent validity of TDS as evaluated by comparing it with FTND-ST was affirmative. Study findings showed significant association between TDS and salivary cotinine concentration. The internal consistency assessed by Cronbach's alpha indicated that TDS had acceptable reliability (α = 0.765). TDS was negatively correlated with time to first chew/dip and positively correlated with frequency (number of chews per day) and years of ST use. Results of logistic regression analysis showed that at an optimal cutoff score of TDS 5+, ST users classified as dependent had significantly higher cotinine concentration and FTND-ST scores. TDS demonstrated acceptable reliability and concurrent validity among ST users. These findings are consistent with the results of previous cigarette smoking studies evaluating TDS. A self-administered tobacco dependence measure for ST users based on a clinical definition of dependence is an effective tool in research setting. ST dependence research is still evolving. This is the first study of the TDS among ST users providing preliminary evidence about some of the psychometric properties of the scale. Similar to cigarette smokers, TDS is an effective measure of ST dependence. Study showed moderate reliability and affirmative concurrent validity of the TDS among ST users. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Reliability and concurrent validity of a motor skill competence test among 4- to 12-year old children.

PubMed

Hoeboer, Joris; Krijger-Hombergen, Michiel; Savelsbergh, Geert; De Vries, Sanne

2018-07-01

The purpose of this study was to examine the test-retest reliability, internal consistency and concurrent validity of the Athletic Skills Track (AST). During a regular PE lesson, 930 4- to 12-year old children (448 girls, 482 boys) completed two motor skill competence tests: (1) the Körperkoordination-Test für Kinder (KTK) and (2) an age-related version of the AST (age 4-6 years: AST-1, age 6-9 years: AST-2, and age 9-12 years: AST-3). The test-retest reliability of the AST was high (AST-1: ICC = 0.881 (95% CI: 0.780-0.934); AST-2: ICC = 0.802 (95% CI: 0.717-0.858); and AST-3: ICC = 0.800 (95% CI: 0.669-0.871). The internal consistency, concerning the three age-bands of the AST was above the acceptable level of Cronbach's α > 0.70 (AST-1: α = 0.764; AST-2: α = 0.700; and AST-3: α = 0.763). There was a moderate to high correlation between the time to complete the AST, and the age- and gender-related motor quotients of the KTK (AST-1: r = -0.747, p = 0.01; AST-2: r = -0.646, p = 0.01; and AST-3: r = -0.602, p = 0.01). The Athletic Skills Track is a reliable and valid assessment tool to assess motor skill competence among 4- to 12-year old children in the PE setting.

Psychometric properties of the Finnish version of the Young Person's Clinical Outcomes in Routine Evaluation (YP-CORE) questionnaire.

PubMed

Gergov, Vera; Lahti, Jari; Marttunen, Mauri; Lipsanen, Jari; Evans, Chris; Ranta, Klaus; Laitila, Aarno; Lindberg, Nina

2017-05-01

An increasing need exists for suitable measures to evaluate treatment outcome in adolescents. YP-CORE is a pan-theoretical brief questionnaire developed for this purpose, but it lacks studies in different cultures or languages. To explore the acceptability, factor structure, reliability, validity, and sensitivity to change of the Finnish translation of YP-CORE. The study was conducted at the Department of Adolescent Psychiatry, Helsinki University Central Hospital. A Finnish translation was prepared by a team of professionals and adolescents. A clinical sample of 104 patients was asked to complete the form together with BDI-21 and BAI, and 92 of them filled the forms again after a 3-month treatment. Analysis included acceptability, confirmatory factor analysis, internal and test-re-test reliability, concurrent validity, influence of gender and age, and criteria for reliable change. YP-CORE was well accepted, and the rate of missing values was low. Internal consistency (α = 0.83-.92) and test-re-test reliability were good (r = 0.69), and the results of CFA supported a one-factor model. YP-CORE showed good concurrent validity against two widely used symptom-specific measures (r = 0.62-0.87). Gender had a moderately strong effect on the scores (d = 0.67), but the effect of age was not as evident. The measure was sensitive to change, showing a larger effect size (d = 0.55) than in the BDI-21 and BAI (d = 0.31-0.50). The results show that the translation of YP-CORE into Finnish has been successful, the YP-CORE has good psychometric properties, and the measure could be taken into wider use in clinical settings for outcome measurement in adolescents.

Validation of the English Language Version of the Violent Ideations Scale.

PubMed

McKenzie, Karen; Murray, Aja Louise; Murray, George Charles; Maguire, Amy; Eisner, Manuel; Ribeaud, Denis

2018-02-01

This study used a within-participant design to evaluate the concurrent validity and test-retest reliability of the Violent Ideations Scale in a general population, English-speaking opportunistic sample. Data from 116 adult participants ( M age = 33.7, SD = 11.9, male = 30 [25.9%]) were used to compare scores on the Violent Ideations Scale and Aggression Questionnaire and responses to the Schedule of Imagined Violence. A subgroup of 27 participants ( M age = 37.2, SD = 13.6, male = 8 [29.6%]) completed the Violent Ideations Scale on a second occasion, 2 weeks later. The Violent Ideations Scale was found to correlate significantly with the Aggression Questionnaire subscale and total scores, with the strongest correlations being with physical aggression and total scores. Participants were more likely to be categorized as having experienced a violent ideation based on responses to the Violent Ideation Scale, compared with the Schedule of Imagined Violence, most likely due to the Schedule of Imagined Violence underestimating the prevalence of violent ideation. A significant, strong correlation was found between total Violent Ideations Scale scores at Time 1 and Time 2. Overall, the Violent Ideations Scale was found to have concurrent validity when compared with the Aggression Questionnaire and good test-retest reliability, suggesting that it would be suitable for use with a nonclinical, English-speaking sample.

Getting precise and pragmatic about the assessment of bullying: the development of the California Bullying Victimization Scale.

PubMed

Felix, Erika D; Sharkey, Jill D; Green, Jennifer Greif; Furlong, Michael J; Tanigawa, Diane

2011-01-01

Accurate assessment of bullying is essential to intervention planning and evaluation. Limitations to many currently available self-report measures of bullying victimization include a lack of psychometric information, use of the emotionally laden term "bullying" in definition-first approaches to self-report surveys, and not assessing all components of the definition of bullying (chronicity, intentionality, and imbalance of power) in behavioral-based self-report methods. To address these limitations, we developed the California Bullying Victimization Scale (CBVS), which is a self-report scale that measures the three-part definition of bullying without the use of the term bully. We examined test-retest reliability and the concurrent and predictive validity of the CBVS across students in Grades 5-12 in four central California schools. Concurrent validity was assessed by comparing the CBVS with a common, definition-based bullying victimization measure. Predictive validity was examined through the co-administration of measures of psychological well-being. Analysis by grade and gender are included. Results support the test-retest reliability of the CBVS over a 2-week period. The CBVS was significantly, positively correlated with another bullying assessment and was related in expected directions to measures of well-being. Implications for differentiating peer victimization and bullying victimization via self-report measures are discussed. © 2011 Wiley-Liss, Inc.

A method of measuring three-dimensional scapular attitudes using the optotrak probing system.

PubMed

Hébert, L J; Moffet, H; McFadyen, B J; St-Vincent, G

2000-01-01

To develop a method to obtain accurate three-dimensional scapular attitudes and to assess their concurrent validity and reliability. In this methodological study, the three-dimensional scapular attitudes were calculated in degrees, using a rotation matrix (cyclic Cardanic sequence), from spatial coordinates obtained with the probing of three non colinear landmarks first on an anatomical model and second on a healthy subject. Although abnormal movement of the scapula is related to shoulder impingement syndrome, it is not clearly understood whether or not scapular motion impairment is a predisposing factor. Characterization of three-dimensional scapular attitudes in planes and at joint angles for which sub-acromial impingement is more likely to occur is not known. The Optotrak probing system was used. An anatomical model of the scapula was built and allowed us to impose scapular attitudes of known direction and magnitude. A local coordinate reference system was defined with three non colinear anatomical landmarks to assess accuracy and concurrent validity of the probing method with fixed markers. Axial rotation angles were calculated from a rotation matrix using a cyclic Cardanic sequence of rotations. The same three non colinear body landmarks were digitized on one healthy subject and the three dimensional scapular attitudes obtained were compared between sessions in order to assess the reliability. The measure of three dimensional scapular attitudes calculated from data using the Optotrak probing system was accurate with means of the differences between imposed and calculated rotation angles ranging from 1.5 degrees to 4.2 degrees. Greatest variations were observed around the third axis of the Cardanic sequence associated with posterior-anterior transverse rotations. The mean difference between the Optotrak probing system method and fixed markers was 1.73 degrees showing a good concurrent validity. Differences between the two methods were generally very low for one and two direction displacements and the largest discrepancies were observed for imposed displacements combining movement about the three axes. The between sessions variation of three dimensional scapular attitudes was less than 10% for most of the arm positions adopted by a healthy subject suggesting a good reliability. The Optotrak probing system used with a standardized protocol lead to accurate, valid and reliable measures of scapular attitudes. Although abnormal range of motion of the scapula is often related to shoulder pathologies, reliable outcome measures to quantify three-dimensional scapular motion on subjects are not available. It is important to establish a standardized protocol to characterize three-dimensional scapular motion on subjects using a method for which the accuracy and validity are known. The method used in the present study has provided such a protocol and will now allow to verify to what extent, scapular motion impairment is linked to the development of specific shoulder pathologies.

Reliability and validity of the parent efficacy for child healthy weight behaviour (PECHWB) scale.

PubMed

Palmer, F; Davis, M C

2014-05-01

Interventions for childhood overweight and obesity that target parents as the agents of change by increasing parent self-efficacy for facilitating their child's healthy weight behaviours require a reliable and valid tool to measure parent self-efficacy before and after interventions. Nelson and Davis developed the Parent Efficacy for Child Healthy Weight Behaviour (PECHWB) scale with good preliminary evidence of reliability and validity. The aim of this research was to provide further psychometric evidence from an independent Australian sample. Data were provided by a convenience sample of 261 primary caregivers of children aged 4-17 years via an online survey. PECHWB scores were correlated with scores on other self-report measures of parenting efficacy and 2- to 4-week test-retest reliability of the PECHWB was assessed. The results of the study confirmed the four-factor structure of the PECHWB (Fat and Sugar, Sedentary Behaviours, Physical Activity, and Fruit and Vegetables) and provided strong evidence of internal consistency and test-retest reliability, as well as good evidence of convergent validity. Future research should investigate the properties of the PECHWB in a sample of parents of overweight or obese children, including measures of child weight and actual child healthy weight behaviours to provide evidence of the concurrent and predictive validity of PECHWB scores. © 2013 John Wiley & Sons Ltd.

Detection of early psychotic symptoms: Validation of the Spanish version of the "Symptom Onset in Schizophrenia (SOS) inventory".

PubMed

Mezquida, Gisela; Cabrera, Bibiana; Martínez-Arán, Anabel; Vieta, Eduard; Bernardo, Miguel

2018-03-01

The period of subclinical signs that precedes the onset of psychosis is referred to as the prodrome or high-risk mental state. The "Symptom Onset in Schizophrenia (SOS) inventory" is an instrument to characterize and date the initial symptoms of a psychotic illness. The present study aims to provide reliability and validity data for clinical and research use of the Spanish version of the SOS. Thirty-six participants with a first-episode of psychosis meeting DSM-IV criteria for schizophrenia/schizoaffective/schizophreniform disorder were administered the translated SOS and other clinical assessments. The internal validity, intrarater and interrater reliability were studied. We found strong interrater reliability. To detect the presence/absence of prodromal symptoms, Kappa coefficients ranged between 0.8 and 0.7. Similarly, the raters obtained an excellent level of agreement regarding the onset of each symptom and the duration of symptoms until first treatment (intraclass correlation coefficients between 0.9 and 1.0). Cronbach's alpha was 0.9-1.0 for all the items. The interrater reliability and concurrent validity were also excellent in both cases. This study provides robust psychometric properties of the Spanish version of the SOS. The translated version is adequate in terms of good internal validity, intrarater and interrater reliability, and is as time-efficient as the original version. Copyright © 2017 Elsevier B.V. All rights reserved.

POLYGON - A New Fundamental Movement Skills Test for 8 Year Old Children: Construction and Validation

PubMed Central

Zuvela, Frane; Bozanic, Ana; Miletic, Durdica

2011-01-01

Inadequately adopted fundamental movement skills (FMS) in early childhood may have a negative impact on the motor performance in later life (Gallahue and Ozmun, 2005). The need for an efficient FMS testing in Physical Education was recognized. The aim of this paper was to construct and validate a new FMS test for 8 year old children. Ninety-five 8 year old children were used for the testing. A total of 24 new FMS tasks were constructed and only the best representatives of movement areas entered into the final test product - FMS-POLYGON. The ICC showed high values for all 24 tasks (0.83-0.97) and the factorial analysis revealed the best representatives of each movement area that entered the FMS-POLYGON: tossing and catching the volleyball against a wall, running across obstacles, carrying the medicine balls, and straight running. The ICC for the FMS-POLYGON showed a very high result (0.98) and, therefore, confirmed the test’s intra-rater reliability. Concurrent validity was tested with the use of the “Test of Gross Motor Development” (TGMD-2). Correlation analysis between the newly constructed FMS-POLYGON and the TGMD-2 revealed the coefficient of -0.82 which indicates a high correlation. In conclusion, the new test for FMS assessment proved to be a reliable and valid instrument for 8 year old children. Application of this test in schools is justified and could play an important factor in physical education and sport practice. Key points All 21 newly constructed tasks demonstrated high intra-rater reliability (0.83-0.97) in FMS assessment. High reliability was also noted in the FMS-POLYGON test (0.98). A high correlation was found between the FMS-POLYGON and TGMD-2 which is a confirmation of the new test’s concurrent validity. The research resolved the problem of long and detailed FMS assessment by adding a new dimension using quick and effective norm-referenced approach but also covering all the most important movement areas. New and validated test can be of great use primarily in school practice for physical education teachers and FMS experts. PMID:24149309

POLYGON - A New Fundamental Movement Skills Test for 8 Year Old Children: Construction and Validation.

PubMed

Zuvela, Frane; Bozanic, Ana; Miletic, Durdica

2011-01-01

Inadequately adopted fundamental movement skills (FMS) in early childhood may have a negative impact on the motor performance in later life (Gallahue and Ozmun, 2005). The need for an efficient FMS testing in Physical Education was recognized. The aim of this paper was to construct and validate a new FMS test for 8 year old children. Ninety-five 8 year old children were used for the testing. A total of 24 new FMS tasks were constructed and only the best representatives of movement areas entered into the final test product - FMS-POLYGON. The ICC showed high values for all 24 tasks (0.83-0.97) and the factorial analysis revealed the best representatives of each movement area that entered the FMS-POLYGON: tossing and catching the volleyball against a wall, running across obstacles, carrying the medicine balls, and straight running. The ICC for the FMS-POLYGON showed a very high result (0.98) and, therefore, confirmed the test's intra-rater reliability. Concurrent validity was tested with the use of the "Test of Gross Motor Development" (TGMD-2). Correlation analysis between the newly constructed FMS-POLYGON and the TGMD-2 revealed the coefficient of -0.82 which indicates a high correlation. In conclusion, the new test for FMS assessment proved to be a reliable and valid instrument for 8 year old children. Application of this test in schools is justified and could play an important factor in physical education and sport practice. Key pointsAll 21 newly constructed tasks demonstrated high intra-rater reliability (0.83-0.97) in FMS assessment. High reliability was also noted in the FMS-POLYGON test (0.98).A high correlation was found between the FMS-POLYGON and TGMD-2 which is a confirmation of the new test's concurrent validity.The research resolved the problem of long and detailed FMS assessment by adding a new dimension using quick and effective norm-referenced approach but also covering all the most important movement areas.New and validated test can be of great use primarily in school practice for physical education teachers and FMS experts.

Development and validation of a fatigue assessment scale for U.S. construction workers.

PubMed

Zhang, Mingzong; Sparer, Emily H; Murphy, Lauren A; Dennerlein, Jack T; Fang, Dongping; Katz, Jeffrey N; Caban-Martinez, Alberto J

2015-02-01

To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Using a two-phased approach, we first identified items (first phase) for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n = 11) and focus groups (three groups with six workers each) with construction workers. The second phase included assessment for the reliability, validity, and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n = 144). Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales ("Lethargy" and "Bodily Ailment"). During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW [0.91], Lethargy [0.86] and Bodily Ailment [0.84]) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59-0.68; Intraclass Correlation Coefficients: 0.74-0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. © 2015 Wiley Periodicals, Inc.

Validity and reliability of the Turkish version of the DSM-5 Dissociative Symptoms Severity Scale-Child Form.

PubMed

Yalın Sapmaz, Şermin; Ergin, Dilek; Şen Celasin, Nesrin; Özek Erkuran, Handan; Karaarslan, Duygu; Öztekin, Siğnem; Uzel Tanrıverdi, Bengisu; Köroğlu, Ertuğrul; Aydemir, Ömer

2017-01-01

The goal of this study was to assess the validity and reliability of the Turkish version of the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) Dissociative Symptoms Severity Scale-Child Form. The scale was prepared by translating and then back-translating the DSM-5 Dissociative Symptoms Severity Scale. The study groups included one group of 30 patients diagnosed with posttraumatic stress disorder who were treated in a child and adolescent psychiatry unit and another group of 83 healthy volunteers from middle and high schools in the community. For assessment, the Adolescent Dissociative Experiences Scale (ADES) was used in addition to the DSM-5 Dissociative Symptoms Severity Scale. Regarding the reliability of the DSM-5 Dissociative Symptoms Severity Scale, Cronbach's alpha was .824 and item-total score correlation coefficients were between .464 and .648. The test-retest correlation coefficient was calculated to be r = .784. In terms of construct validity, one factor accounted for 45.2% of the variance. Furthermore, in terms of concurrent validity, the scale showed a high correlation with the ADES. In conclusion, the Turkish version of the DSM-5 Dissociative Symptoms Severity Scale-Child Form is a valid and reliable tool for both clinical practice and research.

Validation of the secretion severity rating scale.

PubMed

Pluschinski, Petra; Zaretsky, Eugen; Stöver, Timo; Murray, Joseph; Sader, Robert; Hey, Christiane

2016-10-01

Accumulation of secretions within the hypopharynx, aditus laryngis, and trachea is one characteristic of severe dysphagia and is of high clinical and therapeutic relevance. For the graduation of the secretion severity level, a secretion scale was provided by Murray et al. in 1996. The purpose of the study presented here is the validation of this scale by analyzing the intra-rater and inter-rater reliability as well as concurrent validity. For examination of reliability and validity, a reference standard was defined by two expert clinicians who reviewed 40 video recordings of fiberendoscopic swallowing evaluations, with 10 videos for each severity grade. These videos were rated and rerated independently and blinded by 4 ENT-residents with an interval of 4 weeks. Both the intra-rater (Kendall's τ > 0.847***) and inter-rater reliability (Kendall's W > 0.951***) were highly significant and can be considered good or very good. Correlation of the median of all ratings with the reference standard was close to the highest possible value 1 (τ = 0.984***). The scale was proved to be a reliable and valid instrument for graduation of one of the principal symptoms of oropharyngeal dysphagia and is recommended as an evidence-based instrument for standardized fiberoptic endoscopic evaluation of swallowing.

Validity and reliability of the Self-Reported Physical Fitness (SRFit) survey.

PubMed

Keith, NiCole R; Clark, Daniel O; Stump, Timothy E; Miller, Douglas K; Callahan, Christopher M

2014-05-01

An accurate physical fitness survey could be useful in research and clinical care. To estimate the validity and reliability of a Self-Reported Fitness (SRFit) survey; an instrument that estimates muscular fitness, flexibility, cardiovascular endurance, BMI, and body composition (BC) in adults ≥ 40 years of age. 201 participants completed the SF-36 Physical Function Subscale, International Physical Activity Questionnaire (IPAQ), Older Adults' Desire for Physical Competence Scale (Rejeski), the SRFit survey, and the Rikli and Jones Senior Fitness Test. BC, height and weight were measured. SRFit survey items described BC, BMI, and Senior Fitness Test movements. Correlations between the Senior Fitness Test and the SRFit survey assessed concurrent validity. Cronbach's Alpha measured internal consistency within each SRFit domain. SRFit domain scores were compared with SF-36, IPAQ, and Rejeski survey scores to assess construct validity. Intraclass correlations evaluated test-retest reliability. Correlations between SRFit and the Senior Fitness Test domains ranged from 0.35 to 0.79. Cronbach's Alpha scores were .75 to .85. Correlations between SRFit and other survey scores were -0.23 to 0.72 and in the expected direction. Intraclass correlation coefficients were 0.79 to 0.93. All P-values were 0.001. Initial evaluation supports the SRFit survey's validity and reliability.

Reliability and validity of Arabic Rapid Estimate of Adult Literacy in Dentistry (AREALD-30) in Saudi Arabia.

PubMed

Tadakamadla, Santosh Kumar; Quadri, Mir Faeq Ali; Pakpour, Amir H; Zailai, Abdulaziz M; Sayed, Mohammed E; Mashyakhy, Mohammed; Inamdar, Aadil S; Tadakamadla, Jyothi

2014-09-29

To evaluate the reliability and validity of Arabic Rapid Estimate of Adult Literacy in Dentistry (AREALD-30) in Saudi Arabia. A convenience sample of 200 subjects was approached, of which 177 agreed to participate giving a response rate of 88.5%. Rapid Estimate of Adult Literacy in Dentistry (REALD-99), was translated into Arabic to prepare the longer and shorter versions of Arabic Rapid Estimate of Adult Literacy in Dentistry (AREALD-99 and AREALD-30). Each participant was provided with AREALD-99 which also includes words from AREALD-30. A questionnaire containing socio-behavioral information and Arabic Oral Health Impact Profile (A-OHIP-14) was also administered. Reliability of the AREALD-30 was assessed by re-administering it to 20 subjects after two weeks. Convergent and predictive validity of AREALD-30 was evaluated by its correlations with AREALD-99 and self-perceived oral health status, dental visiting habits and A-OHIP-14 respectively. Discriminant validity was assessed in relation to the educational level while construct validity was evaluated by confirmatory factor analysis (CFA). Reliability of AREALD-30 was excellent with intraclass correlation coefficient of 0.99. It exhibited good convergent and discriminant validity but poor predictive validity. CFA showed presence of two factors and infit mean-square statistics for AREALD-30 were all within the desired range of 0.50 - 2.0 in Rasch analysis. AREALD-30 showed excellent reliability, good convergent and concurrent validity, but failed to predict the differences between the subjects categorized based on their oral health outcomes.

Family Self-Efficacy for Diabetes Management: Psychometric Testing

PubMed Central

McEwen, Marylyn M.; Pasvogel, Alice; Murdaugh, Carolyn L.

2017-01-01

Background and Purpose Type 2 diabetes mellitus (T2DM) self-management among Hispanic adults occurs in a family context. Self-efficacy (SE) affects T2DM self-management behaviors; however, no instruments are available to measure family diabetes self-efficacy. The study’s purpose was to test the psychometric properties of the Family Self-Efficacy for Diabetes Scale (FSE). Methods Family members (n = 113) of adults with T2DM participated. Psychometric analysis included internal consistency reliability and concurrent and construct validity. Results Internal consistency reliability was .86. Items loaded on 2 factors, Family SE for Supporting Healthy Behaviors and Family SE for Supporting General Health, accounting for 71% of the variance. FSE correlated significantly with 3 diabetes-related instruments. Conclusions The FSE is a reliable and valid instrument. Further testing is needed in diverse populations and geographic areas. PMID:27103242

Psychometric Properties of the Adolescent Reinforcement Survey Schedule – Alcohol Use Version with College Student Drinkers

PubMed Central

Hallgren, Kevin A.; Greenfield, Brenna L.; Ladd, Benjamin O.

2016-01-01

Background Behavioral economic theories of drinking posit that the reinforcing value of engaging in activities with versus without alcohol influences drinking behavior. Measures of the reinforcement value of drugs and alcohol have been used in previous research, but little work has examined the psychometric properties of these measures. Objectives The present study aims to evaluate the factor structure, test-retest reliability, and concurrent validity of an alcohol-only version of the Adolescent Reinforcement Survey Schedule (ARSS-AUV). Methods A sample of 157 college student drinkers completed the ARSS-AUV at two time points 2–3 days apart. Test-retest reliability, hierarchical factor analysis, and correlations with other drinking measures were examined. Results Single, unidimensional general factors accounted for a majority of the variance in alcohol and alcohol-free reinforcement items. Residual factors emerged that typically represented alcohol or alcohol-free reinforcement while doing activities with friends, romantic or sexual partners, and family members. Individual ARSS-AUV items had fair-to-good test-retest reliability, while general and residual factors had excellent test-retest reliability. General alcohol reinforcement and alcohol reinforcement from friends and romantic partners were positively correlated with past-year alcohol consumption, heaviest drinking episode, and alcohol-related negative consequences. Alcohol-free reinforcement indices were unrelated to alcohol use or consequences. Conclusions/Importance The ARSS-AUV appears to demonstrate good reliability and mixed concurrent validity among college student drinkers. The instrument may provide useful information about alcohol reinforcement from various activities and people and could provide clinically-relevant information for prevention and treatment programs. PMID:27096713

Psychometric Properties of the Adolescent Reinforcement Survey Schedule-Alcohol Use Version with College Student Drinkers.

PubMed

Hallgren, Kevin A; Greenfield, Brenna L; Ladd, Benjamin O

2016-06-06

Behavioral economic theories of drinking posit that the reinforcing value of engaging in activities with versus without alcohol influences drinking behavior. Measures of the reinforcement value of drugs and alcohol have been used in previous research, but little work has examined the psychometric properties of these measures. The present study aims to evaluate the factor structure, test-retest reliability, and concurrent validity of an alcohol-only version of the Adolescent Reinforcement Survey Schedule (ARSS-AUV). A sample of 157 college student drinkers completed the ARSS-AUV at two time points 2-3 days apart. Test-retest reliability, hierarchical factor analysis, and correlations with other drinking measures were examined. Single, unidimensional general factors accounted for a majority of the variance in alcohol and alcohol-free reinforcement items. Residual factors emerged that typically represented alcohol or alcohol-free reinforcement while doing activities with friends, romantic or sexual partners, and family members. Individual ARSS-AUV items had fair-to-good test-retest reliability, while general and residual factors had excellent test-retest reliability. General alcohol reinforcement and alcohol reinforcement from friends and romantic partners were positively correlated with past-year alcohol consumption, heaviest drinking episode, and alcohol-related negative consequences. Alcohol-free reinforcement indices were unrelated to alcohol use or consequences. The ARSS-AUV appears to demonstrate good reliability and mixed concurrent validity among college student drinkers. The instrument may provide useful information about alcohol reinforcement from various activities and people and could provide clinically-relevant information for prevention and treatment programs.

Development of the Observation Scale for Aggressive Behavior (OSAB) for Dutch forensic psychiatric inpatients with an antisocial personality disorder.

PubMed

Hornsveld, Ruud H J; Nijman, Henk L I; Hollin, Clive R; Kraaimaat, Floor W

2007-01-01

The Observation Scale for Aggressive Behavior (OSAB) has been developed to evaluate inpatient treatment programs designed to reduce aggressive behavior in Dutch forensic psychiatric patients with an antisocial personality disorder, who are "placed at the disposal of the government". The scale should have the sensitivity to measure changes in the possible determinants of aggressive behavior, such as limited control of displayed negative emotions (irritation, anger or rage) and a general deficiency of social skills. In developing the OSAB 40 items were selected from a pool of 82 and distributed among the following a priori scales: Irritation/anger, Anxiety/gloominess, Aggressive behavior, Antecedent (to aggressive behavior), Sanction (for aggressive behavior) and Social behavior. The internal consistency of these subscales was good, the inter-rater reliability was moderate to good, and the test-retest reliability over a two to three week period was moderate to good. The correlation between the subscales Irritation/anger, Anxiety/gloominess, Aggressive behavior, Antecedent, Sanction was substantial and significant, but the anticipated negative correlation between these subscales and the Social behavior subscale could not be shown. Relationships between the corresponding subscales of the OSAB and the FIOS, used to calculate concurrent validity, yielded relatively high correlations. The validity of the various OSAB subscales could be further supported by significant correlations with the PCL-R and by significant but weak correlations with corresponding subscales of the self-report questionnaires. The Observation Scale for Aggressive Behavior (OSAB) seems to measure aggressive behavior in Dutch forensic psychiatric inpatients with an antisocial personality disorder reliably and validly. Contrary to expectations, a negative relationship was not found between aggressive and social behavior in either the OSAB or FIOS, which were used for calculating concurrent validity.

Psychometric validation of the dysmenorrhea daily diary (DysDD): a patient-reported outcome for dysmenorrhea.

PubMed

Nguyen, Allison M; Arbuckle, Rob; Korver, Tjeerd; Chen, Fang; Taylor, Beverley; Turnbull, Alice; Norquist, Josephine M

2017-08-01

The objective of this study was to evaluate the psychometric properties of the Dysmenorrhea Daily Diary (DysDD), an electronic patient-reported outcome, in a sample of 355 women with primary dysmenorrhea enrolled in a phase IIb, multicenter, randomized, partially blinded, placebo-controlled trial for treatment of dysmenorrhea. Subjects completed the DysDD over three menstrual cycles, one pre-treatment baseline cycle and two treatment cycles. The DysDD was administered alongside the Menstrual Distress Questionnaire (MDQ), the Short-Form 36 Version 2.0 (SF-36v2), and a Global Assessment of Change (GAC). Item response distributions, test-retest reliability, concurrent and known groups validity, responsiveness, and minimally important difference (MID) were evaluated for the DysDD. As expected, item response distributions varied throughout the menstrual period for all items, with the response scales fully utilized. Within-cycle test-retest reliability was adequate (weighted kappa: 0.5-0.7), although between-cycle test-retest was poor (weighted kappa: 0.1-0.5), most likely due to the highly variable nature of dysmenorrhea between cycles rather than limitations of the measure. Correlations with the MDQ and SF-36v2 were low-moderate, but in the predicted direction, supporting concurrent validity. There were significant differences in DysDD scores across severity groups based on pain medication use. The DysDD was responsive to changes in patients' dysmenorrhea with significantly different changes in scores between change groups (p < 0.0001). MID analyses suggest changes on the DysDD 0-10 pelvic pain score of three points can be considered clinically meaningful. Overall, findings indicate that the DysDD has acceptable reliability and is a valid and responsive instrument for assessing dysmenorrhea.

Development of a Korean Version of the Perceived Deficits Questionnaire-Depression for Patients with Major Depressive Disorder

PubMed Central

Kim, Jae-Min; Hong, Jin-Pyo; Kim, Sang-Dae; Kang, Hee-Ju; Lee, Yong-Sung

2016-01-01

Objective Cognitive symptoms are an important component of depression and the Perceived Deficits Questionnaire-Depression is one of only a few instruments available for the subjective assessment of cognitive dysfunction in depression. Thus, the present study aimed to validate a Korean version of the PDQ-D (K-PDQ-D) using patients with major depressive disorder (MDD). Methods This study included 128 MDD patients who were assessed at study entry and 86 of these patients were then completed 12 weeks of antidepressant monotherapy. All subjects were assessed with the K-PDQ-D, the Montgomery-Asberg Depression Rating Scale (MADRS), the Sheehan Disability Scale (SDS), the EuroQol-5 dimensions questionnaire (EQ-5D), and the number of sick leave days taken in the previous week. The internal consistency, Guttman’s split-half and test-retest reliabilities, factorial analyses, and concurrent and predictive validities of the K-PDQ-D were investigated. Results The K-PDQ-D exhibited excellent internal consistency and reliabilities, and was composed of four factors with high coefficients of determination. The concurrent validity analyses revealed that the K-PDQ-D scores were significantly correlated with the MADRS, SDS, and EQ-5D scores and the number of sick leave days taken. The K-PDQ-D scores at study entry significantly predicted changes in sick leave days and EQ-5D score from study entry to the 12-week endpoint. Conclusion The newly developed K-PDQ-D is a reliable and valid instrument for the evaluation of subjective cognitive symptoms in MDD patients. The K-PDQ-D may assist in the gathering of unique information regarding subjective cognitive complaints, which is important for the comprehensive evaluation of patients with MDD. PMID:26792037

Development and preliminary validation of a measure of social inclusion for use in people with mental health problems: the SInQUE.

PubMed

Mezey, Gillian; White, Sarah; Thachil, Ajoy; Berg, Rachel; Kallumparam, Sen; Nasiruddin, Omar; Wright, Christine; Killaspy, Helen

2013-08-01

Social exclusion can be both a cause and a consequence of mental health problems. Socially inclusive practice by mental health professionals can mitigate against the stigmatizing and excluding effects of severe mental illness. To develop and test the validity of a measure of social inclusion for individuals with severe mental illness - the Social Inclusion Questionnaire User Experience (SInQUE). The domains of the SInQUE were chosen to reflect the domains of social inclusion identified in the Poverty and Social Exclusion Survey. Patients with severe mental illness were recruited from rehabilitation, general and forensic psychiatric services and were asked to complete the questionnaire in an individual interview with a researcher. Sixty six patients with schizophrenia and schizoaffective disorder completed the SInQUE, alongside measures of psychiatric symptoms, needs and quality of life, to assess its acceptability, and concurrent and construct (convergent and discriminant) validity. The SInQUE took 45 minutes to complete and was found to have good concurrent and discriminant validity. Convergent validity was established for two domains: social integration and productivity. Preliminary findings suggest that the SInQUE may be a useful tool for assessing and monitoring social inclusion in individuals with severe mental illness. It has construct and concurrent validity with measures of unmet need and quality of life in this group. Further testing of the reliability of the SInQUE on a larger population is indicated.

Parental Flooding During Conflict: A Psychometric Evaluation of a New Scale

PubMed Central

Del Vecchio, Tamara; Lorber, Michael F.; Slep, Amy M. Smith; Malik, Jill; Heyman, Richard E.; Foran, Heather M.

2016-01-01

Parents who are overwhelmed by the intensity and aversive nature of child negative affect — those who are experiencing flooding — may be less likely to react effectively and instead may focus on escaping the aversive situation, disciplining either overly permissively or punitively to escape quickly from child negative affect. However, there are no validated self-report measures of the degree to which parents experience flooding, impeding the exploration of these relations. Thus, we created and evaluated the Parent Flooding scale (PFS), assessing the extent to which parents believe their children's negative affect during parent-child conflicts is unexpected, overwhelming and distressing. We studied its factorial validity, reliability, and concurrent validity in a community sample of 453 couples with 3- to 7-year-old children (51.9% girls) recruited via random digit dialing. Confirmatory factor analyses indicated a one-factor solution with excellent internal consistency. Test-retest stability over an average of 5.6 months was high. Concurrent validity was suggested by the associations of flooding with parents’ aggression toward their children, overreactive and lax discipline, parenting satisfaction, and parents’ anger, as well as with child externalizing behavior and negative affect. Incrementally concurrent validity analyses indicated that flooding was a unique predictor of mothers’ and fathers’ overreactive discipline and fathers’ parent-child aggression and lax discipline, over and above the contributions of parents’ anger and children's negative affect. The present results support the psychometric validity of the PFS. PMID:26909682

Patient Assessment of Constipation Quality of Life Questionnaire: Translation, Cultural Adaptation, Reliability, and Validity of the Persian Version.

PubMed

Nikjooy, Afsaneh; Jafari, Hassan; Saba, Maryam A; Ebrahimi, Naghmeh; Mirzaei, Rezvan

2018-05-01

The Patient Assessment of Constipation Quality of Life (PAC-QOL) questionnaire is the most validated and the most specific tool for measuring the quality of life of patients with constipation. Over 120 million people live in countries whose official language is Persian. There is no reported Persian version of the PAC-QOL questionnaire yet. The aim of this study was to translate and culturally adapt the PAC-QOL questionnaire and to assess its reliability and validity among Persian patients with chronic constipation. Following the translation and cultural adaptation of the PAC-QOL questionnaire to Persian, 100 patients (mean±SD age=40.51±13.67) with constipation were recruited for validity measurement and 20 patients were re-examined for reliability. Content validity was assessed based on the opinions of an expert committee and the floor/ceiling effect. Construct validity was evaluated according to the hypothesis test. The SF-36 questionnaire was used for concurrent criterion validity, intra-class correlation coefficient for reliability, and Cronbach's alpha for internal consistency. The content validity of the PAC-QOL questionnaire was proven, and there was no floor/ceiling effect. Construct validity also was confirmed based on the hypothesis test. The overall Cronbach's alpha of the PAC-QOL questionnaire was 0.92 (range=0.72-0.92), and the overall intra-class correlation coefficient of the questionnaire was 0.88 (range=0.69-0.87). The correlation between the SF-36 and PAC-QOL questionnaires was moderate. The Persian version of the PAC-QOL questionnaire demonstrated good validity and reliability properties in chronic constipation. Accordingly, Persian researchers and clinicians can benefit from this questionnaire in further research and assessment of treatment outcomes.

Reliability and validity of the test of gross motor development-II in Korean preschool children: applying AHP.

PubMed

Kim, Chung-Il; Han, Dong-Wook; Park, Il-Hyeok

2014-04-01

The Test of Gross Motor Development-II (TGMD-II) is a frequently used assessment tool for measuring motor ability. The purpose of this study is to investigate the reliability and validity of TGMD-II's weighting scores (by comparing pre-weighted TGMD-II scores with post ones) as well as examine applicability of the TGMD-II on Korean preschool children. A total of 121 Korean children (three kindergartens) participated in this study. There were 65 preschoolers who were 5-years-old (37 boys and 28 girls) and 56 preschoolers who were 6-years-old (34 boys and 22 girls). For internal consistency, reliability, and construct validity, only one researcher evaluated all of the children using the TGMD-II in the following areas: running; galloping; sliding; hopping; leaping; horizontal jumping; overhand throwing; underhand rolling; striking a stationary ball; stationary dribbling; kicking; and catching. For concurrent validity, the evaluator measured physical fitness (strength, flexibility, power, agility, endurance, and balance). The key findings were as follows: first, the reliability coefficient and the validity coefficient between pre-weighted and post-weighted TGMD-II scores were quite similar. Second, the research showed adequate reliability and validity of the TGMD-II for Korean preschool children. The TGMD-II is a proper instrument to test Korean children's motor development. Yet, applying relative weighting on the TGMD-II should be a point of consideration. Copyright © 2014 Elsevier Ltd. All rights reserved.

A Turkish Version of the Critical-Care Pain Observation Tool: Reliability and Validity Assessment.

PubMed

Aktaş, Yeşim Yaman; Karabulut, Neziha

2017-08-01

The study aim was to evaluate the validity and reliability of the Critical-Care Pain Observation Tool in critically ill patients. A repeated measures design was used for the study. A convenience sample of 66 patients who had undergone open-heart surgery in the cardiovascular surgery intensive care unit in Ordu, Turkey, was recruited for the study. The patients were evaluated by using the Critical-Care Pain Observation Tool at rest, during a nociceptive procedure (suctioning), and 20 minutes after the procedure while they were conscious and intubated after surgery. The Turkish version of the Critical-Care Pain Observation Tool has shown statistically acceptable levels of validity and reliability. Inter-rater reliability was supported by moderate-to-high-weighted κ coefficients (weighted κ coefficient = 0.55 to 1.00). For concurrent validity, significant associations were found between the scores on the Critical-Care Pain Observation Tool and the Behavioral Pain Scale scores. Discriminant validity was also supported by higher scores during suctioning (a nociceptive procedure) versus non-nociceptive procedures. The internal consistency of the Critical-Care Pain Observation Tool was 0.72 during a nociceptive procedure and 0.71 during a non-nociceptive procedure. The validity and reliability of the Turkish version of the Critical-Care Pain Observation Tool was determined to be acceptable for pain assessment in critical care, especially for patients who cannot communicate verbally. Copyright © 2016 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Psychometric evaluation of the Korean Version of the Self-Efficacy for Exercise Scale for older adults.

PubMed

Choi, Mona; Ahn, Sangwoo; Jung, Dukyoo

2015-01-01

We evaluated the psychometric properties of the Korean version of the Self-Efficacy for Exercise Scale (SEE-K). The SEE-K consists of nine items and was translated into Korean using the forward-backward translation method. We administered it to 212 community-dwelling older adults along with measures of outcome expectation for exercise, quality of life, and physical activity. The validity was determined using confirmatory factor analysis and Rasch analysis with INFIT and OUTFIT statistics, which showed acceptable model fit. The concurrent validity was confirmed according to positive correlations between the SEE-K, outcome expectation for exercise, and quality of life. Furthermore, the high physical activity group had higher SEE-K scores. Finally, the reliability of the SEE-K was deemed acceptable based on Cronbach's alpha, coefficients of determination, and person and item separation indices with reliability. Thus, the SEE-K appears to have satisfactory validity and reliability among older adults in South Korea. Copyright © 2015 Elsevier Inc. All rights reserved.

Objective structured clinical examination for pharmacy students in Qatar: cultural and contextual barriers to assessment.

PubMed

Wilby, K J; Black, E K; Austin, Z; Mukhalalati, B; Aboulsoud, S; Khalifa, S I

2016-07-10

This study aimed to evaluate the feasibility and psychometric defensibility of implementing a comprehensive objective structured clinical examination (OSCE) on the complete pharmacy programme for pharmacy students in a Middle Eastern context, and to identify facilitators and barriers to implementation within new settings. Eight cases were developed, validated, and had standards set according to a blueprint, and were assessed with graduating pharmacy students. Assessor reliability was evaluated using inter-class coefficients (ICCs). Concurrent validity was evaluated by comparing OSCE results to professional skills course grades. Field notes were maintained to generate recommendations for implementation in other contexts. The examination pass mark was 424 points out of 700 (60.6%). All 23 participants passed. Mean performance was 74.6%. Low to moderate inter-rater reliability was obtained for analytical and global components (average ICC 0.77 and 0.48, respectively). In conclusion, OSCE was feasible in Qatar but context-related validity and reliability concerns must be addressed prior to future iterations in Qatar and elsewhere.

Measuring physical activity in preschoolers: Reliability and validity of The System for Observing Fitness Instruction Time for Preschoolers (SOFIT-P)

PubMed Central

Sharma, Shreela; Chuang, Ru-Jye; Skala, Katherine; Atteberry, Heather

2012-01-01

The purpose of this study is describe the initial feasibility, reliability, and validity of an instrument to measure physical activity in preschoolers using direct observation. The System for Observing Fitness Instruction Time for Preschoolers was developed and tested among 3- to 6-year-old children over fall 2008 for feasibility and reliability (Phase I, n=67) and in fall 2009 for concurrent validity (Phase II, n=27). Phase I showed that preschoolers spent >75% of their active time at preschool in light physical activity. The mean inter-observer agreements scores were ≥.75 for physical activity level and type. Correlation coefficients, measuring construct validity between the lesson context and physical activity types with and with the activity levels, were moderately strong. Phase II showed moderately strong correlations ranging from .50 to .54 between the System for Observing Fitness Instruction Time for Preschoolers and Actigraph accelerometers for physical activity levels. The System for Observing Fitness Instruction Time for Preschoolers shows promising initial results as a new method for measuring physical activity among preschoolers. PMID:22485071

Development and practical implications of the Exercise Resourcefulness Inventory.

PubMed

Fast, Hilary V; Kennett, Deborah J

2015-05-01

To determine the validity and reliability of the Exercise Resourcefulness Inventory (ERI) designed to assess the self-regulatory strategies used to promote regular exercise. In Study 1, the inventory's relationship with other established scales in the exercise behavior change field was examined. In Study 2, the test-retest reliability and predictive validity of the ERI was established by having participants from Study 1 complete the inventory a second time. Internal consistency, and convergent, discriminant, and concurrent validity were supported in both studies. The test-retest correlation of the ERI was .80. As well, participants scoring higher on the ERI in Study 1 were more likely to be at a higher stage of change in Study 2, and greater increases in exercise resourcefulness over time were predictive of advancement to higher stages of change. ERI is a reliable and valid measure to assess the self-regulatory strategies used to promote regular exercise. Facilitators may want to tailor exercise programs for individuals scoring lower in resourcefulness to prevent them from relapsing. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Beyond Screening and Progress Monitoring: An Examination of the Reliability and Concurrent Validity of Maze Comprehension Assessments for Fourth-Grade Students

ERIC Educational Resources Information Center

Brasher, Casey F.

2017-01-01

Reading comprehension assessments often lack instructional utility because they do not accurately pinpoint why a student has difficulty. The varying formats, directions, and response requirements of comprehension assessments lead to differential measurement of underlying skills and contribute to noted amounts of unshared variance among tests. Maze…

The Relationship of Language and Symbolic Play in Children with Hearing Loss.

ERIC Educational Resources Information Center

Yoshinaga-Itano, Christine; Snyder, Lynn S.; Day, Diane

1999-01-01

The internal reliability and concurrent validity of the Play Assessment Questionnaire (PAQ) was compared to that of the Minnesota Child Development Inventory with 170 deaf or hard of hearing infants and toddlers. The PAQ was found to be a useful nonverbal tool that assesses symbolic play behaviors and demonstrates a parallel development with…

Cross-cultural adaptation and validation of the VISA-A questionnaire for German-speaking achilles tendinopathy patients.

PubMed

Lohrer, Heinz; Nauck, Tanja

2009-10-30

Achilles tendinopathy is the predominant overuse injury in runners. To further investigate this overload injury in transverse and longitudinal studies a valid, responsive and reliable outcome measure is demanded. Most questionnaires have been developed for English-speaking populations. This is also true for the VISA-A score, so far representing the only valid, reliable, and disease specific questionnaire for Achilles tendinopathy. To internationally compare research results, to perform multinational studies or to exclude bias originating from subpopulations speaking different languages within one country an equivalent instrument is demanded in different languages. The aim of this study was therefore to cross-cultural adapt and validate the VISA-A questionnaire for German-speaking Achilles tendinopathy patients. According to the "guidelines for the process of cross-cultural adaptation of self-report measures" the VISA-A score was cross-culturally adapted into German (VISA-A-G) using six steps: Translation, synthesis, back translation, expert committee review, pretesting (n = 77), and appraisal of the adaptation process by an advisory committee determining the adequacy of the cross-cultural adaptation. The resulting VISA-A-G was then subjected to an analysis of reliability, validity, and internal consistency in 30 Achilles tendinopathy patients and 79 asymptomatic people. Concurrent validity was tested against a generic tendon grading system (Percy and Conochie) and against a classification system for the effect of pain on athletic performance (Curwin and Stanish). The "advisory committee" determined the VISA-A-G questionnaire as been translated "acceptable". The VISA-A-G questionnaire showed moderate to excellent test-retest reliability (ICC = 0.60 to 0.97). Concurrent validity showed good coherence when correlated with the grading system of Curwin and Stanish (rho = -0.95) and for the Percy and Conochie grade of severity (rho 0.95). Internal consistency (Cronbach's alpha) for the total VISA-A-G scores of the patients was calculated to be 0.737. The VISA-A questionnaire was successfully cross-cultural adapted and validated for use in German speaking populations. The psychometric properties of the VISA-A-G questionnaire are similar to those of the original English version. It therefore can be recommended as a sufficiently robust tool for future measuring clinical severity of Achilles tendinopathy in German speaking patients.

Cross-cultural adaptation and validation of the VISA-A questionnaire for German-speaking Achilles tendinopathy patients

PubMed Central

Lohrer, Heinz; Nauck, Tanja

2009-01-01

Background Achilles tendinopathy is the predominant overuse injury in runners. To further investigate this overload injury in transverse and longitudinal studies a valid, responsive and reliable outcome measure is demanded. Most questionnaires have been developed for English-speaking populations. This is also true for the VISA-A score, so far representing the only valid, reliable, and disease specific questionnaire for Achilles tendinopathy. To internationally compare research results, to perform multinational studies or to exclude bias originating from subpopulations speaking different languages within one country an equivalent instrument is demanded in different languages. The aim of this study was therefore to cross-cultural adapt and validate the VISA-A questionnaire for German-speaking Achilles tendinopathy patients. Methods According to the "guidelines for the process of cross-cultural adaptation of self-report measures" the VISA-A score was cross-culturally adapted into German (VISA-A-G) using six steps: Translation, synthesis, back translation, expert committee review, pretesting (n = 77), and appraisal of the adaptation process by an advisory committee determining the adequacy of the cross-cultural adaptation. The resulting VISA-A-G was then subjected to an analysis of reliability, validity, and internal consistency in 30 Achilles tendinopathy patients and 79 asymptomatic people. Concurrent validity was tested against a generic tendon grading system (Percy and Conochie) and against a classification system for the effect of pain on athletic performance (Curwin and Stanish). Results The "advisory committee" determined the VISA-A-G questionnaire as been translated "acceptable". The VISA-A-G questionnaire showed moderate to excellent test-retest reliability (ICC = 0.60 to 0.97). Concurrent validity showed good coherence when correlated with the grading system of Curwin and Stanish (rho = -0.95) and for the Percy and Conochie grade of severity (rho 0.95). Internal consistency (Cronbach's alpha) for the total VISA-A-G scores of the patients was calculated to be 0.737. Conclusion The VISA-A questionnaire was successfully cross-cultural adapted and validated for use in German speaking populations. The psychometric properties of the VISA-A-G questionnaire are similar to those of the original English version. It therefore can be recommended as a sufficiently robust tool for future measuring clinical severity of Achilles tendinopathy in German speaking patients. PMID:19878572

Validity and Reliability Study of the Korean Tinetti Mobility Test for Parkinson's Disease.

PubMed

Park, Jinse; Koh, Seong-Beom; Kim, Hee Jin; Oh, Eungseok; Kim, Joong-Seok; Yun, Ji Young; Kwon, Do-Young; Kim, Younsoo; Kim, Ji Seon; Kwon, Kyum-Yil; Park, Jeong-Ho; Youn, Jinyoung; Jang, Wooyoung

2018-01-01

Postural instability and gait disturbance are the cardinal symptoms associated with falling among patients with Parkinson's disease (PD). The Tinetti mobility test (TMT) is a well-established measurement tool used to predict falls among elderly people. However, the TMT has not been established or widely used among PD patients in Korea. The purpose of this study was to evaluate the reliability and validity of the Korean version of the TMT for PD patients. Twenty-four patients diagnosed with PD were enrolled in this study. For the interrater reliability test, thirteen clinicians scored the TMT after watching a video clip. We also used the test-retest method to determine intrarater reliability. For concurrent validation, the unified Parkinson's disease rating scale, Hoehn and Yahr staging, Berg Balance Scale, Timed-Up and Go test, 10-m walk test, and gait analysis by three-dimensional motion capture were also used. We analyzed receiver operating characteristic curve to predict falling. The interrater reliability and intrarater reliability of the Korean Tinetti balance scale were 0.97 and 0.98, respectively. The interrater reliability and intra-rater reliability of the Korean Tinetti gait scale were 0.94 and 0.96, respectively. The Korean TMT scores were significantly correlated with the other clinical scales and three-dimensional motion capture. The cutoff values for predicting falling were 14 points (balance subscale) and 10 points (gait subscale). We found that the Korean version of the TMT showed excellent validity and reliability for gait and balance and had high sensitivity and specificity for predicting falls among patients with PD.

Validity and Reliability of Nintendo Wii Fit Balance Scores

PubMed Central

Wikstrom, Erik A.

2012-01-01

Context: Interactive gaming systems have the potential to help rehabilitate patients with musculoskeletal conditions. The Nintendo Wii Balance Board, which is part of the Wii Fit game, could be an effective tool to monitor progress during rehabilitation because the board and game can provide objective measures of balance. However, the validity and reliability of Wii Fit balance scores remain unknown. Objective: To determine the concurrent validity of balance scores produced by the Wii Fit game and the intrasession and intersession reliability of Wii Fit balance scores. Design: Descriptive laboratory study. Setting: Sports medicine research laboratory. Patients or Other Participants: Forty-five recreationally active participants (age  =  27.0 ± 9.8 years, height  =  170.9 ± 9.2 cm, mass  =  72.4 ± 11.8 kg) with a heterogeneous history of lower extremity injury. Intervention(s): Participants completed a single-limb–stance task on a force plate and the Star Excursion Balance Test (SEBT) during the first test session. Twelve Wii Fit balance activities were completed during 2 test sessions separated by 1 week. Main Outcome Measure(s): Postural sway in the anteroposterior (AP) and mediolateral (ML) directions and the AP, ML, and resultant center-of-pressure (COP) excursions were calculated from the single-limb stance. The normalized reach distance was recorded for the anterior, posteromedial, and posterolateral directions of the SEBT. Wii Fit balance scores that the game software generated also were recorded. Results: All 96 of the calculated correlation coefficients among Wii Fit activity outcomes and established balance outcomes were interpreted as poor (r < 0.50). Intrasession reliability for Wii Fit balance activity scores ranged from good (intraclass correlation coefficient [ICC]  =  0.80) to poor (ICC  =  0.39), with 8 activities having poor intrasession reliability. Similarly, 11 of the 12 Wii Fit balance activity scores demonstrated poor intersession reliability, with scores ranging from fair (ICC  =  0.74) to poor (ICC  =  0.29). Conclusions: Wii Fit balance activity scores had poor concurrent validity relative to COP outcomes and SEBT reach distances. In addition, the included Wii Fit balance activity scores generally had poor intrasession and intersession reliability. PMID:22892412

Validity of the Malay version of the Internet Addiction Test: a study on a group of medical students in Malaysia.

PubMed

Guan, Ng Chong; Isa, Saramah Mohammed; Hashim, Aili Hanim; Pillai, Subash Kumar; Harbajan Singh, Manveen Kaur

2015-03-01

The use of the Internet has been increasing dramatically over the decade in Malaysia. Excessive usage of the Internet has lead to a phenomenon called Internet addiction. There is a need for a reliable, valid, and simple-to-use scale to measure Internet addiction in the Malaysian population for clinical practice and research purposes. The aim of this study was to validate the Malay version of the Internet Addiction Test, using a sample of 162 medical students. The instrument displayed good internal consistency (Cronbach's α = .91), parallel reliability (intraclass coefficient = .88, P < .001), and concurrent validity with the Compulsive Internet Use Scale (Pearson's correlation = .84, P < .001). Receiver operating characteristic analysis showed that 43 was the optimal cutoff score to discriminate students with and without Internet dependence. Principal component analysis with varimax rotation identified a 5-factor model. The Malay version of the Internet Addiction Test appeared to be a valid instrument for assessing Internet addiction in Malaysian university students. © 2012 APJPH.

Development and validation of a new instrument for testing functional health literacy in Japanese adults.

PubMed

Nakagami, Katsuyuki; Yamauchi, Toyoaki; Noguchi, Hiroyuki; Maeda, Tohru; Nakagami, Tomoko

2014-06-01

This study aimed to develop a reliable and valid measure of functional health literacy in a Japanese clinical setting. Test development consisted of three phases: generation of an item pool, consultation with experts to assess content validity, and comparison with external criteria (the Japanese Health Knowledge Test) to assess criterion validity. A trial version of the test was administered to 535 Japanese outpatients. Internal consistency reliability, calculated by Cronbach's alpha, was 0.81, and concurrent validity was moderate. Receiver Operating Characteristics and Item Response Theory were used to classify patients as having adequate, marginal, or inadequate functional health literacy. Both inadequate and marginal functional health literacy were associated with older age, lower income, lower educational attainment, and poor health knowledge. The time required to complete the test was 10-15 min. This test should enable health workers to better identify patients with inadequate health literacy. © 2013 Wiley Publishing Asia Pty Ltd.

Development and validation of a stock addiction inventory (SAI).

PubMed

Youn, HyunChul; Choi, Jung-Seok; Kim, Dai-Jin; Choi, Sam-Wook

2016-01-01

Investing in financial markets is promoted and protected by the government as an essential economic activity, but can turn into a gambling addiction problem. Until now, few scales have widely been used to identify gambling addicts in financial markets. This study aimed to develop a self-rating scale to distinguish them. In addition, the reliability and validity of the stock addiction inventory (SAI) were demonstrated. A set of questionnaires, including the SAI, south oaks gambling screen (SOGS), and DSM-5 diagnostic criteria, for gambling disorder was completed by 1005 participants. Factor analysis, internal consistency testing, t tests, analysis of variance, and partial correlation analysis were conducted to verify the reliability and validity of SAI. The factor analysis results showed the final SAI consisting of two factors and nine items. The internal consistency and concurrent validity of SAI were verified. The Cronbach's α for the total scale was 0.892, and the SAI and its factors were significantly correlated with SOGS. This study developed a specific scale for financial market investments or trading; this scale proved to be reliable and valid. Our scale expands the understanding of gambling addiction in financial markets and provides a diagnostic reference.

Concurrent and prognostic utility of subtyping anorexia nervosa along dietary and negative affect dimensions.

PubMed

Forbush, Kelsie T; Hagan, Kelsey E; Salk, Rachel H; Wildes, Jennifer E

2017-03-01

Bulimia nervosa can be reliably classified into subtypes based on dimensions of dietary restraint and negative affect. Community and clinical studies have shown that dietary-negative affect subtypes have greater test-retest reliability and concurrent and predictive validity compared to subtypes based on the Diagnostic and Statistical Manual of Mental Disorders (DSM). Although dietary-negative affect subtypes have shown utility for characterizing eating disorders that involve binge eating, this framework may have broader implications for understanding restrictive eating disorders. The purpose of this study was to test the concurrent and predictive validity of dietary-negative affect subtypes among patients with anorexia nervosa (AN; N = 194). Latent profile analysis was used to identify subtypes of AN based on dimensions of dietary restraint and negative affect. Chi-square and multivariate analysis of variance were used to characterize baseline differences between identified subtypes. Structural equation modeling was used to test whether dietary-negative affect subtypes would outperform DSM categories in predicting clinically relevant outcomes. Results supported a 2-profile model that replicated dietary-negative affect subtypes: Latent Profile 1 (n = 68) had clinically elevated scores on restraint only; Latent Profile 2 (n = 126) had elevated scores on both restraint and negative affect. Validation analyses showed that membership in the dietary-negative affect profile was associated with greater lifetime psychiatric comorbidity and psychosocial impairment compared to the dietary class. Dietary-negative affect subtypes only outperformed DSM categories in predicting quality-of-life impairment at 1-year follow-up. Findings highlight the clinical utility of subtyping AN based on dietary restraint and negative affect for informing future treatment-matching or personalized medicine strategies. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Posturography using the Wii Balance Board™: A feasibility study with healthy adults and adults post-stroke.

PubMed

Llorens, Roberto; Latorre, Jorge; Noé, Enrique; Keshner, Emily A

2016-01-01

Posturography systems that incorporate force platforms are considered to assess balance and postural control with greater sensitivity and objectivity than conventional clinical tests. The Wii Balance Board (WBB) system has been shown to have similar performance characteristics as other force platforms, but with lower cost and size. To determine the validity and reliability of a freely available WBB-based posturography system that combined the WBB with several traditional balance assessments, and to assess the performance of a cohort of stroke individuals with respect to healthy individuals. Healthy subjects and individuals with stroke were recruited. Both groups were assessed using the WBB-based posturography system. Individuals with stroke were also assessed using a laboratory grade posturography system and a battery of clinical tests to determine the concurrent validity of the system. A group of subjects were assessed twice with the WBB-based system to determine its reliability. A total of 144 healthy individuals and 53 individuals with stroke participated in the study. Concurrent validity with another posturography system was moderate to high. Correlations with clinical scales were consistent with previous research. The reliability of the system was excellent in almost all measures. In addition, the system successfully characterized individuals with stroke with respect to the healthy population. The WBB-based posturography system exhibited excellent psychometric properties and sensitivity for identifying balance performance of individuals with stroke in comparison with healthy subjects, which supports feasibility of the system as a clinical tool. Copyright © 2015 Elsevier B.V. All rights reserved.

Evaluation of force-velocity and power-velocity relationship of arm muscles.

PubMed

Sreckovic, Sreten; Cuk, Ivan; Djuric, Sasa; Nedeljkovic, Aleksandar; Mirkov, Dragan; Jaric, Slobodan

2015-08-01

A number of recent studies have revealed an approximately linear force-velocity (F-V) and, consequently, a parabolic power-velocity (P-V) relationship of multi-joint tasks. However, the measurement characteristics of their parameters have been neglected, particularly those regarding arm muscles, which could be a problem for using the linear F-V model in both research and routine testing. Therefore, the aims of the present study were to evaluate the strength, shape, reliability, and concurrent validity of the F-V relationship of arm muscles. Twelve healthy participants performed maximum bench press throws against loads ranging from 20 to 70 % of their maximum strength, and linear regression model was applied on the obtained range of F and V data. One-repetition maximum bench press and medicine ball throw tests were also conducted. The observed individual F-V relationships were exceptionally strong (r = 0.96-0.99; all P < 0.05) and fairly linear, although it remains unresolved whether a polynomial fit could provide even stronger relationships. The reliability of parameters obtained from the linear F-V regressions proved to be mainly high (ICC > 0.80), while their concurrent validity regarding directly measured F, P, and V ranged from high (for maximum F) to medium-to-low (for maximum P and V). The findings add to the evidence that the linear F-V and, consequently, parabolic P-V models could be used to study the mechanical properties of muscular systems, as well as to design a relatively simple, reliable, and ecologically valid routine test of the muscle ability of force, power, and velocity production.

Validity and Reliability of the Verbal Numerical Rating Scale for Children Aged 4 to 17 Years With Acute Pain.

PubMed

Tsze, Daniel S; von Baeyer, Carl L; Pahalyants, Vartan; Dayan, Peter S

2018-06-01

The Verbal Numerical Rating Scale is the most commonly used self-report measure of pain intensity. It is unclear how the validity and reliability of the scale scores vary across children's ages. We aimed to determine the validity and reliability of the scale for children presenting to the emergency department across a comprehensive spectrum of age. This was a cross-sectional study of children aged 4 to 17 years. Children self-reported their pain intensity, using the Verbal Numerical Rating Scale and Faces Pain Scale-Revised at 2 serial assessments. We evaluated convergent validity (strong validity defined as correlation coefficient ≥0.60), agreement (difference between concurrent Verbal Numerical Rating Scale and Faces Pain Scale-Revised scores), known-groups validity (difference in score between children with painful versus nonpainful conditions), responsivity (decrease in score after analgesic administration), and reliability (test-retest at 2 serial assessments) in the total sample and subgroups based on age. We enrolled 760 children; 27 did not understand the Verbal Numerical Rating Scale and were removed. Of the remainder, Pearson correlations were strong to very strong (0.62 to 0.96) in all years of age except 4 and 5 years, and agreement was strong for children aged 8 and older. Known-groups validity and responsivity were strong in all years of age. Reliability was strong in all age subgroups, including each year of age from 4 to 7 years. Convergent validity, known-groups validity, responsivity, and reliability of the Verbal Numerical Rating Scale were strong for children aged 6 to 17 years. Convergent validity was not strong for children aged 4 and 5 years. Our findings support the use of the Verbal Numerical Rating Scale for most children aged 6 years and older, but not for those aged 4 and 5 years. Copyright © 2017 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.

Interest in Aesthetic Rhinoplasty Scale.

PubMed

Naraghi, Mohsen; Atari, Mohammad

2017-04-01

Interest in cosmetic surgery is increasing, with rhinoplasty being one of the most popular surgical procedures. It is essential that surgeons identify patients with existing psychological conditions before any procedure. This study aimed to develop and validate the Interest in Aesthetic Rhinoplasty Scale (IARS). Four studies were conducted to develop the IARS and to evaluate different indices of validity (face, content, construct, criterion, and concurrent validities) and reliability (internal consistency, split-half coefficient, and temporal stability) of the scale. The four study samples included a total of 463 participants. Statistical analysis revealed satisfactory psychometric properties in all samples. Scores on the IARS were negatively correlated with self-esteem scores ( r  = -0.296; p  < 0.01) and positively associated with scores for psychopathologic symptoms ( r  = 0.164; p  < 0.05), social dysfunction ( r  = 0.268; p  < 0.01), and depression ( r  = 0.308; p  < 0.01). The internal and test-retest coefficients of consistency were found to be high (α = 0.93; intraclass coefficient = 0.94). Rhinoplasty patients were found to have significantly higher IARS scores than nonpatients ( p  < 0.001). Findings of the present studies provided evidence for face, content, construct, criterion, and concurrent validities and internal and test-retest reliability of the IARS. This evidence supports the use of the scale in clinical and research settings. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

The JFK Coma Recovery Scale-Revised: measurement characteristics and diagnostic utility.

PubMed

Giacino, Joseph T; Kalmar, Kathleen; Whyte, John

2004-12-01

To determine the measurement properties and diagnostic utility of the JFK Coma Recovery Scale-Revised (CRS-R). Analysis of interrater and test-retest reliability, internal consistency, concurrent validity, and diagnostic accuracy. Acute inpatient brain injury rehabilitation hospital. Convenience sample of 80 patients with severe acquired brain injury admitted to an inpatient Coma Intervention Program with a diagnosis of either vegetative state (VS) or minimally conscious state (MCS). Not applicable. The CRS-R, the JFK Coma Recovery Scale (CRS), and the Disability Rating Scale (DRS). Interrater and test-retest reliability were high for CRS-R total scores. Subscale analysis showed moderate to high interrater and test-retest agreement although systematic differences in scoring were noted on the visual and oromotor/verbal subscales. CRS-R total scores correlated significantly with total scores on the CRS and DRS indicating acceptable concurrent validity. The CRS-R was able to distinguish 10 patients in an MCS who were otherwise misclassified as in a VS by the DRS. The CRS-R can be administered reliably by trained examiners and repeated measurements yield stable estimates of patient status. CRS-R subscale scores demonstrated good agreement across raters and ratings but should be used cautiously because some scores were underrepresented in the current study. The CRS-R appears capable of differentiating patients in an MCS from those in a VS.

The Chinese version of hospital anxiety and depression scale: Psychometric properties in Chinese cancer patients and their family caregivers.

PubMed

Li, Qiuping; Lin, Yi; Hu, Caiping; Xu, Yinghua; Zhou, Huiya; Yang, Liping; Xu, Yongyong

2016-12-01

The Hospital Anxiety and Depression Scale (HADS) acts as one of the most frequently used self-reported measures in cancer practice. The evidence for construct validity of HADS, however, remains inconclusive. The objective of this study is to evaluate the psychometric properties of the Chinese version HADS (C-HADS) in terms of construct validity, internal consistency reliability, and concurrent validity in dyads of Chinese cancer patients and their family caregivers. This was a cross-sectional study, conducted in multiple centers: one hospital in each of the seven different administrative regions in China from October 2014 to May 2015. A total of 641 dyads, consisting of cancer patients and family caregivers, completed a survey assessing their demographic and background information, anxiety and depression using C-HADS, and quality of life (QOL) using Chinese version SF-12. Data analysis methods included descriptive statistics, confirmatory factor analysis (CFA), and Pearson correlations. Both the two-factor and one-factor models offered the best and adequate fit to the data in cancer patients and family caregivers respectively. The comparison of the two-factor and single-factor models supports the basic assumption of two-factor construct of C-HADS. The overall and two subscales of C-HADS in both cancer patients and family caregivers had good internal consistency and acceptable concurrent validity. The Chinese version of the HADS may be a reliable and valid screening tool, as indicated by its original two-factor structure. The finding supports the basic assumption of two-factor construct of HADS. Copyright © 2016 Elsevier Ltd. All rights reserved.

The psychometric properties of a shortened Dutch version of the consequences scale used in the Core Alcohol and Drug Survey.

PubMed

De Bruyn, Sara; Wouters, Edwin; Ponnet, Koen; Van Damme, Joris; Van Hal, Guido

2017-01-01

Alcohol and drug misuse among college students has been studied extensively and has been clearly identified as a public health problem. Within more general populations alcohol misuse remains one of the leading causes of disease, disability and death worldwide. Conducting research on alcohol misuse requires valid and reliable instruments to measure its consequences. One scale that is often used is the consequences scale in the Core Alcohol and Drug Survey (CADS). However, psychometric studies on the CADS are rare and the ones that do exist report varying results. This article aims to address this imbalance by examining the psychometric properties of a Dutch version of the CADS in a large sample of Flemish university and college students. The analyses are based on data collected by the inter-university project 'Head in the clouds', measuring alcohol use among students. In total, 19,253 students participated (22.1% response rate). The CADS scale was measured using 19 consequences, and participants were asked how often they had experienced these on a 6-point scale. Firstly, the factor structure of the CADS was examined. Two models from literature were compared by performing confirmatory factor analyses (CFA) and were adapted if necessary. Secondly, we assessed the composite reliability as well as the convergent, discriminant and concurrent validity. The two-factor model, identifying personal consequences (had a hangover; got nauseated or vomited; missed a class) and social consequences (got into an argument or fight; been criticized by someone I know; done something I later regretted; been hurt or injured) was indicated to be the best model, having both a good model fit and an acceptable composite reliability. In addition, construct validity was evaluated to be acceptable, with good discriminant validity, although the convergent validity of the factor measuring 'social consequences' could be improved. Concurrent validity was evaluated as good. In deciding which model best represents the data, it is crucial that not only the model fit is evaluated, but the importance of factor reliability and validity issues is also taken into account. The two-factor model, identifying personal consequences and social consequences, was concluded to be the best model. This shortened Dutch version of the CADS (CADS_D) is a useful tool to screen alcohol-related consequences among college students.

Screening for Moral Injury: The Moral Injury Symptom Scale - Military Version Short Form.

PubMed

Koenig, Harold G; Ames, Donna; Youssef, Nagy A; Oliver, John P; Volk, Fred; Teng, Ellen J; Haynes, Kerry; Erickson, Zachary D; Arnold, Irina; O'Garo, Keisha; Pearce, Michelle

2018-03-26

To develop a short form (SF) of the 45-item multidimensional Moral Injury Symptom Scale - Military Version (MISS-M) to use when screening for moral injury and monitoring treatment response in veterans and active duty military with PTSD. A total of 427 veterans and active duty military with PTSD symptoms were recruited from VA Medical Centers in Augusta, GA; Los Angeles, CA; Durham, NC; Houston, TX; and San Antonio, TX; and from Liberty University, Lynchburg, Virginia. The sample was randomly split in two. In the first half (n = 214), exploratory factor analysis identified the highest loading item on each of the 10 MISS scales (guilt, shame, moral concerns, loss of meaning, difficulty forgiving, loss of trust, self-condemnation, religious struggle, and loss of religious faith) to form the 10-item MISS-M-SF; confirmatory factor analysis was then performed to replicate results in the second half of the sample (n = 213). Internal reliability, test-retest reliability, and convergent, discriminant, and concurrent validity were examined in the overall sample. The study was approved by the institutional review boards and the Research & Development (R&D) Committees at Veterans Administration medical centers in Durham, Los Angeles, Augusta, Houston, and San Antonio, and the Liberty University and Duke University Medical Center institutional review boards. The 10-item MISS-M-SF had a median of 50 and a range of 12-91 (possible range 10-100). Over 70% scored a 9 or 10 (highest possible) on at least one item. Cronbach's alpha was 0.73 (95% CI 0.69-0.76), and test-retest reliability was 0.87 (95% CI 0.79-0.92). Convergent validity with the 45-item MISS-M was r = 0.92. Discriminant validity was demonstrated by relatively weak correlations with social, religious, and physical health constructs (r = 0.21-0.35), and concurrent validity was indicated by strong correlations with PTSD, depression, and anxiety symptoms (r = 0.54-0.58). The MISS-M-SF is a reliable and valid measure of MI symptoms that can be used to screen for MI and monitor response to treatment in veterans and active duty military with PTSD.

Validation of the MOS Social Support Survey 6-item (MOS-SSS-6) measure with two large population-based samples of Australian women.

PubMed

Holden, Libby; Lee, Christina; Hockey, Richard; Ware, Robert S; Dobson, Annette J

2014-12-01

This study aimed to validate a 6-item 1-factor global measure of social support developed from the Medical Outcomes Study Social Support Survey (MOS-SSS) for use in large epidemiological studies. Data were obtained from two large population-based samples of participants in the Australian Longitudinal Study on Women's Health. The two cohorts were aged 53-58 and 28-33 years at data collection (N = 10,616 and 8,977, respectively). Items selected for the 6-item 1-factor measure were derived from the factor structure obtained from unpublished work using an earlier wave of data from one of these cohorts. Descriptive statistics, including polychoric correlations, were used to describe the abbreviated scale. Cronbach's alpha was used to assess internal consistency and confirmatory factor analysis to assess scale validity. Concurrent validity was assessed using correlations between the new 6-item version and established 19-item version, and other concurrent variables. In both cohorts, the new 6-item 1-factor measure showed strong internal consistency and scale reliability. It had excellent goodness-of-fit indices, similar to those of the established 19-item measure. Both versions correlated similarly with concurrent measures. The 6-item 1-factor MOS-SSS measures global functional social support with fewer items than the established 19-item measure.

Scoring Method of a Situational Judgment Test: Influence on Internal Consistency Reliability, Adverse Impact and Correlation with Personality?

ERIC Educational Resources Information Center

De Leng, W. E.; Stegers-Jager, K. M.; Husbands, A.; Dowell, J. S.; Born, M. Ph.; Themmen, A. P.

2017-01-01

Situational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students.…

Validation and Test-Retest Reliability of New Thermographic Technique Called Thermovision Technique of Dry Needling for Gluteus Minimus Trigger Points in Sciatica Subjects and TrPs-Negative Healthy Volunteers

PubMed Central

Rychlik, Michał; Samborski, Włodzimierz

2015-01-01

The aim of this study was to assess the validity and test-retest reliability of Thermovision Technique of Dry Needling (TTDN) for the gluteus minimus muscle. TTDN is a new thermography approach used to support trigger points (TrPs) diagnostic criteria by presence of short-term vasomotor reactions occurring in the area where TrPs refer pain. Method. Thirty chronic sciatica patients (n=15 TrP-positive and n=15 TrPs-negative) and 15 healthy volunteers were evaluated by TTDN three times during two consecutive days based on TrPs of the gluteus minimus muscle confirmed additionally by referred pain presence. TTDN employs average temperature (T avr), maximum temperature (T max), low/high isothermal-area, and autonomic referred pain phenomenon (AURP) that reflects vasodilatation/vasoconstriction. Validity and test-retest reliability were assessed concurrently. Results. Two components of TTDN validity and reliability, T avr and AURP, had almost perfect agreement according to κ (e.g., thigh: 0.880 and 0.938; calf: 0.902 and 0.956, resp.). The sensitivity for T avr, T max, AURP, and high isothermal-area was 100% for everyone, but specificity of 100% was for T avr and AURP only. Conclusion. TTDN is a valid and reliable method for T avr and AURP measurement to support TrPs diagnostic criteria for the gluteus minimus muscle when digitally evoked referred pain pattern is present. PMID:26137486

Validation of Yoruba Version of Family Burden Interview Schedule (Y-FBIS) on Caregivers of Schizophrenia Patients

PubMed Central

Lasebikan, Victor Olufolahan

2012-01-01

Objective. To validate the Yoruba version of Family Burden Interview Schedule (Y-FBIS) for assessing the burden on caregivers of persons with schizophrenia. Methods. Three hundred and sixty-eight dyads of persons with schizophrenia and their caregivers were recruited from a psychiatric outpatient clinic. The (Y-FBIS) and the Yoruba version of the GHQ-12 (Y-GHQ-12) were applied to the caregivers. Patients' level of social functioning was assessed using the Global Assessment of Functioning scale. Results. All (368) caregivers were used for tests of internal consistency, 180 for interrater reliability, and another 180 for test-retest reliability. Internal consistency of the Y-FBIS was demonstrated by a significant Cronbach α of between 0.62 and 0.82 for each item. Concurrent validity of the Y-FBIS was illustrated by its significant positive correlation with Y-GHQ-12 (r = 0.633 , P < 0.01). Split-half reliability was 0.849. Intraclass correlation coefficient for the total score of Y-FBIS was 0.849 at 95% confidence interval. Test-retest reliability of individual scales ranged from 0.780 to 0.874 and was 0.830 for total objective scale score. Convergent validity was shown by the significant positive correlation (r = 0.83) between the objective burden score and subjective burden score of Y-FBIS. ROC curve area was 0.981. Conclusion. The Y-FBIS is a valid, reliable, and sensitive instrument for assessing the burden on caregivers of persons with schizophrenia in Nigeria. PMID:23738196

Validity and reliability of the Physical Activity Scale for the Elderly (PASE) in Japanese elderly people.

PubMed

Hagiwara, Akiko; Ito, Naomi; Sawai, Kazuhiko; Kazuma, Keiko

2008-09-01

In Japan, there are no valid and reliable physical activity questionnaires for elderly people. In this study, we translated the Physical Activity Scale for the Elderly (PASE) into Japanese and assessed its validity and reliability. Three hundred and twenty-five healthy and elderly subjects over 65 years were enrolled. Concurrent validity was evaluated by Spearman's rank correlation coefficient between PASE scores and an accelerometer (waking steps and energy expenditure), a physical activity questionnaire for adults in general (the Japan Arteriosclerosis Longitudinal Study Physical Activity Questionnaire, JALSPAQ), grip strength, mid-thigh muscle area per bodyweight, static valance and bodyfat percentage. Reliability was evaluated by the test-retest method over a period of 3-4 weeks. The mean PASE score in this study was 114.9. The PASE score was significantly correlated with walking steps (rho = 0.17, P = 0.014), energy expenditure (rho = 0.16, P = 0.024), activity measured with the JALSPAQ (rho = 0.48, P < 0.001), mid-thigh muscle area per bodyweight (rho = 0.15, P = 0.006) and static balance (rho = 0.19, P = 0.001). The proportion of consistency in the response between the first and second surveys was adequately high. The intraclass correlation coefficient for the PASE score was 0.65. The Japanese version of PASE was shown to have acceptable validity and reliability. The PASE is useful to measure the physical activity of elderly people in Japan.

Validation of the state version questionnaire on autonomic regulation (state-aR) for cancer patients

PubMed Central

2011-01-01

Objectives Current quality of life inventories used in oncology mainly measure the effects of chemo- or radiotherapy alongside functional and role scales. A new approach is to measure the autonomic state of regulation with the trait-inventory of autonomic regulation (Trait-aR). Loss of Trait-aR has been shown in different medical conditions such as breast cancer (BC) but not in colorectal cancer patients (CRC). In this paper we report the validation of a new state autonomic regulation scale (State-aR) of the last week. Methods Study 1 included 114 participants: (41 women/16 men with cancer and 57 age- and gender-matched healthy people) to conduct a reliability-, factor- and validity-analysis. Concurrent and convergent validity was evaluated with Trait-aR, Fatigue-Numeri-cal-Scale, Hospital Anxiety and Depression Scale (HADS-D) and the self-regulation scale, 65 participants were retested. Study 2 completed 42 participants: 17 with BC and 25 with CRC receiving chemotherapy. The State-aR was administered prior, during and after chemotherapy for measuring responsiveness. Results The factor analysis loaded to four subscales of State-aR (rest-activity, orthostatic-circulatory, thermosweating and digestive regulation) with a: Cronbach-α rα = 0.77-0.83 and a test-retest-reliability rrt = 0.60-0.80. The sum- and sub scales correlated with their concurrent subscales in the Trait-aR (0.48-0.74) and with the sum-scale moderately with all convergent criteria (r = 0.41 --0.44; p < 0.001). During chemotherapy the State-aR-sum and rest-activity-scale decreased significantly compared to the change in the Trait-aR (p < 0.05). Conclusions These findings support that the state autonomic regulation scale has satisfactory to good reliability, good validity and acceptable responsiveness in the context of chemotherapy treatment. PMID:22024425

Development of a problematic mobile phone use scale for Turkish adolescents.

PubMed

Güzeller, Cem Oktay; Coşguner, Tolga

2012-04-01

Abstract The aim of this study was to evaluate the psychometric properties of the Problematic Mobile Phone Use Scale (PMPUS) for Turkish Adolescents. The psychometric properties of PMPUS were tested in two separate sample groups that consisted of 950 Turkish high school students. The first sample group (n=309) was used to determine the factor structure of the scale. The second sample group (n=461) was used to test data conformity with the identified structure, discriminant validity and concurrent scale validity, internal consistency reliability calculations, and item statistics calculations. The results of exploratory factor analyses indicated that the scale had three factors: interference with negative effect, compulsion/persistence, and withdrawal/tolerance. The results showed that item and construct reliability values yielded satisfactory rates in general for the three-factor construct. On the other hand, the average variance extracted value remained below the scale value for three subscales. The scores for the scale significantly correlated with depression and loneliness. In addition, the discriminant validity value was above the scale in all sub-dimensions except one. Based on these data, the reliability of the PMPUS scale appears to be satisfactory and provides good internal consistency. Therefore, with limited exception, the PMPUS was found to be reliable and valid in the context of Turkish adolescents.

Validity and Reliability of the Turkish version of DSM-5 Social Anxiety Disorder Severity Scale- Child Form.

PubMed

Yalin Sapmaz, Şermin; Ergin, Dilek; Şen Celasin, Nesrin; Karaarslan, Duygu; Öztürk, Masum; Özek Erkuran, Handan; Köroğlu, Ertuğrul; Aydemir, Ömer

2017-12-01

This study aimed to assess the validity and reliability of the Turkish version of the Diagnostic and statistical manual of Mental Disorders. (5 th ed.) (DSM-5) Social Anxiety Disorder Severity Scale- Child Form. The scale was prepared by carrying out the translation and back translation of the DSM-5 Social Anxiety Disorder Severity Scale - Child Form. The study group consisted of 31 patients that had been treated in a child psychiatry unit and diagnosed with social anxiety disorder and 99 healthy volunteers that were attending middle or high school during the study period. For the assessment, the Screen for Child Anxiety and Related Emotional Disorders (SCARED) was also used along with the DSM-5 Social Anxiety Disorder Severity Scale - Child Form. Regarding reliability analyses, Cronbach's alpha internal consistency coefficient was calculated as 0.941, while item-total score correlation coefficients were measured between 0.566 and 0.866. A test-retest correlation coefficient was calculated as r=0.711. As for construct validity, one factor that could explain 66.0 % of the variance was obtained. As for concurrent validity, the scale showed a high correlation with the SCARED. It was concluded that the Turkish version of the DSM-5 Social Anxiety Disorder Severity Scale - Child Form could be utilized as a valid and reliable tool both in clinical practice and for research purposes.

Development and Validation of a Fatigue Assessment Scale for U.S. Construction Workers

PubMed Central

Zhang, Mingzong; Sparer, Emily H.; Murphy, Lauren A.; Dennerlein, Jack T.; Fang, Dongping; Katz, Jeffrey N.; Caban-Martinez, Alberto J.

2015-01-01

Objective To develop a fatigue assessment scale and test its reliability and validity for commercial construction workers. Methods Using a two-phased approach, we first identified items for the development of a Fatigue Assessment Scale for Construction Workers (FASCW) through review of existing scales in the scientific literature, key informant interviews (n=11) and focus groups (3 groups with 6 workers each) with construction workers. The second phase included assessment for the reliability, validity and sensitivity of the new scale using a repeated-measures study design with a convenience sample of construction workers (n=144). Results Phase one resulted in a 16-item preliminary scale that after factor analysis yielded a final 10-item scale with two sub-scales (“Lethargy” and “Bodily Ailment”).. During phase two, the FASCW and its subscales demonstrated satisfactory internal consistency (alpha coefficients were FASCW (0.91), Lethargy (0.86) and Bodily Ailment (0.84)) and acceptable test-retest reliability (Pearson Correlations Coefficients: 0.59–0.68; Intraclass Correlation Coefficients: 0.74–0.80). Correlation analysis substantiated concurrent and convergent validity. A discriminant analysis demonstrated that the FASCW differentiated between groups with arthritis status and different work hours. Conclusions The 10-item FASCW with good reliability and validity is an effective tool for assessing the severity of fatigue among construction workers. PMID:25603944

Validity and reliability of the Short Physical Performance Battery (SPPB): a pilot study on mobility in the Colombian Andes.

PubMed

Gómez, José Fernando; Curcio, Carmen-Lucía; Alvarado, Beatriz; Zunzunegui, María Victoria; Guralnik, Jack

2013-07-01

To assess the validity (convergent and construct) and reliability of the Short Physical Performance Battery (SPPB) among non-disabled adults between 65 to 74 years of age residing in the Andes Mountains of Colombia. Design Validation study; 150 subjects aged 65 to 74 years recruited from elderly associations (day-centers) in Manizales, Colombia. The SPPB tests of balance, including time to walk 4 meters and time required to stand from a chair 5 times were administered to all participants. Reliability was analyzed with a 7-day interval between assessments and use of repeated ANOVA testing. Construct validity was assessed using factor analysis and by testing the relationship between SPPB and depressive symptoms, cognitive function, and self rated health (SRH), while the concurrent validity was measured through relationships with mobility limitations and disability in Activities of Daily Living (ADL). ANOVA tests were used to establish these associations. Test-retest reliability of the SPPB was high: 0.87 (CI95%: 0.77-0.96). A one factor solution was found with three SPPB tests. SPPB was related to self-rated health, limitations in walking and climbing steps and to indicators of disability, as well as to cognitive function and depression. There was a graded decrease in the mean SPPB score with increasing disability and poor health. The Spanish version of SPPB is reliable and valid to assess physical performance among older adults from our region. Future studies should establish their clinical applications and explore usage in population studies.

Validity and reliability of the Short Physical Performance Battery (SPPB)

PubMed Central

Curcio, Carmen-Lucía; Alvarado, Beatriz; Zunzunegui, María Victoria; Guralnik, Jack

2013-01-01

Objectives: To assess the validity (convergent and construct) and reliability of the Short Physical Performance Battery (SPPB) among non-disabled adults between 65 to 74 years of age residing in the Andes Mountains of Colombia. Methods: Design Validation study; Participants: 150 subjects aged 65 to 74 years recruited from elderly associations (day-centers) in Manizales, Colombia. Measurements: The SPPB tests of balance, including time to walk 4 meters and time required to stand from a chair 5 times were administered to all participants. Reliability was analyzed with a 7-day interval between assessments and use of repeated ANOVA testing. Construct validity was assessed using factor analysis and by testing the relationship between SPPB and depressive symptoms, cognitive function, and self rated health (SRH), while the concurrent validity was measured through relationships with mobility limitations and disability in Activities of Daily Living (ADL). ANOVA tests were used to establish these associations. Results: Test-retest reliability of the SPPB was high: 0.87 (CI95%: 0.77-0.96). A one factor solution was found with three SPPB tests. SPPB was related to self-rated health, limitations in walking and climbing steps and to indicators of disability, as well as to cognitive function and depression. There was a graded decrease in the mean SPPB score with increasing disability and poor health. Conclusion: The Spanish version of SPPB is reliable and valid to assess physical performance among older adults from our region. Future studies should establish their clinical applications and explore usage in population studies. PMID:24892614

Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review

PubMed Central

Hanskamp-Sebregts, Mirelle; Zegers, Marieke; Vincent, Charles; van Gurp, Petra J; de Vet, Henrica C W; Wollersheim, Hub

2016-01-01

Objectives Record review is the most used method to quantify patient safety. We systematically reviewed the reliability and validity of adverse event detection with record review. Design A systematic review of the literature. Methods We searched PubMed, EMBASE, CINAHL, PsycINFO and the Cochrane Library and from their inception through February 2015. We included all studies that aimed to describe the reliability and/or validity of record review. Two reviewers conducted data extraction. We pooled κ values (κ) and analysed the differences in subgroups according to number of reviewers, reviewer experience and training level, adjusted for the prevalence of adverse events. Results In 25 studies, the psychometric data of the Global Trigger Tool (GTT) and the Harvard Medical Practice Study (HMPS) were reported and 24 studies were included for statistical pooling. The inter-rater reliability of the GTT and HMPS showed a pooled κ of 0.65 and 0.55, respectively. The inter-rater agreement was statistically significantly higher when the group of reviewers within a study consisted of a maximum five reviewers. We found no studies reporting on the validity of the GTT and HMPS. Conclusions The reliability of record review is moderate to substantial and improved when a small group of reviewers carried out record review. The validity of the record review method has never been evaluated, while clinical data registries, autopsy or direct observations of patient care are potential reference methods that can be used to test concurrent validity. PMID:27550650

First evidence on the validity and reliability of the Safety Organizing Scale-Nursing Home version (SOS-NH).

PubMed

Ausserhofer, Dietmar; Anderson, Ruth A; Colón-Emeric, Cathleen; Schwendimann, René

2013-08-01

The Safety Organizing Scale is a valid and reliable measure on safety behaviors and practices in hospitals. This study aimed to explore the psychometric properties of the Safety Organizing Scale-Nursing Home version (SOS-NH). In a cross-sectional analysis of staff survey data, we examined validity and reliability of the 9-item Safety SOS-NH using American Educational Research Association guidelines. This substudy of a larger trial used baseline survey data collected from staff members (n = 627) in a variety of work roles in 13 nursing homes (NHs) in North Carolina and Virginia. Psychometric evaluation of the SOS-NH revealed good response patterns with low average of missing values across all items (3.05%). Analyses of the SOS-NH's internal structure (eg, comparative fit indices = 0.929, standardized root mean square error of approximation = 0.045) and consistency (composite reliability = 0.94) suggested its 1-dimensionality. Significant between-facility variability, intraclass correlations, within-group agreement, and design effect confirmed appropriateness of the SOS-NH for measurement at the NH level, justifying data aggregation. The SOS-NH showed discriminate validity from one related concept: communication openness. Initial evidence regarding validity and reliability of the SOS-NH supports its utility in measuring safety behaviors and practices among a wide range of NH staff members, including those with low literacy. Further psychometric evaluation should focus on testing concurrent and criterion validity, using resident outcome measures (eg, patient fall rates). Copyright © 2013 American Medical Directors Association, Inc. All rights reserved.

Psychometric properties of the Thai Spiritual Well-Being Scale.

PubMed

Chaiviboontham, Suchira; Phinitkhajorndech, Noppawan; Hanucharurnkul, Somchit; Noipiang, Thaniya

2016-04-01

The purpose of this study was to investigate the psychometric properties of the modified Thai Spiritual Well-Being Scale in patients with advanced cancer. This cross-sectional study was employed to investigate psychometric properties. Some 196 participants from three tertiary hospitals in Bangkok and suburban Thailand were asked to complete a Personal Information Questionnaire (PIQ), The Memorial Symptom Assessment Scale (MSAS), and the Spiritual Well-Being Scale (SWBS). Validity was determined by known-group, concurrent, and constructs validity. Reliability was estimated using internal consistency by Cronbach's α coefficients. Three factors were extracted: so-called existential well-being, religious well-being, and peacefulness accounted for 71.44% of total variance. The Cronbach's α coefficients for total SWB, EWB, RWB, and peacefulness were 0.96, 0.94, and 0.93, respectively. These findings indicate that the Thai SWBS is a valid and reliable instrument, and it presented one more factor than the original version.

The Ritvo Autism Asperger Diagnostic Scale-Revised (RAADS-R): a scale to assist the diagnosis of Autism Spectrum Disorder in adults: an international validation study.

PubMed

Ritvo, Riva Ariella; Ritvo, Edward R; Guthrie, Donald; Ritvo, Max J; Hufnagel, Demetra H; McMahon, William; Tonge, Bruce; Mataix-Cols, David; Jassi, Amita; Attwood, Tony; Eloff, Johann

2011-08-01

The Ritvo Autism Asperger Diagnostic Scale-Revised (RAADS-R) is a valid and reliable instrument to assist the diagnosis of adults with Autism Spectrum Disorders (ASD). The 80-question scale was administered to 779 subjects (201 ASD and 578 comparisons). All ASD subjects met inclusion criteria: DSM-IV-TR, ADI/ADOS diagnoses and standardized IQ testing. Mean scores for each of the questions and total mean ASD vs. the comparison groups' scores were significantly different (p < .0001). Concurrent validity with Constantino Social Responsiveness Scale-Adult = 95.59%. Sensitivity = 97%, specificity = 100%, test-retest reliability r = .987. Cronbach alpha coefficients for the subscales and 4 derived factors were good. We conclude that the RAADS-R is a useful adjunct diagnostic tool for adults with ASD.

The Infant Motor Profile: a standardized and qualitative method to assess motor behaviour in infancy.

PubMed

Heineman, Kirsten R; Bos, Arend F; Hadders-Algra, Mijna

2008-04-01

A reliable and valid instrument to assess neuromotor condition in infancy is a prerequisite for early detection of developmental motor disorders. We developed a video-based assessment of motor behaviour, the Infant Motor Profile (IMP), to evaluate motor abilities, movement variability, ability to select motor strategies, movement symmetry, and fluency. The IMP consists of 80 items and is applicable in children from 3 to 18 months. The present study aimed to test intra- and interobserver reliability and concurrent validity of the IMP with the Alberta Infant Motor Scale (AIMS) and Touwen neurological examination. The study group consisted of 40 low-risk term (median gestational age [GA] 40 wks, range 38-42 wks) and 40 high-risk preterm infants (median GA 29.6 wks, range 26-33 wks) with corrected ages 4 to 18 months (31 females, 49 males). Intra- and interobserver agreement of the IMP were satisfactory (Spearman's rho=0.9). Concurrent validity of IMP and AIMS was good (Spearman's rho=0.8, p<0.005). The IMP was able to differentiate between infants with normal neurological condition, simple minor neurological dysfunction (MND), complex MND, and abnormal neurological condition (p<0.005). This means that the IMP may be a promising tool to evaluate neurological integrity during infancy, a suggestion that needs confirmation by means of assessment of larger groups of infants with heterogeneous neurological conditions.

Camera-tracking gaming control device for evaluation of active wrist flexion and extension.

PubMed

Shefer Eini, Dalit; Ratzon, Navah Z; Rizzo, Albert A; Yeh, Shih-Ching; Lange, Belinda; Yaffe, Batia; Daich, Alexander; Weiss, Patrice L; Kizony, Rachel

Cross sectional. Measuring wrist range of motion (ROM) is an essential procedure in hand therapy clinics. To test the reliability and validity of a dynamic ROM assessment, the Camera Wrist Tracker (CWT). Wrist flexion and extension ROM of 15 patients with distal radius fractures and 15 matched controls were assessed with the CWT and with a universal goniometer. One-way model intraclass correlation coefficient analysis indicated high test-retest reliability for extension (ICC = 0.92) and moderate reliability for flexion (ICC = 0.49). Standard error for extension was 2.45° and for flexion was 4.07°. Repeated-measures analysis revealed a significant main effect for group; ROM was greater in the control group (F[1, 28] = 47.35; P < .001). The concurrent validity of the CWT was partially supported. The results indicate that the CWT may provide highly reliable scores for dynamic wrist extension ROM, and moderately reliable scores for flexion, in people recovering from a distal radius fracture. N/A. Copyright © 2016 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Concurrent validity of different functional and neuroproteomic pain assessment methods in the rat osteoarthritis monosodium iodoacetate (MIA) model.

PubMed

Otis, Colombe; Gervais, Julie; Guillot, Martin; Gervais, Julie-Anne; Gauvin, Dominique; Péthel, Catherine; Authier, Simon; Dansereau, Marc-André; Sarret, Philippe; Martel-Pelletier, Johanne; Pelletier, Jean-Pierre; Beaudry, Francis; Troncy, Eric

2016-06-23

Lack of validity in osteoarthritis pain models and assessment methods is suspected. Our goal was to 1) assess the repeatability and reproducibility of measurement and the influence of environment, and acclimatization, to different pain assessment outcomes in normal rats, and 2) test the concurrent validity of the most reliable methods in relation to the expression of different spinal neuropeptides in a chemical model of osteoarthritic pain. Repeatability and inter-rater reliability of reflexive nociceptive mechanical thresholds, spontaneous static weight-bearing, treadmill, rotarod, and operant place escape/avoidance paradigm (PEAP) were assessed by the intraclass correlation coefficient (ICC). The most reliable acclimatization protocol was determined by comparing coefficients of variation. In a pilot comparative study, the sensitivity and responsiveness to treatment of the most reliable methods were tested in the monosodium iodoacetate (MIA) model over 21 days. Two MIA (2 mg) groups (including one lidocaine treatment group) and one sham group (0.9 % saline) received an intra-articular (50 μL) injection. No effect of environment (observer, inverted circadian cycle, or exercise) was observed; all tested methods except mechanical sensitivity (ICC <0.3), offered good repeatability (ICC ≥0.7). The most reliable acclimatization protocol included five assessments over two weeks. MIA-related osteoarthritic change in pain was demonstrated with static weight-bearing, punctate tactile allodynia evaluation, treadmill exercise and operant PEAP, the latter being the most responsive to analgesic intra-articular lidocaine. Substance P and calcitonin gene-related peptide were higher in MIA groups compared to naive (adjusted P (adj-P) = 0.016) or sham-treated (adj-P = 0.029) rats. Repeated post-MIA lidocaine injection resulted in 34 times lower downregulation for spinal substance P compared to MIA alone (adj-P = 0.029), with a concomitant increase of 17 % in time spent on the PEAP dark side (indicative of increased comfort). This study of normal rats and rats with pain established the most reliable and sensitive pain assessment methods and an optimized acclimatization protocol. Operant PEAP testing was more responsive to lidocaine analgesia than other tests used, while neuropeptide spinal concentration is an objective quantification method attractive to support and validate different centralized pain functional assessment methods.

Validity, Reliability, and Sensitivity of a Volleyball Intermittent Endurance Test.

PubMed

Rodríguez-Marroyo, Jose A; Medina-Carrillo, Javier; García-López, Juan; Morante, Juan C; Villa, José G; Foster, Carl

2017-03-01

To analyze the concurrent and construct validity of a volleyball intermittent endurance test (VIET). The VIET's test-retest reliability and sensitivity to assess seasonal changes was also studied. During the preseason, 71 volleyball players of different competitive levels took part in this study. All performed the VIET and a graded treadmill test with gas-exchange measurement (GXT). Thirty-one of the players performed an additional VIET to analyze the test-retest reliability. To test the VIET's sensitivity, 28 players repeated the VIET and GXT at the end of their season. Significant (P < .001) relationships between VIET distance and maximal oxygen uptake (r = .74) and GXT maximal speed (r = .78) were observed. There were no significant differences between the VIET performance test and retest (1542.1 ± 338.1 vs 1567.1 ± 358.2 m). Significant (P < .001) relationships and intraclass correlation coefficient (ICC) were found (r = .95, ICC = .96) for VIET performance. VIET performance increased significantly (P < .001) with player performance level and was sensitive to fitness changes across the season (1458.8 ± 343.5 vs 1581.1 ± 334.0 m, P < .01). The VIET may be considered a valid, reliable, and sensitive test to assess the aerobic endurance in volleyball players.

A comparison of computer-assisted and manual wound size measurement.

PubMed

Thawer, Habiba A; Houghton, Pamela E; Woodbury, M Gail; Keast, David; Campbell, Karen

2002-10-01

Accurate and precise wound measurements are a critical component of every wound assessment. To examine the reliability and validity of a new computerized technique for measuring human and animal wounds, chronic human wounds (N = 45) and surgical animal wounds (N = 38) were assessed using manual and computerized techniques. Using intraclass correlation coefficients, intrarater and interrater reliability of surface area measurements obtained using the computerized technique were compared to those obtained using acetate tracings and planimetry. A single measurement of surface area using either technique produced excellent intrarater and interrater reliability for both human and animal wounds, but the computerized technique was more precise than the manual technique for measuring the surface area of animal wounds. For both types of wounds and measurement techniques, intrarater and interrater reliability improved when the average of three repeated measurements was obtained. The precision of each technique with human wounds and the precision of the manual technique with animal wounds also improved when three repeated measurement results were averaged. Concurrent validity between the two techniques was excellent for human wounds but poor for the smaller animal wounds, regardless of whether single or the average of three repeated surface area measurements was used. The computerized technique permits reliable and valid assessment of the surface area of both human and animal wounds.

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

The individualized neuromuscular quality of life questionnaire: cultural translation and psychometric validation for the Dutch population.

PubMed

Seesing, Femke M; van Vught, Lisanne Ewm; Rose, Michael R; Drost, Gea; van Engelen, Baziel G M; van der Wilt, Gert-Jan

2015-04-01

In this study we describe the translation and psychometric evaluation of the Dutch Individualized Neuromuscular Quality of Life (INQoL) questionnaire. Backward and forward translation of the questionnaire was executed, and psychometric properties were assessed on the basis of reliability and validity. Two hundred six patients were included in the study. Reliability analyses resulted in Cronbach alpha values of >0.70 for all subdomains. Known-group validity showed a significant correlation between INQoL scores and severity as well as age for the majority of subdomains. Item-total correlation for overall quality of life was satisfactory. Concurrent validity with the SF-36 and EQ-5D was good (range of Spearman correlation coefficients -0.43 to -0.76). This study resulted in a questionnaire that is appropiate for use in the Dutch-speaking population to measure quality of life among patients with a wide variety of muscle disorders. This confirms and extends data obtained in the UK, US, Italy, and Serbia. © 2014 Wiley Periodicals, Inc.

[Cross-cultural adaptation and validation of the Health and Taste Attitude Scale (HTAS) in Portuguese].

PubMed

Koritar, Priscila; Philippi, Sonia Tucunduva; Alvarenga, Marle dos Santos; Santos, Bernardo dos

2014-08-01

The scope of this study was to show the cross-cultural adaptation and validation of the Health and Taste Attitude Scale in Portuguese. The methodology included translation of the scale; evaluation of conceptual, operational and item-based equivalence by 14 experts and 51 female undergraduates; semantic equivalence and measurement assessment by 12 bilingual women by the paired t-test, the Pearson correlation coefficient and the coefficient intraclass correlation; internal consistency and test-retest reliability by Cronbach's alpha and intraclass correlation coefficient, respectively, after application on 216 female undergraduates; assessment of discriminant and concurrent validity via the t-test and Spearman's correlation coefficient, respectively, in addition to Confirmatory Factor and Exploratory Factor Analysis. The scale was considered adequate and easily understood by the experts and university students and presented good internal consistency and reliability (µ 0.86, ICC 0.84). The results show that the scale is valid and can be used in studies with women to better understand attitudes related to taste.

Reliability and Validity of Dual-Task Mobility Assessments in People with Chronic Stroke

PubMed Central

Yang, Lei; He, Chengqi; Pang, Marco Yiu Chung

2016-01-01

Background The ability to perform a cognitive task while walking simultaneously (dual-tasking) is important in real life. However, the psychometric properties of dual-task walking tests have not been well established in stroke. Objective To assess the test-retest reliability, concurrent and known-groups validity of various dual-task walking tests in people with chronic stroke. Design Observational measurement study with a test-retest design. Methods Eighty-eight individuals with chronic stroke participated. The testing protocol involved four walking tasks (walking forward at self-selected and maximal speed, walking backward at self-selected speed, and crossing over obstacles) performed simultaneously with each of the three attention-demanding tasks (verbal fluency, serial 3 subtractions or carrying a cup of water). For each dual-task condition, the time taken to complete the walking task, the correct response rate (CRR) of the cognitive task, and the dual-task effect (DTE) for the walking time and CRR were calculated. Forty-six of the participants were tested twice within 3–4 days to establish test-retest reliability. Results The walking time in various dual-task assessments demonstrated good to excellent reliability [Intraclass correlation coefficient (ICC2,1) = 0.70–0.93; relative minimal detectable change at 95% confidence level (MDC95%) = 29%-45%]. The reliability of the CRR (ICC2,1 = 0.58–0.81) and the DTE in walking time (ICC2,1 = 0.11–0.80) was more varied. The reliability of the DTE in CRR (ICC2,1 = -0.31–0.40) was poor to fair. The walking time and CRR obtained in various dual-task walking tests were moderately to strongly correlated with those of the dual-task Timed-up-and-Go test, thus demonstrating good concurrent validity. None of the tests could discriminate fallers (those who had sustained at least one fall in the past year) from non-fallers. Limitation The results are generalizable to community-dwelling individuals with chronic stroke only. Conclusions The walking time derived from the various dual-task assessments generally demonstrated good to excellent reliability, making them potentially useful in clinical practice and future research endeavors. However, the usefulness of these measurements in predicting falls needs to be further explored. Relatively low reliability was shown in the cognitive outcomes and DTE, which may not be preferred measurements for assessing dual-task performance. PMID:26808662

Psychometric Properties of the Catastrophic Cognitions Questionnaire-Modified (CCQ-Modified) Among Community Samples in Malaysia.

PubMed

Abdul Khaiyom, Jamilah Hanum; Mukhtar, Firdaus; Ibrahim, Normala; Mohd Sidik, Sherina; Oei, Tian Po Sumantri

2016-12-01

The Catastrophic Cognitions Questionnaire-Modified (CCQ-M) is a common instrument for measuring catastrophic thoughts. In some countries, however, CCQ-M still poses concerns following the lack of appropriate validation among their populations. The current study aimed to examine the factor structure of the CCQ-M, the reliability, and the validity in community samples in Malaysia. The Malay version of CCQ-M and additional measures assessing the symptoms and cognitions relevant to anxiety disorders were completed by 682 university students and general community. Exploratory factor analysis revealed a two-factor structure accounting for 62.2% of the total variance. Confirmatory factor analysis confirmed the two-factor model by deleting four items. The Cronbach's alpha coefficients for the total and the two subscales were .94, .90, and .92, respectively. Test-retest reliability analysis was conducted on 82 university students in the interval period of 14 days, and the result was r = .58. Evidence supported the concurrent, convergent, and discriminant validity. In conclusion, the 17-item CCQ-M-Malaysia is a valid and reliable instrument for assessing catastrophic cognitions among Malaysian populations. Copyright © 2015 John Wiley & Sons, Ltd. Copyright © 2015 John Wiley & Sons, Ltd.

Development of the 3-SET 4P questionnaire for evaluating former ICU patients' physical and psychosocial problems over time: a pilot study.

PubMed

Akerman, Eva; Fridlund, Bengt; Ersson, Anders; Granberg-Axéll, Anetth

2009-04-01

Current studies reveal a lack of consensus for the evaluation of physical and psychosocial problems after ICU stay and their changes over time. The aim was to develop and evaluate the validity and reliability of a questionnaire for assessing physical and psychosocial problems over time for patients following ICU recovery. Thirty-nine patients completed the questionnaire, 17 were retested. The questionnaire was constructed in three sets: physical problems, psychosocial problems and follow-up care. Face and content validity were tested by nurses, researchers and patients. The questionnaire showed good construct validity in all three sets and had strong factor loadings (explained variance >70%, factor loadings >0.5) for all three sets. There was good concurrent validity compared with the SF 12 (r(s)>0.5). Internal consistency was shown to be reliable (Cronbach's alpha 0.70-0.85). Stability reliability on retesting was good for the physical and psychosocial sets (r(s)>0.5). The 3-set 4P questionnaire was a first step in developing an instrument for assessment of former ICU patients' problems over time. The sample size was small and thus, further studies are needed to confirm these findings.

Concurrent Validation of the Clinical Opiate Withdrawal Scale (COWS) and Single-Item Indices against the Clinical Institute Narcotic Assessment (CINA) Opioid Withdrawal Instrument

PubMed Central

Tompkins, D. Andrew; Bigelow, George E.; Harrison, Joseph A.; Johnson, Rolley E.; Fudala, Paul J.; Strain, Eric C.

2009-01-01

Introduction The Clinical Opiate Withdrawal Scale (COWS) is an 11-item clinician-administered scale assessing opioid withdrawal. Though commonly used in clinical practice, it has not been systematically validated. The present study validated the COWS in comparison to the validated Clinical Institute Narcotic Assessment (CINA) scale. Method Opioid-dependent volunteers were enrolled in a residential trial and stabilized on morphine 30 mg given subcutaneously four times daily. Subjects then underwent double-blind, randomized challenges of intramuscularly administered placebo and naloxone (0.4 mg) on separate days, during which the COWS, CINA, and visual analog scale (VAS) assessments were concurrently obtained. Subjects completing both challenges were included (N=46). Correlations between mean peak COWS and CINA scores as well as self-report VAS questions were calculated. Results Mean peak COWS and CINA scores of 7.6 and 24.4, respectively, occurred on average 30 minutes post-injection of naloxone. Mean COWS and CINA scores 30 minutes after placebo injection were 1.3 and 18.9, respectively. The Pearson correlation coefficient for peak COWS and CINA scores during the naloxone challenge session was 0.85 (p<0.001). Peak COWS scores also correlated well with peak VAS self-report scores of bad drug effect (r=0.57, p<0.001) and feeling sick (r=0.57, p<0.001), providing additional evidence of concurrent validity. Placebo was not associated with any significant elevation of COWS, CINA, or VAS scores, indicating discriminant validity. Cronbach’s alpha for the COWS was 0.78, indicating good internal consistency (reliability). Discussion COWS, CINA, and certain VAS items are all valid measurement tools for acute opiate withdrawal. PMID:19647958

Brazilian version of the Nottingham Sensory Assessment: validity, agreement and reliability.

PubMed

Lima, Daniela H F; Queiroz, Ana P; De Salvo, Geovana; Yoneyama, Simone M; Oberg, Telma D; Lima, Núbia M F V

2010-01-01

To investigate the inter-rater and intra-rater reliability, construct validity and internal consistency of the Brazilian version of the Nottingham Sensory Assessment for Stroke Patients (NSA). The instrument was translated into Portuguese from its original in English by a bilingual translator and was then back-translated into English. Twenty-one hemiparetics were evaluated by two examiners using the NSA and the Fugl-Meyer Assessment (FMA) of physical performance. Significant correlation were found between the FMA and the NSA (r=0.752). The NSA showed excellent internal consistency (0.86), and there were acceptable inter- and intra-rater reliability for all items of the NSA, except temperature. Significant ceiling effects were found for the NSA and the FMA. The Brazilian version of the NSA met the criteria for agreement, internal consistency and concurrent validity. It was quick and easy to apply, and it could be used within clinical practice in neuro-rehabilitation outpatient clinics to assess sensory functions following stroke. The significant ceiling effect for the NSA did not limit its use, given that for the same patients, the FMA also showed ceiling effects.

Evaluation of a modified interview version and of a self-rating version of the Suicide Assessment Scale.

PubMed

Niméus, A; Hjalmarsson Ståhlfors, F; Sunnqvist, C; Stanley, B; Träskman-Bendz, L

2006-10-01

The Suicide Assessment Scale (SUAS) was constructed to be sensitive to change of suicidality. It was recently found to be predictive of suicide in a group of suicide attempters. The aim of the present study was to evaluate the reliability and validity of a modified interview version of SUAS with defined scores and also a new self-rating version (SUAS-S). The subjects consisted of former inpatients, 42 persons who had been admitted because of a suicide attempt about 12 years ago and 22 control patients. The subjects were rated according to the SUAS, the SUAS-S, as well as the Montgomery Asberg Depression Rating Scale (MADRS). The interrater reliability was found to be high. The SUAS correlated significantly with the MADRS, but the concordance was not consistent, which indicates that the SUAS measures something different from depression. The SUAS-S correlated significantly with the interview-rated SUAS, thus exhibiting good concurrent validity. In summary, both the modified interview version of SUAS and the SUAS-S seem to be valid, reliable and easily used suicide assessment instruments.

Construction of a short form of the healthy eating behaviour inventory for the Japanese population.

PubMed

Shimazaki, Takashi; Iio, Misa; Lee, Ying-Hua; Suzuki, Akiko; Konuma, Kayo; Teshima, Yoko; Takenaka, Koji

2016-09-01

The present study constructed a short form of the Healthy Eating Behavior Inventory suitable for use in the Japanese culture (HEBI-J) and confirmed the scale's preliminary reliability and validity. In Study 1, Japanese adults (N=75) completed a free-response questionnaire about healthy eating behaviours. Thematic analysis was used to identify three factors-balance, pattern, and restriction-associated with healthy eating behaviours and 12 items related to these healthy eating behaviours. In Study 2, Japanese office workers (N=784) completed two questionnaires regarding 12 items of healthy eating behaviours and the dietary stages of change. Confirmatory factor analysis demonstrated that the three-factor model was appropriate (GFI=.94, AGFI=.90, CFI=.90, RMSEA=.08, SRMR=.53). Reliability was confirmed by alpha coefficients and the Spearman-Brown formula. Concurrent validity was confirmed by the relationship between the healthy eating stages. This study demonstrated the preliminary reliability and validity of the HEBI-J. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

Psychometric properties of the Talent Development Environment Questionnaire with Chinese talented athletes.

PubMed

Li, Chunxiao; Martindale, Russell; Wu, Yandan; Si, Gangyan

2018-01-01

The development of talented athletes is a priority for many countries across the world, including China. A validated Chinese 5-factor Talent Development Environment Questionnaire (TDEQ-5) would go some way in helping researchers and practitioners investigate talent development systems within China from an evidence-based perspective. For this purpose, the 25-item English TDEQ-5 was translated to Chinese through a standardised process. The translated scale was then administered to 538 talented Chinese youth athletes. Confirmatory factor analysis revealed adequate model fit of the scale. The internal reliability, concurrent and discriminant validity, and test-retest reliability of the scale were adequately supported. The scale was also invariant across gender. It is recommended that the Chinese TDEQ-5 can be used with confidence in both applied and research settings.

Validity and reliability of an instrumented leg-extension machine for measuring isometric muscle strength of the knee extensors.

PubMed

Ruschel, Caroline; Haupenthal, Alessandro; Jacomel, Gabriel Fernandes; Fontana, Heiliane de Brito; Santos, Daniela Pacheco dos; Scoz, Robson Dias; Roesler, Helio

2015-05-20

Isometric muscle strength of knee extensors has been assessed for estimating performance, evaluating progress during physical training, and investigating the relationship between isometric and dynamic/functional performance. To assess the validity and reliability of an adapted leg-extension machine for measuring isometric knee extensor force. Validity (concurrent approach) and reliability (test and test-retest approach) study. University laboratory. 70 healthy men and women aged between 20 and 30 y (39 in the validity study and 31 in the reliability study). Intraclass correlation coefficient (ICC) values calculated for the maximum voluntary isometric torque of knee extensors at 30°, 60°, and 90°, measured with the prototype and with an isokinetic dynamometer (ICC2,1, validity study) and measured with the prototype in test and retest sessions, scheduled from 48 h to 72 h apart (ICC1,1, reliability study). In the validity analysis, the prototype showed good agreement for measurements at 30° (ICC2,1 = .75, SEM = 18.2 Nm) and excellent agreement for measurements at 60° (ICC2,1 = .93, SEM = 9.6 Nm) and at 90° (ICC2,1 = .94, SEM = 8.9 Nm). Regarding the reliability analysis, between-days' ICC1,1 were good to excellent, ranging from .88 to .93. Standard error of measurement and minimal detectable difference based on test-retest ranged from 11.7 Nm to 18.1 Nm and 32.5 Nm to 50.1 Nm, respectively, for the 3 analyzed knee angles. The analysis of validity and repeatability of the prototype for measuring isometric muscle strength has shown to be good or excellent, depending on the knee joint angle analyzed. The new instrument, which presents a relative low cost and easiness of transportation when compared with an isokinetic dynamometer, is valid and provides consistent data concerning isometric strength of knee extensors and, for this reason, can be used for practical, clinical, and research purposes.

Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

PubMed Central

Benjamin, Sara E; Neelon, Brian; Ball, Sarah C; Bangdiwala, Shrikant I; Ammerman, Alice S; Ward, Dianne S

2007-01-01

Background Few assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed. Methods To measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment. Results For inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%. Conclusion This study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) instrument to researchers and practitioners interested in conducting healthy weight intervention in child care. However, a more robust, less subjective measure would be more appropriate for researchers seeking an outcome measure to assess intervention impact. PMID:17615078

Measuring Adolescent Life Satisfaction: Psychometric Properties of the Satisfaction With Life Scale in a Sample of Italian Adolescents and Young Adults

ERIC Educational Resources Information Center

Di Fabio, Annamaria; Gori, Alessio

2016-01-01

This study examined the factor structure and the psychometric properties of the Satisfaction With Life Scale (SWLS) in a sample of 1,515 Italian (females = 60.26%, males = 39.74%) adolescents and young adults (M[subscript age] = 17.6 years, SD = 1.21). Results confirmed the unidimensionality, good reliability, and concurrent validity of the…

Exploring the Relationship between Social Capitals and English Language Achievement within a Specific Grade and Context

ERIC Educational Resources Information Center

Khodadady, Ebrahim; Pishghadam, Reza; Alaee, Farnaz Farokh

2012-01-01

An achievement test based on schema theory (S-Test) was developed on the passages comprising the English textbook taught at grade three in state high schools in Iran and administered concurrently with a validated and reliable Social Capital Scale (SCS) to four hundred seventy seven male and female participants. The Z-scores obtained on the S-Test…

The Daily Heterosexist Experiences Questionnaire: Measuring Minority Stress Among Lesbian, Gay, Bisexual, and Transgender Adults

PubMed Central

Balsam, Kimberly F.; Beadnell, Blair; Molina, Yamile

2013-01-01

The authors conducted a three-phase, mixed-methods study to develop a self-report measure assessing the unique aspects of minority stress for lesbian, gay, bisexual, and transgender adults. The Daily Heterosexist Experiences Questionnaire has 50 items and nine subscales with acceptable internal reliability, and construct and concurrent validity. Mean sexual orientation and gender differences were found. PMID:24058262

Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon.

PubMed

Kowalewski, Karl-Friedrich; Hendrie, Jonathan D; Schmidt, Mona W; Garrow, Carly R; Bruckner, Thomas; Proctor, Tanja; Paul, Sai; Adigüzel, Davud; Bodenstedt, Sebastian; Erben, Andreas; Kenngott, Hannes; Erben, Young; Speidel, Stefanie; Müller-Stich, Beat P; Nickel, Felix

2017-05-01

Training and assessment outside of the operating room is crucial for minimally invasive surgery due to steep learning curves. Thus, we have developed and validated the sensor- and expert model-based laparoscopic training system, the iSurgeon. Participants of different experience levels (novice, intermediate, expert) performed four standardized laparoscopic knots. Instruments and surgeons' joint motions were tracked with an NDI Polaris camera and Microsoft Kinect v1. With frame-by-frame image analysis, the key steps of suturing and knot tying were identified and registered with motion data. Construct validity, concurrent validity, and test-retest reliability were analyzed. The Objective Structured Assessment of Technical Skills (OSATS) was used as the gold standard for concurrent validity. The system showed construct validity by discrimination between experience levels by parameters such as time (novice = 442.9 ± 238.5 s; intermediate = 190.1 ± 50.3 s; expert = 115.1 ± 29.1 s; p < 0.001), total path length (novice = 18,817 ± 10318 mm; intermediate = 9995 ± 3286 mm; expert = 7265 ± 2232 mm; p < 0.001), average speed (novice = 42.9 ± 8.3 mm/s; intermediate = 52.7 ± 11.2 mm/s; expert = 63.6 ± 12.9 mm/s; p < 0.001), angular path (novice = 20,573 ± 12,611°; intermediate = 8652 ± 2692°; expert = 5654 ± 1746°; p < 0.001), number of movements (novice = 2197 ± 1405; intermediate = 987 ± 367; expert = 743 ± 238; p < 0.001), number of movements per second (novice = 5.0 ± 1.4; intermediate = 5.2 ± 1.5; expert = 6.6 ± 1.6; p = 0.025), and joint angle range (for different axes and joints all p < 0.001). Concurrent validity of OSATS and iSurgeon parameters was established. Test-retest reliability was given for 7 out of 8 parameters. The key steps "wrapping the thread around the instrument" and "needle positioning" were most difficult to learn. Validity and reliability of the self-developed sensor-and expert model-based laparoscopic training system "iSurgeon" were established. Using multiple parameters proved more reliable than single metric parameters. Wrapping of the needle around the thread and needle positioning were identified as difficult key steps for laparoscopic suturing and knot tying. The iSurgeon could generate automated real-time feedback based on expert models which may result in shorter learning curves for laparoscopic tasks. Our next steps will be the implementation and evaluation of full procedural training in an experimental model.

Translation, cultural adaptation, and validation of the Sleep Apnea Quality of Life Index (SAQLI) in Persian-speaking patients with obstructive sleep apnea.

PubMed

Rahavi-Ezabadi, Sara; Amali, Amin; Sadeghniiat-Haghighi, Khosro; Montazeri, Ali; Nedjat, Saharnaz

2016-05-01

The aim of this study was the translation, cross-cultural adaptation, and validation of the Sleep Apnea Quality of Life Index (SAQLI) in Persian-speaking patients with obstructive sleep apnea (OSA). Ninety-six patients with OSA completed a series of questionnaires including SAQLI, Epworth Sleepiness Scale (ESS),10-item Functional Outcomes of Sleep Questionnaire (FOSQ-10), and Medical Outcome Survey Short form 12 (SF-12) for assessment of reliability, validity, and responsiveness of Persian version of SAQLI. The Persian version of SAQLI had a very good internal consistency and also demonstrated good test-retest reliability. Concurrent validity was confirmed by significant correlations with ESS, FOSQ-10 and SF-12 subscale scores. Comparison of SAQLI scores in groups of patients categorized by ESS showed the high discriminative power of this instrument. However, there was no significant difference in the SAQLI scores of patients with mild, moderate, and severe sleep apnea. The results of sensitivity to change verified that the SAQLI was able to detect changes after continuous positive airway pressure (CPAP) treatment. The findings of this study indicate that the Persian version of SAQLI is a reliable, valid, and responsive measure for evaluation of quality of life in patients with OSA.

Validity and reliability of a questionnaire to assess social skills in traumatic brain injury: A preliminary study.

PubMed

Francis, Heather M; Osborne-Crowley, Katherine; McDonald, Skye

2017-01-01

To describe the reliability and validity of a new measure, the Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI). Fifty-one adults with severe TBI completed the SSQ-TBI questionnaire. Scores were compared to informant- and self-report on questionnaires addressing frontal lobe mediated behaviour, as well as performance on an objective measure of social cognition and neuropsychological tasks, in order to provide evidence of concurrent, divergent and predictive validity. Internal consistency was excellent at α = 0.90. Convergent validity was good, with informant ratings on the SSQ-TBI significantly correlated with Neuropsychiatric Inventory Disinhibition sub-scales (r = 0.50-63), the Current Behaviour Scale (r = 0.39-0.48) and Frontal Systems Behaviour Scale (r = 0.60-0.83). However, no relationship was seen with an objective measure of social skills or neuropsychological tasks of disinhibition. There was a significant relationship with real-world psychosocial outcomes on the Sydney Psychosocial Reintegration Scale-2 (r = -0.38--0.69) Conclusions: This study provides preliminary findings of good internal consistency and convergent and predictive validity of a social skills questionnaire adapted to be appropriate for individuals with TBI. Further assessment of psychometric properties such as test-re-test reliability and factor structure is warranted.

Assessing Knowledge Sharing Among Academics: A Validation of the Knowledge Sharing Behavior Scale (KSBS).

PubMed

Ramayah, T; Yeap, Jasmine A L; Ignatius, Joshua

2014-04-01

There is a belief that academics tend to hold on tightly to their knowledge and intellectual resources. However, not much effort has been put into the creation of a valid and reliable instrument to measure knowledge sharing behavior among the academics. To apply and validate the Knowledge Sharing Behavior Scale (KSBS) as a measure of knowledge sharing behavior within the academic community. Respondents (N = 447) were academics from arts and science streams in 10 local, public universities in Malaysia. Data were collected using the 28-item KSBS that assessed four dimensions of knowledge sharing behavior namely written contributions, organizational communications, personal interactions, and communities of practice. The exploratory factor analysis showed that the items loaded on the dimension constructs that they were supposed to represent, thus proving construct validity. A within-factor analysis revealed that each set of items representing their intended dimension loaded on only one construct, therefore establishing convergent validity. All four dimensions were not perfectly correlated with each other or organizational citizenship behavior, thereby proving discriminant validity. However, all four dimensions correlated with organizational commitment, thus confirming predictive validity. Furthermore, all four factors correlated with both tacit and explicit sharing, which confirmed their concurrent validity. All measures also possessed sufficient reliability (α > .70). The KSBS is a valid and reliable instrument that can be used to formally assess the types of knowledge artifacts residing among academics and the degree of knowledge sharing in relation to those artifacts. © The Author(s) 2014.

Validity and reliability of an adapted Thai version of Scoliosis Research Society-22 questionnaire for adolescent idiopathic scoliosis.

PubMed

Sathira-Angkura, Vera; Pithankuakul, Kongkit; Sakulpipatana, Susana; Piyaskulkaew, Chaiwat; Kunakornsawat, Sombat

2012-04-20

Cross-sectional observational study to investigate psychometric properties of an adapted Thai version of the refined Scoliosis Research Society-22 (SRS-22) questionnaire. To evaluate the reliability and validity of the adapted Thai version of the refined SRS-22 questionnaire. The SRS-22 questionnaire is a valid instrument for assessing the health-related quality of life for patients with adolescent idiopathic scoliosis. Recently, the questionnaire has been translated and validated in many languages for non-English-speaking countries. Translation/retranslation of the English version of the SRS-22 was conducted, and the cross-cultural adaptation process was performed. The Thai version SRS-22 and previously validated Thai version Short-Form survey version 2.0 (SF-36V2) questionnaires were administered to 77 patients with adolescent idiopathic scoliosis who had surgical treatment. Fifty-eight patients (52 adolescent girls) had filled out the first set of questionnaires. Thirty patients of the first-time responders completed the second set of questionnaires. The mean age at the time of operation was 14.6 years and the mean age at the time of the final follow-up was 18.7 years. The mean preoperative scoliosis curve magnitude was 55.4° (range, 30°-95°) and postoperative curve magnitude was 20.1° (range, 0°-60°). Internal consistency was determined with Cronbach α coefficient. Intraclass correlation coefficient was used for test-retest reliability. Concurrent validity was evaluated by comparing SRS-22 domains with relevant domains in the SF-36V2 questionnaire, using the Pearson correlation coefficient. The mean overall Cronbach α coefficient of the adapted Thai version SRS-22 was 0.76. The 2 of corresponding domains (mental health = 0.80 and self-image = 0.83) had satisfactory internal consistency and the remaining domains (pain = 0.78; function/activity = 0.74; and satisfaction = 0.76) were good. The intraclass correlation coefficient for 5 domains was ranged from 0.79 to 0.90, which demonstrated the satisfactory test/retest reproducibility. The concurrent validity, determined by the Pearson correlation coefficient between SRS-22 and SF-36V2 domains, had a good correlation for 15 relevant comparisons (r = 0.50-0.75). The adapted Thai version of the SRS-22 questionnaire had validity and reliability, which can be used to assess the outcome of treatment among Thai-speaking patients with adolescent idiopathic scoliosis.

Linguistic adaptation and psychometric evaluation of original Oral Health Literacy-Adult Questionnaire (OHL-AQ).

PubMed

Vyas, Shaleen; Nagarajappa, Sandesh; Dasar, Pralhad L; Mishra, Prashant

2016-10-01

Linguistically adapted oral health literacy tools are helpful to assess oral health literacy among local population with clarity and understandability. The original oral health literacy adult questionnaire, Oral Health Literacy Adult Questionnaire, was given in English (2013), consisting of 17 items under 4 domains. The present study rationalizes to culturally adapt and validate Oral Health Literacy Adult Questionnaire into Hindi language. Thus, we objectified to translate Oral Health Literacy Adult Questionnaire into Hindi and test its psychometric properties like reliability and validity among primary school teachers. The Oral Health Literacy Adult Questionnaire was translated into Oral Health Literacy Adult Questionnaire - Hindi Version using the World Health Organization recommended translation back-translation protocol. During pre-testing, an expert panel assessed content validity of the questionnaire. Face validity was assessed on a small sample of 10 individuals. A cross-sectional study was conducted (June-July 2015) and OHL-AQ-H was administered on a convenient sample of 170 primary school teachers. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and Intra-class correlation coefficient (ICC), respectively, with 2 weeks interval to ascertain adherence to the questionnaire response. Predictive validity was tested by comparing OHL-AQ-H scores with clinical indicators like oral hygiene scores and dental caries scores. The concurrent and discriminant validity was assessed through self-reported oral health and through negative association with sociodemographic variables. The data was analyzed by descriptive tests using chi-square and bivariate logistic regression in SPSS software, version 20 and p<0.05 was considered as the significance level. The mean OHL-AQ-H score was 13.58±2.82. ICC and Cronbach's alpha for Oral Health Literacy Adult Questionnaire - Hindi Version were 0.94 and 0.70, respectively. Comparisons of varying levels of oral health literacy with self-reported oral health established significant concurrent validity (p=0.01). Significant predictive validity was observed between OHL-AQ-H scores and clinical parameters like oral hygiene status (p=0.005) and dentition status (p=0.001). The translated and culturally adapted Oral Health Literacy Adult Questionnaire - Hindi Version indicated good reliability and validity among primary school teachers to assess oral health literacy among Hindi speaking population. Hence, improving OHL levels and implementing education oriented policies can improve the quality of life.

A Chinese version of the Psychotic Symptom Rating Scales: psychometric properties in recent-onset and chronic psychosis.

PubMed

Chien, Wai-Tong; Lee, Isabella Yuet-Ming; Wang, Li-Qun

2017-01-01

The purpose of this study was to test the reliability, validity, and factor structure of a Chinese version of the Psychotic Symptom Rating Scale (PSYRATS) in 198 and 202 adult patients with recent-onset and chronic psychosis, respectively. The PSYRATS has been translated into different language versions and has been validated for clinical and research use mainly in chronic psychotic patients but not in recent-onset psychosis patients or in Chinese populations. The psychometric analysis of the translated Chinese version included assessment of its content validity, semantic equivalence, interrater and test-retest reliability, reproducibility, sensitivity to changes in psychotic symptoms, internal consistency, concurrent validity (compared to a valid psychotic symptom scale), and factor structure. The Chinese version demonstrated very satisfactory content validity as rated by an expert panel, good semantic equivalence with the original version, and high interrater and test-retest (at 2-week interval) reliability. It also indicated very good reproducibility of and sensitivity to changes in psychotic symptoms in line with the symptom severity measured with the Positive and Negative Syndrome Scale (PANSS). The scale consisted of four factors for the hallucination subscale and two factors for the delusion subscale, explaining about 80% of the total variance of the construct, indicating satisfactory correlations between the hallucination and delusion factors themselves, between items, factors, subscales, and overall scale, and between factors and relevant item and subscale scores of the PANSS. The Chinese version of the PSYRATS is a reliable and valid instrument to measure symptom severity in Chinese psychotic patients complementary to other existing measures mainly in English language.

The Smartphone Addiction Scale: Development and Validation of a Short Version for Adolescents

PubMed Central

Kwon, Min; Kim, Dai-Jin; Cho, Hyun; Yang, Soo

2013-01-01

Objective This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. Method A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. Results The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001) and self-evaluation of smartphone addiction (p<.001) showed significant difference. The ROC analysis results showed an area under a curve (AUC) value of 0.963(0.888–1.000), a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887–1.000), a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls. Conclusions The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas. PMID:24391787

The smartphone addiction scale: development and validation of a short version for adolescents.

PubMed

Kwon, Min; Kim, Dai-Jin; Cho, Hyun; Yang, Soo

2013-01-01

This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001) and self-evaluation of smartphone addiction (p<.001) showed significant difference. The ROC analysis results showed an area under a curve (AUC) value of 0.963(0.888-1.000), a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887-1.000), a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls. The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas.

Clinical and Psychometric Evaluations of the Cerebral Vision Screening Questionnaire in 461 Nonaphasic Individuals Poststroke.

PubMed

Neumann, Guenter; Schaadt, Anna-Katharina; Reinhart, Stefan; Kerkhoff, Georg

2016-03-01

Cerebral vision disorders (CVDs) are frequent after brain damage and impair the patient's outcome. Yet clinically and psychometrically validated procedures for the anamnesis of CVD are lacking. To evaluate the clinical validity and psychometric qualities of the Cerebral Vision Screening Questionnaire (CVSQ) for the anamnesis of CVD in individuals poststroke. Analysis of the patients' subjective visual complaints in the 10-item CVSQ in relation to objective visual perimetry, tests of reading, visual scanning, visual acuity, spatial contrast sensitivity, light/dark adaptation, and visual depth judgments. Psychometric analyses of concurrent validity, specificity, sensitivity, positive/negative predictive value, and interrater reliability were also done. Four hundred sixty-one patients with unilateral (39.5% left, 47.5% right) or bilateral stroke (13.0%) were included. Most patients were assessed in the chronic stage, on average 36.7 (range = 1-620) weeks poststroke. The majority of all patients (96.4%) recognized their visual symptoms within 1 week poststroke when asked for specifically. Mean concurrent validity of the CVSQ with objective tests was 0.64 (0.54-0.79, P < .05). The mean positive predictive value was 80.1%, mean negative predictive value 82.9%, mean specificity 81.7%, and mean sensitivity 79.8%. The mean interrater reliability was 0.76 for a 1-week interval between both assessments (all P < .05). The CVSQ is suitable for the anamnesis of CVD poststroke because of its brevity (10 minute), clinical validity, and good psychometric qualities. It, thus, improves neurovisual diagnosis and guides the clinician in the selection of necessary assessments and appropriate neurovisual therapies for the patient. © The Author(s) 2015.

The Behavioural Assessment of Self-Structuring (BASS): psychometric properties in a post-acute brain injury rehabilitation programme.

PubMed

Jackson, Howard F; Tunstall, Victoria; Hague, Gemma; Daniels, Leanne; Crompton, Stacey; Taplin, Kimberly

2014-01-01

Jackson et al. (this edition) argue that structure is an important component in reducing the handicaps caused by cognitive impairments following acquired brain injury and that post-acute neuropsychological brain injury rehabilitation programmes should not only endeavour to provide structure but also aim to develop self-structuring. However, at present there is no standardized device for assessing self-structuring. To provide preliminary analysis of the psychometric properties of the Behavioural Assessment of Self-Structuring (BASS) staff rating scale (a 26 item informant five point rating scale based on the degree of support client requires to achieve self-structuring item). BASS data was utilised for clients attending residential rehabilitation. Reliability (inter-rarer and intra-rater), validity (construct, concurrent and discriminate) and sensitivity to change were investigated. Initial results indicate that the BASS has reasonably good reliability, good construct validity (via principal components analysis), good discriminant validity, and good concurrent validity correlating well with a number of other outcome measures (HoNOS; NPDS, Supervision Rating Scale, MPAI, FIM and FAM). The BASS did not correlate well with the NPCNA. Finally, the BASS was shown to demonstrate sensitivity to change. Although some caution is required in drawing firm conclusions at the present time and further exploration of the psychometric properties of the BASS is required, initial results are encouraging for the use of the BASS in assessing rehabilitation progress. These findings are discussed in terms of the value of the concept of self-structuring to the rehabilitation process for individuals with neuropsychological impairments consequent on acquired brain injury.

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents

PubMed Central

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

Background The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. Method A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. Results The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. Conclusions In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years. PMID:26498182

Reliability, factor structure, and validity of the German version of the Trauma Symptom Checklist for Children in a sample of adolescents.

PubMed

Matulis, Simone; Loos, Laura; Langguth, Nadine; Schreiber, Franziska; Gutermann, Jana; Gawrilow, Caterina; Steil, Regina

2015-01-01

The Trauma Symptom Checklist for Children (TSC-C) is the most widely used self-report scale to assess trauma-related symptoms in children and adolescents on six clinical scales. The purpose of the present study was to develop a German version of the TSC-C and to investigate its psychometric properties, such as factor structure, reliability, and validity, in a sample of German adolescents. A normative sample of N=583 and a clinical sample of N=41 adolescents with a history of physical or sexual abuse aged between 13 and 21 years participated in the study. The Confirmatory Factor Analysis on the six-factor model (anger, anxiety, depression, dissociation, posttraumatic stress, and sexual concerns with the subdimensions preoccupation and distress) revealed acceptable to good fit statistics in the normative sample. One item had to be excluded from the German version of the TSC-C because the factor loading was too low. All clinical scales presented acceptable to good reliability, with Cronbach's α's ranging from .80 to .86 in the normative sample and from .72 to .87 in the clinical sample. Concurrent validity was also demonstrated by the high correlations between the TSC-C scales and instruments measuring similar psychopathology. TSC-C scores reliably differentiated between adolescents with trauma history and those without trauma history, indicating discriminative validity. In conclusion, the German version of the TSC-C is a reliable and valid instrument for assessing trauma-related symptoms on six different scales in adolescents aged between 13 and 21 years.

Assessing functional mobility in survivors of lower-extremity sarcoma: reliability and validity of a new assessment tool.

PubMed

Marchese, Victoria G; Rai, Shesh N; Carlson, Claire A; Hinds, Pamela S; Spearing, Elena M; Zhang, Lijun; Callaway, Lulie; Neel, Michael D; Rao, Bhaskar N; Ginsberg, Jill P

2007-08-01

Reliability and validity of a new tool, Functional Mobility Assessment (FMA), were examined in patients with lower-extremity sarcoma. FMA requires the patients to physically perform the functional mobility measures, unlike patient self-report or clinician administered measures. A sample of 114 subjects participated, 20 healthy volunteers and 94 patients with lower-extremity sarcoma after amputation, limb-sparing, or rotationplasty surgery. Reliability of the FMA was examined by three raters testing 20 healthy volunteers and 23 subjects with lower-extremity sarcoma. Concurrent validity was examined using data from 94 subjects with lower-extremity sarcoma who completed the FMA, Musculoskeletal Tumor Society (MSTS), Short-Form 36 (SF-36v2), and Toronto Extremity Salvage Scale (TESS) scores. Construct validity was measured by the ability of the FMA to discriminate between subjects with and without functional mobility deficits. FMA demonstrated excellent reliability (ICC [2,1] >or=0.97). Moderate correlations were found between FMA and SF-36v2 (r = 0.60, P < 0.01), FMA and MSTS (r = 0.68, P < 0.01), and FMA and TESS (r = 0.62, P < 0.01). The patients with lower-extremity sarcoma scored lower on the FMA as compared to healthy controls (P < 0.01). The FMA is a reliable and valid functional outcome measure for patients with lower-extremity sarcoma. This study supports the ability of the FMA to discriminate between patients with varying functional abilities and supports the need to include measures of objective functional mobility in examination of patients with lower-extremity sarcoma.

Reliability and validity of a brief questionnaire to assess television viewing and computer use by middle school children.

PubMed

Schmitz, Kathryn H; Harnack, Lisa; Fulton, Janet E; Jacobs, David R; Gao, Shujun; Lytle, Leslie A; Van Coevering, Pam

2004-11-01

Sedentary behaviors, like television viewing, are positively associated with overweight among young people. To monitor national health objectives for sedentary behaviors in young adolescents, this project developed and assessed the reliability and validity of a brief questionnaire to measure weekly television viewing, usual television viewing, and computer use by middle school children. Reliability and validity of the Youth Risk Behavior Survey (YRBS) question on weekday television viewing also were examined. A brief, five-item television and computer use questionnaire was completed twice by 245 middle school children with one week apart. To concurrently assess validity, students also completed television and computer use logs for seven days. Among all students, Spearman correlations for test-retest reliability for television viewing and computer use ranged from 0.55 to 0.68. Spearman correlations between the first questionnaire and the seven-day log produced the following results: YRBS question for weekday television viewing (0.46), weekend television viewing (0.37), average television viewing over the week (0.47), and computer use (0.39). Methods comparison analysis showed a mean difference (hours/week) between answers to questionnaire items and the log of -0.04 (1.70 standard deviation [SD]) hours for weekday television, -0.21 (2.54 SD) for weekend television, -0.09 (1.75 SD) for average television over the week, and 0.68 (1.26 SD) for computer use. The YRBS weekday television viewing question, and the newly developed questions to assess weekend television viewing, average television viewing, and computer use, produced adequate reliability and validity for surveillance of middle school students.

Reliability and concurrent validity of the iPhone® Compass application to measure thoracic rotation range of motion (ROM) in healthy participants

PubMed Central

Schram, Ben; Cox, Alistair J.; Anderson, Sarah L.; Keogh, Justin

2018-01-01

Background Several water-based sports (swimming, surfing and stand up paddle boarding) require adequate thoracic mobility (specifically rotation) in order to perform the appropriate activity requirements. The measurement of thoracic spine rotation is problematic for clinicians due to a lack of convenient and reliable measurement techniques. More recently, smartphones have been used to quantify movement in various joints in the body; however, there appears to be a paucity of research using smartphones to assess thoracic spine movement. Therefore, the aim of this study is to determine the reliability (intra and inter rater) and validity of the iPhone® app (Compass) when assessing thoracic spine rotation ROM in healthy individuals. Methods A total of thirty participants were recruited for this study. Thoracic spine rotation ROM was measured using both the current clinical gold standard, a universal goniometer (UG) and the Smart Phone Compass app. Intra-rater and inter-rater reliability was determined with a Intraclass Correlation Coefficient (ICC) and associated 95% confidence intervals (CI). Validation of the Compass app in comparison to the UG was measured using Pearson’s correlation coefficient and levels of agreement were identified with Bland–Altman plots and 95% limits of agreement. Results Both the UG and Compass app measurements both had excellent reproducibility for intra-rater (ICC 0.94–0.98) and inter-rater reliability (ICC 0.72–0.89). However, the Compass app measurements had higher intra-rater reliability (ICC = 0.96 − 0.98; 95% CI [0.93–0.99]; vs. ICC = 0.94 − 0.98; 95% CI [0.88–0.99]) and inter-rater reliability (ICC = 0.87 − 0.89; 95% CI [0.74–0.95] vs. ICC = 0.72 − 0.82; 95% CI [0.21–0.94]). A strong and significant correlation was found between the UG and the Compass app, demonstrating good concurrent validity (r = 0.835, p < 0.001). Levels of agreement between the two devices were 24.8° (LoA –9.5°, +15.3°). The UG was found to consistently measure higher values than the compass app (mean difference 2.8°, P < 0.001). Conclusion This study reveals that the iPhone® app (Compass) is a reliable tool for measuring thoracic spine rotation which produces greater reproducibility of measurements both within and between raters than a UG. As a significant positive correlation exists between the Compass app and UG, this supports the use of either device in clinical practice as a reliable and valid tool to measure thoracic rotation. Considering the levels of agreement are clinically unacceptable, the devices should not be used interchangeably for initial and follow up measurements. PMID:29568701

Reliability and concurrent validity of the iPhone® Compass application to measure thoracic rotation range of motion (ROM) in healthy participants.

PubMed

Furness, James; Schram, Ben; Cox, Alistair J; Anderson, Sarah L; Keogh, Justin

2018-01-01

Several water-based sports (swimming, surfing and stand up paddle boarding) require adequate thoracic mobility (specifically rotation) in order to perform the appropriate activity requirements. The measurement of thoracic spine rotation is problematic for clinicians due to a lack of convenient and reliable measurement techniques. More recently, smartphones have been used to quantify movement in various joints in the body; however, there appears to be a paucity of research using smartphones to assess thoracic spine movement. Therefore, the aim of this study is to determine the reliability (intra and inter rater) and validity of the iPhone ® app (Compass) when assessing thoracic spine rotation ROM in healthy individuals. A total of thirty participants were recruited for this study. Thoracic spine rotation ROM was measured using both the current clinical gold standard, a universal goniometer (UG) and the Smart Phone Compass app. Intra-rater and inter-rater reliability was determined with a Intraclass Correlation Coefficient (ICC) and associated 95% confidence intervals (CI). Validation of the Compass app in comparison to the UG was measured using Pearson's correlation coefficient and levels of agreement were identified with Bland-Altman plots and 95% limits of agreement. Both the UG and Compass app measurements both had excellent reproducibility for intra-rater (ICC 0.94-0.98) and inter-rater reliability (ICC 0.72-0.89). However, the Compass app measurements had higher intra-rater reliability ( ICC  = 0.96 - 0.98; 95% CI [0.93-0.99]; vs. ICC  = 0.94 - 0.98; 95% CI [0.88-0.99]) and inter-rater reliability ( ICC  = 0.87 - 0.89; 95% CI [0.74-0.95] vs. ICC  = 0.72 - 0.82; 95% CI [0.21-0.94]). A strong and significant correlation was found between the UG and the Compass app, demonstrating good concurrent validity ( r  = 0.835, p  < 0.001). Levels of agreement between the two devices were 24.8° (LoA -9.5°, +15.3°). The UG was found to consistently measure higher values than the compass app (mean difference 2.8°, P  < 0.001). This study reveals that the iPhone ® app (Compass) is a reliable tool for measuring thoracic spine rotation which produces greater reproducibility of measurements both within and between raters than a UG. As a significant positive correlation exists between the Compass app and UG, this supports the use of either device in clinical practice as a reliable and valid tool to measure thoracic rotation. Considering the levels of agreement are clinically unacceptable, the devices should not be used interchangeably for initial and follow up measurements.

Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID).

PubMed

Sheehan, David V; Sheehan, Kathy H; Shytle, R Douglas; Janavs, Juris; Bannon, Yvonne; Rogers, Jamison E; Milo, Karen M; Stock, Saundra L; Wilkinson, Berney

2010-03-01

To investigate the concurrent validity and reliability of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID), a short structured diagnostic interview for DSM-IV and ICD-10 psychiatric disorders in children and adolescents. Participants were 226 children and adolescents (190 outpatients and 36 controls) aged 6 to 17 years. To assess the concurrent validity of the MINI-KID, participants were administered the MINI-KID and the Schedule for Affective Disorders and Schizophrenia for School Aged Children-Present and Lifetime Version (K-SADS-PL) by blinded interviewers in a counterbalanced order on the same day. Participants also completed a self-rated measure of disability. In addition, interrater (n = 57) and test-retest (n = 83) reliability data (retest interval, 1-5 days) were collected, and agreement between the parent version of the MINI-KID and the standard MINI-KID (n = 140) was assessed. Data were collected between March 2004 and January 2008. Substantial to excellent MINI-KID to K-SADS-PL concordance was found for syndromal diagnoses of any mood disorder, any anxiety disorder, any substance use disorder, any ADHD or behavioral disorder, and any eating disorder (area under curve [AUC] = 0.81-0.96, kappa = 0.56-0.87). Results were more variable for psychotic disorder (AUC = 0.94, kappa = 0.41). Sensitivity was substantial (0.61-1.00) for 15/20 individual DSM-IV disorders. Specificity was excellent (0.81-1.00) for 18 disorders and substantial (> 0.73) for the remaining 2. The MINI-KID identified a median of 3 disorders per subject compared to 2 on the K-SADS-PL and took two-thirds less time to administer (34 vs 103 minutes). Interrater and test-retest kappas were substantial to almost perfect (0.64-1.00) for all individual MINI-KID disorders except dysthymia. Concordance of the parent version (MINI-KID-P) with the standard MINI-KID was good. The MINI-KID generates reliable and valid psychiatric diagnoses for children and adolescents and does so in a third of the time as the K-SADS-PL. (c) 2010 Physicians Postgraduate Press, Inc.

Palliative sedation: reliability and validity of sedation scales.

PubMed

Arevalo, Jimmy J; Brinkkemper, Tijn; van der Heide, Agnes; Rietjens, Judith A; Ribbe, Miel; Deliens, Luc; Loer, Stephan A; Zuurmond, Wouter W A; Perez, Roberto S G M

2012-11-01

Observer-based sedation scales have been used to provide a measurable estimate of the comfort of nonalert patients in palliative sedation. However, their usefulness and appropriateness in this setting has not been demonstrated. To study the reliability and validity of observer-based sedation scales in palliative sedation. A prospective evaluation of 54 patients under intermittent or continuous sedation with four sedation scales was performed by 52 nurses. Included scales were the Minnesota Sedation Assessment Tool (MSAT), Richmond Agitation-Sedation Scale (RASS), Vancouver Interaction and Calmness Scale (VICS), and a sedation score proposed in the Guideline for Palliative Sedation of the Royal Dutch Medical Association (KNMG). Inter-rater reliability was tested with the intraclass correlation coefficient (ICC) and Cohen's kappa coefficient. Correlations between the scales using Spearman's rho tested concurrent validity. We also examined construct, discriminative, and evaluative validity. In addition, nurses completed a user-friendliness survey. Overall moderate to high inter-rater reliability was found for the VICS interaction subscale (ICC = 0.85), RASS (ICC = 0.73), and KNMG (ICC = 0.71). The largest correlation between scales was found for the RASS and KNMG (rho = 0.836). All scales showed discriminative and evaluative validity, except for the MSAT motor subscale and VICS calmness subscale. Finally, the RASS was less time consuming, clearer, and easier to use than the MSAT and VICS. The RASS and KNMG scales stand as the most reliable and valid among the evaluated scales. In addition, the RASS was less time consuming, clearer, and easier to use than the MSAT and VICS. Further research is needed to evaluate the impact of the scales on better symptom control and patient comfort. Copyright © 2012 U.S. Cancer Pain Relief Committee. Published by Elsevier Inc. All rights reserved.

Cross-Cultural Adaptation and Validation of the Italian Version of SWAL-QOL.

PubMed

Ginocchio, Daniela; Alfonsi, Enrico; Mozzanica, Francesco; Accornero, Anna Rosa; Bergonzoni, Antonella; Chiarello, Giulia; De Luca, Nicoletta; Farneti, Daniele; Marilia, Simonelli; Calcagno, Paola; Turroni, Valentina; Schindler, Antonio

2016-10-01

The aim of the study was to evaluate the reliability and validity of the Italian SWAL-QOL (I-SWAL-QOL). The study consisted of five phases: item generation, reliability analysis, normative data generation, validity analysis, and responsiveness analysis. The item generation phase followed the five-step, cross-cultural, adaptation process of translation and back-translation. A group of 92 dysphagic patients was enrolled for the internal consistency analysis. Seventy-eight patients completed the I-SWAL-QOL twice, 2 weeks apart, for test-retest reliability analysis. A group of 200 asymptomatic subjects completed the I-SWAL-QOL for normative data generation. I-SWAL-QOL scores obtained by both the group of dysphagic subjects and asymptomatic ones were compared for validity analysis. I-SWAL-QOL scores were correlated with SF-36 scores in 67 patients with dysphagia for concurrent validity analysis. Finally, I-SWAL-QOL scores obtained in a group of 30 dysphagic patients before and after successful rehabilitation treatment were compared for responsiveness analysis. All the enrolled patients managed to complete the I-SWAL-QOL without needing any assistance, within 20 min. Internal consistency was acceptable for all I-SWAL-QOL subscales (α > 0.70). Test-retest reliability was also satisfactory for all subscales (ICC > 0.7). A significant difference between the dysphagic group and the control group was found in all I-SWAL-QOL subscales (p < 0.05). Mild to moderate correlations between I-SWAL-QOL and SF-36 subscales were observed. I-SWAL-QOL scores obtained in the pre-treatment condition were significantly lower than those obtained after swallowing rehabilitation. I-SWAL-QOL is reliable, valid, responsive to changes in QOL, and recommended for clinical practice and outcome research.

Validation of the German prostate-specific module.

PubMed

Bestmann, Beate; Rohde, Volker; Siebmann, Jens-Ulrich; Galalae, Razvan; Weidner, Wolfgang; Küchler, Thomas

2006-02-01

Theoretically, all patients newly diagnosed with prostate cancer are faced with a choice of treatment options: radical prostatectomy or radio therapy. Although these different treatments may have no differences in terms of survival, they may have very different consequences on the subsequent quality of life (QoL). Prerequisite to analyze QoL is a reliable and valid instrument to assess these differences not only in terms of general QoL (EORTC QLQ-C30) but prostate specific symptoms with a prostate specific module as well. Therefore, the aim of this study was a psychometric evaluation (validation) of the prostate-specific module (PSM). Five historical cohort studies were put together for an empirical meta-analysis. The main objective was to analyze the module's psychometric properties. The total sample consisted of 1,185 patients, of whom 950 completed the QoL questionnaires (EORTC QLQ-C30 and a prostate specific module developed by Kuechler et al.). First step of analysis was a principal component analysis that revealed the following scales: urinary problems, incontinence, erectile dysfunction, sexual problems, problems with partner, pain, heat, nutrition, and psychic strain. The module showed good reliability and concurrent validity and very good construct validity, since the module is able to discriminate between different treatment regimes, tumor stages and age. The German PSM is a reliable, valid and applicable tool for QoL in patients with prostate cancer.

Evaluation of the Cardiac Depression Visual Analogue Scale in a medical and non-medical sample.

PubMed

Di Benedetto, Mirella; Sheehan, Matthew

2014-01-01

Comorbid depression and medical illness is associated with a number of adverse health outcomes such as lower medication adherence and higher rates of subsequent mortality. Reliable and valid psychological measures capable of detecting a range of depressive symptoms found in medical settings are needed. The Cardiac Depression Visual Analogue Scale (CDVAS) is a recently developed, brief six-item measure originally designed to assess the range and severity of depressive symptoms within a cardiac population. The current study aimed to further investigate the psychometric properties of the CDVAS in a general and medical sample. The sample consisted of 117 participants, whose mean age was 40.0 years (SD = 19.0, range 18-84). Participants completed the CDVAS, the Cardiac Depression Scale (CDS), the Depression Anxiety Stress Scales (DASS) and a demographic and health questionnaire. The CDVAS was found to have adequate internal reliability (α = .76), strong concurrent validity with the CDS (r = .89) and the depression sub-scale of the DASS (r = .70), strong discriminant validity and strong predictive validity. The principal components analysis revealed that the CDVAS measured only one component, providing further support for the construct validity of the scale. Results of the current study indicate that the CDVAS is a short, simple, valid and reliable measure of depressive symptoms suitable for use in a general and medical sample.

Psychometrics of the wrist stability and hand mobility subscales of the Fugl-Meyer assessment in moderately impaired stroke.

PubMed

Page, Stephen J; Hade, Erinn; Persch, Andrew

2015-01-01

There remains a need for a quickly administered, stroke-specific, bedside measure of active wrist and finger movement for the expanding stroke population. The wrist stability and hand mobility scales of the upper extremity Fugl-Meyer Assessment (w/h UE FM) constitute a valid, reliable measure of paretic UE impairment in patients with active wrist and finger movement. The aim of this study was to determine performance on the w/h UE FM in a stable cohort of survivors of stroke with only palpable movement in their paretic wrist flexors. A single-center cohort study was conducted. Thirty-two individuals exhibiting stable, moderate upper extremity hemiparesis (15 male, 17 female; mean age=56.6 years, SD=10.1; mean time since stroke=4.6 years, SD=5.8) participated in the study, which was conducted at an outpatient rehabilitation clinic in the midwestern United States. The w/h UE FM and Action Research Arm Test (ARAT) were administered twice. Intraclass correlation coefficients (ICCs), Cronbach alpha, and ordinal alpha were computed to determine reliability, and Spearman rank correlation coefficients and Bland-Altman plots were computed to establish validity. Intraclass correlation coefficients for the w/h UE FM and ARAT were .95 and .99, respectively. The w/h UE FM intrarater reliability and internal consistency were greater than .80, and concurrent validity was greater than .70. This also was the first stroke rehabilitative study to apply ordinal alpha to examine internal consistency values, revealing w/h UE FM levels greater than .85. Concurrent validity findings were corroborated by Bland-Altman plots. It appears that the w/h UE FM is a promising tool to measure distal upper extremity movement in patients with little active paretic wrist and finger movement. This finding widens the segment of patients on whom the w/h UE FM can be effectively used and addresses a gap, as commonly used measures necessitate active distal upper extremity movement. © 2015 American Physical Therapy Association.

Validity and Reliability of the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) in University Students.

PubMed

Tiburcio Sainz, Marcela; Rosete-Mohedano, Ma Guadalupe; Natera Rey, Guillermina; Martínez Vélez, Nora Angélica; Carreño García, Silvia; Pérez Cisneros, Daniel

2016-03-02

The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), developed by the World Health Organization (WHO), has been used successfully in many countries, but there are few studies of its validity and reliability for the Mexican population. The objective of this study was to determine the psychometric properties of the self-administered ASSIST test in university students in Mexico. This was an ex post facto non-experimental study with 1,176 undergraduate students, the majority women (70.1%) aged 18-23 years (89.5%) and single (87.5%). To estimate concurrent validity, factor analysis and tests of reliability and correlation were carried out between the subscale for alcohol and AUDIT, those for tobacco and the Fagerström Test, and those for marijuana and DAST-20. Adequate reliability coefficients were obtained for ASSIST subscales for tobacco (alpha = 0.83), alcohol (alpha = 0.76), and marijuana (alpha = 0.73). Significant correlations were found only with the AUDIT (r = 0.71) and the alcohol subscale. The best balance of sensitivity and specificity of the alcohol subscale (83.8% and 80%, respectively) and the largest area under the ROC curve (81.9%) was found with a cutoff score of 8. The self-administered version of ASSIST is a valid screening instrument to identify at-risk cases due to substance use in this population.

Validity and Reliability of a New Device (WIMU®) for Measuring Hamstring Muscle Extensibility.

PubMed

Muyor, José M

2017-09-01

The aims of the current study were 1) to evaluate the validity of the WIMU ® system for measuring hamstring muscle extensibility in the passive straight leg raise (PSLR) test using an inclinometer for the criterion and 2) to determine the test-retest reliability of the WIMU ® system to measure hamstring muscle extensibility during the PSLR test. 55 subjects were evaluated on 2 separate occasions. Data from a Unilever inclinometer and WIMU ® system were collected simultaneously. Intraclass correlation coefficients (ICCs) for the validity were very high (0.983-1); a very low systematic bias (-0.21°--0.42°), random error (0.05°-0.04°) and standard error of the estimate (0.43°-0.34°) were observed (left-right leg, respectively) between the 2 devices (inclinometer and the WIMU ® system). The R 2 between the devices was 0.999 (p<0.001) in both the left and right legs. The test-retest reliability of the WIMU ® system was excellent, with ICCs ranging from 0.972-0.995, low coefficients of variation (0.01%), and a low standard error of the estimate (0.19-0.31°). The WIMU ® system showed strong concurrent validity and excellent test-retest reliability for the evaluation of hamstring muscle extensibility in the PSLR test. © Georg Thieme Verlag KG Stuttgart · New York.

Design and validation of an automated hydrostatic weighing system.

PubMed

McClenaghan, B A; Rocchio, L

1986-08-01

The purpose of this study was to design and evaluate the validity of an automated technique to assess body density using a computerized hydrostatic weighing system. An existing hydrostatic tank was modified and interfaced with a microcomputer equipped with an analog-to-digital converter. Software was designed to input variables, control the collection of data, calculate selected measurements, and provide a summary of the results of each session. Validity of the data obtained utilizing the automated hydrostatic weighing system was estimated by: evaluating the reliability of the transducer/computer interface to measure objects of known underwater weight; comparing the data against a criterion measure; and determining inter-session subject reliability. Values obtained from the automated system were found to be highly correlated with known underwater weights (r = 0.99, SEE = 0.0060 kg). Data concurrently obtained utilizing the automated system and a manual chart recorder were also found to be highly correlated (r = 0.99, SEE = 0.0606 kg). Inter-session subject reliability was determined utilizing data collected on subjects (N = 16) tested on two occasions approximately 24 h apart. Correlations revealed high relationships between measures of underwater weight (r = 0.99, SEE = 0.1399 kg) and body density (r = 0.98, SEE = 0.00244 g X cm-1). Results indicate that a computerized hydrostatic weighing system is a valid and reliable method for determining underwater weight.

Physical activity measurement instruments for children with cerebral palsy: a systematic review.

PubMed

Capio, Catherine M; Sit, Cindy H P; Abernethy, Bruce; Rotor, Esmerita R

2010-10-01

this paper is a systematic review of physical activity measurement instruments for field-based studies involving children with cerebral palsy (CP). database searches using PubMed Central, MEDLINE, CINAHL Plus, PsycINFO, EMBASE, Cochrane Library, and PEDro located 12 research papers, identifying seven instruments that met the inclusion criteria of (1) having been developed for children aged 0 to 18 years, (2) having been used to evaluate a physical activity dimension, and (3) having been used in a field-based study involving children with CP. The instruments reviewed were the Activities Scale for Kids - Performance version (ASKp), the Canada Fitness Survey, the Children's Assessment of Participation and Enjoyment/Preferences for Activities of Children (CAPE/PAC), the Compendium of Physical Activities, the Physical Activity Questionnaire - Adolescents (PAQ-A), StepWatch, and the Uptimer. Second-round searches yielded 11 more papers, providing reliability and validity evidence for the instruments. the instruments measure physical activity frequency, mode, domain, and duration. Although most instruments demonstrated adequate reliability and validity, only the ASKp and CAPE/PAC have established reliability and validity for children with physical disabilities; the Uptimer has established concurrent validity. No instrument measuring intensity in free-living has been validated or found reliable for children with CP. the findings suggest that further studies are needed to examine the methodological properties of physical activity measurement in children with CP. Combining subjective and objective instruments is recommended to achieve better understanding of physical activity participation.

[Maslach Burnout Inventory - Student Survey: Portugal-Brazil cross-cultural adaptation].

PubMed

Campos, Juliana Alvares Duarte Bonini; Maroco, João

2012-10-01

To perform a cross-cultural adaptation of the Portuguese version of the Maslach Burnout Inventory for students (MBI-SS), and investigate its reliability, validity and cross-cultural invariance. The face validity involved the participation of a multidisciplinary team. Content validity was performed. The Portuguese version was completed in 2009, on the internet, by 958 Brazilian and 556 Portuguese university students from the urban area. Confirmatory factor analysis was carried out using as fit indices: the χ²/df, the Comparative Fit Index (CFI), the Goodness of Fit Index (GFI) and the Root Mean Square Error of Approximation (RMSEA). To verify the stability of the factor solution according to the original English version, cross-validation was performed in 2/3 of the total sample and replicated in the remaining 1/3. Convergent validity was estimated by the average variance extracted and composite reliability. The discriminant validity was assessed, and the internal consistency was estimated by the Cronbach's alpha coefficient. Concurrent validity was estimated by the correlational analysis of the mean scores of the Portuguese version and the Copenhagen Burnout Inventory, and the divergent validity was compared to the Beck Depression Inventory. The invariance of the model between the Brazilian and the Portuguese samples was assessed. The three-factor model of Exhaustion, Disengagement and Efficacy showed good fit (c 2/df = 8.498, CFI = 0.916, GFI = 0.902, RMSEA = 0.086). The factor structure was stable (λ:χ²dif = 11.383, p = 0.50; Cov: χ²dif = 6.479, p = 0.372; Residues: χ²dif = 21.514, p = 0.121). Adequate convergent validity (VEM = 0.45;0.64, CC = 0.82;0.88), discriminant (ρ² = 0.06;0.33) and internal consistency (α = 0.83;0.88) were observed. The concurrent validity of the Portuguese version with the Copenhagen Inventory was adequate (r = 0.21, 0.74). The assessment of the divergent validity was impaired by the approach of the theoretical concept of the dimensions Exhaustion and Disengagement of the Portuguese version with the Beck Depression Inventory. Invariance of the instrument between the Brazilian and Portuguese samples was not observed (λ:χ²dif = 84.768, p<0.001; Cov: χ²dif = 129.206, p < 0.001; Residues: χ²dif = 518.760, p < 0.001). The Portuguese version of the Maslach Burnout Inventory for students showed adequate reliability and validity, but its factor structure was not invariant between the countries, indicating the absence of cross-cultural stability.

[Validation of the Schizophrenia Quality Of Life Scale (SQLS) to Measure Quality of Life in Patients Diagnosed With Schizophrenia in Colombia].

PubMed

Suárez, María Fernanda; Sánchez, Ricardo; Calvo, José Manuel

2013-09-01

To validate the SQLS scale in Colombian patients diagnosed with schizophrenia. The self-report scale was applied to 251 patients. Measures of test-retest reliability, internal consistency and correlation inter-scales with the SF-12 were made by applying the scale 2 days later in 28 patients, and 30 days later in 38; 50 patients filled-out the SF-12 scale to determine the concurrent validity. Three domains were found with all of them having Cronbach's alphas >0.7. The three factors model did not show adequate fit indexes. Test-retest evaluation showed satisfactory correlation values (>0.86). Sensitivity to change did not shown significant differences between the repeated measures. As regards concurrent validity, acceptable correlation values were found only in SF-12 domains related to mental health and functioning. The SQLS has a factorial structure consistent with previous reports, adequate internal consistency and temporal stability. However, a more detailed examination of some of these items is required, considering that the measurement of the construct does not appear to be adequate. Copyright © 2013 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

A comprehensive approach to psychometric assessment of instruments used in dementia educational interventions for health professionals: a cross-sectional study.

PubMed

Wang, Yao; Xiao, Lily Dongxia; He, Guo-Ping

2015-02-01

Suboptimal care for people with dementia in hospital settings has been reported and is attributed to the lack of knowledge and inadequate attitudes in dementia care among health professionals. Educational interventions have been widely used to improve care outcomes; however, Chinese-language instruments used in dementia educational interventions for health professionals are lacking. The aims of this study were to select, translate and evaluate instruments used in dementia educational interventions for Chinese health professionals in acute-care hospitals. A cross-sectional study design was used. A modified stratified random sampling was used to recruit 442 participants from different levels of hospitals in Changsha, China. Dementia care competence was used as a framework for the selection and evaluation of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale for health professionals in the study. These two scales were translated into Chinese using forward and back translation method. Content validity, test-retest reliability and internal consistency were assessed. Construct validity was tested using exploratory factor analysis. Known-group validity was established by comparing scores of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale in two sub-groups. A person-centred care scale was utilised as a gold standard to establish concurrent validity of these two scales. Results demonstrated acceptable content validity, internal consistency, test-retest reliability and concurrent validity. Exploratory factor analysis presented a single-factor structure of the Chinese Alzheimer's Disease Knowledge Scale and a two-factor structure of the Chinese Dementia Care Attitudes Scale, supporting the conceptual dimensions of the original scales. The Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale demonstrated known-group validity evidenced by significantly higher scores identified from the sub-group with a longer work experience compared to those in the sub-group with less work experience. The use of dementia care competence as a framework to inform the selection and evaluation of instruments used in dementia educational interventions for health professionals has wide applicability in other areas. The results support that Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale are reliable and valid instruments for health professionals to use in acute-care settings. Copyright © 2014 Elsevier Ltd. All rights reserved.

Psychometric Properties and Validation of the Arabic Social Media Addiction Scale.

PubMed

Al-Menayes, Jamal

2015-01-01

This study investigated the psychometric properties of the Arabic version of the SMAS. SMAS is a variant of IAT customized to measure addiction to social media instead of the Internet as a whole. Using a self-report instrument on a cross-sectional sample of undergraduate students, the results revealed the following. First, the exploratory factor analysis showed that a three-factor model fits the data well. Second, concurrent validity analysis showed the SMAS to be a valid measure of social media addiction. However, further studies and data should verify the hypothesized model. Finally, this study showed that the Arabic version of the SMAS is a valid and reliable instrument for use in measuring social media addiction in the Arab world.

Psychometric Properties and Validation of the Arabic Social Media Addiction Scale

PubMed Central

Al-Menayes, Jamal

2015-01-01

This study investigated the psychometric properties of the Arabic version of the SMAS. SMAS is a variant of IAT customized to measure addiction to social media instead of the Internet as a whole. Using a self-report instrument on a cross-sectional sample of undergraduate students, the results revealed the following. First, the exploratory factor analysis showed that a three-factor model fits the data well. Second, concurrent validity analysis showed the SMAS to be a valid measure of social media addiction. However, further studies and data should verify the hypothesized model. Finally, this study showed that the Arabic version of the SMAS is a valid and reliable instrument for use in measuring social media addiction in the Arab world. PMID:26347848

Psychometric properties of the Spanish version of the Adolescent Stress Questionnaire (ASQ-S).

PubMed

Lima, Juan F; Alarcón, Rafael; Escobar, Milagros; Fernández-Baena, F Javier; Muñoz, Ángela M; Blanca, María J

2017-10-01

The aim of this study was to develop a Spanish version of the Adolescent Stress Questionnaire and to examine its psychometric properties: factor structure, measurement invariance across samples, reliability, and concurrent validity. Participants consisted of 1,560 Spanish students between 12 and 18 years of age. The results support a structure based on 10 first-order factors (corresponding to stressors on the dimensions Home Life, School Performance, School Attendance, Romantic Relationships, Peer Pressure, Teacher Interaction, Future Uncertainty, School/Leisure Conflict, Financial Pressure, and Emerging Adult Responsibility) and 1 second-order factor that subsumes the first-order factors. This model was selected for measurement invariance testing because it showed good fit indexes and was more parsimonious than the first-order factor model. This structure was replicated across 2 independent samples from the same population, as well as across 3 age groups (early, middle, and late adolescence), showing acceptable fit for all groups. Internal consistency and test-retest reliability were adequate. Evidence of concurrent validity was provided by positive associations with measures of stress manifestations, anxiety, and depression, and by a negative association with life satisfaction. The results indicate that the Spanish version of the Adolescent Stress Questionnaire is a suitable tool for assessing stressors in Spanish adolescents. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Cross-cultural validation of the St. Louis Inventory of Community Living Skills for Chinese patients with schizophrenia in Hong Kong.

PubMed

Au, Raymond Wing Cheong; Tam, Peter Wai Chung; Tam, Gladys Wai Chi; Ungvari, Gabor Sander

2005-01-01

The study validated a culturally sensitive community living skills rating scale for Chinese patients by adapting the St. Louis Inventory of Community Living Skills (SLICLS). The Chinese version (SLICLS-C) was produced by forward and backward translation. An expert panel evaluated its content validity. Its internal consistency, inter-rater reliability, construct and concurrent validity were tested on 80 DSM-IV schizophrenia inpatients in a long-term facility. For predictive validity, the above sample was extended to ensure at least 20 subjects discharged to each of three levels of community care were included in the study sample. The SLICLS-C was psychometrically sound and could be used for predicting level of community care, program evaluation and measuring outcome.

Validation of the Dementia Care Assessment Packet-Instrumental Activities of Daily Living

PubMed Central

Lee, Seok Bum; Park, Jeong Ran; Yoo, Jeong-Hwa; Park, Joon Hyuk; Lee, Jung Jae; Yoon, Jong Chul; Jhoo, Jin Hyeong; Lee, Dong Young; Woo, Jong Inn; Han, Ji Won; Huh, Yoonseok; Kim, Tae Hui

2013-01-01

Objective We aimed to evaluate the psychometric properties of the IADL measure included in the Dementia Care Assessment Packet (DCAP-IADL) in dementia patients. Methods The study involved 112 dementia patients and 546 controls. The DCAP-IADL was scored in two ways: observed score (OS) and predicted score (PS). The reliability of the DCAP-IADL was evaluated by testing its internal consistency, inter-rater reliability and test-retest reliability. Discriminant validity was evaluated by comparing the mean OS and PS between dementia patients and controls by ANCOVA. Pearson or Spearman correlation analysis was performed with other instruments to assess concurrent validity. Receiver operating characteristics curve analysis was performed to examine diagnostic accuracy. Results Chronbach's α coefficients of the DCAP-IADL were above 0.7. The values in dementia patients were much higher (OS=0.917, PS=0.927), indicating excellent degrees of internal consistency. Inter-rater reliabilities and test-retest reliabilities were statistically significant (p<0.05). PS exhibited higher reliabilities than OS. The mean OS and PS of dementia patients were significantly higher than those of the non-demented group after controlling for age, sex and education level. The DCAP-IADL was significantly correlated with other IADL instruments and MMSE-KC (p<0.001). Areas under the curves of the DCAP-IADL were above 0.9. Conclusion The DCAP-IADL is a reliable and valid instrument for evaluating instrumental ability of daily living for the elderly, and may also be useful for screening dementia. Moreover, administering PS may enable the DCAP-IADL to overcome the differences in gender, culture and life style that hinders accurate evaluation of the elderly in previous IADL instruments. PMID:24302946

Internet Gaming Disorder Among Slovenian Primary Schoolchildren: Findings From a Nationally Representative Sample of Adolescents

PubMed Central

Pontes, Halley M.; Macur, Mirna; Griffiths, Mark D.

2016-01-01

Background and aims Since the inclusion of Internet Gaming Disorder (IGD) in the latest (fifth) edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) as a tentative disorder, a few psychometric screening instruments have been developed to assess IGD, including the 9-item Internet Gaming Disorder Scale – Short-Form (IGDS9-SF) – a short, valid, and reliable instrument. Methods Due to the lack of research on IGD in Slovenia, this study aimed to examine the psychometric properties of the IGDS9-SF in addition to investigating the prevalence rates of IGD in a nationally representative sample of eighth graders from Slovenia (N = 1,071). Results The IGDS9-SF underwent rigorous psychometric scrutiny in terms of validity and reliability. Construct validation was investigated with confirmatory factor analysis to examine the factorial structure of the IGDS9-SF and a unidimensional structure appeared to fit the data well. Concurrent and criterion validation were also investigated by examining the association between IGD and relevant psychosocial and game-related measures, which warranted these forms of validity. In terms of reliability, the Slovenian version IGDS9-SF obtained excellent results regarding its internal consistency at different levels, and the test appears to be a valid and reliable instrument to assess IGD among Slovenian youth. Finally, the prevalence rates of IGD were found to be around 2.5% in the whole sample and 3.1% among gamers. Discussion and conclusion Taken together, these results illustrate the suitability of the IGDS9-SF and warrants further research on IGD in Slovenia. PMID:27363464

Psychometric Testing of the Chinese-Version Glover-Nilsson Smoking Behavioral Questionnaire (GN-SBQ-C) for the Identification of Nicotine Dependence in Adult Smokers in Taiwan.

PubMed

Chen, Shu-Ching; Chen, Hsiu-Fang; Peng, Hsi-Ling; Lee, Li-Yun; Chiang, Ting-Yu; Chiu, Hui-Chuan

2017-04-01

The purposes of this study were to evaluate the psychometric properties, reliability, and validity of the Chinese-version Glover-Nilsson Smoking Behavioral Questionnaire (GN-SBQ-C) and assess the behavioral nicotine dependence among community-dwelling adult smokers in Taiwan. The methods used were survey design, administration, and validation. A total of 202 adult smokers completed a survey to assess behavioral dependence, nicotine dependence, depression, social support, and demographic and smoking characteristics. Data analysis included descriptive statistics, internal consistency reliability, t test, exploratory factor analysis, independent t test, and Pearson product moment correlation. The results showed that (1) the GN-SBQ-C has good internal consistency reliability and stability (2-week test-retest reliability); (2) the extracted one factor explained 41.80 % of the variance, indicating construct validity; (3) the scale has acceptable concurrent validity, with significant positive correlation between the GN-SBQ-C and nicotine dependence, depression, and time smoking and negative correlation between the GN-SBQ-C and age and exercise habit; and (4) the instrument has discriminant validity, supported by significant differences between those with high and low-to-moderate nicotine dependence, smokers greater than 43 years old and those 43 years old and younger, and those who smoked 10 years or less and those smoking more than 10 years. The 11-item GN-SBQ-C has satisfactory psychometric properties when applied in a sample of Taiwanese adult smokers. The scale is feasible and valid to use to assess smoking behavioral dependence.

Technical analysis of the Slosson Written Expression Test.

PubMed

Erford, Bradley T; Hofler, Donald B

2004-06-01

The Slosson Written Expression Test was designed to assess students ages 8-17 years at risk for difficulties in written expression. Scores from three independent samples were used to evaluate the test's reliability and validity for measuring students' written expression. Test-retest reliability of the SWET subscales ranged from .80 to .94 (n = 151), and .95 for the Written Expression Total Standard Scores. The median alternate-form reliability for students' Written Expression Total Standard Scores was .81 across the three forms. Scores on the Slosson test yielded concurrent validity coefficients (n = 143) of .60 with scores from the Woodcock-Johnson: Tests of Achievement-Third Edition Broad Written Language Domain and .49 with scores on the Test of Written Language-Third Edition Spontaneous Writing Quotient. Exploratory factor analytic procedures suggested the Slosson test is comprised of two dimensions, Writing Mechanics and Writing Maturity (47.1% and 20.1% variance accounted for, respectively). In general, the Slosson Written Expression Test presents with sufficient technical characteristics to be considered a useful written expression screening test.

The psychometric properties of the Portuguese version of the Personality Inventory for DSM-5.

PubMed

Pires, Rute; Sousa Ferreira, Ana; Guedes, David

2017-10-01

The DSM-5 Section III proposes a hybrid dimensional-categorical model of conceptualizing personality and its disorders that includes assessment of impairments in personality functioning (criterion A) and maladaptive personality traits (criterion B). The Personality Inventory for the DSM-5 is a new dimensional tool, composed of 220 items organized into 25 facets that delineate five higher order domains of clinically relevant personality differences, and was developed to operationalize the DSM-5 model of pathological personality traits. The current studies address the internal consistency (study 1), the test-retest reliability (study 2) and the criterion validity (studies 3 and 4) of the Portuguese version of the PID-5 in samples of native speaking psychology students. Results indicated good internal consistency reliabilities and good temporal stability reliabilities for the majority of the PID-5 traits. The correlational pattern of the PID-5 traits with two measures of personality was in accordance with theoretical expectations and showed its concurrent validity. © 2017 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

Psychometric properties of the Chinese version of the Psycho-educational Profile-Revised (CPEP-R).

PubMed

Shek, Daniel T L; Tsang, Sandra K M; Lam, Lorinda L; Tang, Florence L Y; Cheung, Penita M P

2005-02-01

The purpose of this study was to examine the reliability and validity of the Chinese version of the Psycho-educational Profile-Revised (PEP-R). The Chinese PEP-R (CPEP-R) was administered to 63 preschool children with symptoms of autistic disorder recruited from special child-care centers in Hong Kong. Results showed that the scales of the CPEP-R were internally consistent, reliable across raters and temporally stable. Regarding the concurrent validity of the CPEP-R, the developmental score and developmental age assessed by the CPEP-R were significantly correlated with the Merrill-Palmer Scale of Mental Tests and the Hong Kong Based Adaptive Behavior Scale. The Behavioral Scale of the CPEP-R was also significantly related to the Childhood Autism Rating Scale. Besides replicating the findings in the Western context, the present study suggests that the psychometric properties of the PEP-R are stable across cultures and the related findings support the cross-cultural reliability of the tool.

Relative and absolute reliability of the clinical version of the Narrow Path Walking Test (NPWT) under single and dual task conditions.

PubMed

Gimmon, Yoav; Jacob, Grinshpon; Lenoble-Hoskovec, Constanze; Büla, Christophe; Melzer, Itshak

2013-01-01

Decline in gait stability has been associated with increased fall risk in older adults. Reliable and clinically feasible methods of gait instability assessment are needed. This study evaluated the relative and absolute reliability and concurrent validity of the testing procedure of the clinical version of the Narrow Path Walking Test (NPWT) under single task (ST) and dual task (DT) conditions. Thirty independent community-dwelling older adults (65-87 years) were tested twice. Participants were instructed to walk within the 6-m narrow path without stepping out. Trial time, number of steps, trial velocity, number of step errors, and number of cognitive task errors were determined. Intraclass correlation coefficients (ICCs) were calculated as indices of agreement, and a graphic approach called "mountain plot" was applied to help interpret the direction and magnitude of disagreements between testing procedures. Smallest detectable change and smallest real difference (SRD) were computed to determine clinically relevant improvement at group and individual levels, respectively. Concurrent validity was assessed using Performance Oriented Mobility Assessment Tool (POMA) and the Short Physical Performance Battery (SPPB). Test-retest agreement (ICC1,2) varied from 0.77 to 0.92 in ST and from 0.78 to 0.92 in DT conditions, with no apparent systematic differences between testing procedures demonstrated by the mountain plot graphs. Smallest detectable change and smallest real change were small for motor task performance and larger for cognitive errors. Significant correlations were observed for trial velocity and trial time with POMA and SPPB. The present results indicate that the NPWT testing procedure is highly reliable and reproducible. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Assessment scale of risk for surgical positioning injuries 1

PubMed Central

Lopes, Camila Mendonça de Moraes; Haas, Vanderlei José; Dantas, Rosana Aparecida Spadoti; de Oliveira, Cheila Gonçalves; Galvão, Cristina Maria

2016-01-01

ABSTRACT Objective: to build and validate a scale to assess the risk of surgical positioning injuries in adult patients. Method: methodological research, conducted in two phases: construction and face and content validation of the scale and field research, involving 115 patients. Results: the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning contains seven items, each of which presents five subitems. The scale score ranges between seven and 35 points in which, the higher the score, the higher the patient's risk. The Content Validity Index of the scale corresponded to 0.88. The application of Student's t-test for equality of means revealed the concurrent criterion validity between the scores on the Braden scale and the constructed scale. To assess the predictive criterion validity, the association was tested between the presence of pain deriving from surgical positioning and the development of pressure ulcer, using the score on the Risk Assessment Scale for the Development of Injuries due to Surgical Positioning (p<0.001). The interrater reliability was verified using the intraclass correlation coefficient, equal to 0.99 (p<0.001). Conclusion: the scale is a valid and reliable tool, but further research is needed to assess its use in clinical practice. PMID:27579925

IMatter: validation of the NHS Scotland Employee Engagement Index.

PubMed

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

The therapeutic factor inventory-8: Using item response theory to create a brief scale for continuous process monitoring for group psychotherapy.

PubMed

Tasca, Giorgio A; Cabrera, Christine; Kristjansson, Elizabeth; MacNair-Semands, Rebecca; Joyce, Anthony S; Ogrodniczuk, John S

2016-01-01

We tested a very brief version of the 23-item Therapeutic Factors Inventory-Short Form (TFI-S), and describe the use of Item Response Theory (IRT) for the purpose of developing short and reliable scales for group psychotherapy. Group therapy patients (N = 578) completed the TFI-S on one occasion, and their data were used for the IRT analysis. Of those, 304 completed the TFI-S and other measures on more than one occasion to assess sensitivity to change, concurrent, and predictive validity of the brief version. Results suggest that the new TFI-8 is a brief, reliable, and valid measure of a higher-order group therapeutic factor. The TFI-8 may be used for continuous process measurement and feedback to improve the functioning of therapy groups.

Standardization of Brief Inventory of Social Support Exchange Network (BISSEN) in Japan.

PubMed

Aiba, Miyuki; Tachikawa, Hirokazu; Fukuoka, Yoshiharu; Lebowitz, Adam; Shiratori, Yuki; Doi, Nagafumi; Matsui, Yutaka

2017-07-01

This study describes the Brief Inventory of Social Support Exchange Network (BISSEN) as a standardized brief inventory measuring various aspects of social support. We confirmed the reliability and validity for function and direction of support and standardized the BISSEN. For Sample 1, a stratified random sampling method was used to select 5200 residents in Japan. We conducted mail surveys and responses were retrieved from 2274 participants (collection rate 43.7%). Participants completed a questionnaire packet that included BISSEN, suicidal ideation, depression, support seeking, and Multidimensional Scale of Perceived Social Support (MSPSS). Sample 2 surveys for test-retest reliability were conducted on 23 residents at approximately two-week intervals. Participants were asked about gender, age, and BISSEN. First, we assessed the internal consistency, test-retest reliability, construct, convergent, and concurrent validity. McDonald's omega (.73-.92) and test-retest correlations (.78-.85) demonstrated adequate internal consistency and test-retest reliability. Depression, support seeking, and MSPSS were significantly correlated with all scores of BISSEN. The non-suicidal ideation group had significantly more support compared to the suicidal ideation group. Therefore, function and direction of support in BISSEN had sufficient reliability and validity. Next, we standardized BISSEN using Z-scores and percentile rank with respect to each 12 norm groups by age and gender. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

A Brief Measure of Peer Affiliation and Social Acceptance (PASA): Validity in an Ethnically Diverse Sample of Early Adolescents

PubMed Central

Dishion, Thomas J.; Kim, Hanjoe; Stormshak, Elizabeth A.; O'Neill, Maya

2014-01-01

Objective Conduct a multiagent–multimethod analysis of the validity of a brief measure of deviant peer affiliations and social acceptance (PASA) in young adolescents. Peer relationships are critical to child and adolescent social and emotional development, but currently available measures are tedious and time consuming. The PASA consists of a youth, parent, and teacher report that can be collected longitudinally to study development and intervention effectiveness. Method This longitudinal study included 998 middle school students and their families. We collected the PASA and peer sociometrics data in Grade 7 and a multiagent–multimethod construct of deviant peer clustering in Grade 8. Results Confirmatory factor analyses of the multiagent–multimethod data revealed that the constructs of deviant peer affiliations and social acceptance and rejection were distinguishable as unique but correlated constructs within the PASA. Convergent, discriminant, concurrent, and predictive validity of the PASA was satisfactory, although the acceptance and rejection constructs were highly correlated and showed similar patterns of concurrent validity. Factor invariance was established for mother and for father reports. Conclusions Results suggest that the PASA is a valid and reliable measure of peer affiliation and of social acceptance among peers during the middle school years and provides a comprehensive yet brief assessment of peer affiliations and social acceptance. PMID:24611623

Validity and reliability of the Cognitive Complaints in Bipolar Disorder Rating Assessment (COBRA) in Japanese patients with bipolar disorder.

PubMed

Toyoshima, Kuniyoshi; Fujii, Yutaka; Mitsui, Nobuyuki; Kako, Yuki; Asakura, Satoshi; Martinez-Aran, Anabel; Vieta, Eduard; Kusumi, Ichiro

2017-08-01

In Japan, there are currently no reliable rating scales for the evaluation of subjective cognitive impairment in patients with bipolar disorder. We studied the relationship between the Japanese version of the Cognitive Complaints in Bipolar Disorder Rating Assessment (COBRA) and objective cognitive assessments in patients with bipolar disorder. We further assessed the reliability and validity of the COBRA. Forty-one patients, aged 16-64, in a remission period of bipolar disorder were recruited from Hokkaido University Hospital in Sapporo, Japan. The COBRA (Japanese version) and Frankfurt Complaint Questionnaire (FCQ), the gold standard in subjective cognitive assessment, were administered. A battery of neuropsychological tests was employed to measure objective cognitive impairment. Correlations among the COBRA, FCQ, and neuropsychological tests were determined using Spearman's correlation coefficient. The Japanese version of the COBRA had high internal consistency, good retest reliability, and concurrent validity-as indicated by a strong correlation with the FCQ. A significant correlation was also observed between the COBRA and objective cognitive measurements of processing speed. These findings are the first to demonstrate that the Japanese version of the COBRA may be clinically useful as a subjective cognitive impairment rating scale in Japanese patients with bipolar disorder. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Real-time assessment of perioperative behaviors in children and parents: development and validation of the perioperative adult child behavioral interaction scale.

PubMed

Sadhasivam, Senthilkumar; Cohen, Lindsey L; Hosu, Liana; Gorman, Kristin L; Wang, Yu; Nick, Todd G; Jou, Jing Fang; Samol, Nancy; Szabova, Alexandra; Hagerman, Nancy; Hein, Elizabeth; Boat, Anne; Varughese, Anna; Kurth, Charles Dean; Willging, J Paul; Gunter, Joel B

2010-04-01

Behavior in response to distressful events during outpatient pediatric surgery can contribute to postoperative maladaptive behaviors, such as temper tantrums, nightmares, bed-wetting, and attention seeking. Currently available perioperative behavioral assessment tools have limited utility in guiding interventions to ameliorate maladaptive behaviors because they cannot be used in real time, are only intended to be used during 1 phase of the experience (e.g., perioperative), or provide only a static assessment of the child (e.g., level of anxiety). A simple, reliable, real-time tool is needed to appropriately identify children and parents whose behaviors in response to distressful events at any point in the perioperative continuum could benefit from timely behavioral intervention. Our specific aims were to (1) refine the Perioperative Adult Child Behavioral Interaction Scale (PACBIS) to improve its reliability in identifying perioperative behaviors and (2) validate the refined PACBIS against several established instruments. The PACBIS was used to assess the perioperative behaviors of 89 children aged 3 to 12 years presenting for adenotonsillectomy and their parents. Assessments using the PACBIS were made during perioperative events likely to prove distressing to children and/or parents (perioperative measurement of blood pressure, induction of anesthesia, and removal of the IV catheter before discharge). Static measurements of perioperative anxiety and behavioral compliance during anesthetic induction were made using the modified Yale Preoperative Anxiety Scale and the Induction Compliance Checklist (ICC). Each event was videotaped for later scoring using the Child-Adult Medical Procedure Interaction Scale-Short Form (CAMPIS-SF) and Observational Scale of Behavioral Distress (OSBD). Interrater reliability using linear weighted kappa (kappa(w)) and multiple validations using Spearman correlation coefficients were analyzed. The PACBIS demonstrated good to excellent interrater reliability, with kappa(w) ranging from 0.62 to 0.94. The Child Coping and Child Distress subscores of the PACBIS demonstrated strong concurrent correlations with the modified Yale Preoperative Anxiety Scale, ICC, CAMPIS-SF, and OSBD. The Parent Positive subscore of the PACBIS correlated strongly with the CAMPIS-SF and OSBD, whereas the Parent Negative subscore showed significant correlation with the ICC. The PACBIS has strong construct and predictive validities. The PACBIS is a simple, easy to use, real-time instrument to evaluate perioperative behaviors of both children and parents. It has good to excellent interrater reliability and strong concurrent validity against currently accepted scales. The PACBIS offers a means to identify maladaptive child or parental behaviors in real time, making it possible to intervene to modify such behaviors in a timely fashion.

Reliability and validity of an iPhone(®) application for the measurement of lumbar spine flexion and extension range of motion.

PubMed

Pourahmadi, Mohammad Reza; Taghipour, Morteza; Jannati, Elham; Mohseni-Bandpei, Mohammad Ali; Ebrahimi Takamjani, Ismail; Rajabzadeh, Fatemeh

2016-01-01

Measurement of lumbar spine range of motion (ROM) is often considered to be an essential component of lumbar spine physiotherapy and orthopedic assessment. The measurement can be carried out through various instruments such as inclinometers, goniometers, and etc. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for inclinometric functions. The main purpose was to investigate the reliability and validity of an iPhone(®) app (TiltMeter(©) -advanced level and inclinometer) for measuring standing lumbar spine flexion-extension ROM in asymptomatic subjects. A cross-sectional study was carried out. This study was conducted in a physiotherapy clinic located at School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. A convenience sample of 30 asymptomatic adults (15 males; 15 females; age range = 18-55 years) was recruited between August 2015 and December 2015. Following a 2-minute warm-up, the subjects were asked to stand in a relaxed position and their skin was marked at the T12-L1 and S1-S2 spinal levels. From this position, they were asked to perform maximum lumbar flexion followed by maximum lumbar extension with their knees straight. Two blinded raters each used an inclinometer and the iPhone (®) app to measure lumbar spine flexion-extension ROM. A third rater read the measured angles. To calculate total lumbar spine flexion-extension ROM, the measurement from S1-S2 was subtracted from T12-L1. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. All of the measurements were conducted 3 times and the mean value of 3 repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone(®) app. Furthermore, minimum detectable change at the 95% confidence level (MDC95) was computed as 1.96 × standard error of measurement × [Formula: see text]. Good to excellent intra-rater and inter-rater reliability were demonstrated for both the gravity-based inclinometer with ICC values of ≥0.84 and ≥0.77 and the iPhone(®) app with ICC values of ≥0.85 and ≥0.85, respectively. The MDC95 ranged from 5.82°to 8.18°for the intra-rater analysis and from 7.38°to 8.66° for the inter-rater analysis. The concurrent validity for flexion and extension between the 2 instruments was 0.85 and 0.91, respectively. The iPhone(®)app possesses good to excellent intra-rater and inter-rater reliability and concurrent validity. It seems that the iPhone(®) app can be used for the measurement of lumbar spine flexion-extension ROM. IIb.

Concurrent use of alcohol interactive medications and alcohol in older adults: a systematic review of prevalence and associated adverse outcomes.

PubMed

Holton, Alice E; Gallagher, Paul; Fahey, Tom; Cousins, Gráinne

2017-07-17

Older adults are susceptible to adverse effects from the concurrent use of medications and alcohol. The aim of this study was to systematically review the prevalence of concurrent use of alcohol and alcohol-interactive (AI) medicines in older adults and associated adverse outcomes. A systematic search was performed using MEDLINE (PubMed), Embase, Scopus and Web of Science (January 1990 to June 2016), and hand searching references of retrieved articles. Observational studies reporting on the concurrent use of alcohol and AI medicines in the same or overlapping recall periods in older adults were included. Two independent reviewers verified that studies met the inclusion criteria, critically appraised included studies and extracted relevant data. A narrative synthesis is provided. Twenty studies, all cross-sectional, were included. Nine studies classified a wide range of medicines as AI using different medication compendia, thus resulting in heterogeneity across studies. Three studies investigated any medication use and eight focused on psychotropic medications. Based on the quality assessment of included studies, the most reliable estimate of concurrent use in older adults ranges between 21 and 35%. The most reliable estimate of concurrent use of psychotropic medications and alcohol ranges between 7.4 and 7.75%. No study examined longitudinal associations with adverse outcomes. Three cross-sectional studies reported on falls with mixed findings, while one study reported on the association between moderate alcohol consumption and adverse drug reactions at hospital admission. While there appears to be a high propensity for alcohol-medication interactions in older adults, there is a lack of consensus regarding what constitutes an AI medication. An explicit list of AI medications needs to be derived and validated prospectively to quantify the magnitude of risk posed by the concurrent use of alcohol for adverse outcomes in older adults. This will allow for risk stratification of older adults at the point of prescribing, and prioritise alcohol screening and brief alcohol interventions in high-risk groups.

[A Validation Study of the Modified Korean Version of Ethical Leadership at Work Questionnaire (K-ELW)].

PubMed

Kim, Jeong-Eon; Park, Eun-Jun

2015-04-01

The purpose of this study was to validate the Korean version of the Ethical Leadership at Work questionnaire (K-ELW) that measures RNs' perceived ethical leadership of their nurse managers. The strong validation process suggested by Benson (1998), including translation and cultural adaptation stage, structural stage, and external stage, was used. Participants were 241 RNs who reported their perceived ethical leadership using both the pre-version of K-ELW and a previously known Ethical Leadership Scale, and interactional justice of their managers, as well as their own demographics, organizational commitment and organizational citizenship behavior. Data analyses included descriptive statistics, Pearson correlation coefficients, reliability coefficients, exploratory factor analysis, and confirmatory factor analysis. SPSS 19.0 and Amos 18.0 versions were used. A modified K-ELW was developed from construct validity evidence and included 31 items in 7 domains: People orientation, task responsibility fairness, relationship fairness, power sharing, concern for sustainability, ethical guidance, and integrity. Convergent validity, discriminant validity, and concurrent validity were supported according to the correlation coefficients of the 7 domains with other measures. The results of this study provide preliminary evidence that the modified K-ELW can be adopted in Korean nursing organizations, and reliable and valid ethical leadership scores can be expected.

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity

PubMed Central

Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus

2016-01-01

Objective Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Methods Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. Results The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version’s factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. Conclusions The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research. PMID:26937638

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity.

PubMed

Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus

2016-01-01

Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version's factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research.

The psychometric properties of cellular phone dependency questionnaire in students of Isfahan: A pilot study.

PubMed

Alavi, Seyyed Salman; Maracy, Mohammad Reza; Jannatifard, Fereshte; Ojaghi, Rezvan; Rezapour, Hossein

2014-01-01

A number of diagnostic scales or questionnaires have been developed in recent years, to assess mobile phone dependency. A valid and reliable assessment instrument for correspondence of Iranian culture is essential. The aim of our study is to validate the Iranian version of the Cell Phone Dependency Questionnaire (CPDQ). In this cross-sectional study, data were collected from 784 students, who were studying in four main Isfahan Universities. The participants completed the demographic questionnaire, CPDQ, anonymously. To analyze the data we used concurrent validity, factor analysis, internal consistency, split-half, and test-retest. We extracted three factors including Salience, Overusing of the cell phone, compulsive use of SMS. Cronbach's alpha of the CPDQ was. 88 (Cronbach's alpha of the factors were 0.85, 0.70, and 0.76, respectively). The CPDQ proved to be a reliable questionnaire to assess the extent of problems caused by the 'misuse' of the cell phone in Iranian society.

[A short form of the positions on nursing diagnosis scale: development and psychometric testing].

PubMed

Romero-Sánchez, José Manuel; Paloma-Castro, Olga; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; O'Ferrall-González, Cristina; Gabaldón-Bravo, Eva Maria; González-Domínguez, Maria Eugenia; Castro-Yuste, Cristina; Frandsen, Anna J; Martínez-Sabater, Antonio

2013-06-01

The Positions on Nursing Diagnosis (PND) is a scale that uses the semantic differential technique to measure nurses' attitudes towards the nursing diagnosis concept. The aim of this study was to develop a shortened form of the Spanish version of this scale and evaluate its psychometric properties and efficiency. A double theoretical-empirical approach was used to obtain a short form of the PND, the PND-7-SV, which would be equivalent to the original. Using a cross-sectional survey design, the reliability (internal consistency and test-retest reliability), construct (exploratory factor analysis, known-groups technique and discriminant validity) and criterion-related validity (concurrent validity), sensitivity to change and efficiency of the PND-7-SV were assessed in a sample of 476 Spanish nursing students. The results endorsed the utility of the PND-7-SV to measure attitudes toward nursing diagnosis in an equivalent manner to the complete form of the scale and in a shorter time.

Assessment of an Illness-specific Dimension of Self-esteem in Youths with Type 1 Diabetes

PubMed Central

Iannotti, Ronald J.; Nansel, Tonja R.; Haynie, Denise L.; Sobel, Douglas O.; Simons-Morton, Bruce

2009-01-01

Objective The initial validation of a brief assessment of a diabetes-specific self-esteem dimension in adolescents with type 1 diabetes. Methods Youths with type 1 diabetes (n = 87) aged 10–16 years were administered the multidimensional Self-Esteem Questionnaire (SEQ) and a newly designed assessment of diabetes-specific self-esteem (DSSE). Their parents completed parallel forms. Adherence to the diabetes regimen and glycemic control were also assessed. Results In factor analysis, DSSE items formed a distinct dimension of self-esteem in addition to the SEQ dimensions. This factor uniquely contributed to differences in youths’ global self-esteem. Significant associations with adherence and glycemic control suggested its concurrent validity. Agreement between youth- and parent-report DSSE forms supported inter-rater reliability. Conclusions The findings provide preliminary support for recognizing the importance of a DSSE dimension in adolescents’ adjustment to diabetes, and for the reliability and validity of the proposed assessment strategy. PMID:18664512

[Nursery Teacher's Stress Scale (NTSS): reliability and validity].

PubMed

Akada, Taro

2010-06-01

This study describes the development and evaluation of the Nursery Teacher's Stress Scale (NTSS), which explores the relation between daily hassles at work and work-related stress. In Analysis 1, 29 items were chosen to construct the NTSS. Six factors were identified: I. Stress relating to child care; II. Stress from human relations at work; III. Stress from staff-parent relations; IV. Stress from lack of time; V. Stress relating to compensation; and VI. Stress from the difference between individual beliefs and school policy. All these factors had high degrees of internal consistency. In Analysis 2, the concurrent validity of the NTSS was examined. The results showed that the NTSS total scores were significantly correlated with the Job Stress Scale-Revised Version (job stressor scale, r = .68), the Pre-school Teacher-efficacy Scale (r = -.21), and the WHO-five Well-Being Index Japanese Version (r = -.40). Work stresses are affected by several daily hassles at work. The NTSS has acceptable reliability and validity, and can be used to improve nursery teacher's mental health.

Attitudes toward science: measurement and psychometric properties of the Test of Science-Related Attitudes for its use in Spanish-speaking classrooms

NASA Astrophysics Data System (ADS)

Navarro, Marianela; Förster, Carla; González, Caterina; González-Pose, Paulina

2016-06-01

Understanding attitudes toward science and measuring them remain two major challenges for science teaching. This article reviews the concept of attitudes toward science and their measurement. It subsequently analyzes the psychometric properties of the Test of Science-Related Attitudes (TOSRA), such as its construct validity, its discriminant and concurrent validity, and its reliability. The evidence presented suggests that TOSRA, in its Spanish-adapted version, has adequate construct validity regarding its theoretical referents, as well as good indexes of reliability. In addition, it determines the attitudes toward science of secondary school students in Santiago de Chile (n = 664) and analyzes the sex variable as a differentiating factor in such attitudes. The analysis by sex revealed low-relevance gender difference. The results are contrasted with those obtained in English-speaking countries. This TOSRA sample showed good psychometric parameters for measuring and evaluating attitudes toward science, which can be used in classrooms of Spanish-speaking countries or with immigrant populations with limited English proficiency.

The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training

PubMed Central

2014-01-01

Background Entry into specialty training was determined by a National Assessment Centre (NAC) approach using a combination of a behavioural Multiple-Mini-Interview (MMI) and a written Situational Judgement Test (SJT). We wanted to know if interviewers could make reliable and valid decisions about the non-cognitive characteristics of candidates with the purpose of selecting them into general practice specialty training using the MMI. Second, we explored the concurrent validity of the MMI with the SJT. Methods A variance components analysis estimated the reliability and sources of measurement error. Further modelling estimated the optimal configurations for future MMI iterations. We calculated the relationship of the MMI with the SJT. Results Data were available from 1382 candidates, 254 interviewers, six MMI questions, five alternate forms of a 50-item SJT, and 11 assessment centres. For a single MMI question and one assessor, 28% of the variance between scores was due to candidate-to-candidate variation. Interviewer subjectivity, in particular the varying views that interviewer had for particular candidates accounted for 40% of the variance in scores. The generalisability co-efficient for a six question MMI was 0.7; to achieve 0.8 would require ten questions. A disattenuated correlation with the SJT (r = 0.35), and in particular a raw score correlation with the subdomain related to clinical knowledge (r = 0.25) demonstrated evidence for construct and concurrent validity. Less than two per cent of candidates would have failed the MMI. Conclusion The MMI is a moderately reliable method of assessment in the context of a National Assessment Centre approach. The largest source of error relates to aspects of interviewer subjectivity, suggesting enhanced interviewer training would be beneficial. MMIs need to be sufficiently long for precise comparison for ranking purposes. In order to justify long term sustainable use of the MMI in a postgraduate assessment centre approach, more theoretical work is required to understand how written and performance based test of non-cognitive attributes can be combined, in a way that achieves acceptable generalizability, and has validity. PMID:25123968

Reliability, Concurrent Validity, and Minimal Detectable Change for iPhone Goniometer App in Assessing Knee Range of Motion.

PubMed

Mehta, Saurabh P; Barker, Katherine; Bowman, Brett; Galloway, Heather; Oliashirazi, Nicole; Oliashirazi, Ali

2017-07-01

Much of the published works assessing the reliability of smartphone goniometer apps (SG) have poor generalizability since the reliability was assessed in healthy subjects. No research has established the values for standard error of measurement (SEM) or minimal detectable change (MDC) which have greater clinical utility to contextualize the range of motion (ROM) assessed using the SG. This research examined the test-retest reproducibility, concurrent validity, SEM, and MDC values for the iPhone goniometer app (i-Goni; June Software Inc., v.1.1, San Francisco, CA) in assessing knee ROM in patients with knee osteoarthritis or those after total knee replacement. A total of 60 participants underwent data collection which included the assessment of active knee ROM using the i-Goni and the universal goniometer (UG; EZ Read Jamar Goniometer, Patterson Medical, Warrenville, IL), knee muscle strength, and assessment of pain and lower extremity disability using quadruple numeric pain rating scale (Q-NPRS) and lower extremity functional scale (LEFS), respectively. Intraclass correlation coefficients (ICCs) were calculated to assess the reproducibility of the knee ROM assessed using the i-Goni and UG. Bland and Altman technique examined the agreement between these knee ROM. The SEM and MDC values were calculated for i-Goni assessed knee ROM to characterize the error in a single score and the index of true change, respectively. Pearson correlation coefficient examined concurrent relationships between the i-Goni and other measures. The ICC values for the knee flexion/extension ROM were superior for i-Goni (0.97/0.94) compared with the UG (0.95/0.87). The SEM values were smaller for i-Goni assessed knee flexion/extension (2.72/1.18 degrees) compared with UG assessed knee flexion/extension (3.41/1.62 degrees). Similarly, the MDC values were smaller for both these ROM for the i-Goni (6.3 and 2.72 degrees) suggesting smaller change required to infer true change in knee ROM. The i-Goni assessed knee ROM showed expected concurrent relationships with UG, knee muscle strength, Q-NPRS, and the LEFS. In conclusion, the i-Goni demonstrated superior reproducibility with smaller measurement error compared with UG in assessing knee ROM in the recruited cohort. Future research can expand the inquiry for assessing the reliability of the i-Goni to other joints. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Criterion and Concurrent Validity of the activPAL™ Professional Physical Activity Monitor in Adolescent Females

PubMed Central

Dowd, Kieran P.; Harrington, Deirdre M.; Donnelly, Alan E.

2012-01-01

Background The activPAL has been identified as an accurate and reliable measure of sedentary behaviour. However, only limited information is available on the accuracy of the activPAL activity count function as a measure of physical activity, while no unit calibration of the activPAL has been completed to date. This study aimed to investigate the criterion validity of the activPAL, examine the concurrent validity of the activPAL, and perform and validate a value calibration of the activPAL in an adolescent female population. The performance of the activPAL in estimating posture was also compared with sedentary thresholds used with the ActiGraph accelerometer. Methodologies Thirty adolescent females (15 developmental; 15 cross-validation) aged 15–18 years performed 5 activities while wearing the activPAL, ActiGraph GT3X, and the Cosmed K4B2. A random coefficient statistics model examined the relationship between metabolic equivalent (MET) values and activPAL counts. Receiver operating characteristic analysis was used to determine activity thresholds and for cross-validation. The random coefficient statistics model showed a concordance correlation coefficient of 0.93 (standard error of the estimate = 1.13). An optimal moderate threshold of 2997 was determined using mixed regression, while an optimal vigorous threshold of 8229 was determined using receiver operating statistics. The activPAL count function demonstrated very high concurrent validity (r = 0.96, p<0.01) with the ActiGraph count function. Levels of agreement for sitting, standing, and stepping between direct observation and the activPAL and ActiGraph were 100%, 98.1%, 99.2% and 100%, 0%, 100%, respectively. Conclusions These findings suggest that the activPAL is a valid, objective measurement tool that can be used for both the measurement of physical activity and sedentary behaviours in an adolescent female population. PMID:23094069

Validation of Malay Version of Snaith-Hamilton Pleasure Scale: Comparison between Depressed Patients and Healthy Subjects at an Out-Patient Clinic in Malaysia

PubMed Central

NG, Chong Guan; CHIN, Soo Cheng; YEE, Anne Hway Ann; LOH, Huai Seng; SULAIMAN, Ahmad Hatim; Sherianne Sook Kuan, WONG; HABIL, Mohamed Hussain

2014-01-01

Background: The Snaith-Hamilton Pleasure Scale (SHAPS) is a self-assessment scale designed to evaluate anhedonia in various psychiatric disorders. In order to facilitate its use in Malaysian settings, our current study aimed to examine the validity of a Malay-translated version of the SHAPS (SHAPS-M). Methods: In this cross-sectional study, a total of 44 depressed patients and 82 healthy subjects were recruited from a university out-patient clinic. All participants were given both the Malay and English versions of the SHAPS, Fawcett-Clark Pleasure Scale (FCPS), General Health Questionnaire 12 (GHQ-12), and the Beck Depression Inventory (BDI) to assess their hedonic state, general mental health condition and levels of depression. Results: The results showed that the SHAPS-M has impressive internal consistency (α = 0.96), concurrent validity and good parallel-form reliability (intraclass coefficient, ICC = 0.65). Conclusion: In addition to demonstrating good psychometric properties, the SHAPS-M is easy to administer. Therefore, it is a valid, reliable, and suitable questionnaire for assessing anhedonia among depressed patients in Malaysia. PMID:25246837

Development and validation of a new assessment tool for suturing skills in medical students.

PubMed

Sundhagen, Henriette Pisani; Almeland, Stian Kreken; Hansson, Emma

2018-01-01

In recent years, emphasis has been put on that medical student should demonstrate pre-practice/pre-registration core procedural skills to ensure patient safety. Nonetheless, the formal teaching and training of basic suturing skills to medical students have received relatively little attention and there is no standard for what should be tested and how. The aim of this study was to develop and validate, using scientific methods, a tool for assessment of medical students' suturing skills, measuring both micro- and macrosurgical qualities. A tool was constructed and content, construct, concurrent validity, and inter-rater, inter-item, inter-test reliability were tested. Three groups were included: students with no training in suturing skills, students who have had training, plastic surgery. The results show promising reliability and validity when assessing novice medical students' suturing skills. Further studies are needed on implementation of the instrument. Moreover, how the instrument can be used to give formative feedback, evaluate if a required standard is met and for curriculum development needs further investigation.Level of Evidence: Not ratable.

Validation of Malay Version of Snaith-Hamilton Pleasure Scale: Comparison between Depressed Patients and Healthy Subjects at an Out-Patient Clinic in Malaysia.

PubMed

Ng, Chong Guan; Chin, Soo Cheng; Yee, Anne Hway Ann; Loh, Huai Seng; Sulaiman, Ahmad Hatim; Sherianne Sook Kuan, Wong; Habil, Mohamed Hussain

2014-05-01

The Snaith-Hamilton Pleasure Scale (SHAPS) is a self-assessment scale designed to evaluate anhedonia in various psychiatric disorders. In order to facilitate its use in Malaysian settings, our current study aimed to examine the validity of a Malay-translated version of the SHAPS (SHAPS-M). In this cross-sectional study, a total of 44 depressed patients and 82 healthy subjects were recruited from a university out-patient clinic. All participants were given both the Malay and English versions of the SHAPS, Fawcett-Clark Pleasure Scale (FCPS), General Health Questionnaire 12 (GHQ-12), and the Beck Depression Inventory (BDI) to assess their hedonic state, general mental health condition and levels of depression. The results showed that the SHAPS-M has impressive internal consistency (α = 0.96), concurrent validity and good parallel-form reliability (intraclass coefficient, ICC = 0.65). In addition to demonstrating good psychometric properties, the SHAPS-M is easy to administer. Therefore, it is a valid, reliable, and suitable questionnaire for assessing anhedonia among depressed patients in Malaysia.

Development and Validation of a Nausea Severity Scale for Assessment of Nausea in Children with Abdominal Pain-Related Functional Gastrointestinal Disorders.

PubMed

Russell, Alexandra C; Stone, Amanda L; Wang, Andi; Walker, Lynn S

2018-06-01

The objective of this study was to develop a pediatric measure of chronic nausea severity, the Nausea Severity Scale (NSS), and evaluate its reliability and validity in youth with abdominal pain-related functional gastrointestinal disorders (AP-FGID). Pediatric patients (aged 11⁻17 years-old, n = 236) presenting to an outpatient clinic for evaluation of abdominal pain completed the NSS, Children's Somatization Inventory (CSI), Functional Disability Inventory (FDI), Abdominal Pain Index (API), Patient-Report Outcomes Measurement Information System (PROMIS), Anxiety and Depression Scales and the Pediatric Rome III Questionnaire for FGIDs. The NSS demonstrated good concurrent, discriminant, and construct validity, as well as good internal consistency. One-third (34%) of AP-FGID patients reported experiencing nausea "most" or "every day" in the previous two weeks. The severity of nausea was higher in females than males and correlated significantly with the severity of somatic symptoms, functional disability, anxiety, and depression. The NSS is a valid and reliable measure of nausea in children with AP-FGID.

Development of the Assessment of Belief Conflict in Relationship-14 (ABCR-14).

PubMed

Kyougoku, Makoto; Teraoka, Mutsumi; Masuda, Noriko; Ooura, Mariko; Abe, Yasushi

2015-01-01

Nurses and other healthcare workers frequently experience belief conflict, one of the most important, new stress-related problems in both academic and clinical fields. In this study, using a sample of 1,683 nursing practitioners, we developed The Assessment of Belief Conflict in Relationship-14 (ABCR-14), a new scale that assesses belief conflict in the healthcare field. Standard psychometric procedures were used to develop and test the scale, including a qualitative framework concept and item-pool development, item reduction, and scale development. We analyzed the psychometric properties of ABCR-14 according to entropy, polyserial correlation coefficient, exploratory factor analysis, confirmatory factor analysis, average variance extracted, Cronbach's alpha, Pearson product-moment correlation coefficient, and multidimensional item response theory (MIRT). The results of the analysis supported a three-factor model consisting of 14 items. The validity and reliability of ABCR-14 was suggested by evidence from high construct validity, structural validity, hypothesis testing, internal consistency reliability, and concurrent validity. The result of the MIRT offered strong support for good item response of item slope parameters and difficulty parameters. However, the ABCR-14 Likert scale might need to be explored from the MIRT point of view. Yet, as mentioned above, there is sufficient evidence to support that ABCR-14 has high validity and reliability. The ABCR-14 demonstrates good psychometric properties for nursing belief conflict. Further studies are recommended to confirm its application in clinical practice.

The validity and reliability of the four square step test in different adult populations: a systematic review.

PubMed

Moore, Martha; Barker, Karen

2017-09-11

The four square step test (FSST) was first validated in healthy older adults to provide a measure of dynamic standing balance and mobility. The FSST has since been used in a variety of patient populations. The purpose of this systematic review is to determine the validity and reliability of the FSST in these different adult patient populations. The literature search was conducted to highlight all the studies that measured validity and reliability of the FSST. Six electronic databases were searched including AMED, CINAHL, MEDLINE, PEDro, Web of Science and Google Scholar. Grey literature was also searched for any documents relevant to the review. Two independent reviewers carried out study selection and quality assessment. The methodological quality was assessed using the QUADAS-2 tool, which is a validated tool for the quality assessment of diagnostic accuracy studies, and the COSMIN four-point checklist, which contains standards for evaluating reliability studies on the measurement properties of health instruments. Fifteen studies were reviewed studying community-dwelling older adults, Parkinson's disease, Huntington's disease, multiple sclerosis, vestibular disorders, post stroke, post unilateral transtibial amputation, knee pain and hip osteoarthritis. Three of the studies were of moderate methodological quality scoring low in risk of bias and applicability for all domains in the QUADAS-2 tool. Three studies scored "fair" on the COSMIN four-point checklist for the reliability components. The concurrent validity of the FSST was measured in nine of the studies with moderate to strong correlations being found. Excellent Intraclass Correlation Coefficients were found between physiotherapists carrying out the tests (ICC = .99) with good to excellent test-retest reliability shown in nine of the studies (ICC = .73-.98). The FSST may be an effective and valid tool for measuring dynamic balance and a participants' falls risk. It has been shown to have strong correlations with other measures of balance and mobility with good reliability shown in a number of populations. However, the quality of the papers reviewed was variable with key factors, such as sample size and test set up, needing to be addressed before the tool can be confidently used in these specified populations.

Cross-cultural adaptation, reliability, and validity of the Turkish version of PedsQL 3.0 Arthritis Module: a quality-of-life measure for patients with juvenile idiopathic arthritis in Turkey.

PubMed

Tarakci, E; Baydogan, S N; Kasapcopur, O; Dirican, A

2013-04-01

The aim of this study was to describe the cultural adaptation, validity, and reliability of a Turkish version of the pediatric quality-of-life inventory (PedsQL) 3.0 Arthritis Module in a population with juvenile idiopathic arthritis (JIA). A total of 169 patients with JIA and their parents were enrolled in the study. The Turkish version of the childhood health assessment questionnaire (CHAQ) was used to evaluate the validity of related domains in the PedsQL 3.0 Arthritis Module. Both the PedsQL 3.0 Arthritis Module and CHAQ were filled out by children over 8 years of age and by the parents of children 2-7 years of age. Internal reliability was poor to excellent (Cronbach's alpha coefficients 0.56-0.84 for self-reporting and 0.63-0.82 for parent reporting), and interobserver reliability varied from good to excellent (intraclass correlation coefficient (ICC) 0.79-0.91 for self-reporting and 0.80-0.88 for parent reporting) for the total scores of the PedsQL 3.0 Arthritis Module. Parent-child concordance for all scores was moderate to excellent (ICC 0.42-0.92). The PedsQL 3.0 Arthritis Module and CHAQ were highly positively correlated, with coefficients from 0.21 to 0.76, indicating concurrent validity. We demonstrated the reliability and validity of quality-of-life measurement using the Turkish version of the PedsQL 3.0 Arthritis Module in our sociocultural context. The PedsQL 3.0 Arthritis Module can be utilized as a tool for the evaluation of quality of life in patients with JIA aged 2-18 years.

German validation of the Conners Adult ADHD Rating Scales (CAARS) II: reliability, validity, diagnostic sensitivity and specificity.

PubMed

Christiansen, H; Kis, B; Hirsch, O; Matthies, S; Hebebrand, J; Uekermann, J; Abdel-Hamid, M; Kraemer, M; Wiltfang, J; Graf, E; Colla, M; Sobanski, E; Alm, B; Rösler, M; Jacob, C; Jans, T; Huss, M; Schimmelmann, B G; Philipsen, A

2012-07-01

The German version of the Conners Adult ADHD Rating Scales (CAARS) has proven to show very high model fit in confirmative factor analyses with the established factors inattention/memory problems, hyperactivity/restlessness, impulsivity/emotional lability, and problems with self-concept in both large healthy control and ADHD patient samples. This study now presents data on the psychometric properties of the German CAARS-self-report (CAARS-S) and observer-report (CAARS-O) questionnaires. CAARS-S/O and questions on sociodemographic variables were filled out by 466 patients with ADHD, 847 healthy control subjects that already participated in two prior studies, and a total of 896 observer data sets were available. Cronbach's-alpha was calculated to obtain internal reliability coefficients. Pearson correlations were performed to assess test-retest reliability, and concurrent, criterion, and discriminant validity. Receiver Operating Characteristics (ROC-analyses) were used to establish sensitivity and specificity for all subscales. Coefficient alphas ranged from .74 to .95, and test-retest reliability from .85 to .92 for the CAARS-S, and from .65 to .85 for the CAARS-O. All CAARS subscales, except problems with self-concept correlated significantly with the Barrett Impulsiveness Scale (BIS), but not with the Wender Utah Rating Scale (WURS). Criterion validity was established with ADHD subtype and diagnosis based on DSM-IV criteria. Sensitivity and specificity were high for all four subscales. The reported results confirm our previous study and show that the German CAARS-S/O do indeed represent a reliable and cross-culturally valid measure of current ADHD symptoms in adults. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters

PubMed Central

Scherr, Karen A.; Fagerlin, Angela; Williamson, Lillie D.; Davis, J. Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A.

2016-01-01

Background Physicians’ recommendations affect patients’ treatment choices. However, most research relies on physicians’ or patients’ retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. Objective To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Methods Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used one-way ANOVAs to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients’ perceived treatment recommendations matched our coded recommendations. Results The PhyReCS was highly reliable (Krippendorf’s alpha =. 89, 95% CI [.86, .91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = .98, SE = .18, p < .001) or active surveillance (mean difference = 1.10, SE = .14, p < .001). Patients’ perceived recommendations matched coded recommendations 81% of the time. Conclusion The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. PMID:27343015

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters.

PubMed

Scherr, Karen A; Fagerlin, Angela; Williamson, Lillie D; Davis, J Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A

2017-01-01

Physicians' recommendations affect patients' treatment choices. However, most research relies on physicians' or patients' retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used 1-way analyses of variance to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients' perceived treatment recommendations matched our coded recommendations. The PhyReCS was highly reliable (Krippendorf's alpha = 0.89, 95% CI [0.86, 0.91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = 0.98, SE = 0.18, P < 0.001) or active surveillance (mean difference = 1.10, SE = 0.14, P < 0.001). Patients' perceived recommendations matched coded recommendations 81% of the time. The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. © The Author(s) 2016.

The approved Italian version of the comprehensive assessment of at-risk mental states (CAARMS-ITA): Field test and psychometric features.

PubMed

Pelizza, Lorenzo; Paterlini, Federica; Azzali, Silvia; Garlassi, Sara; Scazza, Ilaria; Pupo, Simona; Simmons, Magenta; Nelson, Barnaby; Raballo, Andrea

2018-04-26

The Comprehensive Assessment of At-Risk Mental States (CAARMS) was specifically developed to assess and detect young people at ultra-high risk (UHR) of developing psychosis. The current study was undertaken to test the reliability and validity of the authorized Italian version of the CAARMS (CAARMS-ITA) in a help-seeking population. Psychometric properties of the CAARMS-ITA were established using a sample of 223 Italian adolescents and young adults aged between 13 and 35 years, who were divided into 3 groups according to the CAARMS criteria: UHR-negative individuals (UHR [-]; n = 64), UHR-positive (UHR [+]; n = 55) and individuals with a first-episode psychosis (FEP; n = 104). The CAARMS-ITA's reliability was tested measuring interrater reliability and internal consistency. Construct validity was tested comparing the Positive and Negative Syndrome Scale (PANSS) and CAARMS-ITA subscale scores across groups (ie, UHR [-], UHR [+] and FEP). For concurrent validity, we studied correlations between symptoms of the CAARMS-ITA and their equivalents in the PANSS. Finally, the predictive validity was examined by following up with UHR [+] individuals. The 12-month transition rate to psychosis was calculated. The CAARMS-ITA showed good interrater reliability. The PANSS "Positive Symptoms" subscale scores in UHR [+] individuals were intermediate between FEP and UHR [-] groups. The positive and negative symptoms scores of the CAARMS-ITA significantly correlated with the corresponding scores of the PANSS. After 12 months, 4 of 41 (9.8%) UHR [+] individuals had transitioned to psychosis. The CAARMS-ITA is a reliable and valid instrument for assessing and detecting at-risk mental states in Italian clinical settings. It also appears to be helpful in the prediction of psychosis transition. © 2018 John Wiley & Sons Australia, Ltd.

Validity and Reliability of a Portable Balance Tracking System, BTrackS, in Older Adults.

PubMed

Levy, Susan S; Thralls, Katie J; Kviatkovsky, Shiloah A

Falls are the leading cause of disability, injury, hospital admission, and injury-related death among older adults. Balance limitations have consistently been identified as predictors of falls and increased fall risk. Field measures of balance are limited by issues of subjectivity, ceiling effects, and low sensitivity to change. The gold standard for measuring balance is the force plate; however, its field use is untenable due to high cost and lack of portability. Thus, a critical need is observed for valid objective field measures of balance to accurately assess balance and identify limitations over time. The purpose of this study was to examine the concurrent validity and 3-day test-retest reliability of Balance Tracking System (BTrackS) in community-dwelling older adults. Minimal detectable change values were also calculated to reflect changes in balance beyond measurement error. Postural sway data were collected from community-dwelling older adults (N = 49, mean [SD] age = 71.3 [7.3] years) with a force plate and BTrackS in multitrial eyes open (EO) and eyes closed (EC) static balance conditions. Force sensors transmitted BTrackS data via a USB to a computer running custom software. Three approaches to concurrent validity were taken including calculation of Pearson product moment correlation coefficients, repeated-measures ANOVAs, and Bland-Altman plots. Three-day test-retest reliability of BTrackS was examined in a second sample of 47 community-dwelling older adults (mean [SD] age = 75.8 [7.7] years) using intraclass correlation coefficients and MDC values at 95% CI (MDC95) were calculated. BTrackS demonstrated good validity using Pearson product moment correlations (r > 0.90). Repeated-measures ANOVA and Bland-Altman plots indicated some BTrackS bias with center of pressure (COP) values higher than FP COP values in the EO (mean [SD] bias = 4.0 [6.8]) and EC (mean [SD] bias = 9.6 [12.3]) conditions. Test-retest reliability using intraclass correlation coefficients (ICC2.1 was excellent (0.83) and calculated MDC95 for EO (9.6 cm) and EC (19.4 cm) and suggested that postural sway changes of these amounts are meaningful. BTrackS showed some bias with values exceeding force plate values in both EO and EC conditions. Excellent test-retest reliability and resulting MDC95 values indicated that BTrackS has the potential to identify meaningful changes in balance that may warrant intervention. BTrackS is an objective measure of balance that can be used to monitor balance in community-dwelling older adults over time. It can reliably identify changes that may require further attention (eg, fall-prevention strategies, declines in physical function) and shows promise for assessing intervention efficacy in this growing segment of the population.

Subtyping adolescents with bulimia nervosa.

PubMed

Chen, Eunice Y; Le Grange, Daniel

2007-12-01

Cluster analyses of eating disorder patients have yielded a "dietary-depressive" subtype, typified by greater negative affect, and a "dietary" subtype, typified by dietary restraint. This study aimed to replicate these findings in an adolescent sample with bulimia nervosa (BN) from a randomized controlled trial and to examine the validity and reliability of this methodology. In the sample of BN adolescents (N=80), cluster analysis revealed a "dietary-depressive" subtype (37.5%) and a "dietary" subtype (62.5%) using the Beck Depression Inventory, Rosenberg Self-Esteem Scale and Eating Disorder Examination Restraint subscale. The "dietary-depressive" subtype compared to the "dietary" subtype was significantly more likely to: (1) report co-occurring disorders, (2) greater eating and weight concerns, and (3) less vomiting abstinence at post-treatment (all p's<.05). The cluster analysis based on "dietary" and "dietary-depressive" subtypes appeared to have concurrent validity, yielding more distinct groups than subtyping by vomiting frequency. In order to assess the reliability of the subtyping scheme, a larger sample of adolescents with mixed eating and weight disorders in an outpatient eating disorder clinic (N=149) was subtyped, yielding similar subtypes. These results support the validity and reliability of the subtyping strategy in two adolescent samples.

Validity of Exercise Measures in Adults with Anorexia Nervosa: The EDE, Compulsive Exercise Test and Other Self-Report Scales.

PubMed

Young, Sarah; Touyz, Stephen; Meyer, Caroline; Arcelus, Jon; Rhodes, Paul; Madden, Sloane; Pike, Kathleen; Attia, Evelyn; Crosby, Ross D; Wales, Jackie; Hay, Phillipa

2017-05-01

Compulsive exercise is a prominent feature for the majority of patients with Anorexia Nervosa (AN), but there is a dearth of research evaluating assessment instruments. This study assessed the concurrent validity of the exercise items of the Eating Disorder Examination (EDE) and Eating Disorder Examination-Questionnaire (EDE-Q), with the Compulsive Exercise Test (CET) and other self-report exercise measures in patients with AN. We also aimed to perform validation of the CET in an adult clinical sample. The sample consisted of 78 adults with AN, recruited for the randomized controlled trial "Taking a LEAP forward in the treatment of anorexia nervosa." At baseline, participants completed the EDE, EDE-Q, CET, Reasons for Exercise Inventory (REI), Commitment to Exercise Scale (CES) and Exercise Beliefs Questionnaire (EBQ). Correlational and regression analyses were performed. EDE exercise days and exercise time per day were positively correlated with each other and with all CET subscales (except Lack of exercise enjoyment), CES mean, EBQ total and REI total. Exercise time per day was associated with a higher EDE global score. The CET demonstrated good concurrent validity with the CES, the REI and the EBQ. Of the self-reports, the CET explained the greatest variance in eating disorder psychopathology and demonstrated good to excellent reliability in this sample. The EDE and EDE-Q demonstrated good concurrent validity with the CET. Further research is required to evaluate the CET's factor structure in a large clinical sample. However, the CET has demonstrated strong clinical utility in adult patients with AN. © 2016 Wiley Periodicals, Inc.(Int J Eat Disord 2017; 50:533-541). © 2016 Wiley Periodicals, Inc.

Autism detection in early childhood (ADEC): reliability and validity data for a Level 2 screening tool for autistic disorder.

PubMed

Nah, Yong-Hwee; Young, Robyn L; Brewer, Neil; Berlingeri, Genna

2014-03-01

The Autism Detection in Early Childhood (ADEC; Young, 2007) was developed as a Level 2 clinician-administered autistic disorder (AD) screening tool that was time-efficient, suitable for children under 3 years, easy to administer, and suitable for persons with minimal training and experience with AD. A best estimate clinical Diagnostic and Statistical Manual of Mental Disorders (4th ed., text rev.; DSM-IV-TR; American Psychiatric Association, 2000) diagnosis of AD was made for 70 children using all available information and assessment results, except for the ADEC data. A screening study compared these children on the ADEC with 57 children with other developmental disorders and 64 typically developing children. Results indicated high internal consistency (α = .91). Interrater reliability and test-retest reliability of the ADEC were also adequate. ADEC scores reliably discriminated different diagnostic groups after controlling for nonverbal IQ and Vineland Adaptive Behavior Composite scores. Construct validity (using exploratory factor analysis) and concurrent validity using performance on the Autism Diagnostic Observation Schedule (Lord et al., 2000), the Autism Diagnostic Interview-Revised (Le Couteur, Lord, & Rutter, 2003), and DSM-IV-TR criteria were also demonstrated. Signal detection analysis identified the optimal ADEC cutoff score, with the ADEC identifying all children who had an AD (N = 70, sensitivity = 1.0) but overincluding children with other disabilities (N = 13, specificity ranging from .74 to .90). Together, the reliability and validity data indicate that the ADEC has potential to be established as a suitable and efficient screening tool for infants with AD. 2014 APA

Validity and reliability of the Nintendo Wii Balance Board to assess standing balance and sensory integration in highly functional older adults.

PubMed

Scaglioni-Solano, Pietro; Aragón-Vargas, Luis F

2014-06-01

Standing balance is an important motor task. Postural instability associated with age typically arises from deterioration of peripheral sensory systems. The modified Clinical Test of Sensory Integration for Balance and the Tandem test have been used to screen for balance. Timed tests present some limitations, whereas quantification of the motions of the center of pressure (CoP) with portable and inexpensive equipment may help to improve the sensitivity of these tests and give the possibility of widespread use. This study determines the validity and reliability of the Wii Balance Board (Wii BB) to quantify CoP motions during the mentioned tests. Thirty-seven older adults completed three repetitions of five balance conditions: eyes open, eyes closed, eyes open on a compliant surface, eyes closed on a compliant surface, and tandem stance, all performed on a force plate and a Wii BB simultaneously. Twenty participants repeated the trials for reliability purposes. CoP displacement was the main outcome measure. Regression analysis indicated that the Wii BB has excellent concurrent validity, and Bland-Altman plots showed good agreement between devices with small mean differences and no relationship between the difference and the mean. Intraclass correlation coefficients (ICCs) indicated modest-to-excellent test-retest reliability (ICC=0.64-0.85). Standard error of measurement and minimal detectable change were similar for both devices, except the 'eyes closed' condition, with greater standard error of measurement for the Wii BB. In conclusion, the Wii BB is shown to be a valid and reliable method to quantify CoP displacement in older adults.

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale.

PubMed

Boonzaaijer, Marike; van Dam, Ellen; van Haastert, Ingrid C; Nuysink, Jacqueline

2017-04-01

Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants.

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale

PubMed Central

van Dam, Ellen; van Haastert, Ingrid C.; Nuysink, Jacqueline

2017-01-01

Purpose: Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. Methods: In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. Results: The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Conclusion: Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants. PMID:28350771

Use of a tibial accelerometer to measure ground reaction force in running: A reliability and validity comparison with force plates.

PubMed

Raper, Damian P; Witchalls, Jeremy; Philips, Elissa J; Knight, Emma; Drew, Michael K; Waddington, Gordon

2018-01-01

The use of microsensor technologies to conduct research and implement interventions in sports and exercise medicine has increased recently. The objective of this paper was to determine the validity and reliability of the ViPerform as a measure of load compared to vertical ground reaction force (GRF) as measured by force plates. Absolute reliability assessment, with concurrent validity. 10 professional triathletes ran 10 trials over force plates with the ViPerform mounted on the mid portion of the medial tibia. Calculated vertical ground reaction force data from the ViPerform was matched to the same stride on the force plate. Bland-Altman (BA) plot of comparative measure of agreement was used to assess the relationship between the calculated load from the accelerometer and the force plates. Reliability was calculated by intra-class correlation coefficients (ICC) with 95% confidence intervals. BA plot indicates minimal agreement between the measures derived from the force plate and ViPerform, with variation at an individual participant plot level. Reliability was excellent (ICC=0.877; 95% CI=0.825-0.917) in calculating the same vertical GRF in a repeated trial. Standard error of measure (SEM) equalled 99.83 units (95% CI=82.10-119.09), which, in turn, gave a minimum detectable change (MDC) value of 276.72 units (95% CI=227.32-330.07). The ViPerform does not calculate absolute values of vertical GRF similar to those measured by a force plate. It does provide a valid and reliable calculation of an athlete's lower limb load at constant velocity. Copyright © 2017 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Validation of a condition-specific measure for women having an abnormal screening mammography.

PubMed

Brodersen, John; Thorsen, Hanne; Kreiner, Svend

2007-01-01

The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.

Validation of a Malay Version of the Smartphone Addiction Scale among Medical Students in Malaysia.

PubMed

Ching, Siew Mooi; Yee, Anne; Ramachandran, Vasudevan; Sazlly Lim, Sazlyna Mohd; Wan Sulaiman, Wan Aliaa; Foo, Yoke Loong; Hoo, Fan Kee

2015-01-01

This study was initiated to determine the psychometric properties of the Smart Phone Addiction Scale (SAS) by translating and validating this scale into the Malay language (SAS-M), which is the main language spoken in Malaysia. This study can distinguish smart phone and internet addiction among multi-ethnic Malaysian medical students. In addition, the reliability and validity of the SAS was also demonstrated. A total of 228 participants were selected between August 2014 and September 2014 to complete a set of questionnaires, including the SAS and the modified Kimberly Young Internet addiction test (IAT) in the Malay language. There were 99 males and 129 females with ages ranging from 19 to 22 years old (21.7±1.1) included in this study. Descriptive and factor analyses, intra-class coefficients, t-tests and correlation analyses were conducted to verify the reliability and validity of the SAS. Bartlett's test of sphericity was significant (p <0.01), and the Kaiser-Mayer-Olkin measure of sampling adequacy for the SAS-M was 0.92, indicating meritoriously that the factor analysis was appropriate. The internal consistency and concurrent validity of the SAS-M were verified (Cronbach's alpha = 0.94). All of the subscales of the SAS-M, except for positive anticipation, were significantly related to the Malay version of the IAT. This study developed the first smart phone addiction scale among medical students. This scale was shown to be reliable and valid in the Malay language.

Survey Development to Assess College Students' Perceptions of the Campus Environment.

PubMed

Sowers, Morgan F; Colby, Sarah; Greene, Geoffrey W; Pickett, Mackenzie; Franzen-Castle, Lisa; Olfert, Melissa D; Shelnutt, Karla; Brown, Onikia; Horacek, Tanya M; Kidd, Tandalayo; Kattelmann, Kendra K; White, Adrienne A; Zhou, Wenjun; Riggsbee, Kristin; Yan, Wangcheng; Byrd-Bredbenner, Carol

2017-11-01

We developed and tested a College Environmental Perceptions Survey (CEPS) to assess college students' perceptions of the healthfulness of their campus. CEPS was developed in 3 stages: questionnaire development, validity testing, and reliability testing. Questionnaire development was based on an extensive literature review and input from an expert panel to establish content validity. Face validity was established with the target population using cognitive interviews with 100 college students. Concurrent-criterion validity was established with in-depth interviews (N = 30) of college students compared to surveys completed by the same 30 students. Surveys completed by college students from 8 universities (N = 1147) were used to test internal structure (factor analysis) and internal consistency (Cronbach's alpha). After development and testing, 15 items remained from the original 48 items. A 5-factor solution emerged: physical activity (4 items, α = .635), water (3 items, α = .773), vending (2 items, α = .680), healthy food (2 items, α = .631), and policy (2 items, α = .573). The mean total score for all universities was 62.71 (±11.16) on a 100-point scale. CEPS appears to be a valid and reliable tool for assessing college students' perceptions of their health-related campus environment.

Validation of a General and Sport Nutrition Knowledge Questionnaire in Adolescents and Young Adults: GeSNK.

PubMed

Calella, Patrizia; Iacullo, Vittorio Maria; Valerio, Giuliana

2017-04-29

Good knowledge of nutrition is widely thought to be an important aspect to maintaining a balanced and healthy diet. The aim of this study was to develop and validate a new reliable tool to measure the general and the sport nutrition knowledge (GeSNK) in people who used to practice sports at different levels. The development of (GeSNK) was carried out in six phases as follows: (1) item development and selection by a panel of experts; (2) pilot study in order to assess item difficulty and item discrimination; (3) measurement of the internal consistency; (4) reliability assessment with a 2-week test-retest analysis; (5) concurrent validity was tested by administering the questionnaire along with other two similar tools; (6) construct validity by administering the questionnaire to three groups of young adults with different general nutrition and sport nutrition knowledge. The final questionnaire, consisted of 62 items of the original 183 questions. It is a consistent, valid, and suitable instrument that can be applied over time, making it a promising tool to look at the relationship between nutrition knowledge, demographic characteristics, and dietary behavior in adolescents and young adults.

Validity and Reliability of the Turkish Version for DSM-5 Level 2 Anger Scale (Child Form for Children Aged 11-17 Years and Parent Form for Children Aged 6-17 Years).

PubMed

Yalin Sapmaz, Şermin; Özek Erkuran, Handan; Yalin, Nefize; Önen, Özlem; Öztekin, Siğnem; Kavurma, Canem; Köroğlu, Ertuğrul; Aydemir, Ömer

2017-12-01

This study aimed to assess the validity and reliability of the Turkish version of Diagnostic and Statistical Manual of Mental Disorders (DSM-5) Level 2 Anger Scale. The scale was prepared by translation and back translation of DSM-5 Level 2 Anger Scale. Study groups consisted of a clinical sample of cases diagnosed with depressive disorder and treated in a child and adolescent psychiatry unit and a community sample. The study was continued with 218 children and 160 parents. In the assessment process, child and parent forms of DSM-5 Level 2 Anger Scale and Children's Depression Inventory and Strengths and Difficulties Questionnaire-Parent Form were used. In the reliability analyses, the Cronbach alpha internal consistency coefficient values were found very high regarding child and parent forms. Item-total score correlation coefficients were high and very high, respectively, for child and parent forms indicating a statistical significance. As for construct validity, one factor was maintained for each form and was found to be consistent with the original form of the scale. As for concurrent validity, the child form of the scale showed significant correlation with Children's Depression Inventory, while the parent form showed significant correlation with Strengths and Difficulties Questionnaire-Parent Form. It was found that the Turkish version of DSM-5 Level 2 Anger Scale could be utilized as a valid and reliable tool both in clinical practice and for research purposes.